A branching process model of heterogeneous DNA damages caused by radiotherapy in in vitro cell cultures

This paper deals with the dynamic modeling and simulation of cell damage heterogeneity and associated mutant cell phenotypes in the therapeutic responses of cancer cell populations submitted to a radiotherapy session during in vitro assays. Each cell is described by a finite number of phenotypic states with possible transitions between them. The population dynamics is then given by an age-dependent multi-type branching process. From this representation, we obtain formulas for the average size of the global survival population as well as the one of subpopulations associated with 10 mutation phenotypes. The proposed model has been implemented into Matlab© and the numerical results corroborate the ability of the model to reproduce four major types of cell responses: delayed growth, anti-proliferative, cytostatic and cytotoxic.