Skip to main content
Advertisement
  • Loading metrics

Complex Dynamics of Virus Spread from Low Infection Multiplicities: Implications for the Spread of Oncolytic Viruses

  • Ignacio A. Rodriguez-Brenes,

    Affiliations Department of Mathematics, University of California, Irvine, Irvine, California, United States of America, Department of Ecology and Evolutionary Biology, University of California, Irvine, Irvine, California, United States of America

  • Andrew Hofacre,

    Affiliation Department of Molecular Biology and Biochemistry, Cancer Research Institute, University of California, Irvine, Irvine, California, United States of America

  • Hung Fan,

    Affiliation Department of Molecular Biology and Biochemistry, Cancer Research Institute, University of California, Irvine, Irvine, California, United States of America

  • Dominik Wodarz

    dwodarz@uci.edu

    Affiliations Department of Mathematics, University of California, Irvine, Irvine, California, United States of America, Department of Ecology and Evolutionary Biology, University of California, Irvine, Irvine, California, United States of America

Correction

19 May 2017: The PLOS Computational Biology Staff (2017) Correction: Complex Dynamics of Virus Spread from Low Infection Multiplicities: Implications for the Spread of Oncolytic Viruses. PLOS Computational Biology 13(5): e1005548. https://doi.org/10.1371/journal.pcbi.1005548 View correction

Abstract

While virus growth dynamics have been well-characterized in several infections, data are typically collected once the virus population becomes easily detectable. Earlier dynamics, however, remain less understood. We recently reported unusual early dynamics in an experimental system using adenovirus infection of human embryonic kidney (293) cells. Under identical experimental conditions, inoculation at low infection multiplicities resulted in either robust spread, or in limited spread that eventually stalled, with both outcomes occurring with approximately equal frequencies. The reasons underlying these observations have not been understood. Here, we present further experimental data showing that inhibition of interferon-induced antiviral states in cells results in a significant increase in the percentage of robust infections that are observed, implicating a race between virus replication and the spread of the anti-viral state as a central mechanism. Analysis of a variety of computational models, however, reveals that this alone cannot explain the simultaneous occurrence of both viral growth outcomes under identical conditions, and that additional biological mechanisms have to be invoked to explain the data. One such mechanism is the ability of the virus to overcome the antiviral state through multiple infection of cells. If this is included in the model, two outcomes of viral spread are found to be simultaneously stable, depending on initial conditions. In stochastic versions of such models, the system can go by chance to either state from identical initial conditions, with the relative frequency of the outcomes depending on the strength of the interferon-based anti-viral response, consistent with the experiments. This demonstrates considerable complexity during the early phase of the infection that can influence the ability of a virus to become successfully established. Implications for the initial dynamics of oncolytic virus spread through tumors are discussed.

Author Summary

We investigate in vitro adenovirus spread starting from the lowest infection multiplicities. This phase of virus dynamics remains poorly understood and is likely critical for ensuring that engineered oncolytic viruses successfully spread and destroy tumors. We find unexpectedly complex dynamics, which are analyzed with a combination of experiments and mathematical models. The experiments indicate that the induction of an interferon-based anti-viral state is a crucial underlying mechanism. The mathematical models demonstrate that this mechanism alone cannot explain the experiments, and that additional mechanisms must be invoked to account for the data. The models suggest that the ability of the virus to overcome the anti-viral state through multiple infection of cells might be one such mechanism.

Introduction

The dynamics of virus spread have been studied extensively in the context of different infections, both experimentally and with mathematical models [13]. In particular, virus growth kinetics have been investigated in vitro and in vivo, in animal models and in human patients (see e.g. [414]). From such data, important kinetic parameters have been measured [4,1519], such as the death rates of infected cells, the rates of viral turnover, and the basic reproductive ratio of the virus, R0, which is thought to determine whether a successful infection can be established in a host or not.

Most studies that investigate the spread of a virus through its target cell population, however, only document virus growth once the number of infected cells has already reached relatively large numbers (in part because virus replication is hard to quantify at very low levels of infection). As a consequence, the dynamics during the earliest stages of virus spread remain poorly understood. Yet, this early phase can be crucial in determining the fate of the infection. We have recently studied such early dynamics experimentally in the context of adenovirus spread in vitro [20,21]. We tracked the spread of adenovirus infection in a 2 dimensional monolayer of human embryonic kidney (293) cells. The adenovirus used expressed green fluorescent protein, so that early virus spread from initially infected cells could be followed in space and time. A variety of interesting findings were made. Experiments showed that when virus replication initiated from a single cell, infections failed to take place for a certain fraction of the experiments. However, once at least three infected cells had been generated, a spreading infection was always established [20]. It was hypothesized that in the monolayer culture, multiply infected cells are generated relatively quickly as the number of infected cells increases, and that a high viral production from multiply infected cells could explain the lack of extinction events once three or more infected cells had been generated [20].

Following the spreading virus further (21), two different outcomes were observed: (i) In what can be called a “limited spread” the infected cell population initially increased slowly, but eventually stalled at relatively low infected cell population sizes. (ii) In what can be called "robust spread", the virus infection grew at a much faster pace, did not stall, and eventually reached a large number of infected cells. Importantly, these two outcomes occurred under identical experimental conditions i.e. on the same infected culture dish. In a given culture, a number of infection foci were initiated and followed, and about half of them displayed robust spread, while the other half displayed limited spread. We also note that the limited spread outcomes were not stochastic extinction events caused by random fluctuations around small numbers. Indeed, in a previous study we found that once 3 or more infected cells were generated a spreading infection was always established [20].

The occurrence of two different outcomes of early virus spread under identical experimental conditions was surprising and has remained unexplained. Here, we combine further experiments with mathematical modeling to better understand these dynamics. A relevant biological system in this respect are oncolytic viruses; they specifically replicate in cancer cells and are being explored as a treatment modality [22]. Cancers are typically infected at relatively low multiplicities, with the aim that that the virus spreads throughout the tumor cell population and kills most malignant cells. Promising results have been obtained in clinical trials, some of which involve adenoviruses upon which our experimental system is based [23]. A herpes-based virus has been approved for the treatment of melanomas, but seems to act through induction of immune responses [24]. The potential of the spreading virus itself to consistently control tumors has yet to be realized, and the initial spread from low infection multiplicities appears to be a crucial and limiting phase. Our work helps to shed light onto how this initial barrier can be overcome.

Results

Experimental observations

The experimental system used in this study has been described previously [20]. Human HEK 293 (Ad-293) cells that express Adenovirus EIA and EIB proteins were infected in monolayer culture with a recombinant Adenovirus expressing jellyfish enhanced green fluorescent protein (EGFP) in place of the EIA and EIB coding region (AdEGFPuci). The infections were carried out with an agar overlay, which restricted viral spread to local cell-cell spread. By conducting the infections on culture dishes with grids, it was possible to repeatedly monitor the same regions of the cultures and count the number of infected (green) cells over time. As described in a previous study, two types of infection outcomes were observed once an initial spreading infection was established—robust spread leading to typical virus plaques, and limited spread where the infection eventually died out (Fig 1). Under the standard infection conditions, the ratio of robust vs. limited infections was approximately 1:1.

thumbnail
Fig 1. Limited and robust infections.

Ad-293 cells were infected with low doses of AdEGFPuci under conditions of plaque formation (10–100 infectious units/5 cm culture dish, agar overlay), and areas of infection were visualized by fluorescence microscopy for GFP. Limited (A) and robust areas (B) were observed on the same plates at 12 days post-infection. The bars represent 500 μ. The limited area of infection is also shown at expanded magnification in panel A. The robust area (B) required multiple photographic fields, and a montage is shown.

https://doi.org/10.1371/journal.pcbi.1005241.g001

As suggested in our previous study one possible explanation for the robust vs. limited viral infections could have been the induction of antiviral responses in the infected cells by interferon [21]. While adenovirus encodes genes that antagonize interferons [25], this is not absolute. We therefore tested if AdEGFPuci infection of Ad-293 cells results in induction of an interferon response. When viruses infect cells, detection of viral infection by cellular sensors leads to production of interferons [25]. The interferons are released from the infected cell where they bind to interferon receptors on the surfaces of the same cell or neighboring uninfected cells; this binding leads to signal transduction and transcriptional activation of a series of IFN-responsive genes (ISGs) and establishment of an antiviral state. Expression of ISGs is indicative of an antiviral state. We tested RNA from AdEGFPuci-infected 293 cells for expression of several ISGs by reverse transcriptase-PCR (RT-PCR). The expression of the ISG oligo-adenylate synthase 2 (OAS2) was consistently induced by AdEGFPuci infection at 72 h, indicative of an antiviral state (Fig 2A). In further experiments we found that the infected cells did not show induction of other ISGs tested, including OAS1, MX-1, IFITM1 and ISG3g, which indicated that the antiviral state induced by AdEGFPuci was partial or relatively weak. We investigated this further by studying transcriptional activation of the OAS2 promoter. 293 cells were transiently transfected with expression plasmids consisting of firefly luciferase driven by either the OAS2 promoter/enhancer, or by an artificial promoter/enhancer containing five tandem copies of the canonical interferon response element (5XISRE) (Fig 2B). The transfected cells were treated with interferon beta or infected with AdEGFPuci, and transcriptional activities of the reporter genes were assessed by measurement of luciferase activity at 24 and 72 hours. As expected, treatment with IFN-beta resulted in rapid induction of luciferase activity for the 5XISRE promoter by 24 h, indicative of rapid induction of an antiviral state. The effect persisted since luciferase activity was still elevated at 72 h (compared to mock-treated cultures). In contrast induction of the OAS2 promoter was more modest, ca. 4-fold, compared to the > 40-fold induction for the 5XISRE promoter. In AdEGFPuci infected cells, the pattern of induction was different. The 5XISRE reporter plasmid did not show significant induction compared to the mock-treated cells at 24 h, and there was a very modest ca. 2-fold induction at 72 hr. The OAS2 reporter did not show significant increase in luciferase activity at 24 h, but there was a 5–10 fold increase at 72 hrs. Thus induction of OAS2 expression by adenovirus may involve elements in addition to the canonical ISRE. The luciferase reporter assays of Fig 2B were consistent with the RT-PCR assays of Fig 2A, and they indicate that AdEGFPuci induces a limited antiviral state in 293 cells. The fact that OAS2 expression was higher at 72 h than 24 h could reflect the time required for induction of IFN expression by the viral infection and/or modulation of the IFN response by adenoviral genes.

thumbnail
Fig 2.

(A,B) Induction of OAS2 expression by AdEGFPuci infection. A) Ad-293 cells were infected with AdEGFPuci at an MOI of 10, and RNA was extracted 72 hr post-infection (Ad). For comparison, cells were incubated in medium alone (M or Mock), or they were treated for the same period with 50 μg/ml human interferon β (IFNβ). The RNAs were used in RT-PCR reactions for several interferon-responsive genes; only OAS2 RNA showed significant enhancement after AdEGFPuci infection; low level of enhancement by IFNβ was also observed. Amplification for the same number of cycles for β-actin RNA was performed for normalization. B) Ad-293 cells were transfected with luciferase reporter plasmids driven by a canonical interferon response element (5XISRE), the upstream regulatory sequences of the OAS2 promoter (OAS2), or the equivalent luciferase construct lacking promoter/enhancer sequences (Null). The transfected cells were treated with 50 μg/ml IFNβ, infected with AdEGFPuci (MOI of 10), or not treated (Mock), and lysates from replicate cultures were harvested at 24 and 72 hr. Luciferase assays were carried out using the dual luciferase assay system, and luciferase activities relative to the reference renilla luciferase activity are shown in arbitrary units. Activities at 24 hr are shown in blue, and those at 72 hr are shown in red. Bars indicate standard deviations from replicate cultures. C) Inhibition of induction of OAS2. i). Ad-293 cells were incubated with valproic acid (VPA) at different concentrations along with 50 μg/ml IFNβ. At 24 and 72 hr, levels of OAS2 RNA in the cells were measured by qRT-PCR. The levels of OAS2 RNA relative to no VPA treatment (set at 1) are shown for the different VPA concentrations. ii). Ad-293 cells were incubated with 1 μg/ml anti-IFNAR mAb, or 5 ng/ml rapamycin, along with 50 μg/ml IFNβ. qRT-PCR assays for OAS2 RNA (relative to no treatment) are shown for 24 and 72 hr post-treatment. Error bars represent standard deviations of triplicate assays.

https://doi.org/10.1371/journal.pcbi.1005241.g002

Since the results of Fig 2 indicated that AdEGFPuci induces a limited antiviral state in 293 cells, we tested if this could be involved in the two types of viral spread observed. Valproic acid (VPA), an inhibitor of histone deacetylases [26], has been shown to inhibit the interferon response in the context of oncolytic herpesviruses [27]. As shown in Fig 2Ci, VPA reduced IFN beta induction of OAS2 RNA in Ad-293 cells at both 24 and 72 h in a dose-dependent manner. Thus it was a suitable inhibitor for these experiments. On the other hand, VPA has been shown to have both negative and positive effects on multiple cellular pathways [28], so it could also have other effects on viral replication. Indeed, the extent of the spreading infections (both robust and limited) were somewhat reduced by VPA (typical examples are shown in Figure A in the Supplementary Materials), and the total numbers of spreading infections were reduced in a dose-dependent fashion (Table 1). Nevertheless VPA increased the proportion of robust vs. limited spreading infections in a dose-dependent manner (Table 1). These results therefore supported the hypothesis that induction of a limited antiviral state by AdEGFPuci was influencing the relative proportion of robust vs. limited virus spread.

Since VPA apparently had other effects besides inhibition of interferon on adenoviral infection, we tested two additional inhibitors of interferon: the mTOR inhibitor rapamycin [29], and a blocking antibody to the interferon alpha receptor 2 (IFNAR2). As shown in Fig 2Cii, both anti—IFNAR2 antibody and rapamycin inhibited IFNβ induction of OAS2 RNA; inhibition by anti—IFNAR2 was rapid (within 24 h), while inhibition by rapamycin was only evident at 72 hr. Experiments analogous to those of Table 1 are shown in Table 2. Treatment with both compounds substantially increased the relative percentage of robust spreading infections, consistent with the conclusion that an interferon response was influencing the relative outcomes of the spreading infections. The effect of the anti-IFNAR2 antibody was particularly noteworthy since it would be expected to be targeting the interferon response quite specifically. In this case the shift from limited to robust spreading outcomes occurred without a change in the total number of spreading infections. Rapamycin treatment reproducibly enhanced the total numbers of spreading infections, but the mechanism of this has not been investigated.

thumbnail
Table 2. Effects of anti—ifnar2 and rapamycin on viral spread1.

https://doi.org/10.1371/journal.pcbi.1005241.t002

Mathematical modeling

While experiments suggest that an IFN-induced antiviral state contributes to explaining our observations, we need mathematical models to test whether this is sufficient to explain the simultaneous occurrence of the limited and robust infections under identical conditions. To account for the data, a model would need to be characterized by some form of bistability, with the outcome depending on initial conditions. In a stochastic setting, the dynamics can then randomly enter one or the other domain of attraction, giving rise to different outcomes even when starting from the same initial conditions.

A variety of mathematical models will be built to investigate this. Models of increasing complexity will be examined. First, we will consider ordinary differential equations (ODEs) that assume perfect mixing of viruses and cells. While this does not account for the spatial constraints in our experiments, it is important to start with such models for two reasons: (i) They are analytically more tractable, and the insights we gain from such models can be used to examine the properties of more complex, spatial models. (ii) Such models form the basis of much of the virus dynamics literature [1], and this analysis will indicate whether the dynamics observed in our experiments are particular to the experimental conditions studied here, or whether this is a more broadly applicable phenomenon. Once we have analyzed such models, we will investigate the dynamics in two different, spatially explicit models: a metapopulation model that builds on the ODEs, and a 2-dimensional agent-based model that is most closely connected to our experiments.

The basic model of virus dynamics

The mathematical models presented here build on a basic virus dynamics model that is well-established in the literature [1] and briefly summarized here. Denoting the number of uninfected target cells by x and the number of infected target cells by y, the model (hereafter called model (1)) is given by the following pair of ordinary differential equations.

(1)

Because the free virus population tends to turn over fast relative to the infected cell population, free virus is assumed to be in a quasi-steady state and hence the concentration of free virus is not modeled directly. Uninfected cells are produced with a rate λ, die with a rate d, and become infected by virus with a rate β. Infected cells are assumed to die with a rate a, where a>d. This model has two equilibria: the virus extinction equilibrium where x(0) = λ/d, y(0) = 0, and the virus persistence equilibrium where x(1) = a/β, y(1) = λ/a-d/β. In particular the virus persistence equilibrium is stable when the basic reproductive ratio of the virus (R0 = (λβ)/(da)) is greater than one. Such a model has been used to describe in vivo infection dynamics where target cells are produced with a constant rate. Target cell input with a constant rate, however, does not typically apply to in vitro experiments or to all in vivo tissues, where target cells can divide. Therefore, we will also consider a second version of this model that assumes division of target cells. In this version, instead of the constant input rate λ, we assume density-dependent target cell division, expressed by the term rx[1-(x+y)/K], where r is the replication rate of uninfected cells and K is the carrying capacity of the system. This model will be referred to as model (S1), and more detailed properties are given in the Supplementary Materials. It is important to consider both models to investigate further whether results are limited to assumptions that apply to our experiments, or whether they have more general relevance.

Modeling anti-viral states with ordinary differential equations

We extend the basic virus dynamics model (1) to include an interferon-induced anti-viral state as follows (the modifications for model (S1) are given in the Supplementary Materials). The uninfected and infected cell populations that are not in an anti-viral state are denoted by x1 and y1, respectively. Uninfected cells that are in an anti-viral state are denoted by x0. We assume that a cell that is in an anti-viral state cannot be productively infected, so infected cells in an anti-viral state are not included in this model. The model is thus given by the following set of ordinary differential equations: (2)

As in model (1), λ denotes the rate of target cell production and β the rate of infection. Uninfected and infected cells die with rates d and a, respectively. Infected cells can induce an anti-viral state in the uninfected cells with a rate γ, making them resistant to infection. This cell population is assumed to die with a rate d, and can lose its anti-viral state with a rate g. The properties of this model are very similar to those of the basic model (1) without the anti-viral state. The virus-free equilibrium is given by x1(0) = λ/d, x0(0) = y(0) = 0. Virus persistence is described by the following equilibrium expressions:

The basic reproductive ratio, R0 = (λβ)/(da)), is identical to model (1). As in model (1), there is also no bistability in this model, and when R0>1, the virus persistence equilibrium is stable. The same properties hold for the model that assumes density-dependent division of target cells (see model S2 in the Supplementary Materials). These results strongly suggest that for well-mixed systems of cells, an interferon-induced anti-viral state alone cannot explain the occurrence of two alternative outcomes under identical experimental conditions.

The saturation of anti-viral defenses by multiple infection can account for the experimental observations in ordinary differential equation models

Here, we introduce another layer of complexity into the model: Cells can be infected multiple times by the virus. Multiple infection has been shown to occur in adenovirus infections, and a higher infection multiplicity can result in higher virus output from infected cells [3034]. If cells in an anti-viral state become infected with multiple viruses, it is possible that this can saturate factors that prevent infection of those cells. Hence, with multiple infection, cells in an antiviral state can still become infected and produce some offspring virus. Modifying our model as follows captures these features: (3)

This model is an extension of model (2) and contains a population of infected cells that are in an anti-viral state, y0. For simplicity we assume that two viruses within a cell are sufficient to overcome the anti-viral state. The number of viruses required to overcome the anti-viral state is unknown and can be easily adjusted in the model. Thus, when an uninfected cell in an anti-viral state, x0, becomes infected it turns into an infected cell in an anti-viral state that fails to replicate the virus, y0. If this cell, however, becomes infected with a second virus, it turns into a productively infected cell. Hence, multiple infection is assumed to completely overcome the anti-viral state and results in a rate of virus production that is identical to cells that are not in an anti-viral state.

In the absence of the infection, we again have the trivial steady state, given by x1* = λ/d, x0* = 0, y1* = 0, y0* = 0. The basic reproductive ratio of the virus is identical to that in the previous models and thus given by R0 = (λβ)/(da). If R0<1, then the virus-free equilibrium is stable and the only outcome is virus extinction. If R0>1, however, the situation is more complex than in the previous models. The Supplementary Materials show that multiple non-trivial steady states are possible, which, however, are too complicated to define analytically. Hence, this is instead explored with numerical methods. We find that depending on the values of the parameters, there can be multiple non-negative stable steady states. That is, some sets of parameter values result in more than one non-negative stable steady state; while other parameter sets result in just one non-negative stable steady state. Fig 3A depicts an instance where the model is bistable: with the same set of parameters and depending on the initial conditions, the trajectories converge to different equilibria. In this figure, if the initial number of infected cells is four (plots labeled with “1”) the infection first takes off, but eventually stalls and regresses to a number very close to zero. If on the other hand the initial number of infected cells is five (plots labeled with “2”) the trajectories converge to a steady state where the overall number of cells is significantly diminished and infected cells make up a large fraction of the entire cell population. Qualitatively identical properties are found if we assume density-dependent proliferation of uninfected cells, as described in the Supplementary Materials (see model (S3)). A detailed numerical exploration of the parameter space for models (3) and (S3) and the parameter regions that lead to multiply stable outcomes is included in the Supplementary Materials. Interestingly, in the parameter space explorations we found that parameter sets that produce bistable outcomes are more frequent when the antiviral induction rate, γ, is significantly larger than the infection rate, β (see e.g. Figure E(ii) in the Supplementary Materials). IFN molecules are many times smaller than virions [35], and thus should diffuse much faster than them [36]. In the context of our modeling framework this suggests significantly higher values of γ compared to β. Ultimately however, the rates β and γ should be determined experimentally in future studies.

thumbnail
Fig 3.

A) Bistability in model (3). The trajectories labeled with “1” depict an example of a weak limited infection. The trajectories labeled with “2” depict a robust viral infection. The only difference between the plots is the initial number of infected cells, four for the limited infection and five for the robust infection. B) Stochastic version of model (3). Panel shows two simulations with identical initial conditions. Stochastic events at early stages of the infection can push the results into in either a weak limited infection that is eventually extinguished (labeled “1”), or in a persistent robust infection that significantly reduces the overall number of cells (labeled “2'”). C) Distribution of the maximum number of infected cells when there is a limited infection. Although the initial number of infected cells is very small (four cells) at their maximum extension limited infections average approximately 43 cells. Results are based on 1000 simulations. D) Probability of the emergence of a robust infection as a function of the normalized level of the antiviral induction rate γ. Results are based on the 1000 simulations for each level of the antiviral induction rate depicted in the panel. Initial conditions: y1(0) = 4, and x1(0) = 996 (all other cell types equal to zero). Error bars indicate 95% confidence intervals. Parameters: In all panels λ = 10, d = 0.01, β = 0.001, g = 0.1, and a = 0.05; γ = 10 in panels A) and B) and it is equal to 5 in C); in panel D) the 100% level of the antiviral induction rate corresponds to a value of γ = 50.

https://doi.org/10.1371/journal.pcbi.1005241.g003

Hence, we conclude that if cells can be induced to be in an anti-viral state by IFN, and if multiple infection of cells can overcome this anti-viral state, then the ODE model can account for the two different experimentally observed outcomes. Depending on the exact initial conditions, either sustained virus growth or limited virus growth can occur for the same parameter sets. If the infection is started from the same initial number of infected cells, then it is possible that stochastic effects push the system in one domain of attraction or the other, thus leading to the alternative infection outcomes. This is explored further in the following section, using a stochastic version of our models.

Stochastic implementation

Here, we investigate if a stochastic formulation of the previous models can produce the different outcomes under identical initial conditions. The idea behind this hypothesis is that early stochastic events can push the system into either one of the observed infection outcomes. We implement the stochastic formulations in the standard way using Gillespie's algorithm [37].

Fig 3B depicts two stochastic simulations of model (3), which use the same set of parameters and identical initial conditions. In the first simulation (plot labeled with “1”) the infection first takes off, peaks at around 60 infected cells and then starts to regress until it eventually goes extinct. In the second simulation (labeled with “2”) the infection is never extinguished, instead the infection persists at high levels. The same is observed for the model with density-dependent target cell proliferation (see Supplementary Materials Figure B). It is important to note that the infection extinction outcomes are not in general the result of stochastic fluctuations around the initial very low numbers of infected cells. This observation is verified by Fig 3C. This figure presents the distribution of the maximum number of infected cells for simulations where the ultimate outcome was viral extinction. Note that although the initial number of infected cells is very small (four cells) at their maximum extension limited infections average approximately 43 cells. This behavior is even more pronounced in the simulations with the density-dependent target cell proliferation model, where the average maximum number of infected cells for the limited growth was 80 cells (Supplementary Materials, Figure B).

As mentioned above, inhibition of IFN signaling in our experiments resulted in a shift in outcome towards a prevalence of robust infections vs. limited infections. The same qualitative behavior is reproduced by our models. Fig 3D plots the probability of the emergence of a robust infection as a function of the relative strength of the antiviral induction rate, γ. As this figure indicates, the reduction of the strength of the antiviral induction rate, which would occur as a consequence of the down modulation of IFN signaling, results in an increased probability of establishing a robust infection. The same is observed for the model with density-dependent target cell proliferation, as described in the Supplementary Materials (Figure B).

Dynamics in spatially explicit metapopulation models

To study the dynamics of multiple infection and antiviral response in a spatial setting we consider a meta-population approach, which builds closely on model (3). The metapopulation model consists of a collection of n local patches. Within individual patches, local dynamics occur according to mass-action rules. The patches are coupled to each other by populations migrating between them. Here, we consider a one-dimensional metapopulation model where populations in a given patch can only migrate to the nearest patches. The ODE formulation of the equivalent to model (3) is given as follows: (4) where k is the carrying capacity of each patch and cells with subscript i refer to cells in the ith patch. We assumed that the patches are arranged in a 1-dimensional linear array, and both target cells and infected cells can migrate to the neighboring patches to the left and to the right of a given patch with migration rate equal to m (the boundary conditions at i = 0 and i = n prevent cell migration outside of the array). The stochastic implementation of the metapopulation model follows directly from the reformulation of model (4) using Gillespie's method.

We find that in the stochastic metapopulation model the two types of infection outcomes (limited vs robust infection) can occur under identical initial conditions and with the same set of parameters (Fig 4B and 4C). Fig 4A illustrates the spatial spread of a robust viral infection. The effect of inhibiting IFN signaling (as done in the experiments) is represented in model (4) through a reduction of the anti-viral induction rate (γ). In agreement with experiments, in the spatial metapopulation model the down modulation of IFN signaling results in an increased proportion of the robust infection outcomes (Fig 4D). The same qualitative results can be obtained in a spatial metapopulation model if we assume density-dependent target cell proliferation (see Supplementary Materials, Figure C).

thumbnail
Fig 4.

A) Spatial spread of a robust infection in the stochastic metapopulation model based on system (model (4)). There are n = 51 local patches of cells. The expected number of cells in each patch prior to the infection is k = 121 (indicated by the dashed lines). At the start of the simulation all patches contain k uninfected cells and three infected cells are placed in the middle of the spatial array (i = 26). B) Time evolution of the infected and uninfected cell populations for the simulation in panel A. The populations refer to the total number of cells in the spatial array. C) Example of a limited infection in the metapopulation model. The infection first takes off, but then stalls and regresses until it is eventually extinguished from the cell population. D) Probability of the emergence of a robust infection as a function of the normalized level of the antiviral induction rate γ. Based on the 1000 simulations for each level of the antiviral induction rate. Error bars indicate 95% confidence intervals. Parameters in panels A-D: λ = 0.0194, d = 0.0194, g = 0.0202, a = 0.0792, β = 1, γ = 10000, and m = 2. Panels (E-G): Robust and limited infections in the two dimensional agent-based model. E) At time t = 0 nine infected cells are placed in the center of a 300 × 300 lattice filled with uninfected cells. Stochastically the simulations result in either limited or robust infections. F) Snapshot of a robust infection, taken at a time point when the system stochastically oscillated around a steady state (see Figure D(i) in Supplementary Materials). Even if there is a ring structure during initial growth, this breaks down over time due to the stochastic dynamics and does not persist in the long-term. G) Snapshot of a limited infection at its maximum extension. Parameters: r = 0.1262, β = 1, γ = 6.238 × 104, g = 18.29, a = 2.403. (See Figure D for the time series of the simulations in the Supplementary Materials).

https://doi.org/10.1371/journal.pcbi.1005241.g004

These explorations show that the induction of an anti-viral state and the ability of multiple infection to overcome the anti-viral state can account for the two infection outcomes observed in the data in a spatial setting, which is closer to our experimental conditions. The advantage of the metapopulation model is that we can build on the insights obtained from the analysis of the ODEs and explore this in a spatial setting. In the next section, we take this work further away from the ODE approach and consider a 2-dimensional stochastic spatial agent-based model of these dynamics.

Dynamics in a two-dimensional stochastic agent-based model

In the experiments, cells are arranged in a two-dimensional layer, and an agar overlay prevents long-range spread of the virus away from infected cells in the culture medium, creating conditions where virus spread is most likely to occur to neighboring cells. To model these dynamics we create a two-dimensional stochastic agent-based model, where each cell occupies a certain position in a two-dimensional rectangular lattice. There are four types of cells: susceptible uninfected cells (x1), uninfected cells in antiviral state (x0), infectious cells (y1) and infected cells in antiviral state (y0). The basic rules are the same as those in the previously explored model. Because this is a model that directly relates to our adenovirus experiments, we will only consider the assumption of density-dependent target cell growth. The rules are described as follows:

  • Infection. Infectious cells (y1) can infect neighbor cells at a rate β. For each kind of susceptible cell, infections result in the following transitions: x1→y1, x0 →y0 and y0→y1.
  • Induction of the antiviral state. Infectious cells (y1) can induce the antiviral state in neighboring uninfected cells at rate γ, (schematically x1→ x0). The rate of antiviral reversal of uninfected cells (x0→x1) is g.
  • Cell death. Infected cells (y0 and y1) die at a certain rate a. In the duration of the experiments, cell death of uninfected cells was not observed and thus, we do not include cell death of uninfected cells in the simulations.
  • Cell division. Uninfected cells that are not in the antiviral state (x1) reproduce at rate r. Cell division is only possible if there is an unoccupied lattice position in the neighborhood of the dividing cell. Note that adenoviruses lock cells in the S-phase for replication, preventing them from undergoing mitosis [38]. There is also evidence that IFN (which induces antiviral states) prevents cell division [3942]. This assumption, however, is not likely crucial to our findings, since the results are robust across models that do and do not assume any target cell division.

As we previously mentioned, in the experiments viral spread is restricted to cell neighbors. In the model the neighborhood of a cell is determined by the lattice coordinates that the cell occupies. For the simulations we choose a neighbor radius of two cells in any direction. The model is implemented using the Next Reaction Method [43] (for details see Supplementary Materials).

Consistent with the other models, we observed both limited and robust infection outcomes (depicted in Fig 4E–4G), and that both can occur stochastically under identical parameter combinations and initial conditions. This again required the occurrence of an antiviral state, and the assumption that multiple infection can overcome the antiviral state. The effect of inhibiting IFN signaling is modeled through a reduction of the anti-viral induction rate γ. In agreement with experiments, the down modulation of IFN signaling results in an increased proportion of the robust infection outcomes (Figure D in Supplementary Materials). Statistical results from the simulations and a numerical exploration of the parameter space are found in the Supplementary Materials.

Discussion and Conclusion

Typically, when virus growth dynamics are investigated, even the early exponential growth phase corresponds to infected cell numbers that are relatively high, where virus levels are readily detectable. This applies to in vitro experiments and even more so to in vivo studies. Our work, however, has shown that complex dynamics can occur when virus concentrations are much lower (starting from a single infected cell), and that these dynamics might play an important role in determining the fate of the infection. In this respect, our experiments identified IFN-induced antiviral states in cells as a crucial mechanism that contributes to the observations. Our mathematical models, however, suggest that this alone cannot explain the experimental outcomes and that additional mechanisms need to be invoked to account for the data. In this respect, we identified the ability of the virus to overcome the anti-viral state by multiple infection as a possible candidate mechanism. Under these assumptions, an initial race between the spread of the virus population and the spread of the antiviral state can stochastically result in two different outcomes under identical conditions. While this is a likely mechanism, and while there is indication that multiple infection of cells might indeed play an important role in adenovirus spread [3034], we have not been able to explicitly test this notion so far. Hence, one has to be aware that there could potentially be other mechanisms that might also explain the data.

An important question concerns the generality of these notions, i.e. whether the results have relevance beyond the virus-cell system considered in our study. Our mathematical models suggest that such dynamics could be a more general phenomenon. Our experimental system involved a two-dimensional monolayer of cells with agar layover, which is best described by a spatially restricted agent based model. Qualitatively identical results, however, are seen in relatively simple ordinary differential equation models that describe virus dynamics in a setting without any spatial restrictions. Further, the results remain robust in different model formulations. For example, the exact target cell dynamics (production vs. division of target cells) does not appear to change the notions reported here. From an empirical point of view, it remains to be investigated whether multiple infection can saturate an antiviral state in cells, and how general a phenomenon this is. This mechanism can explain the data in the context of our model, and is therefore a model-generated hypothesis. In our experimental system, we demonstrated that AdEGFPuci induced only a limited antiviral state in 293 cells. It is possible that a limited anti-viral state can be overcome more easily by multiple infection than a stronger anti-viral state that may occur in other virus-host cell systems. It would be interesting to test this notion experimentally.

Beyond improving our understanding of the principles of virus dynamics, our results have important practical implications for the field of oncolytic virus therapy of tumors [22,23,44], and add to previous mathematical modeling work that analyzes the dynamics of oncolytic viruses, e.g. [21,4549]. Some clinically important oncolytic viruses are based on the adenovirus used in our experiments [23]. An important first step in successful oncolytic virus therapy is that the virus establishes a robust infection and efficiently spreads throughout the tumor. The very early spread dynamics might be a crucial phase in this respect, and might pose the first barrier to success. Our study indicates that not only the strength of interferon-induced anti-viral states might be important in this respect, but that a high local infection multiplicity at the earliest stages of the infection process might be equally important for ensuring that this early barrier is crossed and that the infection enters a regime in which robust growth to large viral population sizes is achieved. As a next step, it would be useful to test these notions in the context of different, specific oncolytic viruses that grow on tumor cell lines in vitro. As mentioned above, it is possible that our findings are the result of a limited IFN-induced anti-viral response in 293 cells infected with our virus AdEGFPuci. Hence, it would be interesting to compare the oncolytic virus dynamics in the context of virus-tumor systems in which the strength of an IFN-induced antiviral state varies. For example, some tumors show abnormalities and defects in IFN signaling, and this can in fact be a mechanism for the selective replication of oncolytic viruses in tumor cells [50]. Oncolytic vesicular stomatitis virus (VSV) is an example of this [51]. It would be important to investigate the dynamics studied here in the context of this virus, as well as with other oncolytic viruses that are characterized by different mechanisms of tumor selectivity, and that experience the induction of a stronger IFN-induced antiviral state in tumor cells. Such insights could guide future work that aims to optimize the virus itself as well as the method by which the virus is delivered to the cancer.

Materials and Methods

Cells and viruses

Ad-293 cells, derivatives of HEK293 cells that express adenovirus EIA and EIB proteins, were purchased from Agilent Technologies (La Jolla, CA) as described previously [20]. AdEGFPuci, a recombinant adenovirus expressing enhanced jellyfish green fluorescent protein in place of EIA and EIB was also described previously [20]. Stocks of 109−1011 pfu/ml were used.

Infections

Infections of AdEGFPuci onto Ad-293 cells on gridded culture dishes were performed at different multiplicities under conditions of plaque formation as described previously [20]. Infections were monitored by fluorescence microscopy for GFP; areas of infection were counted and scored as limited or robust. The same dishes were scored at different days post-infection.

RT-PCRs

Total RNA from infected or uninfected Ad-293 cells was extracted using TRIzol (Life Technologies), and 2 μg of RNA was digested with DNAse I and converted to cDNA using the qScript cDNA synthesis kit (Quantas) according to the manufacturer’s instructions. For detecting induction of cellular interferon response genes, PCR primer sets for different cellular genes from the Interferon Response Detection Kit (Systems Biosciences) were employed and PCR amplifications for different cycles were carried out according the manufacturer’s instructions. PCR products were visualized by agarose gel electrophoresis and ethidium bromide staining. For quantitative RT-PCR of OAS2 RNA, the following human OAS2 primers were used: 5’AGCTCCTCCTTTTTCCTTCCAGTC3’ (forward) and 5’TGGCTGGCTGCTGGCATAGAG3’ (reverse).

For standardization, the following human GAPDH primers were used: 5’CAACTACATGGTCTACATGTTC3’ (forward) and 5’ctcgctcctggaagatg3’ (reverse).

Quantitative RT-PCRs were performed using Power SYBR green PCR master mix with the 7900HT Fast real-time PCR system (Applied Biosystems) according to the manufacturer’s instructions. All qRT-PCRs were run in triplicate. The RNA expression levels were determined by the relative comparative threshold cycle (Cr) method.

Luciferase assays

To measure transcriptional activities, the following firefly luciferase reporter plasmids were used. Path Detect ISRE-luc (Agilent technologies) is a luciferase reporter driven by 5 tandem copies of an Interferon response element (ISRE), and is referred to here as 5XISRE-luc. The matched plasmid lacking promoter or enhancers, pCIS-CK (Agilent), was used as a negative control. A luciferase reporter driven by the upstream control elements of the 2’-5’- oligo (A) synthetase 2 (OAS2) gene was generated by first PCR amplifying OAS2 sequences (–880 to +197) from 293 cell DNA using synthetic primers containing sites for Hind III and Bgl II at either end. The PCR fragment was digested with Hind III and Bgl II, and cloned into the pLuc-MCS plasmid (Agilent) between Hind III and Bgl II sites in the multiple cloning site of the plasmid. This plasmid was designated OAS2-luc.

Ad-293 cells were transfected with the different luciferase reporter plasmids as described previously [52], with or without interferon treatment or infection with AdEGFPuci. Cell lysates were prepared and analyzed for luciferase activity as described previously [52], using the dual luciferase assay kit (Promega). Luciferase activities were read in a Sirius-L luminometer (Berthold Detection Systems); transfections were performed in triplicate, and each assay was performed at least three times.

Reagents

Human interferon beta was purchased from Pepro Tech, Interferon alpha receptor 2 antibody from Life Techologies, valproic acid from Sigma-Aldrich, and rapamycin from Fisher Scientific.

Author Contributions

  1. Conceptualization: HF DW IARB AH.
  2. Data curation: HF.
  3. Formal analysis: IARB DW AH HF.
  4. Funding acquisition: HF DW.
  5. Investigation: IARB DW AH.
  6. Methodology: IARB DW AH HF.
  7. Project administration: HF DW.
  8. Resources: HF DW.
  9. Supervision: DW HF.
  10. Validation: IARB DW AH HF.
  11. Visualization: IARB DW AH HF.
  12. Writing – original draft: IARB DW AH HF.
  13. Writing – review & editing: HF DW.

References

  1. 1. Nowak MA, May RM (2000) Virus dynamics. Mathematical principles of immunology and virology.: Oxford University Press.
  2. 2. Perelson AS (2002) Modelling viral and immune system dynamics. Nature Rev Immunol 2: 28–36.
  3. 3. Perelson AS, Ribeiro RM (2013) Modeling the within-host dynamics of HIV infection. BMC Biol 11: 96. pmid:24020860
  4. 4. Nowak MA, Lloyd AL, Vasquez GM, Wiltrout TA, Wahl LM, et al. (1997) Viral dynamics of primary viremia and antiretroviral therapy in simian immunodeficiency virus infection. J Virol 71: 7518–7525. pmid:9311831
  5. 5. Bangham CRM, Hall S.E., Jeffrey K.J.M, Vine A.M., Witkover A., Nowak M.A., Wodarz D., Usuku K., Osame M. (1999) Genetic control and dynamics of the cellular immune response to the human T-cell leukaemia virus, HTLV-1. Philosophical Transactions of the Royal Society, Series B 354: 691–700.
  6. 6. De Boer RJ, Homann D, Perelson AS (2003) Different dynamics of CD4+ and CD8+ T cell responses during and after acute lymphocytic choriomeningitis virus infection. J Immunol 171: 3928–3935. pmid:14530309
  7. 7. Bonhoeffer S, Barbour AD, De Boer RJ (2002) Procedures for reliable estimation of viral fitness from time-series data. Proc Biol Sci 269: 1887–1893. pmid:12350250
  8. 8. Christensen JP, Bartholdy C, Wodarz D, Thomsen AR (2001) Depletion of CD4+ T cells precipitates immunopathology in immunodeficient mice infected with a noncytocidal virus. J Immunol 166: 3384–3391. pmid:11207295
  9. 9. Lifson JD, Nowak MA, Goldstein S, Rossio JL, Kinter A, et al. (1997) The extent of early viral replication is a critical determinant of the natural history of simian immunodeficiency virus infection. J Virol 71: 9508–9514. pmid:9371613
  10. 10. Lifson JD, Rossio JL, Piatak M Jr., Parks T, Li L, et al. (2001) Role of CD8(+) lymphocytes in control of simian immunodeficiency virus infection and resistance to rechallenge after transient early antiretroviral treatment. J Virol 75: 10187–10199. pmid:11581387
  11. 11. McLean AR (2013) Infectious Disease Modeling. Infectious Diseases: Springer. pp. 99–115.
  12. 12. Regoes RR (2012) The role of exposure history on HIV acquisition: insights from repeated low-dose challenge studies. PLoS Comput Biol 8: e1002767. pmid:23180981
  13. 13. Perelson AS, Herrmann E, Micol F, Zeuzem S (2005) New kinetic models for the hepatitis C virus. Hepatology 42: 749–754. pmid:16175615
  14. 14. Perelson AS, Ribeiro RM (2004) Hepatitis B virus kinetics and mathematical modeling. Semin Liver Dis 24 Suppl 1: 11–16.
  15. 15. Wei XP, Ghosh SK, Taylor ME, Johnson VA, Emini EA, et al. (1995) Viral Dynamics in Human-Immunodeficiency-Virus Type-1 Infection. Nature 373: 117–122. pmid:7529365
  16. 16. Ho DD, Neumann AU, Perelson AS, Chen W, Leonard JM, et al. (1995) Rapid Turnover of Plasma Virions and Cd4 Lymphocytes in Hiv-1 Infection. Nature 373: 123–126. pmid:7816094
  17. 17. Perelson AS, Neumann AU, Markowitz M, Leonard JM, Ho DD (1996) Hiv-1 Dynamics in-Vivo—Virion Clearance Rate, Infected Cell Life- Span, and Viral Generation Time. Science 271: 1582–1586. pmid:8599114
  18. 18. Little SJ, McLean AR, Spina CA, Richman DD, Havlir DV (1999) Viral dynamics of acute HIV-1 infection. J Exp Med 190: 841–850. pmid:10499922
  19. 19. Ribeiro RM, Qin L, Chavez LL, Li D, Self SG, et al. (2010) Estimation of the initial viral growth rate and basic reproductive number during acute HIV-1 infection. J Virol 84: 6096–6102. pmid:20357090
  20. 20. Hofacre A, Wodarz D, Komarova NL, Fan H (2012) Early infection and spread of a conditionally replicating adenovirus under conditions of plaque formation. Virology 423: 89–96. pmid:22192628
  21. 21. Wodarz D, Hofacre A, Lau JW, Sun Z, Fan H, et al. (2012) Complex spatial dynamics of oncolytic viruses in vitro: mathematical and experimental approaches. PLoS Comput Biol 8: e1002547. pmid:22719239
  22. 22. Bell JC, Lichty B, Stojdl D (2003) Getting oncolytic virus therapies off the ground. Cancer Cell 4: 7–11. pmid:12892708
  23. 23. McCormick F (2003) Cancer-specific viruses and the development of ONYX-015. Cancer Biol Ther 2: S157–160. pmid:14508094
  24. 24. Killock D (2015) Skin cancer: T-VEC oncolytic viral therapy shows promise in melanoma. Nat Rev Clin Oncol 12: 438. pmid:26077044
  25. 25. Fonseca GJ, Thillainadesan G, Yousef AF, Ablack JN, Mossman KL, et al. (2012) Adenovirus evasion of interferon-mediated innate immunity by direct antagonism of a cellular histone posttranslational modification. Cell Host Microbe 11: 597–606. pmid:22704620
  26. 26. Gottlicher M, Minucci S, Zhu P, Kramer OH, Schimpf A, et al. (2001) Valproic acid defines a novel class of HDAC inhibitors inducing differentiation of transformed cells. EMBO J 20: 6969–6978. pmid:11742974
  27. 27. Alvarez-Breckenridge CA, Yu J, Price R, Wei M, Wang Y, et al. (2012) The histone deacetylase inhibitor valproic acid lessens NK cell action against oncolytic virus-infected glioblastoma cells by inhibition of STAT5/T-BET signaling and generation of gamma interferon. J Virol 86: 4566–4577. pmid:22318143
  28. 28. Rosenberg G (2007) The mechanisms of action of valproate in neuropsychiatric disorders: can we see the forest for the trees? Cell Mol Life Sci 64: 2090–2103. pmid:17514356
  29. 29. Cao W, Manicassamy S, Tang H, Kasturi SP, Pirani A, et al. (2008) Toll-like receptor-mediated induction of type I interferon in plasmacytoid dendritic cells requires the rapamycin-sensitive PI(3)K-mTOR-p70S6K pathway. Nat Immunol 9: 1157–1164. pmid:18758466
  30. 30. Ferreira TB, Alves PM, Gonçalves D, Carrondo M (2005) Effect of MOI and medium composition on adenovirus infection kinetics. Animal cell technology meets genomics: Springer. pp. 329–332.
  31. 31. Perez-Cruet M, Trask T, Chen SH, Goodman J, Woo S, et al. (1994) Adenovirus-mediated gene therapy of experimental gliomas. Journal of neuroscience research 39: 506–511. pmid:7884826
  32. 32. Gueret V, Negrete-Virgen JA, Lyddiatt A, Al-Rubeai M (2002) Rapid titration of adenoviral infectivity by flow cytometry in batch culture of infected HEK293 cells. Cytotechnology 38: 87–97. pmid:19003090
  33. 33. Rothmann T, Hengstermann A, Whitaker NJ, Scheffner M, zur Hausen H (1998) Replication of ONYX-015, a potential anticancer adenovirus, is independent of p53 status in tumor cells. Journal of virology 72: 9470–9478. pmid:9811680
  34. 34. Dormond E, Perrier M, Kamen A (2009) From the first to the third generation adenoviral vector: what parameters are governing the production yield? Biotechnology advances 27: 133–144. pmid:19013226
  35. 35. Janeway CA, Travers P, Walport M, Shlomchik MJ (1997) Immunobiology: the immune system in health and disease: Current Biology.
  36. 36. Howat TJ, Barreca C, O'Hare P, Gog JR, Grenfell BT (2006) Modelling dynamics of the type I interferon response to in vitro viral infection. Journal of The Royal Society Interface 3: 699–709.
  37. 37. Gillespie DT (1977) Exact Stochastic Simulation of Coupled Chemical-Reactions. Journal of Physical Chemistry 81: 2340–2361.
  38. 38. Bagheri N, Shiina M, Lauffenburger DA, Korn WM (2011) A dynamical systems model for combinatorial cancer therapy enhances oncolytic adenovirus efficacy by MEK-inhibition. PLoS Comput Biol 7: e1001085. pmid:21379332
  39. 39. Gresser I, Brouty-Boye D, Thomas M-T, Macieira-Coelho A (1970) Interferon and cell division, I. inhibition of the multiplication of mouse leukemia L 1210 cells in vitro by interferon preparations. Proceedings of the National Academy of Sciences 66: 1052–1058.
  40. 40. Lindahl-Magnusson P, Leary P, Gresser I (1971) Interferon and Cell Division VI. Inhibitory Effect of Interferon on the Multiplication of Mouse Embryo and Mouse Kidney Cells in Primary Cultures. Experimental Biology and Medicine 138: 1044–1050.
  41. 41. Pfeffer LM, Murphy JS, Tamm I (1979) Interferon effects on the growth and division of human fibroblasts. Experimental cell research 121: 111–120. pmid:446522
  42. 42. Balkwill F, Taylor-Papadimitriou J (1978) Interferon affects both G1 and S&plus; G2 in cells stimulated from quiescence to growth. Nature 274: 798–800. pmid:683317
  43. 43. Gillespie DT (2001) Approximate accelerated stochastic simulation of chemically reacting systems. Journal of Chemical Physics 115: 1716–1733.
  44. 44. Ruiz AJ, Russell SJ (2015) MicroRNAs and oncolytic viruses. Curr Opin Virol 13: 40–48. pmid:25863717
  45. 45. Bailey K, Kirk A, Naik S, Nace R, Steele MB, et al. (2013) Mathematical model for radial expansion and conflation of intratumoral infectious centers predicts curative oncolytic virotherapy parameters. PLoS One 8: e73759. pmid:24040057
  46. 46. Wodarz D (2001) Viruses as antitumor weapons: defining conditions for tumor remission. Cancer Res 61: 3501–3507. pmid:11309314
  47. 47. Dingli D, Cascino MD, Josic K, Russell SJ, Bajzer Z (2006) Mathematical modeling of cancer radiovirotherapy. Math Biosci 199: 55–78. pmid:16376950
  48. 48. Dingli D, Offord C, Myers R, Peng KW, Carr TW, et al. (2009) Dynamics of multiple myeloma tumor therapy with a recombinant measles virus. Cancer Gene Ther 16: 873–882. pmid:19498461
  49. 49. Novozhilov AS, Berezovskaya FS, Koonin EV, Karev GP (2006) Mathematical modeling of tumor therapy with oncolytic viruses: regimes with complete tumor elimination within the framework of deterministic models. Biol Direct 1: 6. pmid:16542009
  50. 50. Galivo F, Diaz RM, Thanarajasingam U, Jevremovic D, Wongthida P, et al. (2010) Interference of CD40L-mediated tumor immunotherapy by oncolytic vesicular stomatitis virus. Hum Gene Ther 21: 439–450. pmid:19922169
  51. 51. Escobar-Zarate D, Liu YP, Suksanpaisan L, Russell SJ, Peng KW (2013) Overcoming cancer cell resistance to VSV oncolysis with JAK1/2 inhibitors. Cancer Gene Ther 20: 582–589. pmid:24030211
  52. 52. McGee-Estrada K, Fan H (2006) In vivo and in vitro analysis of factor binding sites in Jaagsiekte sheep retrovirus long terminal repeat enhancer sequences: roles of HNF-3, NF-I, and C/EBP for activity in lung epithelial cells. J Virol 80: 332–341. pmid:16352558