Recent data shows that HIV-1 is characterised by variation in viral virulence factors that is heritable between infections, which suggests that viral virulence can be naturally selected at the population level. A trade-off between transmissibility and duration of infection appears to favour viruses of intermediate virulence. We developed a mathematical model to simulate the dynamics of putative viral genotypes that differ in their virulence. As a proxy for virulence, we use set-point viral load (SPVL), which is the steady density of viral particles in blood during asymptomatic infection. Mutation, the dependency of survival and transmissibility on SPVL, and host effects were incorporated into the model. The model was fitted to data to estimate unknown parameters, and was found to fit existing data well. The maximum likelihood estimates of the parameters produced a model in which SPVL converged from any initial conditions to observed values within 100–150 years of first emergence of HIV-1. We estimated the 1) host effect and 2) the extent to which the viral virulence genotype mutates from one infection to the next, and found a trade-off between these two parameters in explaining the variation in SPVL. The model confirms that evolution of virulence towards intermediate levels is sufficiently rapid for it to have happened in the early stages of the HIV epidemic, and confirms that existing viral loads are nearly optimal given the assumed constraints on evolution. The model provides a useful framework under which to examine the future evolution of HIV-1 virulence.
Recent studies have suggested that virulence in HIV-1 is partly a characteristic of the virus which is carried from one infection to the next. An infection with intermediate virulence will produce more transmissions during the infectious lifetime because it optimises the trade-off between rate of transmission and duration of infection. Natural selection acts on the heritable variation to increase the relative prevalence of strains with intermediate virulence. In this study we model the evolution of virulence in the viral population as these more successful strains are preferentially transmitted. We fit this model to data from transmitting couples, and find that the model fits the data well. We use this fit to estimate the contribution of the host and the virus to virulence, which complements recent estimates of the heritability of virulence. We also estimate the rate at which the viral determinants of virulence evolve between infections, and this provides predictions for how rapidly the virulence of HIV-1 evolves in a population. We suggest that natural selection on transmissibility results in substantial evolution of virulence in the population. This is sufficiently rapid for virulence to have reached current levels over the available timescale of the human epidemic.
Citation: Shirreff G, Pellis L, Laeyendecker O, Fraser C (2011) Transmission Selects for HIV-1 Strains of Intermediate Virulence: A Modelling Approach. PLoS Comput Biol 7(10): e1002185. https://doi.org/10.1371/journal.pcbi.1002185
Editor: Viktor Müller, Eötvös Loránd University, Hungary
Received: June 1, 2011; Accepted: July 20, 2011; Published: October 13, 2011
Copyright: © 2011 Shirreff et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by the School of Public Health, Imperial College London, the Medical Research Council Centre for Outbreak Analysis and Modelling, and the Royal Society. Additional support was provided by the Division of Intramural Research, National Institute of Allergy and Infectious Diseases, National Institutes of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors declare that they have no financial, personal, or professional interests in conflict with the findings in this paper.
The median time between HIV-1 seroconversion and progression to symptomatic Acquired Immune Deficiency Syndrome (AIDS) is approximately 10 years . However, there is considerable variation in this rate of progression, with substantial proportions of infected individuals progressing to AIDS in less than 5 years, or remaining AIDS-free after 20 years. Explaining this variability is an important goal of HIV pathogenesis research. Many cofactors which influence time to AIDS have been identified e.g. host genetics , host age , and recently viral factors have been implicated –.
In this paper we explore the extent to which viral factors which influence virulence, changing from one infected individual to the next, may have evolved under natural selection in the early phase of HIV-1's history. Between-host selection, leading to changes in the virulence of HIV-1, has potential major implications for the number of human life years affected.
Virulence is often defined as the excess mortality of the host which occurs as a result of infection with a pathogen. In the case of HIV the excess mortality is nearly 100%, so virulence can be better defined by the reciprocal of the time from infection to death, or time to AIDS. However, since this can only be defined at the host's death, we use set-point viral load (SPVL) as a proxy for virulence. This refers to the relatively stable density of virions in the blood which characterises asymptomatic infection. There is considerable population level variation in SPVL, in spite of its relative stability within the individual . SPVL is widely used as a prognostic indicator for AIDS, as individuals with a higher SPVL have a higher rate of CD4+ cell decline, and they tend to progress more rapidly to AIDS ,  and die sooner as a consequence . As a result of its relative constancy during asymptomatic infection, SPVL can be measured at a wide range of time points in an individual's infection .
A simple conceptual model of how SPVL may evolve by between-host natural selection (i.e. selection for the more transmissible genotypes) requires consideration of the transmission potential of individuals of different SPVL. The transmission potential, defined as the product of duration of infection and infection rate, increases with either component of this product. A positive correlation between SPVL and transmission rate has been convincingly demonstrated within heterosexual couples with initially discordant serostatus –. Since there is also a negative correlation between SPVL and duration of asymptomatic infection , there is therefore a trade-off between duration of and transmission rate during asymptomatic infection. Previous work has quantified this trade-off to suggest that SPVL most commonly observed in infections maximise the transmission potential, suggesting that the distribution of SPVL was shaped by natural selection .
Natural selection requires that a trait has heritability from one generation to the next, in addition to variation and differential reproductive success. A number of recent studies have identified and quantified this heritable component of SPVL variation which is maintained from one infection to the next , , , , .
Recent studies from the Netherlands  and Italy  have found that the mean log10 SPVL has increased over the recorded history of an HIV-infected cohort, and the rate of CD4+ cell decline has increased. However different transmission groups have demonstrated different patterns of evolution of SPVL. In the initial stages of the epidemic (mid 1980s) injecting drug users showed slower CD4+ declines than heterosexuals or men having sex with men, but this difference decreased over the subsequent decade . A study with similar methodology in Switzerland found stable virulence over the same time period . This suggests that such trends may be area- and risk-group specific. In two studies showing an increase, the levels of SPVL in the earlier time points are lower ,  than those which are optimal for transmission . Various studies of the rate of CD4+ decline also suggest an increasing virulence , . A study of the in vitro replicative fitness of viruses sampled at different time points reported a decrease in replicative fitness over the course of the epidemic in Amsterdam  although a subsequent study of the same city which controlled for time of seroconversion found an increase . Overall, observational results on changing virulence are inconclusive, though they suggest either an equilibrium or a slow increase in that direction.
The lack of evidence for consistent population level trends in SPVL evolution ,  suggests a) the global distribution of SPVL has stabilised at an equilibrium level; b) the rate of evolution is very slow or c) the distribution of SPVL is determined by factors which do not evolve. However, we think c) unlikely, first due to the observations on the heritability of SPVL described above, and second because there is evidence for evolution of SPVL occurring in particular areas or risk groups , .
To address the expected dynamics of SPVL evolution, we developed and analysed a deterministic mathematical model of between-host transmission and evolution incorporating known parameters linking SPVL to the duration of infection and the rate of transmission. The broad aim was to investigate the hypothesis that viral genotypes of intermediate virulence are naturally selected by transmission .
The primary of aim of this study was to use the observed distribution of SPVL to estimate the quantities of unknown host and viral factors which affect the process of between-host evolution. Comparing the model to data allowed us to calculate the likelihood of the unknown parameters.
The secondary aim was to assess whether the model, under these parameter estimates, allows convergence of the SPVL distribution towards an intermediate level, or at least to slowly changing levels consistent with observational studies, regardless of the virulence of the founding strain, and whether this can occur within a plausible timescale. The estimated time of origin of HIV-1 is before the most recent common ancestor, which has been dated to 1908 with 95% confidence interval 1884–1924 . If evolution has occurred between the founding strain and current infections then it has occurred over a period of ∼100 years.
We modelled the dynamics of putative genotypes of HIV-1 which differ from one another in their mean log10 SPVL. SPVL was assumed to vary as a result of both host and virus factors. These genotypes differ in their reproductive success as a result of the dependency of duration of asymptomatic infection and transmission rate on SPVL. Their prevalences change over time through competition for susceptible individuals in a constant population.
The model is formulated as a standard HIV epidemic model in which different viral strains or genotypes compete. Virulence is considered as a one-dimensional trait, with each genotype represented by a point on the one-dimensional spectrum of increasing virulence. When a person is infected by a virus of a given genotype, the infection is characterised by a SPVL which reflects the virulence, but also other non-viral factors. When transmitted, the virus can also mutate to higher or lower levels of virulence.
The model encodes the natural history of infection. After infection, individuals experience a brief period of highly infectious acute stage, after which they progress to chronic asymptomatic infection. Their SPVL determines both the duration and infectiousness of this asymptomatic stage, after which their viral load and infectiousness increases again as they progress to AIDS and death. Individuals are assumed to engage in serially monogamous partnerships; a realistic description of the sexual network was not an aim of this study.
For the sake of parsimony, we focused on relatively simple mathematical models with minimal sets of parameters, and thus left some important questions open for further study. In particular, we did not explore the effect of population structure, stochastic fluctuations, differences between subtypes, superinfection, and founder effects, and we considered only the situation of natural, untreated infection, thus appropriate to describing the evolution of the virus prior to the widespread adoption of antiretroviral therapy. We also did not address the question of conflicting directions of selection at the within and between host level, describing in-host changes in virulence instead as random drift. We hope to address these important questions in future work.
A useful practical and conceptual approach to interpreting various influences acting on SPVL is to decompose the total observed variance, σP2, into its components, genotypic, mutational and environmental variance (σG2, σM2, and σE2) .(1.1)Genotypic variance σG2 refers to differences in SPVL between infected individuals caused by viral factors which are preserved from one infection to the next. Environmental variance, σE2, refers to any source of SPVL variance external to the virus. Host factors e.g. age , sex  and host genotype , in particular HLA type  contribute significantly to variation in SPVL between individuals, and there may be other human and non-human covariates of SPVL e.g. antigenic stimulation . All of these factors, extrinsic to the virus, contribute to σE2 in our terminology.
Mutational variance, σM2, accounts for changes in the viral virulence genotype which result from mutation of the virus between one generation and the next (i.e. one infected host and the next) as a result of within-host replication and selection of the virus. Since the viral determinants of SPVL are not currently known, this cannot be related to the nucleotide substitution rate.The mutational standard deviation, σM, is simply the expected difference in the viral component of SPVL between an index and a secondary infection.
Heritability, h2, which has been quantified in previous studies, was defined as the fraction of variance explained by shared viral factors within a transmitting couple , . We estimate h2 as the proportion of variance in SPVL explained by heritable viral genetic factors:(1.2)Alternative definitions of heritability, including the proportion of variance in SPVL explained by the SPVL of the index case, and the proportion explained by viral factors, are discussed and estimated in Text S1.
In this study, we aim to separately estimate σM2 and σE2, and thus gain a better estimate of the extent of viral factors in individual infections, and the parameters needed to predict evolution.
Model fitting and parameter estimation
The primary aim of the analysis was to quantify the effects of host and virus on variation in SPVL. The values of the environmental and mutational standard deviations (σE and σM) were estimated using a maximum likelihood approach. Since the model predicts not just the distribution of SPVL, but how they change from one infection to the next, the model could predict the observed SPVL in both index and recipient partners in transmitting couples.
Figure 1 shows the likelihood surface for the environmental and mutational standard deviations (σE and σM), and the bivariate confidence bounds. The maximum likelihood estimates are σM = 0.12 (95% confidence interval 0.00 to 0.39) and σE = 0.66 (95% confidence interval 0.47–0.94). The estimates with highest mutational standard deviation within the 95% confidence bounds are σM = 0.39 and σE = 0.55 referred to later as the most mutable plausible scenario. Further details of the likelihood surface are given in Figure S2. The diagonal nature of the region of high likelihood in Figure 1 (or better viewed in Figure S2) indicates a trade-off between the two parameters in terms of the quality of model fit.
The maximum likelihood estimate is represented by the red point, and the regions of 50%, 95% and 99.9% confidence in orange, yellow and green respectively. The method for calculating confidence intervals is given in Text S1 equation (5.4).
Figure 2 shows the quality of fit of the model to the distribution of SPVL in index partners and recipients in transmitting couples, and the estimated heritability was 26% (compared to 27% in a previous statistical analysis of these couples ). We conclude that the model describes the data well. The distribution and heritability of set-point viral load is well described by a multi-strain model of HIV-1 virulence evolution.
(a) The distribution of SPVL in the index partner, and (b) the recipient. Where these roles are unknown, each individual in the pair represents half an individual in each figure. The modelled distributions were calculated from equations (3.5) and Text S1 (5.5) for the recipient and index partner, respectively.
Convergence of SPVL distribution
Having derived maximum likelihood estimates of parameters from an equilibrium solution to the model, the dynamics of genotype competition were then simulated numerically in order to assess whether or not convergence would occur under those parameter values, and on what timescale the convergence would occur.
The evolution of the SPVL distribution is shown in Figure 3. Regardless of whether the virulence of the founding genotype was high or low, the SPVL evolved towards an intermediate level with a mean log10 SPVL of 4.5.
The SPVL distribution evolves in the population over the years since introduction of the founding genotype. Maximum likelihood values from Figure 1 were used (σM = 0.12, σE = 0.66). The mean log10 SPVL of the founding genotype was (a) 3.5 and (b) 5.5.
This convergence on intermediate SPVL values also occurred when other combinations of parameter values in the region of high likelihood (Figure 1) were used instead. The rate of convergence was positively related to σM, as shown in Figure 4(a), where the maximum likelihood prediction is compared to the most mutable plausible scenario. Convergence towards intermediate virulence occurred in approximately 150 years under the maximum likelihood values. There was still change in the mean after this time but runs beginning with high or low virulence converge around this time point. The same point was reached in 50 years under the most mutable plausible scenario.
(a) Mean log10 SPVL, (b) heritability. The epidemic was run under maximum likelihood parameter (σM = 0.12 and σE = 0.66, black), or the combination of parameters with maximum σM, consistent with high likelihood (σM = 0.39 and σE = 0.55, red). The solid lines show runs in which the founding genotype had μ = 5.5, while the dashed lines show runs with a founding genotype with μ = 3.5.
The heritability was also calculated over time (Figure 4(b)) and under maximum likelihood values of σE and σM this reached equilibrium at 26%, which is consistent with previous studies , , , , . Further details of the heritability and variance at equilibrium are given in Figures S3 and S4.
In order to examine how changes in mean log10 SPVL are related to the stage of the epidemic, we examined the effect of proportion infected over time. The effect was most evident when the founding virulence closely matched the equilibrium virulence (Figure 5(b)). During the epidemic growth phase the mean virulence increased to levels above the optimum, and then returned to the optimum as the proportion infected reached equilibrium.
The founding genotype has μ = 4.5, very close to the equilibrium mean, to illustrate changes in the mean in response to growth or shrinkage of the epidemic. (a) The evolution of the mean log10 SPVL during epidemic growth (b).
We varied the founding virulence to investigate its effect on rate of convergence (Figure 6(a)). This had a marked effect on how quickly the mean log10 SPVL reached equilibrium (4.52 log10 SPVL). When the founding genotype had mean 4.5 log10 SPVL, equilibrium with regard to the mean was reached very quickly, and the more different the SPVL of the founding genotype, the longer the time to convergence. A similarly rapid convergence is seen if all genotypes had equal prevalence at the start of the run. The mean underwent little change (data not shown) but the variance rapidly decreased as the most successful genotype, already present in the population, began to dominate (Figure 6(b)).
(a) Mean log10 SPVL over time for different founding virulences. These range from μ = 2.5 to 6.5 log10 SPVL, “All” (red) begins with all genotypes from μi = 2.0 to 7.0 at equal prevalence, and “Equilibrium” (dashed black) is the SPVL value to which all scenarios in this figure are evolving. (b) Evolution of SPVL distribution from high diversity scenario where all genotypes are equally represented at the start, corresponding to “All” in panel (a). The parameter values for both are maximum likelihood values, σM = 0.12 and σE = 0.66.
Finally, we investigated the sensitivity of our findings to the choice of parameter values determining the dependencies of infectiousness and duration of asymptomatic infection on SPVL. These parameters were previously estimated from datasets from Amsterdam and Zambia . Here, we tested the sensitivity to those estimates by bootstrapping these datasets, refitting the parameters each time and calculating the corresponding maximum likelihood estimates of σE and σM. Details of the method are in Text S1 and Table S2. The resulting maximum likelihood estimates (Table S3 and Table S4) are similar to those from the principal analysis (Figure 1).
In this paper, we developed a multi-strain evolutionary epidemiological model of HIV-1 virulence, and showed that it could accurately reproduce observations on the distribution of viral load and its heritability in transmitting couples (Figure 2). We were able to estimate the proportion of variance in set-point viral load explained by viral genetic factors (26%, 1−(σE2+σM2)/σP2), and separately how much these factors change (‘mutate’) from one infection to the next. Our best estimate is that virulence changes slowly towards an evolutionary optimum over decades, but we cannot rule out faster changes (Figure 4 and Figure 6).
Our aim here was to develop a simple, parsimonious ‘broad-brush’ model to understand the principles of HIV-1 virulence evolution in a generalised epidemic using data currently available. Most of the parameters were derived from Sub-Saharan African studies (Table S1), suggesting that the model has most direct relevance for this context. This is our intention, as this is where most of the adaptation of HIV-1 to the human population has occurred. The parameters determining the curve of survival from disease progression were derived from European data, and since these data predate antiretroviral therapy they are not expected to differ substantially from parameters derived from Sub-Saharan Africa.
We do not expect the epidemic in other contexts to differ drastically. Two studies which have observed a change in virulence in the Netherlands  and Italy  appear to support our hypothesis as the virulence in both situations has risen from a sub-optimal level towards equilibrium, as predicted in our model. The same trend was not seen in Switzerland , however, and further work is required to apply the model rigorously to the European context with a view to explaining these trends. More realistic predictions will require more detailed models, and by necessity more data. We list some factors that could be included in a more detailed analysis.
Describing the differences between subtypes of HIV-1 seems like one of the biggest challenges to the model presented here. We considered virulence evolution on a single dimension of low-to-high, with single functions describing the relationship between viral load, infectiousness and duration of asymptomatic infection. HIV-1 subtypes in fact differ in their transmission parameters independently of their differences in SPVL , , . Subtype A shows a slower disease progression when compared to other subtypes . More specifically, data from the Rakai study showed that subtype A infection results in slower disease progression than subtype D even though the distribution of SPVL is the same , . From the same cohort it was shown that subtype A is also more transmissible than subtype D even when viral load and other confounding variables are controlled for in a regression . Subtype A is therefore fitter than D in both duration and transmissibility, and the evolutionary hypothesis would predict the gradual replacement of subtype D by subtype A, which has been observed in Uganda  and Greece . Other noteworthy trends include the dominance of subtype C in southern Africa , which may be a result of an extended period of high viraemia in primary infection . Taken together, these findings strongly suggest that HIV-1 virulence can change in ways not fully reflected by set-point viral load, and thus that more data are needed to identify other appropriate surrogate measures (or determinants) of virulence. More generally, the theoretical challenge is then to explain in terms of these other determinants of infectiousness and survival, how differences in virulence are maintained in different viral subtypes.
There are a number of other directions in which our model could be developed. In this study the mutational variance, the extent to which the viral genotype changed from one infection to the next, was considered independent of the age of infection (AOI). At first, this may seem a paradoxical choice, since mutation which occurs between hosts must be the result of mutations and selection occurring within the infected host. It would reasonable to suggest that the size of between-host mutation is positively related to the AOI, since nucleotide divergence from the founding strain has been shown to occur at a constant rate during infection . If this were the case, the between-host mutation rate would be the same regardless of the generation time and consequently of the virulence of the virus. However, a study of within-host evolution over time found that the rate of divergence from the founding genotype was positively correlated with viral load , suggesting that higher virulence infections diverge more rapidly. A model with a mutational variance independent of the AOI allows for this, as a higher virulence virus will have more generations in a given amount of time and therefore more between-host mutation events.
An accurate functional representation of mutational variance as a function of AOI thus requires more detailed understanding than seems currently possible. To resolve this, and for the sake of parsimony, we assume that the two effects described above cancel each other out, and thus that the mutational variance is independent of AOI. To test the sensitivity to this assumption, we changed the model to include AOI-dependent mutational variance (linearly increasing as a function of time), and the results were qualitatively and quantitatively similar (data not shown).
An additional problem with this model is that the data to which the model is fitted consists of transmission pairs, for most of whom the age of infection at which transmission occurs is unknown. Assuming an AOI-independent mutational variance considerably reduces the complexity of the analysis. There is however little doubt that extending the model to include a more detailed description of within-host processes and also resolving the effects of conflicting selection at the within and between host levels will be enlightening.
The pattern of mutation was modelled as a log-normal distribution. It may be reasonable to assume that the distribution is negatively skewed because deleterious mutations are much more frequent than beneficial ones, for example in the case of protease gene . However, it is misleading to compare the between-host mutation process to the mutation of individual viral genomes because deleterious mutations may be counterbalanced by within-host selection for viable viruses and there is no evidence for asymmetry in the net effect.
The host effect in this study was also modelled by a log-normal distribution which is justified if there are a large number of host effects and they are assumed to each have a multiplicative effect on SPVL. Host effects are known to account for a certain quantity of SPVL variation , –,  and a very low estimate of the environmental variance would not be consistent with these studies. The maximum likelihood estimate of σE was encouragingly high (σE = 0.66, Figure 1), contributing 71% of the total variance in SPVL. As more is understood about how the host contributes to variation in SPVL, this source of variance may be further decomposed .
The epidemiological component of this model could be made more realistic. The model could for example be structured by age, sex, location, sexual activity, HLA type and include stochastic effects. It is not clear to us what effect on virulence these heterogeneities will have, but they might help for example explain the persistence of diversity between subtypes and help provide reasonable initial conditions, since a stochastic model could elucidate which viruses are more likely to have started the epidemic. The analysis could be further developed by relaxing the assumption that the SPVL is at an evolutionary optimal equilibrium, though we note that this assumption provides good agreement with data (Figure 2). We note that the mean log10 SPVL and its heritability do not change substantially in the later stages of the epidemic (Figure 4a–c), and the mean log10 SPVL of the Ugandan data (4.51) is close to the predicted equilibrium value (4.52), suggesting that even if the observed data do not represent an equilibrium, they represent something close enough to render the maximum likelihood parameter estimations reasonable.
Despite being simple and parsimonious rather than detailed, our model provides a general framework that makes use of the most recent data on the heritability of set-point viral load, and that can be used to interpret past and predict future trends in SPVL.
One interesting trend is that the mean log10 SPVL can be observed to increase above the equilibrium value for a short while during the early stages of the epidemic. Epidemic growth is expected to favour a higher virulence than at equilibrium as a result of the cumulative advantage of rapid transmission when hosts are abundant , . This is better demonstrated in Figure 5(c) which shows the evolution of the mean log10 SPVL from a founding virulence very close to the equilibrium mean. At this level of resolution the temporary spike in virulence can be seen, and this corresponds to the period of epidemic growth. As the number of susceptible individuals grows and the epidemic begins to slow, the virulence decreases in response towards equilibrium as longer-lived genotypes are favoured.
This suggests that if SPVL can evolve at the between-host level then a growing epidemic could select for higher virulence viruses. Bolker et al.  model this phenomenon and suggest that the peak of this transient virulence is likely to occur late within the first exponential growth phase of the epidemic, so if this were observable the virulence is likely still to be in this transient state above the equilibrium. Whether this phenomenon has contributed to the recent increase in virulence in Italy and the Netherlands ,  cannot be distinguished from an increase in virulence as a result of the founder having sub-optimal virulence. A future slight decrease in virulence as an epidemic saturates would provide evidence for this hypothesis, if it could be identified . The optimum virulence could also be shifted by a widespread intervention which affects the nature of transmission such as circumcision, vaccination, or antiretroviral therapy. In the current study we introduced a model which may be used to predict such effects on virulence.
Recently published studies reporting the development of a reasonably effective vaccine  and a protective vaginal gel  are promising in the fight against HIV transmission. Hypothetically, a vaccine may offer more protection against lower virulence genotypes and select for more virulent ones, or vice versa. Gandon et al.  produced simple models which suggested that vaccines which target infection or transmission should have a negligible or negative effect on virulence as reducing the rate of transmission benefits pathogens which keep their host alive longer. However they also modelled vaccines which reduce the growth or the toxicity of the pathogen and suggest that this would select for pathogens which have higher virulence which would have a negative effect when unvaccinated individuals were infected.
Antiretroviral therapy during asymptomatic infection reduces transmission rate , , presumably by reducing viral load , . Antiretroviral therapy would therefore modify the relationship between SPVL, transmission and duration of asymptomatic infection, and it is possible to construct hypothetical scenarios that could select for either increased or decreased SPVL. In summary, our model could be used to predict (in general terms) the effects different interventions would have on virulence. These changes are expected to be relatively modest compared to gains obtained by curtailing transmission, but nonetheless some consideration should be given to the possibility of increased virulence and whether it could be mitigated.
Our results support the hypothesis that the distribution of SPVL, and by implication of HIV-1 virulence, can plausibly be explained by selection for increased transmission in populations, though differences between viral subtypes needs to be elucidated in future work. Our method disaggregates the effects of viral factors acting to determine SPVL, the effect of mutation (and thus indirectly within-host evolution), and other environmental and host factors. The best estimates indicate a relatively high proportion of SPVL explained by viral factors (26%), as well as a modest rate of evolution of putative viral virulence factors. Reconciling these findings with data on within-host viral evolution may yet shed further light on the role of viral factors in HIV-1 pathogenesis.
Materials and Methods
Viral genotypes and SPVL phenotypes
In order to simplify simulations, we modelled a discrete finite set of viral strains (‘genotype’), each capable of producing a finite range of possible SPVL (‘phenotype’).
Each infected host in the model carries a viral genotype, i, and has a phenotype, j. Hosts were not explicitly described in the model, rather the model specified the dynamics of relative prevalences of hosts infected with a virus of genotype i and phenotype j. In other words, we used a compartmental multi-strain epidemic model.
Each genotype is defined by a predisposition to give rise to higher or lower SPVL. Following the decomposition given by equation (1.1), viral loads can be given as:(2.1)where ej is the environmental component (with mean zero and variance σE2) and μi is the component attributed to viral factors. For a population of individuals infected with viral genotype i, the mean log10 SPVL will be given by μi, which is therefore a natural measure of the virulence of genotype i. For two viral genotypes i and k such that i is more virulent than k, i.e. μi>μk, not all individuals infected with genotype i will have higher SPVL than individuals infected with genotype k, but on average they will.
The means log10 SPVL for the viral genotypes, μi, are in the range 2.0–7.0, and SPVL phenotypes, Vj, are in the range 0.0–9.0, discretised with step 0.05 and 0.025 respectively. An individual carrying genotype i, will have a phenotype j with a probability denoted by fij which is taken from a normal distribution with mean μi and variance σE2 (2.2), normalised to sum to one for each genotype i.(2.2)
The prevalence of infections with viral genotype i, SPVL phenotype j, and age of infection a is represented by Yij,a(t) at time point t. The age of infection is the time since the individual was infected. During the course of an infection each host passes through three stages, primary, asymptomatic and disease (AIDS) (P, A and D) as the age of infection a increases.
Duration of infection
Primary and disease stages have equal duration (DP and DD) and rate of transmission (βP and βD), regardless of SPVL. Duration of and rate of transmission during asymptomatic infection are dependent on SPVL and the relationships were modelled as Hill functions as fitted in Fraser et al. , from which the parameter values relating to these functions were also taken (Table S1). The mean duration of the asymptomatic stage of infection for a given SPVL j is given by:(2.3)The progression from asymptomatic to disease stage is governed by a survival function in Text S1 equation (5.1), in which SPj,a is the probability of an individual with SPVL Vj remaining AIDS free at age of infection a. This is illustrated in Figure S1.
Rate of transmission
Force of infection
The rate of transmission, βj,a, is given in equation (5.3) which incorporates the different stages of infection and the curve for survival during asymptomatic infection. The force of infection for genotype i at time t, is calculated in equation (2.5) where Δt is the size of the time-step.(2.5)
Between generations a between-host mutation step occurs, so the force of infection for genotype k seeds a distribution of genotypes. The probability mik of an infection with genotype mean μk mutating so as to seed a new infection with genotype mean μi is taken from a normal distribution with mean μk and variance σM2 (2.6), normalised to sum to one for each genotype k.(2.6)Note that this is not mutation in the genetic sense, but rather a measure of the change in the distribution of viral genotypes that occurs over the course of infection within the host.
This model for the change that occurs from one infection to the next, defined by equation (2.6), represents the simplest possible model of the effect of within-host evolution on the distribution of transmitted viruses. More complex models, with directional and host-dependent selection, could feasibly be encoded in more complex mutational matrices.
New infections in each time-step
The total number of infections for a given genotype in the next time step, t+Δt, is calculated by the sum of the elementwise product of each FOIk and the probability that it will mutate into genotype i, mik. This is scaled according to X(t), the proportion of susceptibles in the population at time t, meaning that the genotypes are competing for the available pool of susceptibles. To give the prevalence for each genotype and its SPVL category in the next set of new infections (where a = 0), this value is multiplied by the probability of genotype i producing SPVL category j, fij.(2.7)
The prevalent infections are updated as in equation (2.8). The term SPj,a is the function of survival from progression to AIDS, given in equation (5.1). Since AIDS is a stage of determined length, DD, the function of survival from death at age of infection a is given by , the probability of surviving progression to AIDS at a time DD years previously.(2.8)
The terms Xout(t) and Xin(t) refer to new infections and deaths, respectively.(2.9)(2.10)These are used to update the susceptible pool, with new infections being removed and individuals who die of AIDS being replaced in the population.(2.11)
Calculating R0 for each genotype
The basic reproductive rate, R0, can be calculated for each genotype, and this can be used to calculate the genotype distribution at equilibrium using the next-generation formalism. The R0 of each genotype is calculated in two steps. Firstly the transmission potential is calculated for an infection with SPVL category j by multiplying the rate of transmission in each of the three stages of infection by the length of that stage. The duration of asymptomatic infection DA(Vj) is the mean of the survival curve.(3.1)Secondly, the basic reproductive rate, R0i, for each genotype i, is then calculated by taking the weighted average transmission potential, TPj, weighted by the probability that infection with genotype i results in infection with SPVL category j.(3.2)
Solution to equilibrium using next-generation formalism
The R0 for each genotype k (3.2) and the probability that genotype k mutates into genotype i (2.6) can be used to calculate the next-generation matrix, K.(3.3)The distribution of genotypes at equilibrium is the eigenvector ε corresponding to the dominant eigenvalue, λ, of K.(3.4)The prevalence of SPVL category j, pj, at equilibrium in the population is then calculated as follows.(3.5)This value can then be directly compared with the observed distribution of SPVL.
The likelihood of each run of the model is calculated by comparison with data from a previous study reporting the SPVL of phylogenetically confirmed transmission pairs  selected from a cohort in Rakai, Uganda , . The likelihood is given by the probability of observing the index SPVL, Vd, and the recipient's SPVL, Vr. This is calculated using conditional probabilities and is given as follows. The mean log10 SPVL of the genotypes infecting the recipient and index case are given by μx and μy. As these are unknown, all possible combinations of genotypes are considered.(3.6)in which C is a constant:(3.7)and the following have been previously defined in equations (2.2), (2.6) and (3.4):(3.8)(3.9)(3.10)The total log likelihood is calculated for each couple c in which the direction of transmission is known, and for each couple u where the direction is unknown the log likelihood is worked out for each direction and the mean is taken (in this case, Vm and Vf refer to SPVL of males and females, respectively).(3.11)
Heritability is the proportion of total variation which is determined by genetic variation in the viral population. It was measured previously by calculating the proportion of the total variance which was explained by carrying genetically similar virus . This can be measured for the modelled distribution in a similar fashion. The non-heritable component is the variance in SPVL in individuals infected by an index partner with a particular SPVL, as a proportion of total variance. This is weighted according to each possible SPVL of the index.(3.12)(3.13)
The likelihood was estimated by calculating the total likelihood, ℓtotal, for each combination of values of σE (range 0–1.2, step 0.005) and σM (range 0–1.0, step 0.005). Outside of these ranges the likelihood of observing the data is very low, as the variance of the equilibrium distribution becomes vastly higher than is observed. These values were used instead of their squares, σE2 and σM2, because they are on the same scale as log10 SPVL and are therefore directly related to the size of the host effect and of between-host mutation. Furthermore, using σE and σM gives greater resolution at lower values in the range of interest.
The values of Y0 and μî were not included in this analysis as they are not relevant to the equilibrium distribution since they serve only as starting points in the model. All other parameter values were taken from the literature (Table S1).
The maximum likelihood combination of these two parameters was estimated and the 95% confidence bounds were identified using a likelihood ratio test (5.4).
Convergence of SPVL distribution
The next-generation formalism solution described above is sufficient for analysing the equilibrium distribution of SPVL as the end results are identical. However, the model must be run in full to determine the rate at which SPVL evolves in real time.
To run the model in continuous time, the infection is initialised at time t = 0 for the starting genotype î with mean μî and a proportion Y0 of the population are infected. The total number of infected individuals at the start of the epidemic all enter genotype category î, and are divided up between all the SPVL categories according to fîj.(4.1)All other genotype categories begin at zero, (4.2), as do all ages of infection greater than zero (4.3).(4.2)(4.3)The model was run for 500 years in discrete time-steps corresponding to one month for each set of the parameter values.
Parameter values, listed in Table S1, were taken from the literature , , . Analyses were conducted using C++, MATLAB and R –, the latter of which was also used to produce the figures .
Possible disease progression outcomes for an infection with log10 SPVL of 6.0. All individuals have the same length of primary and disease stage infection, regardless of SPVL. The survival function is the border between asymptomatic and disease stage infection (“survival” here refers to survival from progression to AIDS, not death). A similar pattern is seen at other SPVL, but with a different survival function.
Details of the likelihood surface. (a) For each value of σM, the value of σE which gives the highest likelihood is marked in orange on the figure, while the yellow region gives the 95% confidence bounds. Similarly, for each value of σE, the optimum σM value is marked in dark blue, with 95% confidence bounds in light blue. Where the maximum likelihood regions for the two parameters overlap this is marked in green, and the point of maximum likelihood is white. (b) Likelihood at the optimum value of σE for each value of σM i.e. it tracks the likelihood of the orange line. (c) Likelihood at the optimum value of σM for each value of σE i.e. it tracks the likelihood of the dark blue line.
Heritability of SPVL measured at equilibrium for each combination of parameters σM and σE. The black line represents the border of the 95% confidence interval on the maximum likelihood plot, Figure 1.
Population variance of SPVL measured at equilibrium for each combination of parameters σM and σE. The black line represents the border of the 95% confidence interval on the maximum likelihood plot, Figure 1.
Parameter values. Where possible these values have been taken from the literature, and a broad range of plausible values are applied to unknown parameters.
The range of values used to construct the latin hypercube sample. The values for each point in the hypercube were sampled from a uniform distribution within that range.
The maximum likelihood estimates of σM and σE in 1000 bootstraps. The figures are the proportion of each combination of values of σM and σE which were the maximum likelihood estimate when a low resolution likelihood surface was calculated with 1000 sets of bootstrapped parameters. These exclude 19 bootstraps in which the optimised parameter values gave a next-generation matrix with mixed signs, rendering the result incalculable.
The combination of parameters with the highest value of σM in 1000 bootstraps. The figures are the proportion of each combination of values of σM and σE which formed the highest value of σM which was still consistent with the 95% confidence region of the maximum likelihood estimate. Where several values of σE were available, the one with the highest likelihood was chosen.
We thank Déirdre Hollingsworth, Bill Hanage, Frank de Wolf and Samuel Alizon for their help and discussions.
Conceived and designed the experiments: GS LP CF. Performed the experiments: GS. Analyzed the data: GS CF. Contributed reagents/materials/analysis tools: GS LP CF. Wrote the paper: GS CF. Provided the data to which the model was fit: OL.
- 1. Babiker A, Darby S, De Angelis D, Kwart D, Porter K, et al. (2000) Time from HIV-1 seroconversion to AIDS and death before widespread use of highly-active antiretroviral therapy: a collaborative re-analysis. Lancet 355: 1131–1137.
- 2. Gao XJ, O'Brien TR, Welzel TM, Marti D, Qi Y, et al. (2010) HLA-B alleles associate consistently with HIV heterosexual transmission, viral load, and progression to AIDS, but not susceptibility to infection. AIDS 24: 1835–1840.
- 3. Alizon S, von Wyl V, Stadler T, Kouyos RD, Yerly S, et al. (2010) Phylogenetic approach reveals that virus genotype largely determines HIV set-point viral load. PLoS Pathog 6: e1001123.
- 4. Baeten JM, Chohan B, Lavreys L, Chohan V, McClelland RS, et al. (2007) HIV-1 subtype D infection is associated with faster disease progression than subtype A in spite of similar plasma HIV-1 loads. J Infect Dis 195: 1177–1180.
- 5. Hecht FM, Hartogensis W, Bragg L, Bacchetti P, Atchison R, et al. (2010) HIV RNA level in early infection is predicted by viral load in the transmission source. AIDS 24: 941–945.
- 6. Hollingsworth TD, Laeyendecker O, Shirreff G, Donnelly CA, Serwadda D, et al. (2010) HIV-1 transmitting couples have similar viral load set-points in Rakai, Uganda. PLoS Pathog 6: e1000876.
- 7. Kiwanuka N, Laeyendecker O, Robb M, Kigozi G, Arroyo M, et al. (2008) Effect of human immunodeficiency virus type 1 (HIV-1) subtype on disease progression in persons from Rakai, Uganda, with incident HIV-1 infection. J Infect Dis 197: 707–713.
- 8. Ng OT, Lin L, Laeyendecker O, Quinn TC, Sun YJ, et al. (2011) Increased rate of CD4+ T-cell decline and faster time to antiretroviral therapy in HIV-1 subtype CRF01_AE infected seroconverters in Singapore. PLoS One 6: e15738.
- 9. Tang JM, Tang SH, Lobashevsky E, Zulu I, Aldrovandi G, et al. (2004) HLA allele sharing and HIV type 1 viremia in seroconverting Zambians with known transmitting partners. AIDS Res Hum Retroviruses 20: 19–25.
- 10. van der Kuyl AC, Jurriaans S, Pollakis G, Bakker M, Cornelissen M (2010) HIV RNA levels in transmission sources only weakly predict plasma viral load in recipients. AIDS 24: 1607–1608.
- 11. Henrard DR, Phillips JF, Muenz LR, Blattner WA, Wiesner D, et al. (1995) Natural history of HIV-1 cell-free viremia. JAMA 274: 554–558.
- 12. deWolf F, Spijkerman I, Schellekens PT, Langendam M, Kuiken C, et al. (1997) AIDS prognosis based on HIV-1 RNA, CD4+ T-cell count and function: Markers with reciprocal predictive value over time after seroconversion. AIDS 11: 1799–1806.
- 13. Korenromp EL, Williams BG, Schmid GP, Dye C (2009) Clinical prognostic value of RNA viral load and CD4 cell counts during untreated HIV-1 infection–a quantitative review. PLoS One 4: e5950.
- 14. Mellors JW, Rinaldo CR, Gupta P, White RM, Todd JA, et al. (1996) Prognosis in HIV-1 infection predicted by the quantity of virus in plasma. Science 272: 1167–1170.
- 15. Geskus RB, Prins M, Hubert JB, Miedema F, Berkhout B, et al. (2007) The HIV RNA setpoint theory revisited. Retrovirology 4: 65.
- 16. Quinn TC, Wawer MJ, Sewankambo N, Serwadda D, Li CJ, et al. (2000) Viral load and heterosexual transmission of human immunodeficiency virus type 1. NEJM 342: 921–929.
- 17. Lingappa JR, Hughes JP, Wang RS, Baeten JM, Celum C, et al. (2010) Estimating the impact of plasma HIV-1 RNA reductions on heterosexual HIV-1 transmission risk. PLoS ONE 5: e12598.
- 18. Fideli US, Allen SA, Musonda R, Trask S, Hahn BH, et al. (2001) Virologic and immunologic determinants of heterosexual transmission of human immunodeficiency virus type 1 in Africa. AIDS Res Hum Retroviruses 17: 901–910.
- 19. Fraser C, Hollingsworth TD, Chapman R, de Wolf F, Hanage WP (2007) Variation in HIV-1 set-point viral load: Epidemiological analysis and an evolutionary hypothesis. PNAS 104: 17441–17446.
- 20. Gras L, Jurriaans S, Bakker M, van Sighem A, Bezemer D, et al. (2009) Viral load levels measured at set-point have risen over the last decade of the HIV epidemic in the Netherlands. PLoS One 4: e7365.
- 21. Müller V, Maggiolo F, Suter F, Ladisa N, De Luca A, et al. (2009) Increasing clinical virulence in two decades of the Italian HIV epidemic. PLoS Pathog 5: e1000454.
- 22. Müller V, Ledergerber B, Perrin L, Klimkait T, Furrer H, et al. (2006) Stable virulence levels in the HIV epidemic of Switzerland over two decades. AIDS 20: 889–894.
- 23. Crum-Cianflone N, Eberly L, Zhang YF, Ganesan A, Weintrob A, et al. (2009) Is HIV Becoming More Virulent? Initial CD4 Cell Counts among HIV Seroconverters during the Course of the HIV Epidemic: 1985–2007. Clin Infect Dis 48: 1285–1292.
- 24. Dorrucci M, Phillips AN, Longo B, Rezza G, Italian Seroconversion S (2005) Changes over time in post-seroconversion CD4 cell counts in the Italian HIV-seroconversion study: 1985–2002. AIDS 19: 331–335.
- 25. Arien KK, Troyer RM, Gali Y, Colebunders RL, Arts EJ, et al. (2005) Replicative fitness of historical and recent HIV-1 isolates suggests HIV-1 attenuation over time. AIDS 19: 1555–1564.
- 26. Gali Y, Berkhout B, Vanham G, Bakker M, Back NKT, et al. (2007) Survey of the temporal changes in HIV-1 replicative fitness in the Amsterdam Cohort. Virology 364: 140–146.
- 27. Worobey M, Gemmel M, Teuwen DE, Haselkorn T, Kunstman K, et al. (2008) Direct evidence of extensive diversity of HIV-1 in Kinshasa by 1960. Nature 455: 661–U657.
- 28. Müller V, Fraser C, Herbeck JT (2011) A Strong Case for Viral Genetic Factors in HIV Virulence. Viruses 3: 204–216.
- 29. Richardson BA, Mbori-Ngacha D, Lavreys L, John-Stewart GC, Nduati R, et al. (2003) Comparison of human immunodeficiency virus type 1 viral loads in Kenyan women, men, and infants during primary and early infection. J Virol 77: 7120–7123.
- 30. Donnelly CA, Bartley LM, Ghani AC, Le Fevre AM, Kwong GP, et al. (2005) Gender difference in HIV-1 RNA viral loads. HIV Med 6: 170–178.
- 31. Fellay J, Ge DL, Shianna KV, Colombo S, Ledergerber B, et al. (2009) Common genetic variation and the control of HIV-1 in humans. PLoS Genet 5: e1000791.
- 32. Fraser C, Ferguson NM, de Wolf D, Anderson RM (2001) The role of antigenic stimulation and cytotoxic T cell activity in regulating the long-term immunopathogenesis of HIV: mechanisms and clinical implications. Proc R Soc London, Ser B 268: 2085–2095.
- 33. Fraser C, Hollingsworth TD (2010) Interpretation of correlations in setpoint viral load in transmitting couples. AIDS 24: 2596–2597.
- 34. Kanki PJ, Hamel DJ, Sankale JL, Hsieh CC, Thior I, et al. (1999) Human immunodeficiency virus type 1 subtypes differ in disease progression. J Infect Dis 179: 68–73.
- 35. Kiwanuka N, Laeyendecker O, Quinn TC, Wawer MJ, Shepherd J, et al. (2009) HIV-1 subtypes and differences in heterosexual HIV transmission among HIV-discordant couples in Rakai, Uganda. AIDS 23: 2479–2484.
- 36. Conroy SA, Laeyendecker O, Redd AD, Collinson-Streng A, Kong X, et al. (2010) Changes in the distribution of HIV-1 subtypes D and A in Rakai District, Uganda between 1994 and 2002. AIDS Res Hum Retroviruses 10: 1087–91.
- 37. Paraskevis D, Magiorkinis E, Magiorkinis G, Sypsa V, Paparizos V, et al. (2007) Increasing prevalence of HIV-1 subtype a in Greece: Estimating epidemic history and origin. J Infect Dis 196: 1167–1176.
- 38. Tebit DM, Arts EJ (2011) Tracking a century of global expansion and evolution of HIV to drive understanding and to combat disease. Lancet Infect Dis 11: 45–56.
- 39. Novitsky V, Ndung'u T, Wang R, Bussmann H, Chonco F, et al. (2011) Extended high viremics: a substantial fraction of individuals maintain high plasma viral RNA levels after acute HIV-1 subtype C infection. AIDS 25: 1515–1522.
- 40. Shankarappa R, Margolick JB, Gange SJ, Rodrigo AG, Upchurch D, et al. (1999) Consistent viral evolutionary changes associated with the progression of human immunodeficiency virus type 1 infection. J Virol 73: 10489–10502.
- 41. Bello G, Casado C, Sandonis V, Alvaro-Cifuentes T, Dos Santos CAR, et al. (2007) Plasma viral load threshold for sustaining intrahost HIV type 1 evolution. AIDS Res Hum Retroviruses 23: 1242–1250.
- 42. Parera M, Fernandez G, Clotet B, Martinez MA (2007) HIV-1 protease catalytic efficiency effects caused by random single amino acid substitutions. Mol Biol Evol 24: 382–387.
- 43. Jones LE, Perelson AS (2007) Transient viremia, plasma viral load, and reservoir replenishment in HIV-Infected patients on antiretroviral therapy. JAIDS 45: 483–493.
- 44. Bolker BM, Nanda A, Shah D (2010) Transient virulence of emerging pathogens. J R Soc Interface 7: 811–822.
- 45. Rerks-Ngarm S, Pitisuttithum P, Nitayaphan S, Kaewkungwal J, Chiu J, et al. (2009) Vaccination with ALVAC and AIDSVAX to Prevent HIV-1 Infection in Thailand. NEJM 361: 2209–2220.
- 46. Karim QA, Karim SSA, Frohlich JA, Grobler AC, Baxter C, et al. (2010) Effectiveness and Safety of Tenofovir Gel, an Antiretroviral Microbicide, for the Prevention of HIV Infection in Women. Science 329: 1168–1174.
- 47. Gandon S, Mackinnon MJ, Nee S, Read AF (2001) Imperfect vaccines and the evolution of pathogen virulence. Nature 414: 751–756.
- 48. Attia S, Egger M, Muller M, Zwahlen M, Low N (2009) Sexual transmission of HIV according to viral load and antiretroviral therapy: systematic review and meta-analysis. AIDS 23: 1397–1404.
- 49. HIV Prevention Trials Network (2011) Initiation of antiretroviral treatment protects uninfected sexual partners from HIV infection (HPTN Study 052). Press Release. Washington, DC: HIV Prevention Trials Network. Available: www.hptn.org/web%20documents/PressReleases/HPTN052PressReleaseFINAL5_12_118am.pdf. Accessed 25 July 2011.
- 50. Reynolds SJ, Makumbi F, Nakigozi G, Kagaayi J, Gray RH, et al. (2011) HIV-1 transmission among HIV-1 discordant couples before and after the introduction of antiretroviral therapy. AIDS 25: 473–477.
- 51. Donnell D, Baeten JM, Kiarie J, Thomas KK, Stevens W, et al. (2010) Heterosexual HIV-1 transmission after initiation of antiretroviral therapy: a prospective cohort analysis. Lancet 375: 2092–2098.
- 52. Wawer MJ, Sewankambo NK, Serwadda D, Quinn TC, Paxton LA, et al. (1999) Control of sexually transmitted diseases for AIDS prevention in Uganda: a randomised community trial. Lancet 353: 525–535.
- 53. Wawer MJ, Gray RH, Sewankambo NK, Serwadda D, Paxton L, et al. (1998) A randomized, community trial of intensive sexually transmitted disease control for AIDS prevention, Rakai, Uganda. AIDS 12: 1211–1225.
- 54. Hollingsworth TD, Anderson RM, Fraser C (2008) HIV-1 transmission, by stage of infection. J Infect Dis 198: 687–693.
- 55. Wawer MJ, Gray RH, Sewankambo NK, Serwadda D, Li XB, et al. (2005) Rates of HIV-1 transmission per coital act, by stage of HIV-1 infection, in Rakai, Uganda. J Infect Dis 191: 1403–1409.
- 56. R Development Core Team (2011) R: A language and environment for statistical computing. Version 2.12.2 [computer program]. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0. Available: www.R-project.org. Accessed 1 August 2011.
- 57. Gramacy RB (2007) tgp: An R package for bayesian nonstationary, semiparametric nonlinear regression and design by treed gaussian process models. J Stat Softw 19: 1–46. Available: www.jstatsoft.org/v19/i09. Accessed 1 August 2011.
- 58. Gramacy RB, Taddy M (2010) Categorical inputs, sensitivity analysis, optimization and importance tempering with tgp version 2, an R package for treed gaussian process models. J Stat Softw 33: 1–48. Available at: www.jstatsoft.org/v33/i06. Accessed 1 August 2011.
- 59. Furrer R, Nychka D, Sain S (2010) fields: Tools for spatial data. R package version 6.3. Available at: http://CRAN.R-project.org/package=fields. Accessed 1 August 2011.