The potential for emergence and spread of HIV drug resistance from rollout of antiretroviral (ARV) pre-exposure prophylaxis (PrEP) is an important public health concern. We investigated determinants of HIV drug resistance prevalence after PrEP implementation through mathematical modeling.
A model incorporating heterogeneity in age, gender, sexual activity, HIV infection status, stage of disease, PrEP coverage/discontinuation, and HIV drug susceptibility, was designed to simulate the impact of PrEP on HIV prevention and drug resistance in a sub-Saharan epidemic.
Analyses suggest that the prevalence of HIV drug resistance is influenced most by the extent and duration of inadvertent PrEP use in individuals already infected with HIV. Other key factors affecting drug resistance prevalence include the persistence time of transmitted resistance and the duration of inadvertent PrEP use in individuals who become infected on PrEP. From uncertainty analysis, the median overall prevalence of drug resistance at 10 years was predicted to be 9.2% (interquartile range 6.9%–12.2%). An optimistic scenario of 75% PrEP efficacy, 60% coverage of the susceptible population, and 5% inadvertent PrEP use predicts a rise in HIV drug resistance prevalence to only 2.5% after 10 years. By contrast, in a pessimistic scenario of 25% PrEP efficacy, 15% population coverage, and 25% inadvertent PrEP use, resistance prevalence increased to over 40%.
Inadvertent PrEP use in previously-infected individuals is the major determinant of HIV drug resistance prevalence arising from PrEP. Both the rate and duration of inadvertent PrEP use are key factors. PrEP rollout programs should include routine monitoring of HIV infection status to limit the spread of drug resistance.
Citation: Abbas UL, Hood G, Wetzel AW, Mellors JW (2011) Factors Influencing the Emergence and Spread of HIV Drug Resistance Arising from Rollout of Antiretroviral Pre-Exposure Prophylaxis (PrEP). PLoS ONE 6(4): e18165. https://doi.org/10.1371/journal.pone.0018165
Editor: Gary Maartens, University of Cape Town, South Africa
Received: September 23, 2010; Accepted: February 25, 2011; Published: April 15, 2011
Copyright: © 2011 Abbas et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by the National Institute of Allergy and Infectious Diseases (R21AI078789) and the Bill and Melinda Gates Foundation. Ume L. Abbas acknowledges grant support from the National Institute of Allergy and Infectious Diseases (R21AI078789) and the Bill and Melinda Gates Foundation (OPP1005974). John W. Mellors acknowledges support from the AIDS Clinical Trials Group (NIAID U01AI38858), the Microbicide Trials Network (NIAID U01AI068633) and the National Cancer Institute (SAIC contract 20XS190A). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: John W. Mellors reports that he is a consultant to Gilead Sciences, Merck, and RFS Pharmaceuticals, has received grant support from Merck, and owns share options in RFS Pharmaceuticals. This does not alter the authors' adherence to all the PLoS ONE policies on sharing data and materials.
Antiretroviral (ARV) pre-exposure prophylaxis (PrEP) is a promising HIV prevention strategy , . There is widespread concern, however, about the potential emergence and spread of HIV drug resistance arising from PrEP rollout, particularly in resource-constrained settings, where antiretroviral treatment options are limited. This concern is amplified by the possibility that the same antiretroviral drugs will be used for both treatment and PrEP. Insight is needed into factors influencing the emergence and spread of HIV drug resistance at the population level from PrEP . We therefore used a mathematical model to analyze the potential impact of orally administered PrEP on HIV drug resistance outcomes through simulation of different PrEP implementation scenarios. The focus of the current work was to identify major determinants of HIV drug resistance prevalence after PrEP implementation rather than prediction of actual outcomes.
We have developed and analyzed a population model of heterosexual HIV transmission and disease progression to assess the impact of PrEP implementation . In brief, the model consists of coupled, nonlinear differential equations describing population and epidemiological stratifications based on gender, age, sexual activity, PrEP use status (on/off), infection status (susceptible/infected), stage of HIV infection, and HIV drug susceptibility. Model input parameters were chosen to simulate a mature epidemic in southern sub-Saharan Africa . Parameter assignments were made from recent literature on HIV disease progression, infectivity, sexual behavior and the emergence, transmission and persistence of HIV drug resistance.
For the present work, we extended our published model  by incorporating detailed representation of HIV drug resistance, both transmitted and acquired, arising from PrEP as outlined in Figure 1, and with parameter assignments listed in Table 1. Model equations and details are provided in Appendix S1. In addition to PrEP use in susceptible individuals, we model inadvertent PrEP use in individuals previously HIV-infected (pre-infected) as well as those who become infected while on PrEP (post-infected). The final model describes a sexually active population (15–49 year-olds) that is stratified into many different states based on epidemiologic, demographic and behavioral characteristics, including 22 unique HIV drug susceptibility strata described below.
A. Resistant = acquired resistance and T. Resistance = transmitted resistance.
Effectiveness of PrEP.
Our model represents the transmission of HIV as a Poisson process . The probability of transmission per heterosexual partnership, β, between an individual (on PrEP) of gender g, activity level k, and age i, with an (infected) individual of opposite gender g′, activity level l and age j is given by:where Ψ is the number of sex acts within the partnership; γ is the probability of HIV transmission per sex-act (infectivity) based on the disease stage, Ω, and drug resistance status, Θ, of the infected partner; and ξθ is the effectiveness of PrEP. Effectiveness is defined as the probability of preventing HIV transmission per sex-act through PrEP and is given by the product of the average efficacy of PrEP, ξ (the degree of protection provided, from HIV transmission per sex-act) and the average level of adherence to PrEP, θ (assuming once daily dosing of a single antiretroviral drug and that doses are missed at random). In a partnership, where the infected partner harbors major drug-resistant variants (discussed below), the probability of transmission of resistant virus is υβ, while that of wild-type virus is (1−υ)β, and the effectiveness of PrEP against resistant virus is ιξθ. The parameters ξ, θ, υ and ι assume values between 0 and 1 (Table 1).
Modeling Drug Resistance.
We sub-classified HIV-infected individuals based on their PrEP status (naïve, on PrEP or off PrEP), HIV drug susceptibility (drug-sensitive or drug-resistant), type of drug resistance (transmitted or acquired), and virus population dynamics of drug-resistant HIV (persistence of resistance or reversion of resistance, the latter either from genetic reversion of virus to wild-type or overgrowth of resistant virus by wild-type virus) into 22 different HIV drug susceptibility strata (Figure 1 and Tables 1, 2). Our key model assumptions for HIV drug resistance are as follows. In an HIV-infected individual, the virus population is comprised of a set of related variants, termed a quasispecies . Before the introduction of PrEP in antiretroviral naïve persons, the major (predominant) variants are wild-type and drug-sensitive. After the introduction of PrEP, drug-sensitive virus or drug-resistant variants may predominate. Individuals with predominantly drug-sensitive or drug-resistant variants may probabilistically transmit either drug-sensitive or drug-resistant virus to their sexual partners (Table 1). Transmitted resistance (Table 2) may occur from: i) a donor having a majority population of drug-resistant variant to a recipient either receiving or not receiving PrEP; or ii) a donor having a majority population of drug-sensitive virus to a recipient receiving PrEP. Acquired resistance may occur from the selection of drug-resistant virus in individuals with drug-sensitive virus, who were either previously infected or became infected while receiving PrEP , . Upon removal of drug selection, either by discontinuation of PrEP  or transmission to an individual not on PrEP (never started or discontinued) , the drug-resistant virus reverts to drug-sensitive virus after a period of persistence, either from overgrowth of resistant variants by wild-type variants or genetic reversion of the resistant variants to wild-type , , . Prior to reversion, drug-resistant variants comprise the majority population, whereas following reversion they become a minor population , , . Compared to individuals with wild-type virus, individuals with majority resistant variants may have: i) decreased per act probability of transmission of HIV to their sexual partners (infectivity) because of reduced transmission fitness or from lower virus levels, the latter either from continued antiretroviral activity of PrEP ,  or from reduced viral replicative fitness , , ; and ii) increased probability of sexual transmission of drug-resistant strains versus drug-sensitive strains , , . Individuals with minority drug-resistant variants are similar to individuals with majority wild-type variants in terms of HIV transmission and disease progression. The re-emergence of drug-resistant variants from antiretroviral therapy was not modeled , , .
Model Output and Introduction of PrEP.
The model's dynamical behavior was investigated using numerical methods. The key model outputs were: i) HIV incidence; ii) HIV prevalence; iii) cumulative new HIV infections; iv) proportion of cumulative new infections with transmitted resistance; v) overall prevalence of HIV drug resistance (transmitted plus acquired); vi) prevalence of transmitted resistance; and vii) prevalence of acquired resistance. PrEP was introduced (once daily oral dosing of a single antiretroviral drug, e.g. tenofovir disoproxil fumarate) at endemic equilibrium when HIV prevalence in sexually active adults (15–49 year-olds) was approximately 20%. We made comparisons between the epidemics with and without PrEP at each simulation time-step over a 10 year interval after PrEP introduction.
We performed sensitivity analyses ,  to determine the relative influence of PrEP-related input parameters (Table 1) on outcomes and examined our prediction uncertainty . Univariate sensitivity analyses were performed using batch simulations in which the PrEP-related input parameters were individually varied, over their entire range, followed by examination of tornado and contour plots of output. For multivariate time-dependent sensitivity analyses, we performed two sets of 10,000 runs using Latin hypercube sampling to simulate HIV epidemics and the implementation of PrEP, either with or without risk compensation (increase in rate of sex partner change) occurring in the population on PrEP. We rank transformed input and output data obtained from simulations and derived standardized rank regression coefficients (SRRCs) . The strength and nature of the relationship between an input parameter and the outcome are given by the size and sign (+/−) of the relevant SRRC. Because we sampled the input parameters independently, the fraction of variance in model outcome explained by each parameter is given by the square of its SRRC , . In addition to the model's sensitivity to parameter uncertainty, we studied the model's sensitivity to key assumptions by comparing the outputs of an original model with those obtained using different structural assumptions (singly or combined) including no PrEP use in previously-infected individuals.
The impact of PrEP was next determined by simulating three different scenarios: optimistic, realistic and pessimistic (Table 1). For each of these scenarios, we simulated PrEP implementation with proportional PrEP coverage in the following susceptible populations: i) the sexually active population in general (non-targeted strategy); ii) targeted to the group 15–20 years of age (targeted-by-age strategy); iii) targeted to the female population (targeted-by-gender strategy); and iv) targeted to the two highest sexual activity levels (targeted-by-activity strategy). In addition, the scenarios (optimistic, realistic and pessimistic) represented inadvertent PrEP use in the previously-infected population (rates/year of 5%, 10% and 25%) as well as in all the individuals infected on PrEP, for a variable period of time.
Our mathematical model stratifies the study population by gender, age, sexual activity level, PrEP use, HIV infection status, disease stage and HIV drug susceptibility (Figure 1), and its dynamical behavior is analyzed numerically. We introduced PrEP at endemic equilibrium and simulated optimistic, realistic and pessimistic scenarios (Table 1). For each scenario we simulated four strategies of PrEP implementation: i) in the sexually active population in general (non-targeted strategy); ii) targeted to the group 15–20 years of age (targeted-by-age strategy); iii) targeted to the female population (targeted-by-gender strategy); and iv) targeted to the two highest sexual activity levels (targeted-by-activity strategy). To determine the epidemiological impact of PrEP, we compared epidemics with and without PrEP for up to 10 years for: i) HIV incidence; ii) HIV prevalence; iii) cumulative new HIV infections; in addition we determined outcomes of drug resistance from PrEP including iv) proportion of cumulative new infections with transmitted resistance; v) overall prevalence of HIV drug resistance (transmitted plus acquired); vi) prevalence of transmitted resistance; and vii) prevalence of acquired resistance.
Factors Influencing Impact of PrEP on Transmission vs. HIV Drug Resistance
Table 3 shows multivariate sensitivity analyses of model outcomes after 10 years of PrEP implementation in the absence of risk compensation. The key parameters influencing the impact of PrEP on HIV prevention were different from those affecting the prevalence of HIV drug resistance. Specifically, the extent of PrEP coverage (SRRC = 0.52) explained 26.9% of the variance in cumulative infections prevented. The level of PrEP adherence (SRRC = 0.49), PrEP efficacy against wild-type virus (SRRC = 0.42), infectivity of individuals with acquired resistance (SRRC = −0.32), and the rate of PrEP discontinuation in susceptible individuals (SRRC = −0.23) explained 24%, 17.5%, 9.9% and 5.4% of the variance in infections prevented, respectively.
By contrast, the overall prevalence of drug resistance was influenced most by the duration of inadvertent PrEP use (SRRC = 0.62) and the rate of PrEP uptake (SRRC = 0.34) in previously-infected individuals. Together these two parameters explained 50.5% of the variance in overall prevalence of resistance after 10 years. Not surprisingly, the prevalence of transmitted resistance after 10 years was most influenced by the persistence time of transmitted resistance (SRRC = 0.53), explaining 28% of the variance. The rate of PrEP uptake and duration of inadvertent use in previously-infected individuals (SRRC = 0.32) explained another 10.5% and 10.2% of variance in transmitted resistance, respectively. The prevalence of acquired resistance was most sensitive to the duration of inadvertent PrEP use (SRRC = 0.74) and its rate of uptake (SRRC = 0.27) in previously-infected individuals; together these parameters explained 61.6% of the variance in the prevalence of acquired resistance after 10 years. Likewise, the rate (SRRC = 0.40) and duration (SRRC = 0.36) of inadvertent PrEP use in previously-infected individuals were most influential for the proportion of cumulative new infections with transmitted resistance, explaining 28.8% of the variance in this outcome (data not shown). Factors influencing the prevalence of drug resistance when risk compensation was assumed were similar to the above (data not shown).
Table 1 shows the PrEP-related input parameters for the three different scenarios. Table 4 compares the epidemiologic outcomes in optimistic, realistic and pessimistic scenarios 10 years after the introduction of PrEP. The overall prevalence of drug resistance was highest for the pessimistic scenario (42.3%), but was minimal for the optimistic scenario (2.5%), illustrating the importance of the key scenario parameters on resistance prevalence (Figure 2A). With uncertainty analysis (Figure 3), the median overall prevalence of drug resistance at 10 years was 9.2% (interquartile range 6.9%–12.2%), similar to the resistance prevalence for the realistic scenario (9.9%). For both the optimistic and the realistic scenario, the non-targeted strategy generated the most resistance, whereas the targeted-by-activity strategy generally produced the least resistance with the following rank order of resistance prevalence: non-targeted>targeted-by-age>targeted-by-gender>targeted-by-activity. By contrast, high resistance prevalence was seen with the pessimistic scenario across the four different strategies (Table 4 and Figure 2A).
Panel A shows overall prevalence of HIV drug resistance and Panel B shows cumulative new HIV infections prevented.
For each time point, results of 10,000 simulations are shown as a box-and-whisker plot; representing the median, upper and lower quartiles, and maximum and minimum values.
For each scenario, the largest decrease in infections was achieved with the non-targeted strategy and the smallest decrease with the targeted-by-activity strategy (Table 4 and Figure 2B). Specifically, a 30.3% reduction in infections occurred for the optimistic scenario, 6.6% for the realistic scenario and 0.2% for the pessimistic scenario with the non-targeted strategy. These reductions fell to 8%, 3% and 0%, respectively, with the targeted-by-activity strategy. However, the proportion of cumulative infections with transmitted resistance also fell with the targeted-by-activity strategy: from 2.2% to 1.3% for the optimistic scenario: from 8.3% to 7.1% for the realistic scenario; and minimally from 40.3% to 39.7% for the pessimistic scenario. The targeted-by age and targeted by-gender strategies yielded intermediate declines in infections (17.5%, 4.5%, 0.1% and 18.5%, 4.6%, 0.1%, respectively). Overall, the declines in HIV prevalence and incidence were highest for the optimistic scenario (26.2% and 32.3%, respectively, for the non-targeted strategy) with minimal changes observed with the pessimistic scenario (0.2% for the non-targeted strategy).
Univariate sensitivity analyses of resistance prevalence confirmed that the most important factors affecting resistance prevalence were the rate and duration of use of inadvertent PrEP in previously-infected individuals. When no inadvertent PrEP use in previously infected individuals was assumed, there was a major decline in the prevalence of drug resistance (Figure 4A), particularly in the pessimistic scenario, but only modest changes occurred in infections prevented (Figure 4B). Specifically, the prevalence of overall resistance fell from 2.5% to 1.5% in the optimistic, 9.9% to 3.3% in the realistic and 42.3% to 4.5% in the pessimistic scenario (Figure 2A and 4A).
Panel A shows overall prevalence of HIV drug resistance and Panel B shows cumulative new HIV infections prevented.
Using the targeted-by-gender strategy (PrEP targeted to female population), more infections were prevented in women compared to men. These findings were generally robust (data not shown) to single and multiple changes in the model's key structural assumptions including those related to balance in the supply and demand of sexual partnerships in the population over time  and infectivity of females on PrEP.
Trends in Resistance.
Figure 5 shows the trends in the overall prevalence drug resistance for 10 years after PrEP rollout. After an initial rise, the overall resistance plateaued in the pessimistic scenario, whereas it declined in optimistic and realistic scenarios.
Data from animal studies show that orally administered antiretrovirals can prevent infection of macaques by simian immunodeficiency virus . The safety and efficacy of oral antiretroviral PrEP in humans is being studied in several clinical trials in the United States, Latin America, Africa and Asia ; the results of the iPrEx trial are promising . However, these studies are not designed to address the population-level impact of PrEP including potential HIV drug resistance consequences. Uncertainty about HIV drug resistance from PrEP could prevent deployment of PrEP even though it may be shown to prevent HIV infection in clinical trials. Although PrEP implementation has been modeled before by us  and others , , , , , , , we report here for the first time the main drivers of drug resistance from PrEP in a heterosexual HIV epidemic using a carefully stratified and well-parameterized mathematical model of HIV transmission. Inadvertent PrEP use in already infected individuals is the key driver of increasing drug resistance in a heterosexual population. The prevalence of drug resistance is influenced by both the rate of uptake and duration of use of PrEP in this group. Inadvertent PrEP use in already-infected individuals is not a failure of PrEP per se, but it may occur as an unexpected consequence of PrEP rollout programs and should be assiduously avoided. The duration of PrEP use in susceptible individuals and in individuals infected while on PrEP has less influence on drug resistance outcomes. As expected, the persistence times of transmitted and acquired resistance were critical determinants of the prevalence of transmitted and acquired resistance.
The current model represents a significant refinement of our earlier version in terms of model structure, parameter assignment and scenario design . The current model also includes detailed representations of both transmitted and acquired HIV drug resistance, arising both in individuals who become infected while on PrEP and in previously infected individuals exposed to PrEP. These refinements provided improved precision of model output. Assumptions regarding the effectiveness of PrEP (composite of efficacy and adherence) in our optimistic and neutral scenarios are in general agreement with the results of iPrEx , a clinical trial of oral PrEP in men who have sex with men that showed a 44% decrease in HIV incidence (95% confidence interval, 15 to 63).
Notwithstanding model improvements, sensitivity analyses of infections prevented confirm our earlier findings of the impact of PrEP on HIV prevention . The parameters that most influence the impact of PrEP are PrEP coverage, PrEP efficacy and adherence, duration of PrEP use in susceptible individuals, and the infectivity of individuals with acquired resistance. The estimated decreases in HIV infections from PrEP are also in line with our earlier work , but are more conservative due to deliberately more pessimistic modeling assumptions, including lower estimates of PrEP efficacy, adherence and coverage, higher rates of PrEP discontinuation in susceptible individuals and significant PrEP exposure in previously-infected individuals.
The results of our scenario analyses provide important insight into potential emergence of HIV drug resistance after PrEP implementation. The non-targeted optimistic and realistic scenarios predicted low to moderate prevalence of drug resistance (2.5% and 9.9% respectively) along with high to moderate decreases in cumulative infections (30.3% and 6.6%, respectively). Uncertainty analysis also predicted moderate levels of overall drug resistance. With targeted optimistic and realistic scenarios, the prevalence of resistance was modestly reduced with considerable erosion (up to 70%) of infections prevented. The prevalence of drug resistance rose to over 40% in the pessimistic scenarios with minimal reduction in HIV infections. Sensitivity analyses showed that the key driver of this negative outcome was the high level of inadvertent PrEP use in the already infected population. When the pessimistic scenarios were re-simulated excluding PrEP use in previously-infected individuals, the prevalence of resistance decreased to 4.5%.
There are some important limitations of our current model structure and the assumptions within it. The precise quantitative detail of our predictions will be affected by variations in the sexual activity patterns of different populations, for which data are very limited, especially on sexual mixing patterns. However, we employed a well-established template of sexual behavior , with robust epidemiological and demographic parameterization, broadly applicable to southern sub-Saharan Africa.
The actual impact of PrEP on drug resistance will depend on the PrEP agent or agents used as well as the biological, behavioral and viral characteristics of the HIV-infected population. Although we do not model a specific PrEP agent, we used resistance-related input estimates that would be expected for a single antiretroviral drug used for PrEP such as tenofovir disoproxil fumarate , . We did not include combinations of antiretrovirals for PrEP in our initial modeling of drug resistance , , . Non-human primate studies of PrEP suggest superiority of tenofovir plus emtricitabine over tenofovir alone , , but it is unknown whether this will be observed in human studies. Natural polymorphisms in HIV subtypes may play an important role in drug resistance, including the propensity of HIV subtype C virus that is predominant in Sub-Saharan Africa for more frequent and rapid development of the K65R tenofovir-resistance mutation noted by some investigators , though not by others . To address the substantial uncertainty regarding PrEP-related resistance, we employed wide ranges within plausible bounds for input parameters and performed extensive sensitivity analyses. Our work underscores the need for additional data on the persistence time of transmitted and acquired resistance and the probability of transmission with and without PrEP.
We excluded from our analyses the impact of antiretroviral therapy for infected persons and various other influences on transmission (e.g. STDs, circumcision and condom use). These and other refinements will be addressed in future work. Nevertheless, the important conclusion for our modeling is that the spread of HIV drug resistance could be mitigated by limiting inadvertent PrEP exposure in already infected individuals. To accomplish this, PrEP implementation programs would need to be tightly coupled with HIV testing of individuals who are candidates for PrEP and monitoring of PrEP recipients for HIV infection and drug resistance.
Wrote the paper: ULA.Model formulation: ULA JWM. Model analyses: ULA. Computer programming and multivariate sensitivity analyses at the Pittsburgh Supercomputing Center: GH AWW. Interpreted results and edited the manuscript: JWM.
- 1. AIDS Vaccine Advocacy Coalition PrEP watch Available at: http://wwwprepwatchorg/ Accessed: 22 March 2011.
- 2. Grant RM, Lama JR, Anderson PL, McMahan V, Liu AY, et al. (2010) Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med 363: 2587–2599.
- 3. Anderson RM, May RM (1991) Infectious diseases of humans: dynamics and control. Oxford: Oxford University Press.
- 4. Abbas UL, Anderson RM, Mellors JW (2007) Potential impact of antiretroviral chemoprophylaxis on HIV-1 transmission in resource-limited settings. PLoS ONE 2: e875.
- 5. Nowak MA, May R (2001) Virus dynamics: mathematical principles of immunology and virology. New York: Oxford University Press.
- 6. Coffin JM (1995) HIV population dynamics in vivo: implications for genetic variation, pathogenesis, and therapy. Science 267: 483–489.
- 7. Van Rompay KK, Singh RP, Heneine W, Johnson JA, Montefiori DC, et al. (2006) Structured treatment interruptions with tenofovir monotherapy for simian immunodeficiency virus-infected newborn macaques. J Virol 80: 6399–6410.
- 8. Atchison R, Liegler T, Javier J, Fiss E, Hecht F, et al. (2005) Early and isolated reversion of transmitted RT K65R in a multi-drug resistant infection detected using a novel quantitative allele-specific PCR. Antivir Ther 10: Suppl 145.
- 9. Deeks SG, Hoh R, Neilands TB, Liegler T, Aweeka F, et al. (2005) Interruption of treatment with individual therapeutic drug classes in adults with multidrug-resistant HIV-1 infection. J Infect Dis 192: 1537–1544.
- 10. Gandhi RT, Wurcel A, Rosenberg ES, Johnston MN, Hellmann N, et al. (2003) Progressive reversion of human immunodeficiency virus type 1 resistance mutations in vivo after transmission of a multiply drug-resistant virus. Clin Infect Dis 37: 1693–1698.
- 11. Hance AJ, Lemiale V, Izopet J, Lecossier D, Joly V, et al. (2001) Changes in human immunodeficiency virus type 1 populations after treatment interruption in patients failing antiretroviral therapy. J Virol 75: 6410–6417.
- 12. Charpentier C, Dwyer DE, Mammano F, Lecossier D, Clavel F, et al. (2004) Role of minority populations of human immunodeficiency virus type 1 in the evolution of viral resistance to protease inhibitors. J Virol 78: 4234–4247.
- 13. Palmer S, Boltz V, Maldarelli F, Kearney M, Halvas EK, et al. (2006) Selection and persistence of non-nucleoside reverse transcriptase inhibitor-resistant HIV-1 in patients starting and stopping non-nucleoside therapy. AIDS 20: 701–710.
- 14. García-Lerma JG, Qari S, Otten R, Johnson J, Kim C, et al. (2006) Blunted viraemia and slow drug resistance emergence in rhesus macaques failing chemoprophylaxis with emtricitabine. Antivir Ther 11: Suppl 152.
- 15. Weber J, Chakraborty B, Weberova J, Miller MD, Quinones-Mateu ME (2005) Diminished replicative fitness of primary human immunodeficiency virus type 1 isolates harboring the K65R mutation. J Clin Microbiol 43: 1395–1400.
- 16. White KL, Margot NA, Wrin T, Petropoulos CJ, Miller MD, et al. (2002) Molecular mechanisms of resistance to human immunodeficiency virus type 1 with reverse transcriptase mutations K65R and K65R+M184V and their effects on enzyme function and viral replication capacity. Antimicrob Agents Chemother 46: 3437–3446.
- 17. Leigh Brown AJ, Frost SD, Mathews WC, Dawson K, Hellmann NS, et al. (2003) Transmission fitness of drug-resistant human immunodeficiency virus and the prevalence of resistance in the antiretroviral-treated population. J Infect Dis 187: 683–686.
- 18. Turner D, Brenner B, Routy JP, Moisi D, Rosberger Z, et al. (2004) Diminished representation of HIV-1 variants containing select drug resistance-conferring mutations in primary HIV-1 infection. J Acquir Immune Defic Syndr 37: 1627–1631.
- 19. Yerly S, Jost S, Telenti A, Flepp M, Kaiser L, et al. (2004) Infrequent transmission of HIV-1 drug-resistant variants. Antivir Ther 9: 375–384.
- 20. Delaugerre C, Valantin MA, Mouroux M, Bonmarchand M, Carcelain G, et al. (2001) Re-occurrence of HIV-1 drug mutations after treatment re-initiation following interruption in patients with multiple treatment failure. AIDS 15: 2189–2191.
- 21. Izopet J, Souyris C, Hance A, Sandres-Saune K, Alvarez M, et al. (2002) Evolution of human immunodeficiency virus type 1 populations after resumption of therapy following treatment interruption and shift in resistance genotype. J Infect Dis 185: 1506–1510.
- 22. Johnson JA, Li JF, Wei X, Lipscomb J, Irlbeck D, et al. (2008) Minority HIV-1 drug resistance mutations are present in antiretroviral treatment-naive populations and associate with reduced treatment efficacy. PLoS Med 5: e158.
- 23. Iman RL, Johnson ME, Schroeder TA (2002) Assessing hurricane effects. Part 1. Sensitivity analysis. Reliab Eng Syst Safe 78: 131–145.
- 24. Saltelli A, Chan K, Scott EM, editors. (2000) Sensitivity analysis. John Wiley & Sons. 475 p.
- 25. Iman RL, Johnson ME, Schroeder TA (2002) Assessing hurricane effects. Part 2. Uncertainty analysis. Reliab Eng Syst Safe 78: 147–155.
- 26. Iman RL, Conover WJ (1979) The use of the rank transform in regression. Technometrics 21: 499–509.
- 27. Grassly NC, Lowndes CM, Rhodes T, Judd A, Renton A, et al. (2003) Modelling emerging HIV epidemics: the role of injecting drug use and sexual transmission in the Russian Federation, China and India. Int J Drug Policy 14: 25–43.
- 28. Hofer E (1999) Sensitivity analysis in the context of uncertainty analysis for computationally intensive models. Comput Phys Commun 117: 21–34.
- 29. Garnett GP, Anderson RM (1994) Balancing sexual partnerships in an age and activity stratified model of HIV transmission in heterosexual populations. IMA J Math Appl Med Biol 11: 161–192.
- 30. Garcia-Lerma JG, Paxton L, Kilmarx PH, Heneine W (2010) Oral pre-exposure prophylaxis for HIV prevention. Trends Pharmacol Sci 31: 74–81.
- 31. Desai K, Sansom SL, Ackers ML, Stewart SR, Hall HI, et al. (2008) Modeling the impact of HIV chemoprophylaxis strategies among men who have sex with men in the United States: HIV infections prevented and cost-effectiveness. AIDS 22: 1829–1839.
- 32. Grant R, Lama J, Goicochea P, Levy V, Porco T (2006) Cost-effectiveness analysis of HIV chemoprophylaxis [Abstract THLB0102]. XVI International AIDS Conference. Toronto, Canada.
- 33. Paltiel AD, Freedberg KA, Scott CA, Schackman BR, Losina E, et al. (2009) HIV preexposure prophylaxis in the United States: impact on lifetime infection risk, clinical outcomes, and cost-effectiveness. Clin Infect Dis 48: 806–815.
- 34. Smith D, Kebaabetswe P, Disasi K, Fleming D, Paxton L, et al. Antiretroviral resistance is not an important risk of the oral tenofovir prophylaxis trial in Botswana: a simple mathematical modelling approach; 2006 Aug 13–18; Toronto, Canada.
- 35. van de Vijver DA, Derdelinckx I, Boucher CA (2009) Circulating HIV type 1 drug resistance will have limited impact on the effectiveness of preexposure prophylaxis among young women in Zimbabwe. J Infect Dis 199: 1310–1317.
- 36. Vissers DC, Voeten HA, Nagelkerke NJ, Habbema JD, de Vlas SJ (2008) The impact of pre-exposure prophylaxis (PrEP) on HIV epidemics in Africa and India: a simulation study. PLoS ONE 3: e2077.
- 37. Supervie V, Garcia-Lerma JG, Heneine W, Blower S (2010) HIV, transmitted drug resistance, and the paradox of preexposure prophylaxis. Proc Natl Acad Sci U S A 107: 12381–12386.
- 38. Johnson J, Van Rompay K, Delwart E, Heneine W (2006) Rapid emergence of drug-resistant SIV in tenofovir-treated macaques: implications for tenofovir chemoprophylaxis against HIV [Abstract 609]. Program and Abstracts of the13th Conference on Retroviruses and Opportunistic Infections Denver, CO.
- 39. Tedder RS, Kaye S, Loveday C, Weller IV, Jeffries D, et al. (1998) Comparison of culture- and non-culture-based methods for quantification of viral load and resistance to antiretroviral drugs in patients given zidovudine monotherapy. J Clin Microbiol 36: 1056–1063.
- 40. Brun-Vezinet F, Boucher C, Loveday C, Descamps D, Fauveau V, et al. (1997) HIV-1 viral load, phenotype, and resistance in a subset of drug-naive participants from the Delta trial. The National Virology Groups. Delta Virology Working Group and Coordinating Committee. Lancet 350: 983–990.
- 41. Rey D, Hughes M, Pi JT, Winters M, Merigan TC, et al. (1998) HIV-1 reverse transcriptase codon 215 mutation in plasma RNA: immunologic and virologic responses to zidovudine. The AIDS Clinical Trials Group Study 175 Virology Team. J Acquir Immune Defic Syndr Hum Retrovirol 17: 203–208.
- 42. Garcia-Lerma JG, Otten RA, Qari SH, Jackson E, Cong ME, et al. (2008) Prevention of rectal SHIV transmission in macaques by daily or intermittent prophylaxis with emtricitabine and tenofovir. PLoS Med 5: e28.
- 43. Subbarao S, Otten RA, Ramos A, Kim C, Jackson E, et al. (2006) Chemoprophylaxis with tenofovir disoproxil fumarate provided partial protection against infection with simian human immunodeficiency virus in macaques given multiple virus challenges. J Infect Dis 194: 904–911.
- 44. Doualla-Bell F, Avalos A, Brenner B, Gaolathe T, Mine M, et al. (2006) High prevalence of the K65R mutation in human immunodeficiency virus type 1 subtype C isolates from infected patients in Botswana treated with didanosine-based regimens. Antimicrob Agents Chemother 50: 4182–4185.
- 45. Miller MD, Margot N, McColl D, Cheng AK (2007) K65R development among subtype C HIV-1-infected patients in tenofovir DF clinical trials. AIDS 21: 265–266.
- 46. Miller DK, Homan SM (1994) Determining transition probabilities: confusion and suggestions. Med Decis Making 14: 52–58.