Figures
Abstract
Background
It is largely unknown how frequently low-abundance HIV drug-resistant variants at levels under limit of detection of conventional genotyping (<20% of quasi-species) are present in antiretroviral-experienced persons experiencing virologic failure. Further, the clinical implications of low-abundance drug-resistant variants at time of virologic failure are unknown.
Methodology/Principal Findings
Plasma samples from 22 antiretroviral-experienced subjects collected at time of virologic failure (viral load 1380 to 304,000 copies/mL) were obtained from a specimen bank (from 2004–2007). The prevalence and profile of drug-resistant mutations were determined using Sanger sequencing and ultra-deep pyrosequencing. Genotypes were interpreted using Stanford HIV database algorithm. Antiretroviral treatment histories were obtained by chart review and correlated with drug-resistant mutations. Low-abundance drug-resistant mutations were detected in all 22 subjects by deep sequencing and only in 3 subjects by Sanger sequencing. In total they accounted for 90 of 247 mutations (36%) detected by deep sequencing; the majority of these (95%) were not detected by standard genotyping. A mean of 4 additional mutations per subject were detected by deep sequencing (p<0.0001, 95%CI: 2.85–5.53). The additional low-abundance drug-resistant mutations increased a subject's genotypic resistance to one or more antiretrovirals in 17 of 22 subjects (77%). When correlated with subjects' antiretroviral treatment histories, the additional low-abundance drug-resistant mutations correlated with the failing antiretroviral drugs in 21% subjects and correlated with historical antiretroviral use in 79% subjects (OR, 13.73; 95% CI, 2.5–74.3, p = 0.0016).
Conclusions/Significance
Low-abundance HIV drug-resistant mutations in antiretroviral-experienced subjects at time of virologic failure can increase a subject's overall burden of resistance, yet commonly go unrecognized by conventional genotyping. The majority of unrecognized resistant mutations correlate with historical antiretroviral use. Ultra-deep sequencing can provide important historical resistance information for clinicians when planning subsequent antiretroviral regimens for highly treatment-experienced patients, particularly when their prior treatment histories and longitudinal genotypes are not available.
Citation: Le T, Chiarella J, Simen BB, Hanczaruk B, Egholm M, Landry ML, et al. (2009) Low-Abundance HIV Drug-Resistant Viral Variants in Treatment-Experienced Persons Correlate with Historical Antiretroviral Use. PLoS ONE 4(6): e6079. https://doi.org/10.1371/journal.pone.0006079
Editor: Rupert Kaul, University of Toronto, Canada
Received: March 25, 2009; Accepted: June 5, 2009; Published: June 29, 2009
Copyright: © 2009 Le et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: NIH T32 Training Grant (TL), VA MERIT Award (MJK), K02 DA017277 (MIR) and 454 Life Sciences/Roche for providing ultra-deep sequencing support free of charge. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: MJK has funding from the NIH, VA and Industry (Merck Co., Bristol Myers Squib, Tibotec, Abbott, and Boehringer-Ingleheim). MJK has received honoraria and speaker fees, including reimbursement for travel and accommodation expenses from Abbott and 454 Life Sciences/Roche. MJK has received royalties from a patent owned by Stanford University for some HIV diagnostic tests. MJK is a consultant for Stanford University, Merck and Shering-Plough Research Institute. KD has received speaker's fees and honoraria for Boehringer-Ingelheim and Gilead. BBS, BH, and ME are employees of 454 Life Sciences/Roche. No competing interest from the other authors.
Introduction
HIV genotyping technologies other than the conventional HIV genotyping have been used to show that viral variants in an HIV-infected person, whether acutely or chronically infected, are more genetically diverse than previously appreciated by conventional HIV genotyping assays [1]–[9]. Current genotyping assays are based on population sequencing of reverse transcriptase - polymerase chain reaction (RT-PCR) generated products of HIV protease (PR) and reverse transcriptase (RT) genes. Although this technology has been a major advancement in the understanding and management of HIV drug resistance in clinical practice, a major limitation is the inability to detect low-abundance drug-resistant mutations (DRMs) at levels <20% of the viral quasi-species [10], [11]. Low-abundance drug-resistant HIV variants can occur de novo through the extraordinary HIV genetic diversity generated via highly error-prone replication [12] or as the result of transmitted resistant strains that persist within an infected individual [6], [7], [13]. Understanding the environments in which low-abundance drug-resistant variants develop, how they evolve and impact treatment response are important areas that require further investigations.
A growing number of studies have shown that low-abundance DRMs can be detected in chronically-infected antiretroviral-naïve individuals using ultra-sensitive allele-specific PCR assays or by ultra-deep sequencing methods [8], [14]–[17]. These studies show that baseline low-abundance DRMs undetected by conventional sequencing, in particular non-nucleoside reverse transcriptase inhibitor (NNRTI) mutations, are associated with poor treatment response in persons initiating antiretroviral therapy (ART). This finding follows the Darwinian principle of ‘survival of the fittest’, in that drug-resistant variants at low levels can out-compete wild-type virus in presence of antiretroviral selection pressure and lead to treatment failure. A common and clinically-relevant question that clinicians ask is how often commercial HIV genotyping underestimates the presence of low-abundance DRMs in treatment-experienced patients being evaluated for virologic failure, and whether unrecognized low-abundance DRMs can contribute to virologic failure. In this study, we examine the prevalence and patterns of low-abundance DRMs in antiretroviral-experienced subjects experiencing virologic failure using standard Sanger sequencing and a new ultra-deep sequencing method [9], [16], [18]. We characterize how the addition of low-level DRMs affects the resistance burden in antiretroviral-experienced subjects using the Stanford HIV drug resistance database algorithm and describe the relationship of the low-abundance DRMs to subjects' failing antiretroviral drugs and their longitudinal antiretroviral histories.
Materials and Methods
Study sample selection
Plasma samples from 22 different HIV-infected antiretroviral-experienced subjects who had HIV genotype testing done for virologic failure indication (viral loads ranging from 1380 to 304,000 copies/mL) were obtained from a specimen bank collected between 2004–2007 from routine HIV care at Yale New Haven Hospital and from an adherence-focused clinical trial in Connecticut [19]. All samples were identified only by a lab number during standard and ultra-deep sequencing analyses. Once blinded drug resistance analyses were completed, chart reviews of patients' existing clinical information were performed, and subjects' antiretroviral treatment histories were merged with resistance data. Antiretroviral histories from clinical trial subjects (N = 12) were obtained from the study's existing electronic database. The study met criteria for informed consent exemption and was approved by Yale University School of Medicine and University of Connecticut human investigation committees.
Standard population genotyping analysis
Viral RNA was isolated from 140 µl of plasma samples using QIAmp RNA Mini kit (QIAGEN, Valencia, CA). The extracted RNA specimens were subjected to RT-PCR using SuperScript III (Invitrogen, Carlsbad, CA) to make cDNAs. A PCR assay previously described was used to amplify PR and RT genes [20], [21]. PCR amplicons were sequenced directly by population sequencing using an ABI 3730 XL automated sequencing system (Applied Biosystems, Foster City, CA). All amino acid positions associated with antiretroviral resistance according to IAS-USA 2008 and Stanford HIV drug resistance database were evaluated [22]. Nucleotide mixtures at drug-resistant sites were called if a discriminate peak from baseline was observed in two independent reactions.
Ultra-deep pyrosequencing analysis
The same volume of plasma (140 µl) and RNA extraction protocol used for standard sequencing was used for deep sequencing to allow for a direct comparison of the two methods. Input HIV RNA was not measured for standard sequencing nor ultra deep sequencing for this set of samples. It has been shown that the stochastic effects of sampling variation become low when the starting RNA copy number in a specimen is ≥1,000 (or ≥10,000 HIV RNA copies/mL for an unextracted sample considering a 10% RNA extraction efficiency) [9], [23]. Thus for samples with RNA copy numbers <10,000 (#3, 9, 11, 16, 18, and 22), ultra-deep sequencing identifies the proportion of sequenced PCR amplicons containing the mutation and may not represent the actual proportion of HIV variants in a plasma sample.
Three gene-specific overlapping cDNA per sample were generated and subjected to 40 cycles of PCR with FastStart HiFi polymerase (Roche, Indianapolis, IN) to make eight partly overlapping amplicons that cover the entire PR and the first 236 codons of RT genes. The amplicons were purified with AMPure magnetic beads (Agencourt, Beverly, MA) and quantitated by PicoGreen fluorescence (Invitrogen). After equimolar pooling of all 8 amplicons per sample, clonal amplification on beads was performed using reagents enabling sequencing in both forward (kit II) and reverse (kit III) directions (Roche/454 Life Sciences, Branford, CT). Kit II and III emulsions were pooled for each sample before bead isolation. After enrichment of DNA-containing beads, these were counted on a Multisizer3 Coulter counter.
Approximately thirty-thousand beads per sample were prepared for ultra-deep sequencing and loaded on a PicoTiter plate fitted with a 16-lane gasket. Sequencing was performed on a Genome Sequencer FLX (Roche/454 Life Sciences). An average of 1700 reads per nucleotide position was obtained for this set of samples, which allowed for accurate detection of variants down to approximately 1% when viral load is >10,000 copies/mL. Ultra-deep sequencing reproducibility and level of variant detection have been previously reported [9], [18]. The sensitivity of ultra-deep sequencing in its current platform for detection of low-level viral variants at levels 0.1 to 1% has been confirmed by used of standard cloning methods [9], [18], [24], [25]. In this study we reported a variant detection limit of ≥1% as resistant variants at this level have been shown to be clinically relevant [7], [14]–[16].
Amplicon Variant Analyzer software was used to align all amplicon sequence reads to a consensus sequence generated from over 6000 sequences found in the Los Alamos HIV sequence database for identification of all nucleotide changes of interest. Further detailed of this technology can be found elsewhere [9], [16], [18].
Statistical analysis
Paired Student T test was used to compare the mean number of DRMs detected by ultra-deep versus standard sequencing in 22 samples for all mutations, nucleoside reverse transcriptase inhibitor (NRTI) mutations, NNRTI mutations and protease inhibitor (PI) mutations, respectively. All p values presented were two tailed, and 95% confidence intervals were calculated and reported in figure 1. Odds ratios were used to describe the association of low-abundance DRMs and subjects' current failing antiretroviral versus historical antiretroviral drugs. Fisher exact test was used to determine the statistical significance of the association.
A mean of 4 additional mutations per subject were detected by ultra-deep sequencing. The difference in the number of mutations detected by the two methods were statistically significant for NRTI (nucleotide/nucleoside reverse transcriptase inhibitor), NNRTI (non-nucleotide reverse transcriptase inhibitor), and PI (protease inhibitor) mutations. Two-tailed p values and 95% confidence intervals were calculated from the paired Student T test.
Definition of low-abundance drug-resistant mutations
DRMs that are not detected by standard sequencing but detected using more sensitive technologies have been referred to as “minority” or “low-level” drug-resistant variants in the literature [1]–[9]. For the purpose of discussion in this paper, we define “low-abundance” DRMs as mutations detected at <20% of viral quasi-species and “high-abundance” DRMs as mutations detected at ≥20% of viral quasi-species by ultra-deep sequencing.
Results
Comparison of ultra-deep vs. standard population sequencing data
Low-abundance DRMs were detected in all 22 subjects by deep sequencing and were unrecognized in 19 subjects by standard sequencing. In total they accounted for 90 of the 247 mutations (36%) detected by deep sequencing; the majority of these (95%) were not detected by standard genotyping. A mean of 4 (ranging from 1 to 10) additional mutations per subject were detected by deep sequencing compared to standard sequencing (p<0.0001, 95%CI: 2.85–5.53). The differences in the numbers of DRMs detected by the two methods remained statistically significant when mutations were classified into NRTIs, NNRTIs, and PIs (Figure 1).
DRMs that were detected at levels <13% of viral quasi-species by deep sequencing were not detected by standard sequencing in this study. Ultra-deep sequencing identified all DRMs at levels ≥20% that were detected by standard sequencing. By comparison, standard sequencing detected only 152 of 157 (97%) DRMs at levels ≥20% that were detected by deep sequencing. The high-abundance mutations that were not detected by standard sequencing were at levels between 20 to 30.5%. In total, only 57% of mutations at levels between 20 and 30.5% were identified by standard sequencing in this study.
Low-abundance drug-resistant mutation profiles
Of the total 90 additional low-abundance DRMs detected by ultra-deep sequencing in subjects, 62% were detected at levels 1 to 5%, and 38% were detected at levels 5 to 20% (Figure 1). Low-abundance DRMs from all three antiretroviral classes were detected. Eight of 22 subjects (36.5%) harbored low-abundance mutations that imparted resistance to a single antiretroviral class; 6 of 22 subjects (27%) harbored resistance to two antiretroviral classes, and 8 of 22 subjects (36.5%) harbored resistance to three antiretroviral classes.
Low-abundance PI mutations were most commonly seen, occurring in 18 of 22 subjects (82%); however the majority was “minor” IAS-USA PI mutations [23]. Low-abundance NRTI and NNRTI mutations were also frequently detected, occurring in 17 of 22 subjects (73%) and 10 of 22 subjects (45%), respectively. Table 1 lists all mutations detected in each subject by standard and deep sequencing. The most common low-abundance NRTI mutations detected were thymidine analog mutations (TAMs) M41L, K70R, L210W, T215F/Y or K219E/Q. At least one of these was detected in 11 of 22 subjects. T215F/Y was the most common low-abundance TAMs detected. T215Y and T215F have been shown to be associated with two distinct TAM pathways. T215Y is associated with M41L, L210W, and sometimes D67N (TAM-1 pathway), and T215F is associated with D67N, K70R, and K219Q (TAM-2 pathway) [26], [27]. T215Y was observed to cluster with mutations in TAM-1 pathway (subjects #5 & 16) and also with mutations in TAM-2 pathway (subjects #6 & 13). T215F was either detected alone (subjects #11 & 15) or together with mutations from both TAM-1 and TAM-2 pathways (subjects #1 & 3). Low-abundance M184V was detected in only one of 22 samples. Low-abundance NNRTI mutations were detected in 10 of 22 subjects (45%) by deep sequencing and in only 1 of 22 subjects by standard sequencing (subject #1 - K103N at 13.9%). The most common low-abundance NNRTI mutations were K103N, followed by Y181C, Y188C and G190A in this set of samples.
Correlation of low-abundance DRMs with subjects' antiretroviral histories
Current failing antiretroviral regimens were known for 19 subjects, and full antiretroviral histories were known for 14 subjects listed in table 1. None of the 10 subjects with low-abundance TAMs (#1, 3, 4, 5, 6, 11, 13, 15, 16, 18) were on zidovudine/stavudine-containing regimens at time of virologic failure. Longitudinal antiretroviral histories were known for 9 of these subjects, and all had prior zidovudine/stavudine exposure. Subjects 5 and 6 had not been on zidovudine for 2 and 7 years, respectively, yet TAMs were still being detected at low levels in their blood. Low-abundance M184V was detected in only one subject (#21) and was not detected in subjects who went off lamivudine/emtricitabine. M184V was detected in 12 of 13 subjects who were on a failing regimen containing lamivudine/emtricitabine and was predominantly present at levels >70%. NNRTI mutations were detected in both low and high abundance in subjects who were on NNRTI-containing regimens either at time of virologic failure or in the past.
Overall, among the 19 subjects with known antiretroviral regimens at time of virologic failure, low-abundance DRMs correlated with the failing regimens in only 4 subjects (21%); all were NNRTI mutations. By comparison, among the 14 subjects with complete longitudinal antiretroviral histories, low-abundance DRMs correlated with historical antiretroviral use in 11 subjects (79%); most were TAMs (OR 13.75, 95% CI 2.5–74.3, p = 0.0016).
Impact of low-abundance DRMs on the resistance burden in subjects failing ART
We used the Stanford HIV drug resistance scoring algorithm to evaluate the extent to which additional low-abundance DRMs detected by ultra-deep sequencing added to the resistance burden in each subject. Seventeen of 22 subjects (77%) had additional low-abundance DRMs that increased the subjects' genotypic resistance to at least one antiretroviral, and 11 of 22 subjects (50%) harbored new resistance to at least one antiretroviral. For example, in subject 16 the addition of K103N and V108I detected by ultra-deep sequencing to the G190S detected by both methods changed etravirine from intermediate resistance to high level resistance. In the same sample, the addition of M41L, L210W and T215Y to the M184V detected by both methods implied resistance to multiple NRTIs, in addition to lamivudine.
Discussion
Our study demonstrates that low-abundance HIV DRMs are commonly unrecognized in antiretroviral-experienced subjects at time of virologic failure. DRMs at levels <20% of viral quasi-species made up 36% of the total number of mutations detected by ultra-deep sequencing; the vast majority were undetected by standard HIV genotyping. The additional low-abundance DRMs increased the subjects' genotypic resistance to at least one antiretroviral drug in 77% of subjects and conferred new resistance to at least one antiretroviral drug in 50% of subjects when evaluated with the Stanford HIV drug resistance algorithm. Our findings were in agreement with a prior study by Palmer and colleagues who reported detection of additional 1 to 10 minority drug-resistant variants from each of 26 treatment-experienced subjects failing ART using single-genome sequencing [24]. Our study using a new ultra-deep sequencing method provides additional evidence that the burden of resistance in treatment-experienced subjects at time of virologic failure is greater than that reflected by standard HIV genotyping.
The concept that low-abundance HIV drug-resistant variants can out-compete wild-type virus in presence of drug pressure is a basic evolutionary tenet. When virologic failure is driven by selection of drug-resistant virus, one would expect that mutant variants conferring resistance to a failing antiretroviral regimen to have a relative fitness advantage and to be detected in relatively high abundance compared to wild-type virus. In addition to the question of clinical relevance of low-abundance resistant virus, other more fundamental questions about low-abundance drug-resistant variants detected at time of virologic failure are a) whether they represent accessory mutations or mutations present in succession that increase the level of resistance to the current failing regimens (in which case they would correlate with the failing antiretroviral drug/s) or b) whether they are remnants of resistant populations from prior failed therapy (in which case they would correlate with historical antiretroviral use). The treatment history correlation suggested different associations for different low-abundance DRMs. We found that TAMs when detected at low levels in subjects failing ART were highly correlated with zidovudine/stavudine from prior exposure and not from the current failing regimens. Some of the subjects harboring low-abundance TAMs had not received zidovudine/stavudine for 2 to 7 years. The finding that drug-resistant variants can persist in the circulation for much longer than previously known because of more sensitive sequencing methods support further research using these technologies to understand the mechanism of resistant viral persistence and evolution in an infected person.
M184V was detected in 12 of 13 subjects who were on a failing regimen containing lamivudine/emtricitabine, and all were detected in relatively high abundance (generally >70%). In contrast to TAMs, low-abundance M184V was not detected when subjects were off lamivudine/emtricitabine. The lack of M184V detection in these subjects may be due to M184V variants that were either below the detection limit of this ultra-deep sequencing, were never present, or were cleared from plasma compartment of these subjects. M184V variants may wane from plasma relatively faster than variants carrying other DRMs, probably due to the fitness cost of M184V possessing virus [25], [26].
NNRTI mutations are known to minimally impact viral fitness, and this was observed in our study, in that the majority of subjects (73%) with high-abundance NNRTI mutations were not on NNRTI-containing regimens at time of virologic failure. By comparison, low-abundance NNRTI mutations were seen equally in subjects who were (4 of 9) or were not (5 of 9) on NNRTI-containing regimens. Presence of low-abundance NNRTI mutations in subjects who were not on NNRTI-containing regimens may indicate longer elapsed time from last NNRTI use compared to subjects with high-abundance NNRTI mutations. They may also represent remnant mutations linked in the same genetic backbone of a more favored mutational profile. Longitudinal studies of patients with well-characterized treatment history who stop NNRTI therapy using quantitative full-length sequencing such as single genome sequencing would be desirable.
Interestingly, low-abundance mutations T215F and Y were detected most commonly in subjects who were not on zidovudine/stavudine-containing regimens. T215F and Y mutations require two nucleotide substitutions (T215ACC to 215FTCC or 215YTAC), which is a probable reason for their later appearance during the course of zidovudine failure [27]. When zidovudine/stavudine drug pressure is removed, T215F/Y-containing viral strains would have to reverse-mutate in two different nucleotide positions to return to wild-type. This could therefore explain their prolonged persistence in infected persons off zidovudine/stavudine therapy. In this study, ultra-deep sequencing was able to detect a single revertant T215N at 4.3% in subject #18, essentially capturing a snapshot of evolving HIV strains that may have once been thymidine analog resistant, and providing historical resistance information that would not otherwise be possible by conventional genotyping.
The finding that the additional low-abundance DRMs were more correlated with historical antiretroviral use than to the failing antiretroviral drugs (OR, 13.73; 95% CI, 2.5–74.3, p = 0.0016) is interesting and needs to be confirmed in larger studies, particularly studies with well-characterized antiretroviral histories and with longitudinal deep sequencing. Although the clinical significance of these unrecognized mutations cannot be ascertained due to the cross-sectional nature of our study, a potential clinical implication here is that conventional genotype might be adequate for a subset of patients with well-characterized antiretroviral treatment histories and known longitudinal HIV genotypes. However this clinical scenario does not represent the majority of patients in clinical practice. New sequencing technologies with better sensitivity such as ultra-deep pyrosequencing method can provide important historical resistance information that help clinicians planning subsequent antiretroviral regimens for highly treatment-experienced patients, especially for those whose antiretroviral treatment histories and longitudinal HIV genotypes are not obtainable. Studies have shown that cross-sectional HIV genotyping consistently underestimates mutation rates compared to longitudinal resistance data [28], [29] and longitudinal resistance mutations predict therapy failure better than cross-sectional resistance mutations [30].
Our study has several limitations. First, the findings from the clinical correlation are preliminary in nature due to the relatively small sample size and inherent biases in any retrospective study. Half of the study samples were from an adherence-focused clinical trial [20] and were subjected to selection bias towards highly non-adhered subjects, which might bias the number of minority drug-resistant variants identified. The failing antiretroviral regimens were known for most patients; however, complete antiretroviral treatment histories were obtainable for only 14 subjects in the study. For most subjects the precise treatment time tables and subsequent clinical follow up were not obtainable due to the IRB restriction on use of data that had already been collected in another clinical study. Therefore larger confirmation studies with well-characterized and longitudinal clinical histories are needed. Second, an issue for all HIV genotyping technologies designed to detect low-copy-number viral variants is that sensitivity is dependent on the number of viral templates provided for cDNA synthesis and clonal amplification [9]. Sampling of viral RNA molecules from an extraction solution that follows Poisson distribution is subjected to the stochastic effects of sampling variation. These effects are lessened when the number of template RNA molecules increases (typically >1000) [31]. Since current HIV RNA extraction techniques may only recover up to 10% of viral genomes from a plasma sample [32], only samples with starting RNA copy numbers ≥10,000 can statistically account for the sampling variation. One can still perform HIV genotyping of low-copy-number samples (#3, 9, 11, 16, 18, 22 and 23); however, the levels of mutations identified represent the proportion of sequenced PCR amplicons containing the mutation and may not represent the actual proportion in a plasma sample. We used 140 µl extraction volume because that was the standard plasma volume used for standard sequencing. To obtain a better representative sampling of HIV variants in low-copy-number samples, larger volume extractions from plasma samples would be required. Lastly, ultra-deep sequencing is highly sensitive but more labor-intensive than population sequencing, and the technology will need to be clinically validated before being considered for clinical use.
Despite above limitations, we can conclude that low-abundance HIV drug-resistant mutations commonly go unrecognized in treatment-experienced persons who experience virologic failure. The majority of the unrecognized resistant mutations are clinically-relevant, and they increased the overall burden of resistance in these subjects. The clinical significance of these unrecognized mutations cannot be ascertained due to the cross-sectional nature of our study; however, we can conclude that the majority of unrecognized resistant mutations correlate with historical antiretroviral use rather than to the failing antiretroviral drugs. A potential clinical implication is that ultra-deep sequencing can provide important historical resistance information that help clinicians planning subsequent antiretroviral regimens for highly treatment-experienced patients, particularly for a significant proportion of patients in clinical practice whom treatment histories and longitudinal HIV genotypes are not available.
Author Contributions
Conceived and designed the experiments: TL JC MK. Performed the experiments: TL JC BS BH. Analyzed the data: TL MK. Contributed reagents/materials/analysis tools: BS BH ME ML KD MR MK. Wrote the paper: TL JC BS BH ME ML KD MR MK.
References
- 1. Dykes C, Najjar J, Bosch RJ, Wantman M, Furtado M, et al. (2004) Detection of drug-resistant minority variants of HIV-1 during virologic failure of indinavir, lamivudine, and zidovudine. J Infect Dis 189(6): 1091–1096.
- 2. Kapoor A, Jones M, Shafer RW, Rhee SY, Kazanjian P, et al. (2004) Sequencing-based detection of low-frequency human immunodeficiency virus type 1 drug-resistant mutants by an RNA/DNA heteroduplex generator-tracking assay. J Virol 78(13): 7112–7123.
- 3. Lalonde MS, Troyer RM, Syed AR, Bulime S, Demers K, et al. (2007) Sensitive oligonucleotide ligation assay for low-level detection of nevirapine resistance mutations in human immunodeficiency virus type 1 quasispecies. J Clin Microbiol 45(8): 2604–2615.
- 4. Lecossier D, Shulman NS, Morand-Joubert L, Shafer RW, Joly V, et al. (2005) Detection of minority populations of HIV-1 expressing the K103N resistance mutation in patients failing nevirapine. J Acquir Immune Defic Syndr 38(1): 37–42.
- 5. Metzner KJ, Bonhoeffer S, Fischer M, Karanicolas R, Allers K, et al. (2003) Emergence of minor populations of human immunodeficiency virus type 1 carrying the M184V and L90M mutations in subjects undergoing structured treatment interruptions. J Infect Dis 188(10): 1433–1443.
- 6. Metzner KJ, Rauch P, Walter H, Boesecke C, Zollner B, et al. (2005) Detection of minor populations of drug-resistant HIV-1 in acute seroconverters. AIDS 19(16): 1819–1825.
- 7. Palmer S, Boltz V, Maldarelli F, Kearney M, Halvas EK, et al. (2006) Selection and persistence of non-nucleoside reverse transcriptase inhibitor-resistant HIV-1 in patients starting and stopping non-nucleoside therapy. AIDS 20(5): 701–710.
- 8. Roquebert B, Malet I, Wirden M, Tubiana R, Valantin MA, et al. (2006) Role of HIV-1 minority populations on resistance mutational pattern evolution and susceptibility to protease inhibitors. AIDS 20(2): 287–289.
- 9. Wang C, Mitsuya Y, Gharizadeh B, Ronaghi M, Shafer RW (2007) Characterization of mutation spectra with ultra-deep pyrosequencing: Application to HIV-1 drug resistance. Genome Res 17(8): 1195–1201.
- 10. Korn K, Reil H, Walter H, Schmidt B (2003) Quality control trial for human immunodeficiency virus type 1 drug resistance testing using clinical samples reveals problems with detecting minority species and interpretation of test results. J Clin Microbiol 41(8): 3559–3565.
- 11. Schuurman R, Brambilla D, de Groot T, Huang D, Land S, et al. (2002) Underestimation of HIV type 1 drug resistance mutations: Results from the ENVA-2 genotyping proficiency program. AIDS Res Hum Retroviruses 18(4): 243–248.
- 12. Coffin JM (1995) HIV population dynamics in vivo: Implications for genetic variation, pathogenesis, and therapy. Science 267(5197): 483–489.
- 13. Flys T, Nissley DV, Claasen CW, Jones D, Shi C, et al. (2005) Sensitive drug-resistance assays reveal long-term persistence of HIV-1 variants with the K103N nevirapine (NVP) resistance mutation in some women and infants after the administration of single-dose NVP: HIVNET 012. J Infect Dis 192(1): 24–29.
- 14. Paredes R, Lalama C, Ribaudo HJea (2008) Presence of minor populations of Y181C mutants detected by allele-specific PCR and risk of efavirenz failure in treatment-naive patients: Results of an ACTG5095 case-cohort study. 15th Conference of Retroviruses and Opportunistic Infections. Boston Feb 3–6: Abstract 83.
- 15. Johnson JA, Li JF, Wei X, Lipscomb J, Irlbeck D, et al. (2008) Minority HIV-1 drug resistance mutations are present in antiretroviral treatment-naive populations and associate with reduced treatment efficacy. PLoS Med 5(7): e158.
- 16. Simen B, Simons J, Hullsiek K, Novak R, MacArthur R, et al. (2009) Low-Abundance Drug-Resistant viral variants in chronically HIV-Infected, antiretroviral Treatment–Naive patients significantly impact treatment outcomes. J Infect Dis 199(5): 693–701.
- 17. Metzner KJ, Giulieri SG, Knoepfel SA, Rauch P, Burgisser P, et al. (2009) Minority quasispecies of drug-resistant HIV-1 that lead to early therapy failure in treatment-naive and -adherent patients. Clin Infect Dis 48(2): 239–247.
- 18. Margulies M, Egholm M, Altman WE, Attiya S, Bader JS, et al. (2005) Genome sequencing in microfabricated high-density picolitre reactors. Nature 437(7057): 376–380.
- 19. Rosen MI, Dieckhaus K, McMahon TJ, Valdes B, Petry NM, et al. (2007) Improved adherence with contingency management. AIDS Patient Care STDS 21(1): 30–40.
- 20. Kozal MJ, Shah N, Shen N, Yang R, Fucini R, et al. (1996) Extensive polymorphisms observed in HIV-1 clade B protease gene using high-density oligonucleotide arrays. Nat Med 2(7): 753–759.
- 21. Kozal MJ, Amico KR, Chiarella J, Cornman D, Fisher W, et al. (2006) A population-based and longitudinal study of sexual behavior and multidrug-resistant HIV among patients in clinical care. MedGenMed 8(2): 72.
- 22. Hirsch MS, Gunthard HF, Schapiro JM, Brun-Vezinet F, Clotet B, et al. (2008) Antiretroviral drug resistance testing in adult HIV-1 infection: 2008 recommendations of an international AIDS society-USA panel. Clinical Infectious Diseases 47(2): 266–285.
- 23. Stenman J, Lintula S, Rissanen O, Finne P, Hedstrom J, et al. (2003) Quantitative detection of low-copy-number mRNAs differing at single nucleotide positions. BioTechniques 34(1): 172–177.
- 24. Thomas RK, Nickerson E, Simons JF, Janne PA, Tengs T, et al. (2006) Sensitive mutation detection in heterogeneous cancer specimens by massively parallel picoliter reactor sequencing. Nat Med 12(7): 852–855.
- 25. Mitsuya Y, Varghese V, Wang C, Liu TF, Holmes SP, et al. (2008) Minority human immunodeficiency virus type 1 variants in antiretroviral-naive persons with reverse transcriptase codon 215 revertant mutations. J Virol 82(21): 10747–10755.
- 26. Hanna GJ, Johnson VA, Kuritzkes DR, Richman DD, Brown AJ, et al. (2000) Patterns of resistance mutations selected by treatment of human immunodeficiency virus type 1 infection with zidovudine, didanosine, and nevirapine. J Infect Dis 181(3): 904–911.
- 27. Marcelin AG, Delaugerre C, Wirden M, Viegas P, Simon A, et al. (2004) Thymidine analogue reverse transcriptase inhibitors resistance mutations profiles and association to other nucleoside reverse transcriptase inhibitors resistance mutations observed in the context of virological failure. J Med Virol 72(1): 162–165.
- 28. Palmer S, Kearney M, Maldarelli F, Halvas EK, Bixby CJ, et al. (2005) Multiple, linked human immunodeficiency virus type 1 drug resistance mutations in treatment-experienced patients are missed by standard genotype analysis. J Clin Microbiol 43(1): 406–413.
- 29. Devereux HL, Emery VC, Johnson MA, Loveday C (2001) Replicative fitness in vivo of HIV-1 variants with multiple drug resistance-associated mutations. J Med Virol 65(2): 218–224.
- 30. Paredes R, Sagar M, Marconi VC, Hoh R, Martin JN, et al. (2009) In vivo fitness cost of the M184V mutation in multidrug-resistant human immunodeficiency virus type 1 in the absence of lamivudine. J Virol 83(4): 2038–2043.
- 31. Kuritzkes DR (2001) A fossil record of zidovudine resistance in transmitted isolates of HIV-1. Proc Natl Acad Sci U S A 98(24): 13485–13487.
- 32. Harrigan PR, Wynhoven B, Brumme ZL, Brumme CJ, Sattha B, et al. (2005) HIV-1 drug resistance: Degree of underestimation by a cross-sectional versus a longitudinal testing approach. J Infect Dis 191(8): 1325–1330.
- 33. Yerly S, Michel PA, Emler S, et al. (2008) Cross-sectional versus cumulative interpretation of HIV-1 drug resistance mutations. Antivir Ther 13(3): A110.
- 34. Zaccarelli M, Lorenzini P, Tozzi Vea (2008) Are current or archived resistance mutations predictive of treatment failure in heavily pre-treated HIV patients? 6th European HIV Drug Resistance Workshop. March 26–28. Budapest Abstract 42.
- 35. Shafer RW, Levee DJ, Winters MA, Richmond KL, Huang D, et al. (1997) Comparison of QIAamp HCV kit spin columns, silica beads, and phenol-chloroform for recovering human immunodeficiency virus type 1 RNA from plasma. J Clin Microbiol 35(2): 520–522.