Commercially available HIV-1 drug resistance (HIVDR) genotyping assays are expensive and have limitations in detecting non-B subtypes and circulating recombinant forms that are co-circulating in resource-limited settings (RLS). This study aimed to optimize a low cost and broadly sensitive in-house assay in detecting HIVDR mutations in the protease (PR) and reverse transcriptase (RT) regions of pol gene. The overall plasma genotyping sensitivity was 95.8% (N = 96). Compared to the original in-house assay and two commercially available genotyping systems, TRUGENE® and ViroSeq®, the optimized in-house assay showed a nucleotide sequence concordance of 99.3%, 99.6% and 99.1%, respectively. The optimized in-house assay was more sensitive in detecting mixture bases than the original in-house (N = 87, P<0.001) and TRUGENE® and ViroSeq® assays. When the optimized in-house assay was applied to genotype samples collected for HIVDR surveys (N = 230), all 72 (100%) plasma and 69 (95.8%) of the matched dried blood spots (DBS) in the Vietnam transmitted HIVDR survey were genotyped and nucleotide sequence concordance was 98.8%; Testing of treatment-experienced patient plasmas with viral load (VL) ≥ and <3 log10 copies/ml from the Nigeria and Malawi surveys yielded 100% (N = 46) and 78.6% (N = 14) genotyping rates, respectively. Furthermore, all 18 matched DBS stored at room temperature from the Nigeria survey were genotyped. Phylogenetic analysis of the 236 sequences revealed that 43.6% were CRF01_AE, 25.9% subtype C, 13.1% CRF02_AG, 5.1% subtype G, 4.2% subtype B, 2.5% subtype A, 2.1% each subtype F and unclassifiable, 0.4% each CRF06_CPX, CRF07_BC and CRF09_CPX.
The optimized in-house assay is broadly sensitive in genotyping HIV-1 group M viral strains and more sensitive than the original in-house, TRUGENE® and ViroSeq® in detecting mixed viral populations. The broad sensitivity and substantial reagent cost saving make this assay more accessible for RLS where HIVDR surveillance is recommended to minimize the development and transmission of HIVDR.
Citation: Zhou Z, Wagar N, DeVos JR, Rottinghaus E, Diallo K, Nguyen DB, et al. (2011) Optimization of a Low Cost and Broadly Sensitive Genotyping Assay for HIV-1 Drug Resistance Surveillance and Monitoring in Resource-Limited Settings. PLoS ONE6(11): e28184. https://doi.org/10.1371/journal.pone.0028184
Editor: Cecilio Lopez-Galindez, Centro Nacional de Microbiología - Instituto de Salud Carlos III, Spain
Received: September 20, 2011; Accepted: November 2, 2011; Published: November 23, 2011
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding: Dr. Erin Rottinghaus is a recipient of the 2009-2011 Emerging Infectious Disease (EID) Fellowship program sponsored by American Public Health Laboratory (APHL) and CDC. The authors thank Dr. Guoqing Zhang, a recipient of APHL/CDC 2011 International EID program for statistical assistance. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: Chunfu Yang, Zhiyong Zhou, Joshua R. DeVos and Nick Wager are the inventors in U.S. patent application no.: 61/504,522. This does not alter the authors' adherence to all the PLoS ONE policies on sharing data and materials.
Treatment of HIV-1 infection with highly active antiretroviral therapy (HAART) in the past decades has remarkably reduced HIV/AIDS related mortality and morbidity. However, the emergence of drug resistance in persons on antiretroviral therapy (ART) and the transmission of drug-resistant HIV strains to newly infected persons are a major threat to the global success on HIV prevention and treatment effort , , . Recent years, under multilateral supports for HIV treatment and prevention programs, especially the U.S. President Emergency Plan for AIDS Relief (PEPFAR) with the targets of treating two million HIV-infected people with ART, preventing five million new HIV infection and care for 10 million HIV-infected people and AIDS orphans, access to antiretroviral drugs (ARVs) has been scaled up rapidly in resource-limited countries where availability of laboratory monitoring is often limited or lacking , . This creates the potential for HIV drug resistance (HIVDR) emergence and transmission in these settings. Detection and monitoring of HIVDR by molecular genotyping is pivotal to ensure ongoing regimen efficacy. It is the standard of care in resource-rich countries , ; however in resource-limited countries, HIVDR testing is not generally available or it is too costly to be used in routine monitoring of patients receiving ARVs. Therefore, the World Health Organization (WHO) recommends population-based surveillance and monitoring of HIVDR in resource-limited settings , , . Pattern and rates of transmitted and acquired drug resistant HIV variants will collectively inform regional and global recommendations on which ARVs to maintain or change in first and second-line regimens .
Population sequencing-based genotyping methods including ViroSeq®, TRUGENE® and in-house assays are widely used, and the most informative and affordable genotyping methods for monitoring patients on ART in clinical practice , , , . However, ViroSeq® and TRUGENE®, the two FDA-approved genotyping assays were designed for HIV-1 group M subtype B viruses which are the predominant HIV-1 strains in resource-rich countries. In addition, these commercial kits are expensive and less sensitive to non-B subtypes, limiting their utility in resource-limited settings , , . There have been no commercially available HIV-1 genotyping assays designed for non-B subtypes and circulating recombinant forms (CRFs) that are predominant viral strains in resource-limited countries. Moreover, the demand for low cost and sensitive genotyping methods is increasing with the establishment and expansion of laboratory molecular monitoring in these settings , .
The most frequently used HIVDR genotypic assays are assays that detect resistance mutations in the reverse-transcriptase (RT) and protease (PR) genes , , . The minimal genotyping requirements for these two regions are PR codons 10–99 and RT codons 41–240 , , . Our original in-house assay  has its limitations: (1). It does not cover the entire PR gene region required for resistance testing; (2). For some HIV-1 subtypes or CRFs, some sequencing primers generate higher background noises which would affect the detection of mixture bases. We redesigned two primers for RT-PCR, one for nested PCR and four sequencing primers in the optimized assay.
In-house assays are relatively inexpensive and sensitive for multiple subtypes, but in-house assays should only be implemented after adequate validation, including evaluating assay's performance with various HIV-1 subtypes and CRFs , , . Factors that could contribute to genotyping quality include type of assay/kit used, specimen handling and storage, level of experience of technicians performing the analysis, heterozygosity of sequences, and viral subtypes in clinical samples , . In this study, therefore, we validated sensitivity, accuracy and specificity of the optimized in-house assay. We also evaluated the assay applicability to HIVDR surveillance and monitoring.
Materials and Methods
A total of 381 samples were used in this study: 151 samples were used for validation and 230 for application. For validation, we included 111 HIV-1 positive plasma and 10 dried blood spot (DBS) samples, as well as 30 HIV-1 negative DBS samples. For application, we tested 132 plasma and 98 DBS samples. The detailed information on these samples is described in Table 1.
Dried blood spot sample preparation and storage
Dried blood spot samples were prepared by spotting 100 µl of whole blood onto each of the five preprinted circles on a Whatman 903 filter paper (Whatman Inc, Piscataway, NJ) and were then dried overnight at ambient temperature. The next day, a piece of glassine paper was folded and a DBS card was placed in the folded paper, and 10–20 wrapped DBS cards were then packaged in a Bitran bag containing desiccant sacks and a humidity indicator card and sealed. The packaged DBS cards were stored either at −70°C for Vietnam samples or at room temperature for an average of 85.31±42.66 days (median 83.5 days) for Nigeria samples. The DBS cards were shipped to the WHO Specialized Drug Resistance Laboratory at the Centers for Disease Control and Prevention (CDC) (Atlanta, GA, USA) either on dry ice for the samples from Vietnam or at ambient temperature for the DBS samples from Nigeria. All samples were stored at −70°C upon the arrival at CDC.
Viral RNA and total nucleic acid extraction
The QIAamp mini-viral RNA kit (Qiagen, Valencia, CA) was used to extract RNA from all plasma samples for validation purpose. Details for viral load (VL) measurement on samples from Cameroon, Thailand and Zambia were described previously , , . For Malawi samples, Abbott m2000 automatic sample preparation system (0.2 ml extraction protocol) was used to extract the plasma RNA. For Nigeria and Vietnam plasma and DBS samples, the NucliSens® EasyMAGTM automatic sample preparation system (BioMérieux, Durbam, NC) was used to extract the plasma RNA and blood total nucleic acid (TNA). To extract TNA, one DBS spot was cut out per specimen and placed in a 2ml of NucliSENS® lysis buffer (Biomeriuex, Durham, NC) for 30 min at room temperature with gentle rotation. Nucleic acid was then extracted from DBS samples using the NucliSENS® EasyMag® automated extraction system following the manufacturer's instructions. Nucleic acid was eluted in 25 µl of NucliSENS® Extraction Buffer 3 and stored at −80°C until use.
RT-PCR and nested PCR
Sequences of RT-PCR and sequencing primers that were re-designed or modified based on the original assay  and HIV-1 sequences available at the Los Alamos HIV Database (www.hiv.lanl.gov) are shown in Table 2. Three RT-PCR and four sequencing primers were replaced during the optimization process. All primers used were synthesized at CDC Biotechnology Core Facility. Two oligonucleotides that mixed at a ratio of 1:1 (w/w) were used as the forward primer for one step RT-PCR. One-step RT-PCR was performed in a 50 µl reaction, which consisted of 10 µl of RNA or TNA extracts, 0.16 µM each of primers PRTM-F1 and RT-R1, and 0.5 µl SuperScriptTM III one step RT/Platinum® Taq high Fidelity Enzyme Mix and 1x reaction buffer mixture containing Mg2+ and eoxyribonucleotide triphosphates (dNTPs) (Invitrogen, Carlsbad, CA). RT-PCR condition was an initial cycle RT step at 50°C for 45 min and 94°C for 2 min, and followed by 40 cycles of PCR at 94°C for 15 sec, 50°C for 20 sec, 72°C for 2 min and an extension at 72°C for 10 min. For nested PCR, 2 µl of RT-PCR product was added to a 50 µl reaction containing 0.12 µM of each of the inner primers PRT-F2 and RT-R2, 1x GeneAmp Gold Buffer II, 2 mM MgCl2, 400 µM each dNTP and 2.5 U of AmpliTaq Gold LD DNA polymerase (Applied Biosystems, Foster City, CA). After initial denaturation at 94°C for 4 min, 40 cycles of PCR were performed in GeneAmp 9700 thermocycler with the PCR conditions as 94°C for 15 sec, 55°C for 20 sec and 72 for 2 min and following an extension at 72°C for 10 min. In the case of the failed first RT-PCR attempt, PRTM2-F1 was used as rescue primer to replace PRTM-F1 to account for mutations occurring within the primer binding site. The nested PCR product was confirmed by 1% agarose gel electrophoresis with a product size of 1,084 base pairs. The confirmed PCR products were purified using Exo-SAP IT PCR purification kits and used for cycle sequencing reaction with BigDye terminator cycle sequencing kit 3.1 (Applied Biosystems, CA).
DNA sequencing of HIV-1 pol was performed in 3730 DNA genetic analyzer (Applied Biosystems). Six sequencing primers overlapping the entire amplicon were used (Table 2). Sequencing raw data were edited with ChromasPro, v1.5 (Technelysium Pty Ltd, Australia) and confirmed by a second technician. To double check for all mixed bases, we also used a web-based sequence analysis tool, ReCall , in which minor peak calling was set at 15% of the main peak. To rule out PCR contamination, phylogenetic analyses were performed on all newly obtained sequences by MEGA 4 . Sequence quality was also checked by Stanford HIVdb program. Sequences with frame shifts or stop codons were excluded from analysis. For transmitted HIVDR surveillance, WHO surveillance drug resistance mutation (SDRM) list was used . For HIVDR monitoring surveys, drug resistance-associated mutations in PR and RT were interpreted using the Stanford Genotypic Resistance Interpretation Algorithm (http://hivdb.stanford.edu/pages/algs/HIVdb.html). Pairwise nucleotide sequence identity and discrepancy were analyzed using BioEdit .
Sensitivity, accuracy and specificity of the assay
As for HIV-1 drug resistance genotyping, there are no standardized or reference method (gold standard) to evaluate analytic and clinical performance in molecular genotyping for HIV-1 group M viruses. We validated the new method according to WHO/HIVResNet drug resistance guidelines , including participation in an external quality assessment (EQA) program, proficiency testing (PT) panels and comparing the results between new method and the original method already established in our laboratory .
Because the validation criteria were difficult to define based on the complexity of samples tested in this multi-subtype evaluation and all currently available assays (commercial or in-house) were unable to genotype 100% of the samples tested , for this study we used the genotyping sensitivity intervals as ≥95% for samples with VL ≥3 log copies/ml; accuracy was defined as detection of 99% of known DR mutation codons, and reproducibility/precision was defined as ≥98% nucleotide identities in ≥ 90% of pairwise comparisons. In this study, sensitivity and reproducibility of the assay were assessed by comparing the current genotyping results from 96 field collected samples of known VL with those of the original assay  from Cameroon, Zambia and Thailand. The assay was also evaluated using TRUGENE® system GL12 with plasma from DigitalPT (N = 5), a HIVDR PT program offered by AccuTest at Boston, MA, USA and using ViroSeq® system v 2.8 with plasma from Virology Quality Assurance program (VQA, N = 5), a WHO-sponsored HIIVDR PT program and offered by VQA at Chicago, IL, USA. Additionally, the precision of the assay was evaluated using 4 replicates of a second VQA plasma PT panel (N = 5) and 3 of 4 replicates were tested with the optimized in-house assay and the remaining one was tested with TRUGENE®. The precision test was performed by 3 technicians. In addition, 10 DBS panels shipped at two different temperature conditions from VQA were also tested by the optimized assay. Specificity was determined by testing 30 HIV-negative DBS specimens collected from pregnant women in Tanzania.
Applying the assay for surveillance of transmitted HIVDR and HIVDR prevention monitoring surveys in resource-limited countries
Seventy two matched plasma and DBS samples from newly HIV-diagnosed persons in Vietnam were tested. For HIVDR monitoring surveys, we applied the optimized assay for resistance testing in samples collected from patients 12–15 months after the commencement of ART in two monitoring surveys. For the Malawi monitoring survey, 34 plasma samples from patients with VL ranged from 2.25 to 5.89 log10 copies/ml were tested. In Nigeria monitoring survey, 26 matched plasma and DBS samples with plasma VL ranged from 2.18 to 6.41 log10 copies/ml were analyzed.
HIV-1 subtyping for the newly obtained sequences was performed using the REGA 4 HIV-1 Genotyping Tool . Phylogenetic analyses were further conducted using neighbor-joining method included in the MEGA 4 for sequences with unclassifiable subtypes. Reference sequences were obtained from the Los Alamos HIV Database (www.hiv.lanl.gov). Sequences obtained in the study were submitted to GenBank and their accession numbers are JN885633 to JN885719.
Reagent cost comparison
To estimate reagent cost savings by using the optimized broad sensitive genotyping assay, we calculated reagent cost per test of the assay and compared it with the reagent costs of commercially available genotyping systems, TRUGENE® and ViroSeq®. We used current U.S. market values in dollars for all the reagents we used in the in-house assay including RNA/TNA extraction, RT-PCR, nested PCR, PCR amplification confirmation, PCR purification and sequencing reactions. These reagent cost estimates did not include the cost for running test controls and any repetitions when needed.
Wilcoxon Signed-Rank test was used to analyze the difference in number of nucleotide mixtures detected between the optimized and original in-house assays. The statistical significance was considered when P value was <0.05.
In accordance with United States regulations and international guidelines, the CDC human subjects review process determined this activity to be non-research and the protocol was approved by the Associate Director for Science (ADS), National Center for HIV, Hepatitis, STD and TB Prevention, CDC, Atlanta. All the study protocols were approved by local institutional review boards: the National Health Sciences Research Committee, Ministry of Health of Malawi; the National Institute for Medical Research at Lagos, Nigeria; the Thailand Ministry of Public Health and Sirriraj Hospital, Mahidol University, Thailand; the University of Alabama, Birmingham and the University of Zambia Research Ethics Committee, Zambia.
Validation of the optimized in-house assay
The sensitivity of the optimized in-house assay was evaluated with 96 HIV-1 positive plasma samples collected from Cameroon, Thailand and Zambia. Of these, all 5 samples with VL <3 log10 copies/ml and 87 (95.6%) of 91 samples with VL ≥3 log10 copies/ml were genotyped, resulting in an overall genotyping rate of 95.8% (92/96) comparing to 96.8% (93/96) by the original assay.
The accuracy of the optimized assay was first assessed by comparing 87 paired nucleotide sequences generated by the original in-house assay  and the optimized assay using ReCall and BioEdit programs. The mean nucleotide identity was 99.3±0.50% (mean ± SD) among paired nucleotide sequences. Wilcoxon signed-rank test was used to compare original and optimized in-house assays in basecalling for mixed bases and revealed that the optimized assay detected significantly more mixed bases than the original one (P<0.001). However, this difference did not translate into differences in HIVDR mutations. Among 144 DR mutations detected in paired samples, we did not detect any complete discordant mutations at DR mutation sites and only 11 partially discordant DR mutation sites including 3 in PR and 8 in RT (Table 3) were seen. The overall DR codon agreement was 99.8% between the 87 paired samples.
Testing 10 plasma PT panel samples (five from DigitalPT and five from VQA) using the optimized in-house and TRUGENE® or ViroSeq® assays also indicated that the optimized in-house assay appeared to detect more mixed bases than commercial kits. However, DR mutation site differences only occurred in 2 of 76 DR mutations between the optimized in-house and TRUGENE® and 2 of 44 between the in-house and ViroSeq® in mixed bases. The overall sequence identity was 99.6±0.41% between the in-house and TRUGENE® (Table 4), and 99.1±0.65% between the in-house and ViroSeq® (Table 5). Further examination to see whether more sensitive detection of base mixtures in the optimized in-house assay is a reproducible event, we analyzed 4 replicates of 5 samples that were tested by three optimized in-house assay runs and one TRUGENE® run under different operators. We found highly concordant sequence identities ranging from 98.22% to 99.65%. The minor differences observed in sequence identity were caused by base mixtures (Table 6). For example, at codons 37 and 41 of RT in sample 3 (Fig 1), one replicate detected mixture RY at the 2nd and 3rd positions of codon 37, and the second replicate did not find any mixtures, while the third replicate showed lower, yet visible, second peaks comparing to the first replicate. Similarly at the 2nd position of codon 41, the first replicate revealed a Y (C/T), the second replicate showed a W (A/T), and the third replicate revealed an H (A/C/T) while TRUGENE® replicate detected a Y (C/T). Nucleotide mixtures also caused some mismatched DR mutations between the replicates. For instance, one in-house replicate missed 3 mixed codons (K65KR, D67DN and T69IT) in sample 2 among the 4 replicates. However, the minor peaks of nucleotide bases at these three codons could be seen, but were below the mixture cutoff (15%) on the chromatogram by ReCall. Thus these mixtures were not counted and resulted in the codon discrepancy. Another partial discordant example was the DR mutation M184MV, which was detected in sample 5 by all 3 in-house replicates but not found in TRUGENE® replicate. These results indicated that the sequences generated by population-based sequencing were highly reproducible but the sensitivity at detecting low frequency of drug resistant HIV variants was very challenging.
Panel A shows 2 codons (37 and 41 of RT) with nucleotide base calling of AYR; Panel B shows the AWR at codon 41 (the second peaks at codon 37 were not detected in this replicate); Panel C shows ACR at codon 37 (minor T was not called by the ReCall at the cutoff of 15%) and AHR at codon 41 (almost equal height of second and third peak at the 2nd position).
Sensitivity on DBS samples.
DBS samples are recommended by WHO for HIVDR surveillance in resource-limited settings in treatment-naïve populations . The mission of our laboratory at CDC is to support HIVDR surveillance in PEPFAR-supported countries; thus, we evaluated the assay sensitivity with two matched DBS experimental panels shipped under different temperature conditions from VQA. The optimized in-house assay was able to genotype all 5 DBS samples shipped with dry ice and 4 of 5 DBS samples shipped at ambient temperature with DBS VL ranging from 3.17 to 3.98 log10 copies/ml. The failed sample GEN001BS.04C was the sample with the lowest VL of 3.17 log10 copies/ml (f 7).
To evaluate the specificity of the optimized in-house assay, we tested HIV negative DBS samples (N = 30) collected from women attending ANC clinics in Tanzania and they were all found to be negative, resulting in the assay specificity of 100%.
EQA assessment results: Based on WHO/HIVResNet requirement to pass the PT panels, a drug resistance mutation (DRM) site score and nucleotide (nt) alignment score with consensus sequence of at least 99% (considering all 5 samples) must be achieved. The optimized in-house assay passed two sets of plasma PT panels with 100% DRM, 99.98% nt and 100% DRM, 99.88% nt scores, respectively. The assay showed high sequence concordance with the laboratories participating in the EQA program.
Application of the assay in the surveillance of HIVDR in resource-poor countries
With the satisfactory validation results of the optimized in-house assay, we applied this assay in the surveillance of HIVDR in three PEPFAR-supported countries.
Threshold survey of transmitted HIVDR in recently HIV-infected population in Vietnam.
For this survey, we tested 72 plasma and matched DBS specimens collected from individuals attending voluntary counseling and testing (VCT) in Ho Chi Minh City. We were able to genotype all 72 plasma and 69 (95.8%) DBS samples and sequence identity analysis (N = 69) indicated that overall nucleotide identity was 98.9%±0.62% between matched plasma and DBS samples. The sequence differences were caused by partially discordant mixture bases located in the three HIVDR codons in the RT region.
Detection of HIVDR development in ART-experienced patients from Malawi and Nigeria.
We next utilized the optimized in-house assay in detecting HIVDR development in patients treated with first-line ARVs for 12-15 months in two monitoring surveys conducted in Malawi (N = 34) and Nigeria (N = 26). Genotyping was successful for all 46 plasma samples collected from virologically failed patients defined as VL ≥3 log10 copies/ml according to the WHO definition . For patients with VL between 2.18 and <3 log10 copies/ml, 78.6% (11/14) plasma samples (7/8 from Nigeria and 4/6 from Malawi) were also successful. Furthermore, all 18 matched DBS samples from virologically failing patients and 4 of the 8 DBS samples with VL between 2.18 and <3 log10 copies/ml from Nigeria were genotyped. The nucleotide sequence identity between the 22 plasma and DBS pairs was 98.8±0.80%. For DR mutations, 90.4% DR mutations identified in plasma were also found in DBS. For the 9.6% discordant DR mutations identified, majority of them was partially discordant (7.5%) and only 2.1% were completely discordant.
HIV -1 subtypes
Phylogenetic analyses revealed that the overall subtype distributions among the 236 newly obtained sequences were 43.6% CRF 01_AE, 25.6% C, 13.1% CRF02_AG, 5.1% G, 4.2% B, 2.5% A, 2.1% F, 2.1% unclassified (UC), and 0.4% each CRF06_CPX, CRF09_CPX and CRF-07_BC. Subtype distributions are different from country to country. For instance, all samples tested from Vietnam and Malawi were CRF-01_AE and subtype C, respectively, while multiple subtypes were identified from samples collected from Cameroon, Canada and Nigeria (Table 8).
Reagent cost comparison
Using the current U.S. market values in dollars for all the reagents used in the optimized in-house assay, we estimated that the reagent cost per test for the optimized in-house assay was $40.00, comparing to $213.20 for TRUGENE® and $172.86 for ViroSeq®. In the reagent cost calculations, we did not include the cost for assay controls and any need for repetition of tests, which would increase the cost of reagents for all the assays compared here.
The newly optimized in-house assay was broadly sensitive in genotyping multiple HIV-1 group M subtypes and CRFs from plasma and DBS collected from 6 resource-limited countries. The original in-house assay, although a success from the broad sensitivity perspective, was in need for improvement due to the concern of incomplete genotyping of PR gene and suboptimal sequence quality due to primer design . The validation of the re-designed RT-PCR and some of the sequencing primers in the current study confirmed that the newly optimized in-house assay is comparable to the original in-house assay in assay sensitivity and specificity and it is also broadly sensitive to all group M subtypes and CRFs circulating in PEPFAR-supported countries. Pairwise nucleotide sequence identity analyses from sequences generated by the optimized in-house assay and the ones obtained from the original in-house assay and two commercially available genotyping systems indicated the optimized in-house assay produced comparable genotyping results. More importantly, the optimized in-house assay expanded genotyping codon coverage to include all PR mutations and improved sequence quality by reducing background noises to minimal, resulting in more sensitive mixture calling. The ability to detect nucleotide mixtures (low frequency viral strains) is important as recent studies have demonstrated that low frequency variants can grow rapidly and become predominant viral population under the selective drug pressure and lead to treatment failure , .
Given that the newly optimized in-house assay was broadly sensitive in genotyping B and non-B subtype viral strains of HIV-1 group M viruses, it would be expected that the assay would efficiently genotype plasma and DBS samples from various geographical areas, and this was verified by applying the assay in genotyping samples collected from patients enrolled in two perspective HIVDR monitoring surveys. The optimized in-house assay was able to genotype 100% of plasma samples collected from virological failure patients, defined as VL ≥3 log10 copies/ml  in the present study and over three-fourths of the patients with VL between 2.18 and <3 log 10 copies/ml. More importantly, genotyping was successful for all the 18 matched DBS samples collected from Nigerian patients with virological failure. It is worthy to note that these DBS samples had been stored at room temperature for an average of 85 days before shipping to our laboratory for testing. In addition, testing of two DBS PT panels shipped frozen or at ambient temperature revealed that genotyping was successful for all DBS samples except one with the lowest VL and shipped at ambient temperature. These results indicate that the optimized in-house assay is highly sensitive in genotyping both plasma and DBS samples. It is important to point out that interpretation of the genotyping results from the DBS samples stored at room temperature for a long period of time however, needs to be cautious since these DBS cards were packaged correctly and stored in an air-conditioning room with low humidity. These package and storage condition might have limited the true impact of suboptimal storage conditions existed in resource-limited settings on the quality of DBS cards and resulted in better genotyping efficiency. Studies have shown that correct packaging and storage of DBS are critical elements in ensuring successful genotyping results , , , . In fact, our own data here generated from two identical DBS PT panels and shipped at frozen or ambient temperature also indicate that even overnight exposure of DBS samples with low VL to ambient temperature in domestic shipment could have some detrimental impact on DBS quality for genotyping. Comparing the performance of the optimized in-house assay with TRUGENE®, ViroSeq® and the original in-house assay, high nucleotide sequence identity was revealed; however, minor differences existed in mixture base callings. The optimized in-house assay detected more mixed bases than the commercial kits and our original in-house assay. Many factors could contribute to the sequence discordances at the mixed nucleotide sites in HIV genotyping including viral quasispecies, primer binding preference and location, Taq polymerase mis-incorporation, sequence quality, basecalling criteria or technical errors , , . Because HIV-1 viruses are rapidly evolving quasispecies , there are multiple HIV-1 variants in one patient , . Sequence identity and codon concordance are challenging when mixed bases are present . It has been reported that ViroSeq® detected more mixtures (78%) than an in-house assay (22%) . In contrast, our optimized in-house assay detected more mixture bases than other assays. This may be due to the fact that the optimized assay produced sequence chromatographs containing minimal background noise. To confirm this, we performed sequence editing for all validation samples (N = 102) including PT panels with ReCall program  using minor peak default mixture calling setting at >15% of the major peak in bi-directional sequences. We also independently tested one set of the PT panels by 3 different operators. These analyses showed that the optimized in-house assay gave more sensitive mixture calling. The variability in detecting nucleotide mixtures was likely due to the first-round RT-PCR  in sampling of quasispecies strains rather than by technical errors in the sequencing process . The use of wide-spectrum degenerate primers and a mixture of two forward primers at slightly different binding sites in the initial run of RT-PCR are likely contributed to more mixtures calling in the optimized in-house assay. To what extent and by what factors the mixture variants could be affected and detected in HIV genotyping is a matter of speculation, which needs further studies.
Phylogenetic analyses indicated that the optimized in-house assay could genotype HIV-1 group M subtypes A (A1, A2), B, C, F (F1, F2), G and CRFs including CRF01_AE, CRF02_AG, CRF06_CPX, CRF07_BC, CRF09_CPX and UC with an overall sensitivity of 96% using specimens from different geographical regions around the world. Due to the limited availability of HIV-positive samples, we only genotyped a small number of subtype A and F viral strains and further studies are needed to confirm our findings with larger sample sizes on these viral strains. It has been reported that genotyping sensitivity with two FDA-approved systems using non-B subtypes varies . Some studies indicated that these two systems performed well for B and non-B subtypes , , ,  while others demonstrated that they were less sensitive to non-B subtypes and CRFs , , , . For instance, only 52% of serum samples were genotyped in an Ethiopian threshold survey using ViroSeq® and TRUGENE® methods sequentially . For genotyping DBS samples collected from subtype B infected persons, one study reported 78.8% genotyping rate by TRUGENE®  while another study reported 57.5% genotyping rate using ViroSeq® for DBS samples stored for one year at 4°C . An additional study reported an even lower DBS genotyping rate of 38.6% by ViroSeq® system . However, a study using ViroSeq® documented 100% genotyping rate for DBS samples collected from subtype B-infected patients with VL great than 2,000 copies/ml and 54.5% genotyping rate with DBS samples from patients with VL less than 2,000 copies/ml when DBS samples were stored at optimal conditions . Thus, commercial genotyping systems might work well with DBS samples collected from subtype-B-infected patients. Genotyping of DBS samples using these genotyping systems in non-B subtypes needs to be further studied. In comparison to our original in-house assay, our own experience using these two commercial assays with non-B subtypes was also not satisfactory. They often required repetition of RT-PCR or sequencing due to failure to amplify or sequence in TRUGENE® and ViroSeq® assays , . Compared to these commercial assays, the optimized in-house assay was not only sensitive, but also inexpensive. The assay could reduce the cost for genotyping reagents by 75%. The availability of low cost and broadly sensitive genotyping assay for plasma and DBS would make HIVDR surveillance and monitoring in resource-limited settings more accessible.
In conclusion, we have validated and improved a broadly sensitive and less expensive in-house genotyping assay for HIVDR surveillance and monitoring in resource-limited countries. Validation analyses indicate that the optimized in-house assay detected more mixed HIV-1 population than our original in-house assay and commercial genotyping kits. Given the high efficiency in genotyping diverse HIV-1 group M viral strains from plasma and DBS samples and substantial reagent cost saving, the optimized in-house assay could be applicable to DR genotyping in both ART-naive and -experienced populations according to current WHO recommendations for surveillance purpose .
The authors feel in debt to all the participants who participated in the studies and surveillance activities and the authors would also like to express their sincere thanks to all the local surveillance staff and clinical staff who were involved in the studies.
Conceived and designed the experiments: CY JN ZZ. Performed the experiments: ZZ NW JRD ER. Analyzed the data: ZZ CY NW ER KD. Contributed reagents/materials/analysis tools: DBN OB RU NW-K MSM IZ BC JN. Wrote the paper: ZZ CY.
- 1. Geretti AM (2007) Epidemiology of antiretroviral drug resistance in drug-naive persons. Curr Opin Infect Dis 20: 22–32.AM Geretti2007Epidemiology of antiretroviral drug resistance in drug-naive persons.Curr Opin Infect Dis202232
- 2. Bennett DE (2006) The requirement for surveillance of HIV drug resistance within antiretroviral rollout in the developing world. Curr Opin Infect Dis 19: 607–614.DE Bennett2006The requirement for surveillance of HIV drug resistance within antiretroviral rollout in the developing world.Curr Opin Infect Dis19607614
- 3. Bertagnolio S, Derdelinckx I, Parker M, Fitzgibbon J, Fleury H, et al. (2008) World Health Organization/HIVResNet Drug Resistance Laboratory Strategy. Antivir Ther 13: Suppl 249–57.S. BertagnolioI. DerdelinckxM. ParkerJ. FitzgibbonH. Fleury2008World Health Organization/HIVResNet Drug Resistance Laboratory Strategy.Antivir Ther13Suppl 24957
- 4. Jordan MR, Bennett DE, Bertagnolio S, Gilks CF, Sutherland D (2008) World Health Organization surveys to monitor HIV drug resistance prevention and associated factors in sentinel antiretroviral treatment sites. Antivir Ther 13: Suppl 215–23.MR JordanDE BennettS. BertagnolioCF GilksD. Sutherland2008World Health Organization surveys to monitor HIV drug resistance prevention and associated factors in sentinel antiretroviral treatment sites.Antivir Ther13Suppl 21523
- 5. Bennett DE, Camacho RJ, Otelea D, Kuritzkes DR, Fleury H, et al. (2008) World Health Organization surveys to monitor HIV drug resistance prevention and associated factors in sentinel antiretroviral treatment sites. PLoS One 13: Suppl 2e4724.DE BennettRJ CamachoD. OteleaDR KuritzkesH. Fleury2008World Health Organization surveys to monitor HIV drug resistance prevention and associated factors in sentinel antiretroviral treatment sites.PLoS One13Suppl 2e4724
- 6. Hirsch MS, Gunthard HF, Schapiro JM, Brun-Vezinet F, Clotet B, et al. (2008) Antiretroviral drug resistance testing in adult HIV-1 infection: 2008 recommendations of an International AIDS Society-USA panel. Top HIV Med 16: 266–285.MS HirschHF GunthardJM SchapiroF. Brun-VezinetB. Clotet2008Antiretroviral drug resistance testing in adult HIV-1 infection: 2008 recommendations of an International AIDS Society-USA panel.Top HIV Med16266285
- 7. Gilks CF, Crowley S, Ekpini R, Gove S, Perriens J, et al. (2006) The WHO public-health approach to antiretroviral treatment against HIV in resource-limited settings. Lancet 368: 505–510.CF GilksS. CrowleyR. EkpiniS. GoveJ. Perriens2006The WHO public-health approach to antiretroviral treatment against HIV in resource-limited settings.Lancet368505510
- 8. Eshleman SH, Guay LA, Mwatha A, Brown ER, Cunningham SP, et al. (2004) Characterization of nevirapine resistance mutations in women with subtype A vs. D HIV-1 6-8 weeks after single-dose nevirapine (HIVNET 012). J Acquir Immune Defic Syndr 35: 126–130.SH EshlemanLA GuayA. MwathaER BrownSP Cunningham2004Characterization of nevirapine resistance mutations in women with subtype A vs. D HIV-1 6-8 weeks after single-dose nevirapine (HIVNET 012).J Acquir Immune Defic Syndr35126130
- 9. Jagodzinski LL, Cooley JD, Weber M, Michael NL (2003) Performance characteristics of human immunodeficiency virus type 1 (HIV-1) genotyping systems in sequence-based analysis of subtypes other than HIV-1 subtype B. J Clin Microbiol 41: 998–1003.LL JagodzinskiJD CooleyM. WeberNL Michael2003Performance characteristics of human immunodeficiency virus type 1 (HIV-1) genotyping systems in sequence-based analysis of subtypes other than HIV-1 subtype B.J Clin Microbiol419981003
- 10. Saravanan S, Vidya M, Balakrishnan P, Kumarasamy N, Solomon SS, et al. (2009) Evaluation of two human immunodeficiency virus-1 genotyping systems: ViroSeq 2.0 and an in-house method. J Virol Methods 159: 211–216.S. SaravananM. VidyaP. BalakrishnanN. KumarasamySS Solomon2009Evaluation of two human immunodeficiency virus-1 genotyping systems: ViroSeq 2.0 and an in-house method.J Virol Methods159211216
- 11. Schuurman R, Demeter L, Reichelderfer P, Tijnagel J, de Groot T, et al. (1999) Worldwide evaluation of DNA sequencing approaches for identification of drug resistance mutations in the human immunodeficiency virus type 1 reverse transcriptase. J Clin Microbiol 37: 2291–2296.R. SchuurmanL. DemeterP. ReichelderferJ. TijnagelT. de Groot1999Worldwide evaluation of DNA sequencing approaches for identification of drug resistance mutations in the human immunodeficiency virus type 1 reverse transcriptase.J Clin Microbiol3722912296
- 12. Aghokeng AF, Mpoudi-Ngole E, Chia JE, Edoul EM, Delaporte E, et al. (2011) High failure rate of the ViroSeq HIV-1 genotyping system for drug resistance testing in Cameroon, a country with broad HIV-1 genetic diversity. J Clin Microbiol 49: 1635–1641.AF AghokengE. Mpoudi-NgoleJE ChiaEM EdoulE. Delaporte2011High failure rate of the ViroSeq HIV-1 genotyping system for drug resistance testing in Cameroon, a country with broad HIV-1 genetic diversity.J Clin Microbiol4916351641
- 13. Beddows S, Galpin S, Kazmi SH, Ashraf A, Johargy A, et al. (2003) Performance of two commercially available sequence-based HIV-1 genotyping systems for the detection of drug resistance against HIV type 1 group M subtypes. J Med Virol 70: 337–342.S. BeddowsS. GalpinSH KazmiA. AshrafA. Johargy2003Performance of two commercially available sequence-based HIV-1 genotyping systems for the detection of drug resistance against HIV type 1 group M subtypes.J Med Virol70337342
- 14. Fontaine E, Riva C, Peeters M, Schmit JC, Delaporte E, et al. (2001) Evaluation of two commercial kits for the detection of genotypic drug resistance on a panel of HIV type 1 subtypes A through J. J Acquir Immune Defic Syndr 28: 254–258.E. FontaineC. RivaM. PeetersJC SchmitE. Delaporte2001Evaluation of two commercial kits for the detection of genotypic drug resistance on a panel of HIV type 1 subtypes A through J.J Acquir Immune Defic Syndr28254258
- 15. Bennett DE, Bertagnolio S, Sutherland D, Gilks CF (2008) The World Health Organization's global strategy for prevention and assessment of HIV drug resistance. Antivir Ther 13: Suppl 21–13.DE BennettS. BertagnolioD. SutherlandCF Gilks2008The World Health Organization's global strategy for prevention and assessment of HIV drug resistance.Antivir Ther13Suppl 2113
- 16. Wallis CL, Papathanasopoulos MA, Lakhi S, Karita E, Kamali A, et al. Affordable in-house antiretroviral drug resistance assay with good performance in non-subtype B HIV-1. J Virol Methods 163: 505–508.Wallis CL, Papathanasopoulos MA, Lakhi S, Karita E, Kamali A, et al. Affordable in-house antiretroviral drug resistance assay with good performance in non-subtype B HIV-1.J Virol Methods163505508
- 17. Eshleman SH, Hackett J Jr, Swanson P, Cunningham SP, Drews B, et al. (2004) Performance of the Celera Diagnostics ViroSeq HIV-1 Genotyping System for sequence-based analysis of diverse human immunodeficiency virus type 1 strains. J Clin Microbiol 42: 2711–2717.SH EshlemanJ. Hackett JrP. SwansonSP CunninghamB. Drews2004Performance of the Celera Diagnostics ViroSeq HIV-1 Genotyping System for sequence-based analysis of diverse human immunodeficiency virus type 1 strains.J Clin Microbiol4227112717
- 18. Grant RM, Hecht FM, Warmerdam M, Liu L, Liegler T, et al. (2002) Time trends in primary HIV-1 drug resistance among recently infected persons. JAMA 288: 181–188.RM GrantFM HechtM. WarmerdamL. LiuT. Liegler2002Time trends in primary HIV-1 drug resistance among recently infected persons.JAMA288181188
- 19. Hirsch MS, Brun-Vezinet F, Clotet B, Conway B, Kuritzkes DR, et al. (2003) Antiretroviral drug resistance testing in adults infected with human immunodeficiency virus type 1: 2003 recommendations of an International AIDS Society-USA Panel. Clin Infect Dis 37: 113–128.MS HirschF. Brun-VezinetB. ClotetB. ConwayDR Kuritzkes2003Antiretroviral drug resistance testing in adults infected with human immunodeficiency virus type 1: 2003 recommendations of an International AIDS Society-USA Panel.Clin Infect Dis37113128
- 20. Buckton AJ (2008) New methods for the surveillance of HIV drug resistance in the resource poor world. Curr Opin Infect Dis 21: 653–658.AJ Buckton2008New methods for the surveillance of HIV drug resistance in the resource poor world.Curr Opin Infect Dis21653658
- 21. WHO (2010) WHO/HIVResNet HIV Drug Resistance Laboratory Strategy.WHO2010WHO/HIVResNet HIV Drug Resistance Laboratory Strategy.http://www.who.int/hiv/pub/drugresistance/hiv_reslab_strategy.pdf. Accessed 2010 Sep 3. http://www.who.int/hiv/pub/drugresistance/hiv_reslab_strategy.pdf. Accessed 2010 Sep 3.
- 22. Yang C, McNulty A, Diallo K, Zhang J, Titanji B, et al. (2010) Development and application of a broadly sensitive dried-blood-spot-based genotyping assay for global surveillance of HIV-1 drug resistance. J Clin Microbiol 48: 3158–3164.C. YangA. McNultyK. DialloJ. ZhangB. Titanji2010Development and application of a broadly sensitive dried-blood-spot-based genotyping assay for global surveillance of HIV-1 drug resistance.J Clin Microbiol4831583164
- 23. WHO (2010) WHO Manual for HIV drug resiatance testing using dried blood spot specimens.WHO2010WHO Manual for HIV drug resiatance testing using dried blood spot specimens.http://www.who.int/hiv/topics/drugresistance/dbs_protocol.pdf. Accessed 2010, Sep 3. http://www.who.int/hiv/topics/drugresistance/dbs_protocol.pdf. Accessed 2010, Sep 3.
- 24. McConnell M, Jariyasethpong T, Chantharojwong N, Utenpitak C, Zhou Z, et al. (2010) Low level HIV-1 viremia in Thai women 24 weeks after treatment initiation with NNRTI-based ART was not associated with prior single-dose Nevirapine exposure or viral resistance mutations. 17th Conference on Retroviruses and Opportunistic Infections Poster Abstracts #502, page 243, Sanfrancisco, CA, USA. M. McConnellT. JariyasethpongN. ChantharojwongC. UtenpitakZ. Zhou2010Low level HIV-1 viremia in Thai women 24 weeks after treatment initiation with NNRTI-based ART was not associated with prior single-dose Nevirapine exposure or viral resistance mutations.17th Conference on Retroviruses and Opportunistic Infections Poster Abstracts #502, page 243, Sanfrancisco, CA, USA
- 25. Stringer JS, McConnell MS, Kiarie J, Bolu O, Anekthananon T, et al. (2010) Effectiveness of non-nucleoside reverse-transcriptase inhibitor-based antiretroviral therapy in women previously exposed to a single intrapartum dose of nevirapine: a multi-country, prospective cohort study. PLoS Med 7: e1000233.JS StringerMS McConnellJ. KiarieO. BoluT. Anekthananon2010Effectiveness of non-nucleoside reverse-transcriptase inhibitor-based antiretroviral therapy in women previously exposed to a single intrapartum dose of nevirapine: a multi-country, prospective cohort study.PLoS Med7e1000233
- 26. Harrigan PR, Dong W, Wynhoven B, Mo T, Hall T, et al. (2002) Performance of ReCall basecalling software for high-throughput HIV drug resistance basecalling using “in-house” methods. The XIV international AIDS Conference, Barcelona, Spain, July 7-12, Abstract #TuPeB4598. PR HarriganW. DongB. WynhovenT. MoT. Hall2002Performance of ReCall basecalling software for high-throughput HIV drug resistance basecalling using “in-house” methods.The XIV international AIDS Conference, Barcelona, Spain, July 7-12, Abstract #TuPeB4598
- 27. Tamura K DJ, Neil M, Kumar S (2007) MEGA4: Molecular evolutionary genetics analysis software version 4.0. Mol Biol Evol 24: 1596–1599.DJ Tamura KM. NeilS. Kumar2007MEGA4: Molecular evolutionary genetics analysis software version 4.0.Mol Biol Evol2415961599
- 28. Bennett DE, Camacho RJ, Otelea D, Kuritzkes DR, Fleury H, et al. (2009) Drug resistance mutations for surveillance of transmitted HIV-1 drug-resistance: 2009 update. PLoS One 4: e4724.DE BennettRJ CamachoD. OteleaDR KuritzkesH. Fleury2009Drug resistance mutations for surveillance of transmitted HIV-1 drug-resistance: 2009 update.PLoS One4e4724
- 29. Hall TA (1999) BioEdit: a user-friendly biological sequence alignment editor and analysis program for windows 95/98/NT. Nucl Acids Symp Ser 41: 95–98.TA Hall1999BioEdit: a user-friendly biological sequence alignment editor and analysis program for windows 95/98/NT.Nucl Acids Symp Ser419598
- 30. de Oliveira T, Deforche K, Cassol S, Salminen M, Paraskevis D, et al. (2005) An automated genotyping system for analysis of HIV-1 and other microbial sequences. Bioinformatics 21: 3797–3800.T. de OliveiraK. DeforcheS. CassolM. SalminenD. Paraskevis2005An automated genotyping system for analysis of HIV-1 and other microbial sequences.Bioinformatics2137973800
- 31. Johnson JA, Li JF, Wei X, Lipscomb J, Irlbeck D, et al. (2008) Minority HIV-1 drug resistance mutations are present in antiretroviral treatment-naive populations and associate with reduced treatment efficacy. PLoS Med 5: e158.JA JohnsonJF LiX. WeiJ. LipscombD. Irlbeck2008Minority HIV-1 drug resistance mutations are present in antiretroviral treatment-naive populations and associate with reduced treatment efficacy.PLoS Med5e158
- 32. Simen BB, Simons JF, Hullsiek KH, Novak RM, Macarthur RD, et al. (2009) Low-abundance drug-resistant viral variants in chronically HIV-infected, antiretroviral treatment-naive patients significantly impact treatment outcomes. J Infect Dis 199: 693–701.BB SimenJF SimonsKH HullsiekRM NovakRD Macarthur2009Low-abundance drug-resistant viral variants in chronically HIV-infected, antiretroviral treatment-naive patients significantly impact treatment outcomes.J Infect Dis199693701
- 33. McNulty A, Jennings C, Bennett D, Fitzgibbon J, Bremer JW, et al. (2007) Evaluation of dried blood spots for human immunodeficiency virus type 1 drug resistance testing. J Clin Microbiol 45: 517–521.A. McNultyC. JenningsD. BennettJ. FitzgibbonJW Bremer2007Evaluation of dried blood spots for human immunodeficiency virus type 1 drug resistance testing.J Clin Microbiol45517521
- 34. Bertagnolio S, Parkin NT, Jordan M, Brooks J, Garcia-Lerma JG (2010) Dried blood spots for HIV-1 drug resistance and viral load testing: A review of current knowledge and WHO efforts for global HIV drug resistance surveillance. AIDS Rev 12: 195–208.S. BertagnolioNT ParkinM. JordanJ. BrooksJG Garcia-Lerma2010Dried blood spots for HIV-1 drug resistance and viral load testing: A review of current knowledge and WHO efforts for global HIV drug resistance surveillance.AIDS Rev12195208
- 35. Garrido C, Zahonero N, Fernandes D, Serrano D, Silva AR, et al. (2008) Subtype variability, virological response and drug resistance assessed on dried blood spots collected from HIV patients on antiretroviral therapy in Angola. J Antimicrob Chemother 61: 694–698.C. GarridoN. ZahoneroD. FernandesD. SerranoAR Silva2008Subtype variability, virological response and drug resistance assessed on dried blood spots collected from HIV patients on antiretroviral therapy in Angola.J Antimicrob Chemother61694698
- 36. Garcia-Lerma JG, McNulty A, Jennings C, Huang D, Heneine W, et al. (2009) Rapid decline in the efficiency of HIV drug resistance genotyping from dried blood spots (DBS) and dried plasma spots (DPS) stored at 37 degrees C and high humidity. J Antimicrob Chemother 64: 33–36.JG Garcia-LermaA. McNultyC. JenningsD. HuangW. Heneine2009Rapid decline in the efficiency of HIV drug resistance genotyping from dried blood spots (DBS) and dried plasma spots (DPS) stored at 37 degrees C and high humidity.J Antimicrob Chemother643336
- 37. Goodenow M, Huet T, Saurin W, Kwok S, Sninsky J, et al. (1989) HIV-1 isolates are rapidly evolving quasispecies: evidence for viral mixtures and preferred nucleotide substitutions. J Acquir Immune Defic Syndr 2: 344–352.M. GoodenowT. HuetW. SaurinS. KwokJ. Sninsky1989HIV-1 isolates are rapidly evolving quasispecies: evidence for viral mixtures and preferred nucleotide substitutions.J Acquir Immune Defic Syndr2344352
- 38. Hearps AC, Ryan CE, Morris LM, Plate MM, Greengrass V, et al. (2010) Stability of dried blood spots for HIV-1 drug resistance analysis. Curr HIV Res 8: 134–140.AC HearpsCE RyanLM MorrisMM PlateV. Greengrass2010Stability of dried blood spots for HIV-1 drug resistance analysis.Curr HIV Res8134140
- 39. Kijak GH, Simon V, Balfe P, Vanderhoeven J, Pampuro SE, et al. (2002) Origin of human immunodeficiency virus type 1 quasispecies emerging after antiretroviral treatment interruption in patients with therapeutic failure. J Virol 76: 7000–7009.GH KijakV. SimonP. BalfeJ. VanderhoevenSE Pampuro2002Origin of human immunodeficiency virus type 1 quasispecies emerging after antiretroviral treatment interruption in patients with therapeutic failure.J Virol7670007009
- 40. Lira R, Valdez-Salazar H, Vazquez-Rosales G, Rojas-Montes O, Ruiz-Tachiquin M, et al. (2010) Genotypic testing for HIV-1 drug resistance using dried blood samples. Arch Virol 155: 1117–1125.R. LiraH. Valdez-SalazarG. Vazquez-RosalesO. Rojas-MontesM. Ruiz-Tachiquin2010Genotypic testing for HIV-1 drug resistance using dried blood samples.Arch Virol15511171125
- 41. Parkin NT, Fitzgibbon J, Bremer J, Bertagnolio S (2009) HIV drug resistance genotyping external quality assurance (EQA) for laboratories in the World Health Organization (WHO) ResNet during 2007-2009. Antivir Ther 14: suppl 1A162.NT ParkinJ. FitzgibbonJ. BremerS. Bertagnolio2009HIV drug resistance genotyping external quality assurance (EQA) for laboratories in the World Health Organization (WHO) ResNet during 2007-2009.Antivir Ther14suppl 1A162
- 42. Galli RA, Sattha B, Wynhoven B, O'Shaughnessy MV, Harrigan PR (2003) Sources and magnitude of intralaboratory variability in a sequence-based genotypic assay for human immunodeficiency virus type 1 drug resistance. J Clin Microbiol 41: 2900–2907.RA GalliB. SatthaB. WynhovenMV O'ShaughnessyPR Harrigan2003Sources and magnitude of intralaboratory variability in a sequence-based genotypic assay for human immunodeficiency virus type 1 drug resistance.J Clin Microbiol4129002907
- 43. Shafer RW, Hertogs K, Zolopa AR, Warford A, Bloor S, et al. (2001) High degree of interlaboratory reproducibility of human immunodeficiency virus type 1 protease and reverse transcriptase sequencing of plasma samples from heavily treated patients. J Clin Microbiol 39: 1522–1529.RW ShaferK. HertogsAR ZolopaA. WarfordS. Bloor2001High degree of interlaboratory reproducibility of human immunodeficiency virus type 1 protease and reverse transcriptase sequencing of plasma samples from heavily treated patients.J Clin Microbiol3915221529
- 44. Chen JH, Wong KH, Chan K, Lam HY, Lee SS, et al. (2007) Evaluation of an in-house genotyping resistance test for HIV-1 drug resistance interpretation and genotyping. J Clin Virol 39: 125–131.JH ChenKH WongK. ChanHY LamSS Lee2007Evaluation of an in-house genotyping resistance test for HIV-1 drug resistance interpretation and genotyping.J Clin Virol39125131
- 45. Eshleman SH, Crutcher G, Petrauskene O, Kunstman K, Cunningham SP, et al. (2005) Sensitivity and specificity of the ViroSeq human immunodeficiency virus type 1 (HIV-1) genotyping system for detection of HIV-1 drug resistance mutations by use of an ABI PRISM 3100 genetic analyzer. J Clin Microbiol 43: 813–817.SH EshlemanG. CrutcherO. PetrauskeneK. KunstmanSP Cunningham2005Sensitivity and specificity of the ViroSeq human immunodeficiency virus type 1 (HIV-1) genotyping system for detection of HIV-1 drug resistance mutations by use of an ABI PRISM 3100 genetic analyzer.J Clin Microbiol43813817
- 46. Eshleman SH, Jones D, Flys T, Petrauskene O, Jackson JB (2003) Analysis of HIV-1 variants by cloning DNA generated with the ViroSeq HIV-1 Genotyping System. Biotechniques 35: 614–618, 620, 622.SH EshlemanD. JonesT. FlysO. PetrauskeneJB Jackson2003Analysis of HIV-1 variants by cloning DNA generated with the ViroSeq HIV-1 Genotyping System.Biotechniques35614618, 620, 622
- 47. Eshleman SH, Mracna M, Guay LA, Deseyve M, Cunningham S, et al. (2001) Selection and fading of resistance mutations in women and infants receiving nevirapine to prevent HIV-1 vertical transmission (HIVNET 012). Aids 15: 1951–1957.SH EshlemanM. MracnaLA GuayM. DeseyveS. Cunningham2001Selection and fading of resistance mutations in women and infants receiving nevirapine to prevent HIV-1 vertical transmission (HIVNET 012).Aids1519511957
- 48. Mracna M, Becker-Pergola G, Dileanis J, Guay LA, Cunningham S, et al. (2001) Performance of Applied Biosystems ViroSeq HIV-1 Genotyping System for sequence-based analysis of non-subtype B human immunodeficiency virus type 1 from Uganda. J Clin Microbiol 39: 4323–4327.M. MracnaG. Becker-PergolaJ. DileanisLA GuayS. Cunningham2001Performance of Applied Biosystems ViroSeq HIV-1 Genotyping System for sequence-based analysis of non-subtype B human immunodeficiency virus type 1 from Uganda.J Clin Microbiol3943234327
- 49. Abegaz WE, Grossman Z, Wolday D, Ram D, Kaplan J, et al. (2008) Threshold survey evaluating transmitted HIV drug resistance among public antenatal clinic clients in Addis Ababa, Ethiopia. Antivir Ther 13: Suppl 289–94.WE AbegazZ. GrossmanD. WoldayD. RamJ. Kaplan2008Threshold survey evaluating transmitted HIV drug resistance among public antenatal clinic clients in Addis Ababa, Ethiopia.Antivir Ther13Suppl 28994
- 50. Hallack R, Doherty LE, Wethers JA, Parker MM (2008) Evaluation of dried blood spot specimens for HIV-1 drug-resistance testing using the Trugene HIV-1 genotyping assay. J Clin Virol 41: 283–287.R. HallackLE DohertyJA WethersMM Parker2008Evaluation of dried blood spot specimens for HIV-1 drug-resistance testing using the Trugene HIV-1 genotyping assay.J Clin Virol41283287
- 51. Youngpairoj AS, Masciotra S, Garrido C, Zahonero N, de Mendoza C, et al. (2008) HIV-1 drug resistance genotyping from dried blood spots stored for 1 year at 4 degrees C. J Antimicrob Chemother 61: 1217–1220.AS YoungpairojS. MasciotraC. GarridoN. ZahoneroC. de Mendoza2008HIV-1 drug resistance genotyping from dried blood spots stored for 1 year at 4 degrees C. J Antimicrob Chemother6112171220
- 52. Masciotra S, Garrido C, Youngpairoj AS, McNulty A, Zahonero N, et al. (2007) High concordance between HIV-1 drug resistance genotypes generated from plasma and dried blood spots in antiretroviral-experienced patients. AIDS 21: 2503–2511.S. MasciotraC. GarridoAS YoungpairojA. McNultyN. Zahonero2007High concordance between HIV-1 drug resistance genotypes generated from plasma and dried blood spots in antiretroviral-experienced patients.AIDS2125032511