Figures
Abstract
Resistance to antiretroviral drugs used to treat HIV is an important and evolving concern, particularly in low- and middle-income countries (LMICs) which have been impacted to the greatest extent by the HIV pandemic. Efforts to monitor the emergence and transmission of resistance over the past decade have shown that drug resistance–especially to the nucleoside analogue and non-nucleoside reverse transcriptase inhibitors–can (and have) increased to levels that can jeopardize the efficacy of available treatment options at the population level. The global shift to integrase-based regimens as the preferred first-line therapy as well as technological advancements in the methods for detecting resistance have had an impact in broadening and diversifying the landscape of and use case for HIV drug resistance testing. This review estimates the potential demand for HIV drug resistance tests, and surveys current testing methodologies, with a focus on their application in LMICs.
Citation: Parkin N, Harrigan PR, Inzaule S, Bertagnolio S (2023) Need assessment for HIV drug resistance testing and landscape of current and future technologies in low- and middle-income countries. PLOS Glob Public Health 3(10): e0001948. https://doi.org/10.1371/journal.pgph.0001948
Editor: Mbuzeleni Hlongwa, University of KwaZulu-Natal College of Health Sciences, SOUTH AFRICA
Published: October 18, 2023
Copyright: © 2023 World Health Organization. Licensee Public Library of Science. This is an open access article distributed under the Creative Commons Attribution IGO License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. http://creativecommons.org/licenses/by/3.0/igo/. In any use of this article, there should be no suggestion that WHO endorses any specific organisation, products or services. The use of the WHO logo is not permitted. This notice should be preserved along with the article’s original URL.
Funding: This work was funded by the World Health Organization (WHO). PRH, SI and NP are WHO consultants. NP has been a paid consultant to ThermoFisher Scientific and Aldatu within the past five years. PRH has developed software owned by the University of British Columbia for automated processing of HIV drug resistance sequence data for Sanger, Illumina, and Oxford Nanopore sequencers. SI and SB report no potential conflicts. The views presented in this article are those of the authors and do not necessarily reflect those of WHO. WHO had no role in study design, data collection and analysis.
Competing interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: Consultant to the World Health Organization (WHO) for this work and management of the HIV drug resistance laboratory network (PRH, SI and NP); consultant to ThermoFisher Scientific 2017-2019 (NP); consultant to Aldatu in 2017 and 2020 (NP). Information and views expressed in this manuscript represent the view of the authors and not of the World Health Organization.
Introduction
Shortly after the first antiretroviral (ARV) drugs were developed, it was discovered that human immunodeficiency virus type 1 (HIV-1) drug resistance (HIVDR) could evolve quickly both in vitro and in vivo, reducing the effectiveness of monotherapy and early dual combination therapies [1, 2]. The individual risk of HIVDR is reduced with combination antiretroviral therapies, but since the start of the global scale-up of antiretroviral therapy (ART) in the early 2000s, levels of HIVDR have been increasing steadily [3, 4]. There is a high prevalence of pre-treatment drug resistance to non-nucleoside reverse transcriptase (RT) inhibitors (NNRTIs) among people initiating first-line therapy in most of the low- and middle-income countries (LMICs) monitoring and reporting resistance data [5]. These levels are even higher in certain subpopulations, including children [5, 6], with pre-treatment prevalence of resistance as high as 68% in some countries. Resistance to antiretrovirals brings great human and economic costs. In 2017, lack of action to address high levels of pre-treatment HIVDR to NNRTIs in sub-Saharan Africa was predicted to result in high death toll and significant increase in both new HIV infections and ART program costs in by 2030 [7].
Different approaches have been used to detect HIVDR including phenotypic and genotypic tests. The most intuitive way to test for HIVDR is to culture the virus in the presence of increasing drug concentration to determine the 50% inhibitory concentration (IC50), in an analogous fashion to susceptibility tests for most antimicrobials [8] or antifungals [9]. However, issues of cost, biosafety, sensitivity, and inherent variability have made traditional intact virus phenotypic testing impractical for routine use. Recombinant virus phenotypic assays, which utilize the viral genomic regions of interest (i.e., containing the coding sequences for targets of ARV drugs) from the infected individual in a constant “wild-type” virus vector, have enabled large-scale susceptibility testing [10, 11], at the expense of excluding the potential impact of variation outside the target regions. Additionally, if the constant “wild-type” background is extremely divergent from the patient-derived virus, it is possible that important indirect interactions might be missed. These phenotypic susceptibility tests remain critical to understanding resistance, but require highly specialized and centralized laboratory facilities, and ultimately have not been broadly transferrable to LMICs.
More commonly, indirect tests that rely on the sequence-based detection of mutations associated with HIVDR are used to infer resistance to ARV drugs [12]. Prediction of resistance from genotyping assays is thus dependent on interpretation algorithms, which are derived from associations between sequence variation and drug exposure, phenotypic susceptibility, and/or clinical outcome data [13]. The availability of algorithms to interpret sequence results, and the comparatively advantageous cost of sequencing compared to phenotypic tests, has resulted in a rapid uptake of genotype testing in many countries. While interpretive algorithms for nucleoside RT inhibitors (NRTIs), NNRTIs and protease inhibitors (PIs) are robust and built upon large datasets, the relatively small number of individuals who have failed ART containing integrase (IN) strand transfer inhibitors (INSTIs), especially in LMICs where non-B HIV-1 subtypes predominate [14], make the interpretive algorithms for INSTIs much less robust or complete.
The potential applications of HIVDR testing include surveillance, research, or individual patient clinical management. While HIVDR testing for surveillance is broadly used in LMICs, the cost and complexity of the test has hampered its applicability for individual clinical management. However, new technologies offering the potential for reduced cost per test, greater simplicity and/or near point of care implementation could be important breakthroughs in the near future. Large amounts of HIVDR testing data can also be useful for the development of computational models for prediction of treatment outcomes without genotypic test results because of restricted availability of laboratory testing in LMICs [15].
Several reviews on resistance testing and sequencing technologies in LMICs have been published previously [16, 17]. However, since these publications, treatment paradigms have transitioned to new ARV regimens based on INSTIs instead of NNRTIs, and changes in some of the underlying testing technologies have occurred. Metzner [17] has published a particularly relevant recent review with a focus on the requirements for an optimal genotypic HIV DR assay based on NGS sequencing.
The aim of this review is to provide a description of the potential demand for HIVDR tests in LMICs, to summarize the characteristics (including regulatory status), advantages and limitations of available HIVDR testing strategies, and to describe promising technologies in development. The review focuses on HIVDR testing relevant for commonly used ARV drug classes (NRTIs and NNRTIs, PIs, and INSTIs) and on mutations which occur in the related target regions of the HIV-1 pol gene.
Methods
To estimate the potential number of HIVDR tests required in LMIC, we relied on two use case descriptions recently developed by WHO [18]. The first use case applies to patients failing ART regimens including an INSTI (likely to be predominantly dolutegravir, DTG). This includes patients who may have had prior treatment experience with NNRTI-based regimens, and children who may have initiated ART with a PI/r- based regimen but switched to abacavir/lamivudine/DTG for reasons other than treatment failure. The second use case is for more treatment-experienced patients, such as those with a history of treatment failure of regimens including an INSTI or an NNRTI as well as a regimen including a PI/r. Historically, this corresponds to “second line” failures in adults, with DR test results being used to optimize third-line ART. It also includes children with prior exposure to NNRTI-based prevention interventions (in the mother or the child) who subsequently fail a boosted protease inhibitor (PI/r)-based regimen. In both use cases, the results from the test can be used to identify patients most likely to benefit from a treatment change (i.e., those with detectable resistance), and to design the optimal next regimen.
The number of people on ART in LMIC, and the proportions with suppressed viral load, were obtained from UNAIDS (https://aidsinfo.unaids.org). The proportion of treated patients receiving DTG and the number of patients receiving PI/r-based second line ART were obtained from the Clinton Health Access Initiative (CHAI) 2022 HIV Market Report [20]. Other sources of information involved in the calculations are described below. Calculations were performed for adults (>15 years old) and children (0–14 years old) separately, since estimates of the proportion on DTG and proportion with elevated viral load are different. Numbers were rounded to the nearest 100 for simplicity. Calculations and assumptions about numbers and proportions of patients meeting use case criteria are those of the authors, and do not represent the views or positions of WHO or CHAI.
To describe the landscape of HIVDR tests, either available or in advanced development, we used a mixed-method approach including a review of (i) published literature (PubMed) and pre-prints (Google Scholar), (ii) abstracts presented at scientific meetings which appeared in Google Scholar since 2015 (iii) diagnostic company websites (including Roche, Abbott, Cepheid, Vela, LabCorp, Quest Diagnostics, Advanced Biological Laboratories, ThermoFisher, Illumina, Oxford Nanopore, Pacific Biosciences, and Aldatu), and (iv) unscripted key informant one-on-one interviews with known developers of HIVDR test kits to explore their research and development plans. Information was gathered between June 2021 and August 2022.
The types of HIVDR tests covered were categorized as follows: (1) sequencing of “bulk” DNAs produced by RT-PCR amplification (including Sanger and dye-primer sequencing); (2) “next generation” sequencing; and (3) point mutation assays. Tests were further grouped within each category based on their regulatory status: approved by US Food and Drug Administration (FDA) or conformité européenne in vitro diagnostic (CE-IVD), research use only (RUO), and “in-house” or lab-developed tests.
Findings
HIVDR testing in low- and middle-income countries: A market assessment
Potential market size for use case 1.
Using estimates of numbers of people living with HIV (PLHIV) who are receiving ART, an approximation of the percentage of ART regimens that include DTG and of people with viral load over 1000 copies/mL, we calculated the number of people receiving DTG with elevated viral load who might be considered eligible for DR testing (Fig 1). Before a switch in ART regimen is undertaken in LMICs, patients are recommended to be assessed for adherence (often through a package of interventions referred to as enhanced adherence counselling or EAC). Thus, the last component of the DR testing market size is the proportion of DTG-treated patients with viral load over 1000 copies/mL who do not re-suppress after EAC. Very few data have been published in this regard. One post-hoc analysis of patients receiving DTG with VL > 1000 copies/mL after 48 weeks of treatment reported that 12 of 15 (80%) had VL < 1000 copies/mL after adherence counselling [19]. This parameter is likely to change with further research and monitoring, and so the calculations below are subject to revision when additional information is available. Using this preliminary estimate of 20% not re-suppressing, we were able to calculate the numbers of patients meeting the WHO definition of treatment failure in each geographic region for 2021 (Table 1). Globally, the number of patients with confirmed treatment failure as defined by WHO is approximately 2% of the number on ART. In subsequent years, it is likely that the number of PLHIV on ART, as well as the percentage on DTG, will increase. From 2018 to 2021, the number of people on ART increased by an average of between 5 and 10% per year in different regions. The percentage of adults on DTG is expected to rise to 88% in 2023 [20]. The percentage of children on DTG is expected to increase rapidly in the coming years, possibly reaching over 90% by 2024 [20]. These two increases, and a projected increase in the total number of PLHIV on ART, would lead to a 36% increase in the total number with confirmed treatment failure compared to 2021.
PLHIV: people living with HIV. ART: antiretroviral therapy. DTG: dolutegravir. CHAI: Clinton Health Access Initiative. EAC: enhanced adherence counselling.
Potential market size for use case 2.
To approximate the number of people who meet this use case definition, the estimated number of adults on second line ART, and the total number of children on ART, were multiplied by the estimated proportion using PI/r-based regimens (Table 2). Since the treatment landscape is evolving, it is challenging to predict how these numbers and proportions will change over time. For example, since initial ART is likely to be based on DTG and the confirmed failure rate is expected to be much lower than historical averages from experience with NNRTI-based ART, the proportion of patients on second line ART should decrease over time. At the same time, the absolute number of patients on DTG is likely to increase. Also, since patients failing an NNRTI-based regimen will likely be prescribed DTG, the proportion of regimens that are based on PI/r should decrease. Given the very large uncertainty about trends over time, no attempt has been made to project the numbers for Use Case 2 beyond what it might have been in 2021 (Table 2).
Combining the estimated maximum market size for both use cases gives a total of 457,700 tests per year. However, it should be noted that the specifications for the test used may differ between use cases, for example based on whether or not the protease (PR) region is included.
Methods of testing for HIV drug resistance
Bulk sequencing
Historically, the mainstay of HIVDR testing has been Sanger-based sequencing methods, as well as dye-primer approaches, which were first developed and validated “in-house” by academic research groups and subsequently adapted into kits for sale by commercial entities. This approach involves the amplification of viral RNA mainly from a patient plasma sample to produce a population of DNA products reflecting the regions of interest from the viral population in the specimen. The sequencing of this “bulk” viral population is then performed through the use of dye-labeled terminating dideoxy-nucleotides (Sanger sequencing) [21] or dye-labeled primers [22].
TRUGENE.
The Visible Genetics TRUGENE test kit was approved by the US FDA in April 2002. It was based on the use of dye-labeled primers and consisted of the reagents, hardware, and software necessary to generate test results. This was a milestone in HIV resistance testing, because its approval included evidence from randomized clinical trials that there was both short term [23] and longer term [24] benefit to patients from using genotype guided treatment decisions. However, following commercialization by the original developer Visible Genetics, as well as licensees Bayer and Siemens, production of the test was discontinued in 2014.
ViroSeq.
The Applied Biosystems (ABI) ViroSeq kit was approved by the US FDA in December 2002. It included viral nucleic acid extraction, amplification, and sequencing reagents and interpretation software [25]. The kit was validated for use on ABI 3130/3130xl automated sequencers made by ABI. ViroSeq was discontinued in late 2021, concomitant with the end of the manufacturer’s support for the ABI 3130/3130xl instrument. To date, no replacement product for ViroSeq has been produced, and the current manufacturer (Abbott) has not disclosed whether it will develop alternative HIV drug resistance tests.
HIV-1 genotyping kit.
Thermo Fisher offers an HIV genotyping kit on a RUO basis; that is, not for individual patient management. The kit is based upon an assay developed at the US Centres for Disease Control [26], and is progressively becoming relatively popular in LMICs. The genotyping kit incorporates manufacturing standardization and product quality control. Starting from extracted HIV RNA, the kit includes modules for RT-PCR of the pol gene and sequencing on one of the Thermo Fisher sequencing platforms (Table 3). While the kit itself stops at the generation of raw sequence data, the company recommends basecalling with the Exatype [27] (Hyrax Biosciences) or ReCall [28] software to generate a consensus sequence, followed by HIVDR interpretation with the Stanford HIVdb algorithm (also integrated into the Exatype software). Use of this kit requires users to develop and validate their own RNA extraction procedures. The original kit encompassed codons 6–99 in the PR region and codons 1–251 in the RT region of the pol gene. Both plasma and dried blood spots were evaluated, considerably extending the utility of the assay in LMIC. In mid-2022, a new version of the genotyping kit including IN became available.
Other potential developers.
Other test developers with potential interest in this area include Roche Molecular Systems and Cepheid. Roche, however, confirmed that it does not have short term plans to develop HIV drug resistance tests, and Cepheid had not yet responded by the time this report was written.
Lab-developed genotypic tests.
Generally, tests performed in research laboratories do not have regulatory approval for use in individual patient management in North America or Europe. As such, they are usually less expensive and more adaptable than kit-based sequencing methods, but inherently lack some of the standardization and quality control that manufactured kits provide. Some laboratory-developed tests that are based on Sanger sequencing and are performed in large central testing laboratories (i.e., requiring specimen transport to centralized locations such as those managed by LabCorp or Quest in the United States) have been extensively validated and approved by clinical laboratory regulatory agencies.
Thermo Fisher Scientific manufactures the most commonly used ABI DNA sequencers used for HIVDR testing. These are automated Sanger sequencing instruments based on capillary electrophoresis and include several different instrument models (e.g., models 3130, 3500, 3730, SeqStudio). Support for the smaller scale 3130 instrument is being discontinued, leaving only the more expensive 3500 and 3730 models, which range from 8 to 96 capillaries, and the SeqStudio platform. The advantages of the Sanger sequencing approach include the one-to-one correspondence between a sequencing lane and a sample (i.e., no “barcodes” are required) and the wealth of experience with the platform. Read lengths of individual sequences can be up to ~800 bases, and the sensitivity for detection for low abundance variants is approximately 20%. Sanger sequencing is particularly suitable where low-to-medium throughput is required with relatively small batch sizes. This, as well as the relatively large pre-existing base of ThermoFisher/ABI sequencers in the field, experienced users, and the availability of software which can process their data has led to their usage in most of the LMICs with capacity to perform HIVDR testing. The World Health Organization (WHO) has published recommendations for sequencing assay validation and minimum requirements for laboratories that perform sequencing in support of HIVDR surveillance [29].
“Next generation” sequencing approaches
“Next generation” and even “third generation” sequencing (“NGS”) has replaced Sanger sequencing in many laboratories for many pathogens, although usually not for HIVDR. NGS uses parallel testing of a large number of templates to produce a vast amount of sequencing data at a low cost per base obtained (but not necessarily per sample tested). Many individual samples can be tested simultaneously by pooling samples (usually using molecular “barcodes” to identify each sample)–for example as many as 1000 samples on a single MiSeq run [30]. The use of unique molecular identifiers (UMIs, also known as “primer IDs”) in addition to the sample barcodes at the reverse-transcription step allows for the accurate quantification of the proportion of each individual variant [30]. Several publicly available and web-based bioinformatics pipelines specifically designed for the analysis of HIVDR have been described, and a special journal supplement was recently dedicated to discussing these methods [31].
Scaling up testing to handle large numbers of samples at once on Illumina instruments is straightforward due to the large capacity of these machines. For example, NGS sequencing of the SARS-CoV-2 genome [32] demonstrated that it is technically feasible to produce millions of consensus sequences from a small viral genome in a short time. Theoretically, a single Illumina NovaSeq 6000 (capable of producing up to 20 billion sequencing reads in under 24 hours), coupled with automated sample handling and data processing could easily handle the entire world’s HIVDR sequencing needs. However, these large-scale instruments are extremely expensive and require considerable technical expertise to operate. Thus, this approach would be most useful in use cases where centralization–or extreme centralization—of testing is desired.
SENTOSA SQ.
The SENTOSA SQ HIV-1 Genotyping Assay (Vela Diagnostics) can detect mutations in HIV-1 Group M RNA (Table 4). It is the only FDA-approved test currently on the market and is the first such test to use NGS for HIV DR [33–35]. This is a highly integrated and automated system which includes extraction, amplification, barcoding, and library construction using robotic pipetting, and sequencing based on a specialized Ion Torrent sequencer known as the Sentosa SQ301. The SENTOSA SQ assay has its own analysis pipeline, including a susceptibility report that uses three HIVDR interpretation algorithms (Stanford HIVdb, ANRS, and REGA). It has been used to sequence both subtype B and non-B viruses(personal communication), and HIV proviral DNA, but to date it has not been widely used in LMICs [33–35]. The HIV RNA resistance testing system is FDA approved (Version 1) and a version 2 will soon be submitted for European approval. Despite reported concerns about relatively high cost per sample, and turnaround time [35], resistance data can be used to inform individual patient care.
DeepChek.
Advanced Biological Laboratories (ABL) produces an HIV genotyping assay for PI, NRTI, NNRTI and INSTI resistance using Sanger technology as well as a separate assay using Illumina-based sequencing (Tables 3 and 4). These assays as well as the related software (“DeepChek”) are CE-marked to allow automated analysis and resistance interpretation of NGS or Sanger data. More recently, a whole genome sequencing method for HIV was described using a scaled-down Illumina sequencer [36]. Although it is not clear that the entire HIV genome needs to be sequenced for current ARVs (or how to interpret mutations outside the target regions), the development of ARVs that target regions outside of pol may make this approach attractive in the future.
Lab-developed NGS tests.
Illumina sequencing. The majority of NGS for HIVDR genotyping has been performed using laboratory-developed assays, especially on the mid-scale Illumina MiSeq model (~25 million reads per run). These are massively parallel, short-read (e.g., 150 bp) sequencing devices. The millions of generated reads require complex bioinformatic pipelines to assess, filter, map and align into a final consensus sequence. Illumina-based NGS can detect HIV variants present in low abundance, which is likely most relevant for characterizing NNRTI resistance [37]. While good concordance has been demonstrated between Illumina and Sanger sequencing for the most abundant variants in a given sample, at the lower ranges of variant abundance (e.g. below 5%), processing of the same raw data by three different software packages can lead to discordant results [38].
While Illumina sequencers may account for the vast majority of DNA sequencing data generated worldwide, they have had less of an impact on HIVDR genotyping as a routine test, primarily because the short length of HIV requires relatively little actual sequencing. Scaling the technology down to sequence a small number of samples in a cost-effective manner has been problematic. The Illumina sequencer is coupled with a large demand for bioinformatics processing (not yet standardized) and data storage which can further complicate its applicability in LMICs. There are also significant issues with training, logistics, standardized quality control and other practical issues. Illumina does not appear to have plans to develop its own HIV DR testing kit.
Ion torrent. The Ion Torrent sequencing platform (ThermoFisher) works on a different principle than Illumina sequencers, but also provides massively parallel sequencing capacity. In this approach, barcoded PCR product libraries are clonally amplified on capture beads using “emulsion PCR” to generate single-template substrates that are used for sequencing on semiconductor chips. Recently, a new assay has been described using this platform which includes not only the PCR product generation but also includes a freely available “end-to-end” analysis and reporting software [39]. A total of 17 PCR amplicons are produced in two independent amplification pools, allowing redundant coverage of almost every major resistance-associated position in HIV PR, RT, and IN. This combination of wet-lab, sequencing hardware and software was shown to have greater than 98% sensitivity and specificity relative to the ViroSeq Sanger-based comparator [39]. The sequences of the primers used were not disclosed by the authors, but they can be obtained from ThermoFisher.
Pacific biosciences. Pacific Biosciences (“PacBio”) makes DNA sequencers that use a novel technology enabling it to sequence long strands of DNA—for example the entire HIV genome—in a single read [40]. This approach could be of use particularly where mutation linkage information is required, if resistance to drugs other than PIs, NRTIs, NNRTIs or INSTIs are of interest, or if one is investigating contributions of regions outside of pol to HIVDR. Initial attempts to use this platform for HIV DR tests showed the individual reads from early PacBio systems were relatively inaccurate [41]. Recent improvements including the Single Molecule, Real-Time (SMRT) Sequencing and the Sequel II System allow >99% single molecule read accuracy, while still providing long reads. This platform demonstrated an ability to discern low-abundance variants in the HIV pol gene [42]. The platform is currently not widely used for HIVDR testing in LMICs in part because of its relatively high instrument costs (>$500,000). This cost may restrict its implementation to well-resourced countries, and to very centralized facilities, since (as for the Illumina platform) the high capital investment can be offset by the large amount of data which can be produced. Pacific Biosciences might develop its own HIVDR testing kit, although this plan is still to be confirmed (personal communication).
A laboratory-developed HIVDR test called HIV incidence and drug resistance assay (HIDA) was recently described by researchers at the University of Southern California. HIDA tags individual reverse-transcribed molecules with a “barcode” or “Unique Molecular Index” (UMI), followed by amplification of HIV pol or env sequences segregated into microdroplet compartments and then separately amplified and sequenced using long read sequencing [43]. These long-read sequences were obtained using SMRT sequencing on the PacBio Sequel II system. The detection limit for low abundance variants was reported to range between 2.5–10%, and linkage between mutations on the same genome could be determined. The advantages of this approach include the ability to accurately quantify individual variants using UMIs, coupled with long individual sequence reads. The data generated for diversity of variants in a sample can also be used as an indicator of the duration of infection [43], which may be useful in epidemiological surveillance and incidence studies. The assay is being commercialized, with the potential for future regulatory approval. The high equipment costs required for the assay (PacBio sequencing machine in addition to a BioRad QX20 microdroplet generator) suggest that it would be more appropriate for a centralized testing approach.
Oxford nanopore. Oxford Nanopore Technologies have both large and small, portable sequencing systems available. The smaller, palm-sized “MinIon” sequencer has a low upfront cost (~$5000) and is marketed to run on any desktop or laptop computer. This mobile approach has been used in tracking the Ebola outbreak in West Africa [44], and more recently in the COVID-19 pandemic [45].
In nanopore sequencing, a nucleic acid library is prepared using one of several kits in which a proprietary adaptor is ligated onto the nucleic acid molecules. The library is then loaded onto a flow cell array containing an electro-resistance membrane with embedded protein nanopores. An electrical current is applied across the flow cell array, and the electric current for each pore is recorded using a series of channels and sensor chips under conditions where nucleic acids pass through the nanopores at a defined rate. As the nucleic acids pass through the pore, an electrical current is disrupted in a sequence-specific manner which can be decoded to determine the DNA or RNA sequence.
One advantage of nanopore sequencing technology is the ability to sequence in real time. Within minutes of loading a nucleic acid library onto the sequencer, molecules are analyzed and can be resolved into individual reads. Bioinformatic software can be initialized to filter, map and align individual reads to a target reference for real-time detection of a pathogen such as HIV-1 or SARS-CoV-2. When combined with the portability of the sequencing device, point of care (POC) or near-POC HIVDR testing is possible. The length of sequencing reads can also be adjusted to balance data throughput against other factors including data storage and utility. While the portability of the MinIon (and smaller scale options in development) make this an attractive option for small scale sequencing, the company also supplies larger scale equipment (such as the Promethion) which would be more appropriate for centralized testing.
Nanopore technology still faces several challenges and limitations to its widespread adoption. Wide variation in sequencing accuracy particularly in regions with homopolymeric sequences and error rates have limited its use in the past. Given that some of the most relevant resistance-associated mutations for HIV are in homopolymeric regions (e.g., K65R and K103N in RT), this limitation appeared to disqualify nanopore sequencing as a viable method for HIVDR testing. However, continued improvements in the technology have been reported to result in higher accuracy, and newer approaches to further improve the homopolymeric sequence accuracy may improve the utility of this technology for HIVDR testing. Accuracy up to 99.6% (mode) for individual reads have been reported [46]. In addition, the company supplies a “field sequencing kit”, with many of the reagents supplied in lyophilized form that are stable at ambient temperatures for extended periods. The stability of the components makes it ideal for use in settings where access to cold storage may be limited.
Despite the clear advantages of the portability of the device, basecalling of raw nanopore data remains computationally expensive and requires a powerful graphics processing unit to ensure completion of basecalling by the end of a sequencing run. Most laptop computers lack the processing power to ensure timely basecalling, and Oxford Nanopores’ own portable Mk1C MinIon device may still require hours or even days after sequencing itself has completed, depending on how much data is collected. Simplified, complete bioinformatic processing of nanopore data for HIVDR testing would be required for broad uptake [47].
Point mutation assays
Several HIVDR kits that are not based on sequencing are also in development. Most of these kits are potentially deployable at or near the POC, which would be extremely useful in settings where access to standard genotypic testing is limited. Such a test would be particularly useful in conjunction with or as a reflex from POC HIV viral load tests [48], especially if minimal sample handling were required and rapid turnaround possible. None of the point mutation assays described below have been approved for clinical use by US FDA or CE authorities.
Oligonucleotide ligation assay (OLA) and vOLA.
OLA is a point mutation detection assay based on selective oligonucleotide ligation developed by researchers at the University of Washington [49]. The OLA-simple kit was developed to detect mutations associated with resistance to certain NRTIs and NNRTIs in HIV-1 subtypes A, B, C, D, and CRF01_AE (Table 5). The kit uses dried reagents to facilitate assay setup, lateral flow devices for visual detection, and in-house software with an interface for guiding analysis of results [49]. This test has been investigated in field studies in Kenya [50] and Mexico [51]. A newer iteration of OLA under development (“vOLA”) includes a POC viral load assay coupled with a reflex option for the detection of DR variants (personal communication).
Pan Degenerate Amplification and Adaptation (PANDAA) qDx HIVDR RTI.
The PANDAA qDx HIVDR RTI resistance testing kit from Aldatu Biosciences (Boston, MA) is a real-time, allele-specific PCR based assay which detects the K65R, K103N, V106M, Y181C, M184V/I and G190A mutations in the RT region of the pol gene (Table 5). The PANDAA assay incorporates degenerate primers with fixed-sequence adaptor regions that overlap with the probe-binding site to account for the fact that viral sequences surrounding the target mutations being queried can also vary [52]. These variations greatly complicate the design of traditional allele-specific PCR assays. The kit design is based on a batch size of 96 samples (including controls) using a real-time quantitative PCR machine, and therefore may be best suited to centralized laboratory testing facilities, especially where these instruments already exist. The advantages of this assay are speed (1–2 hours), a relatively simple and familiar procedure for experienced laboratory technicians, and an automated analysis step. The target viral load ranges from 2000 to 750,000 HIV RNA copies/mL. The speed advantage is somewhat negated by the need to transfer samples to a centralized laboratory, but the simplified workflow is a distinct advantage. Versions of the PANDAA assay have been used in both treatment naïve [53] and treatment-experienced individuals [53, 54], and a recent comparison in Zimbabwe [53] and Botswana [55] showed good agreement with Sanger sequencing results. PANDAA qDx HIVDR RTI is available for RUO applications.
ANRS near point of care.
The ANRS near POC diagnostic test [56] was developed at the University of Montpellier and combines sequence-specific primer extension with a lateral flow DNA microarray strip, allowing visual detection of HIVDR mutations in a short turnaround time (< 5 hours). To date, there has been a “proof of concept” study published on this approach, examining two NNRTI resistance associated mutations K103N and Y181C [56]. The visual detection step does not require specialized equipment, which is an advantage, but does seem to introduce a level of subjectivity.
Insilixa.
Insilixa provides a platform for the large-scale identification of variant sequences using an array of surface-bound oligonucleotide probe sets, with a solid-phase melting curve analysis used to distinguish bound variants. In one study of different NNRTI mutations at HIV RT codon 103, it was able to detect low-abundance variants present at a proportion of ≥10% [57]. A particular strength of this platform is the ability to multiplex up to several hundred probes at a time (to account for the large amount of HIV sequence variation surrounding drug resistance sites both within and across HIV subtypes) and can still support POC deployment. In addition to detecting resistance this approach could potentially also simultaneously perform HIV viral load assessments [57]. This approach could have particular advantages where complete sequence data are not required.
In addition to the assays listed above, there are other approaches to detect DR-associated mutations which have been proposed, but whose current status is unknown or no longer under active development. These include a heteroduplex mobility assay [58], MALDI-TOF [59] and an eclectic range of different allele-specific PCR approaches.
An overview of the timeline of development and availability of all the HIV DR testing methods described above is presented in Fig 2.
OLA: Oligonucleotide ligation assay. PANDAA: Pan-Degenerate Amplification and Adaptation. RUO: research use only. FDA: Food and Drug Administration. CE: conformité européenne.
Discussion
This review summarises the landscape of technologies available for HIVDR testing for PIs, RTIs, and INSTIs. As indicated in Tables 1 and 2, there are approximately half a million individuals in LMICs who are expected to meet criteria for HIVDR every year according to WHO-defined Use Case 1 (after failure of a DTG-containing regimen) or Use Case 2 (after failure of multiple regimens including PI/r-based ART). In the future, additional use cases for HIVDR testing may be defined as ART treatment and prevention recommendations evolve. For example, the possibility of the development of INSTI resistance in the rare cases of HIV infection in people using long-acting cabotegravir for pre-exposure prophylaxis [60–62] could increase the forecasted number of DR tests that include integrase.
No current testing method can be considered ideal in every circumstance for meeting these use cases. The increasing usage of INSTI based ART in many LMICs has resulted in the decreased utility of assays assessing exclusively NRTI and/or NNRTI inhibitor resistance. Sanger-based sequencing is currently the most widespread technology in LMICs, but it is expected to be eventually replaced by NGS methods. These newer methods could be centralized and scaled up, but currently there is a lack of the required (expensive) equipment, expertise, and supply chains in LMICs, making this a challenging approach for resistance testing in many countries. The Oxford Nanopore system could potentially be used in a more mobile, scaled-down fashion, but currently requires more optimization to be used for routine HIVDR testing.
The number of test kits which could be used in clinical centres worldwide that are approved by main regulatory bodies (such as the US FDA and CE-IVD) is relatively small, and two of the previously available, approved kits have been discontinued. Such tests are more expensive than laboratory-developed tests, limiting their use in LMICs. However, it is important to note that the use of laboratory-developed tests for surveillance or patient management requires significant time and expense for validation, documentation, troubleshooting, batch validation, assay development and ongoing quality control. Therefore, reported costs per sample for laboratory-developed assays cannot be directly compared to kit-based test costs. Point mutation assays also apply genotypic approaches but have the inherent limitation that they can only detect known resistance-associated mutations, mostly related to NRTIs and NNRTIs. As most countries have or are transitioning to INSTIs, this constraint limits their use to fewer settings.
Finally, it is worth considering that some mutations which may be relevant for resistance may not be detected by any of the testing methods currently available if these lie outside the pol gene. Furthermore, there are other ARV drugs either available or soon to be available–including fostemsavir, lenacapavir and others—which have entirely different mechanisms of action and for which there are no widespread testing kits or protocols. These other drugs are certainly out of scope for most current global use cases, but this could change in the future.
Conclusions
This review has informed the WHO’s process of developing a Target Product Profile (TPP) for HIVDR tests for use in individual patients. The aim of the TPP is to guide diagnostic product development efforts with regard to essential (minimal) and optimal product requirements, and can ensure alignment of objectives across stakeholders, accelerate development timelines, minimize development risks, and eventually lead to an optimal product that meets user needs in different situations. Ideal HIVDR tests would require simpler and cheaper sample collection and storage matrices, simplified sample processing, heat-stable reagents, simpler sequencing, workflows which capture PR, RT, and IN (or the whole genome) without additional labor. These would require seamless data analyses, and cost-effectively scale from testing a few samples at a time to testing many thousands at once.
Despite the availability of several HIVDR testing methods, their use in LMICs is limited by financial and programmatic constraints, including lack of expertise on the use and interpretation of the test, and in some instances by the limited applicability in a changing treatment landscape. More research and investment are needed to develop a HIVDR test meeting WHO specifications and adapted to LMICs.
Acknowledgments
We are grateful to Zach Panos at CHAI for discussions about the market size estimates. The authors would particularly like to thank those individuals who took the time to discuss their technologies.
References
- 1. Larder B, Darby G, Richman D. HIV with reduced sensitivity to zidovudine (AZT) isolated during prolonged therapy. Science. 1989;243: 1731–1734. pmid:2467383
- 2. Kuritzkes DR, Quinn JB, Benoit SL, Shugarts DL, Griffin A, Bakhtiari M, et al. Drug resistance and virologic response in NUCA 3001, a randomized trial of lamivudine (3TC) versus zidovudine (ZDV) versus ZDV plus 3TC in previously untreated patients. AIDS. 1996;10: 975–981. pmid:8853730
- 3. Gupta RK, Jordan MR, Sultan BJ, Hill A, Davis DH, Gregson J, et al. Global trends in antiretroviral resistance in treatment-naive individuals with HIV after rollout of antiretroviral treatment in resource-limited settings: a global collaborative study and meta-regression analysis. Lancet. 2012;380: 1250–1258. pmid:22828485
- 4.
World Health Organization. WHO HIV drug resistance report 2012. WHO, editor. Geneva, Switzerland; 2012. Available from: http://apps.who.int/iris/bitstream/10665/75183/1/9789241503938_eng.pdf (accessed April 22, 2023)
- 5.
World Health Organization(WHO); HIV drug resistance report 2021. 2021. Available from: https://www.who.int/publications/i/item/9789240038608 (accessed April 22, 2023)
- 6. Macdonald V, Mbuagbaw L, Jordan MR, Mathers B, Jay S, Baggaley R, et al. Prevalence of pretreatment HIV drug resistance in key populations: a systematic review and meta-analysis. J Int AIDS Soc. 2020;23: e25656. pmid:33369131
- 7. Phillips AN, Stover J, Cambiano V, Nakagawa F, Jordan MR, Pillay D, et al. Impact of HIV Drug Resistance on HIV/AIDS-Associated Mortality, New Infections, and Antiretroviral Therapy Program Costs in Sub–Saharan Africa. The Journal of Infectious Diseases. US; 2017. pp. 1362–1365. pmid:28329236
- 8. Leclercq R, Cantón R, Brown DFJ, Giske CG, Heisig P, MacGowan AP, et al. EUCAST expert rules in antimicrobial susceptibility testing. Clin Microbiology and Infection 2013;19: 141–160. pmid:22117544
- 9. Berkow EL, Lockhart SR, Ostrosky-Zeichner L. Antifungal Susceptibility Testing: Current Approaches. Clin Microbiol Rev. 2020;33. pmid:32349998
- 10. Hertogs K, de Béthune MP, Miller V, Ivens T, Schel P, Van Cauwenberge A, et al. A rapid method for simultaneous detection of phenotypic resistance to inhibitors of protease and reverse transcriptase in recombinant human immunodeficiency virus type 1 isolates from patients treated with antiretroviral drugs. Antimicrob Agents Chemother. 1998;42: 269–276. pmid:9527771
- 11. Petropoulos CJ, Parkin NT, Limoli KL, Lie YS, Wrin T, Huang W, et al. A novel phenotypic drug susceptibility assay for human immunodeficiency virus type 1. Antimicrob Agents Chemother. 2000;44: 920–928. pmid:10722492
- 12. Brun-Vézinet F, Costagliola D, Khaled MA, Calvez V, Clavel F, Clotet B, et al. Clinically validated genotype analysis: guiding principles and statistical concerns. Antivir Ther. 2004;9: 465–478. pmid:15456077
- 13. Shafer RW. Rationale and uses of a public HIV drug-resistance database. J Infect Dis. 2006;194. pmid:16921473
- 14. Hemelaar J, Elangovan R, Yun J, Dickson-Tetteh L, Fleminger I, Kirtley S, et al. Global and regional molecular epidemiology of HIV-1, 1990–2015: a systematic review, global survey, and trend analysis. Lancet Infect Dis. 2019;19: 143–155. pmid:30509777
- 15. Revell AD, Wang D, Perez-Elias M-J, Wood R, Cogill D, Tempelman H, et al. 2021 update to HIV-TRePS: a highly flexible and accurate system for the prediction of treatment response from incomplete baseline information in different healthcare settings. J Antimicrob Chemother. 2021;76: 1898–1906. pmid:33792714
- 16. Manyana S, Gounder L, Pillay M, Manasa J, Naidoo K, Chimukangara B. HIV-1 Drug Resistance Genotyping in Resource Limited Settings: Current and Future Perspectives in Sequencing Technologies. Viruses. 2021;13. pmid:34208165
- 17. Metzner KJ. Technologies for HIV-1 drug resistance testing: inventory and needs. Curr Opin HIV AIDS. 2022;17: 222–228. pmid:35762377
- 18.
World Health Organization. Target product profile for HIV drug resistance tests in low- and middle-income countries: Africa. 2023. Available from: https://www.who.int/publications/i/item/9789240076662
- 19. Pepperrell T, Venter WDF, Moorhouse M, McCann K, Bosch B, Tibbatts M, et al. Time to rethink endpoints for new clinical trials of antiretrovirals? Long-term re-suppression of HIV RNA with integrase inhibitors. AIDS (London, England). England; 2020. pp. 321–324. pmid:31876594
- 20.
Clinton Health Access Initiative. 2022 HIV Market Report: The state of the HIV market in low- and middle-income countries. 2022. Available from: https://www.clintonhealthaccess.org/report/2022-hiv-market-report-the-state-of-the-hiv-market-in-low-and-middle-income-countries/ (accessed December 19, 2022)
- 21. Sanger F, Nicklen S, Coulson AR. DNA sequencing with chain-terminating inhibitors. Proc Natl Acad Sci U S A. 1977;74: 5463–5467. pmid:271968
- 22. Smith LM, Sanders JZ, Kaiser RJ, Hughes P, Dodd C, Connell CR, et al. Fluorescence detection in automated DNA sequence analysis. Nature. 1986;321: 674–679. pmid:3713851
- 23. Durant J, Clevenbergh P, Halfon P, Delgiudice P, Porsin S, Simonet P, et al. Drug-resistance genotyping in HIV-1 therapy: the VIRADAPT randomised controlled trial. Lancet (London, England). 1999;353: 2195–2199. pmid:10392984
- 24. Clevenbergh P, Durant J, Halfon P, del Giudice P, Mondain V, Montagne N, et al. Persisting long-term benefit of genotype-guided treatment for HIV-infected patients failing HAART. The Viradapt Study: week 48 follow-up. Antivir Ther. 2000;5: 65–70. pmid:10846595
- 25. Eshleman SH, Crutcher G, Petrauskene O, Kunstman K, Cunningham SP, Trevino C, et al. Sensitivity and specificity of the ViroSeq human immunodeficiency virus type 1 (HIV-1) genotyping system for detection of HIV-1 drug resistance mutations by use of an ABI PRISM 3100 genetic analyzer. J Clin Microbiol. 2005;43: 813–817. pmid:15695685
- 26. Zhou Z, Wagar N, DeVos JR, Rottinghaus E, Diallo K, Nguyen DB, et al. Optimization of a low cost and broadly sensitive genotyping assay for HIV-1 drug resistance surveillance and monitoring in resource-limited settings. PLoS One. 2011;6: e28184. pmid:22132237
- 27. Kingwara L, Karanja M, Ngugi C, Kangogo G, Bera K, Kimani M, et al. From Sequence Data to Patient Result: A Solution for HIV Drug Resistance Genotyping With Exatype, End to End Software for Pol-HIV-1 Sanger Based Sequence Analysis and Patient HIV Drug Resistance Result Generation. J Int Assoc Provid AIDS Care. 2020;19: 2325958220962687. pmid:32990139
- 28. Woods CK, Brumme CJ, Liu TF, Chui CKS, Chu AL, Wynhoven B, et al. Automating HIV drug resistance genotyping with RECall, a freely accessible sequence analysis tool. J Clin Microbiol. 2012;50: 1936–1942. pmid:22403431
- 29.
World Health Organization. WHO/HIVResNet HIV drug resistance laboratory operational framework-second edition. 2020. Available from: https://www.who.int/publications/i/item/978-92-4-000987-5 (accessed April 22, 2023)
- 30. Lapointe H, Dong W, Lee GQ, Bangsberg DR, Martin JN, Mocello AR, et al. HIV Drug Resistance Testing by High-Multiplex “Wide” Sequencing on the Illumina MiSeq. Antimicrob Agents Chemother. 2015.
- 31. Kantor R. Next Generation Sequencing for HIV-1 Drug Resistance Testing-A Special Issue Walkthrough. Viruses. Switzerland; 2021. pmid:33671700
- 32.
Wellcome Sanger Institute. Sequencing COVID: our latest stats. 2021. Available from: https://sangerinstitute.blog/2021/02/05/sequencing-covid-our-latest-stats/ (accessed December 19, 2022)
- 33. Dessilly G, Goeminne L, Vandenbroucke A-T, Dufrasne FE, Martin A, Kabamba-Mukadi B. First evaluation of the Next-Generation Sequencing platform for the detection of HIV-1 drug resistance mutations in Belgium. PLoS One. 2018;13: e0209561. pmid:30596682
- 34. Raymond S, Nicot F, Carcenac R, Lefebvre C, Jeanne N, Saune K, et al. HIV-1 genotypic resistance testing using the Vela automated next-generation sequencing platform. J Antimicrob Chemother. 2018;73: 1152–1157. pmid:29444253
- 35. Raymond S, Nicot F, Abravanel F, Minier L, Carcenac R, Lefebvre C, et al. Performance evaluation of the Vela Dx Sentosa next-generation sequencing system for HIV-1 DNA genotypic resistance. J Clin Virol Off Publ Pan Am Soc Clin Virol. 2020;122: 104229. pmid:31809945
- 36.
Ardizzoni O, Naldi L, Bernard J, Deblir L, Gonzalez D, Boulme R, et al. Evaluation of a commercial assay whole genome HIV-1 using next-generation sequencing for the detection of HIV-1 drug resistance mutation. 32nd ECCMID Lisbon Portugal. 2022. Available from: https://www.ablsa.com/wp-content/uploads/2022/04/ECCMID-2022_2884_Evaluation-of-a-commercial-assay-whole-genome-HIV-1-using-next-generation-sequencing-for-the-detection-of-HIV-1-drug-resistance-mutations.pdf (accessed December 19, 2022)
- 37. Li JZ, Paredes R, Ribaudo HJ, Svarovskaia ES, Metzner KJ, Kozal MJ, et al. Low-frequency HIV-1 drug resistance mutations and risk of NNRTI-based antiretroviral treatment failure: a systematic review and pooled analysis. JAMA J Am Med Assoc. 2011;305: 1327–1335. pmid:21467286
- 38. Lee ER, Parkin N, Jennings C, Brumme CJ, Enns E, Casadellà M, et al. Performance comparison of next generation sequencing analysis pipelines for HIV-1 drug resistance testing. Sci Rep. 2020;10: 1634. pmid:32005884
- 39. Pyne MT, Simmon KE, Mallory MA, Hymas WC, Stevenson J, Barker AP, et al. HIV-1 Drug Resistance Assay Using Ion Torrent Next Generation Sequencing and On-Instrument End-to-End Analysis Software. J Clin Microbiol. 2022;60: e0025322. pmid:35699434
- 40. Huang C, Sam V, Du S, Le T, Fletcher A, Lau W, et al. Towards Personalized Medicine: An Improved De Novo Assembly Procedure for Early Detection of Drug Resistant HIV Minor Quasispecies in Patient Samples. Bioinformation. 2018;14: 449–454. pmid:30310253
- 41. Monaco DC, Zapata L, Hunter E, Salomon H, Dilernia DA. Resistance profile of HIV-1 quasispecies in patients under treatment failure using single molecule, real-time sequencing. AIDS. 2020;34: 2201–2210. pmid:33196493
- 42. Su B, Zheng X, Liu Y, Liu L, Xin R, Lu H, et al. Detection of pretreatment minority HIV-1 reverse transcriptase inhibitor-resistant variants by ultra-deep sequencing has a limited impact on virological outcomes. J Antimicrob Chemother. 2019;74: 1408–1416. pmid:30668734
- 43. Park SY, Faraci G, Murphy G, Pilcher C, Busch MP, Lee HY. Microdrop Human Immunodeficiency Virus Sequencing for Incidence and Drug Resistance Surveillance. J Infect Dis. 2021;224: 1048–1059. pmid:33517458
- 44. Quick J, Loman NJ, Duraffour S, Simpson JT, Severi E, Cowley L, et al. Real-time, portable genome sequencing for Ebola surveillance. Nature. 2016;530: 228–232. pmid:26840485
- 45. Freed NE, Vlková M, Faisal MB, Silander OK. Rapid and inexpensive whole-genome sequencing of SARS-CoV-2 using 1200 bp tiled amplicons and Oxford Nanopore Rapid Barcoding. Biol methods Protoc. 2020;5: bpaa014. pmid:33029559
- 46.
Oxford Nanopore Technologies. The power of Q20+ chemistry. Available from: https://nanoporetech.com/q20plus-chemistry (accessed December 19, 2022)
- 47. Wright IA, Delaney KE, Katusiime MGK, Botha JC, Engelbrecht S, Kearney MF, et al. NanoHIV: A Bioinformatics Pipeline for Producing Accurate, Near Full-Length HIV Proviral Genomes Sequenced Using the Oxford Nanopore Technology. Cells. 2021;10. pmid:34685559
- 48. Rhee SY, Jordan MR, Raizes E, Chua A, Parkin N, Kantor R, et al. HIV-1 Drug Resistance Mutations: Potential Applications for Point-of-Care Genotypic Resistance Testing. PLoS One. 2015;10: e0145772. pmid:26717411
- 49. Panpradist N, Beck IA, Vrana J, Higa N, McIntyre D, Ruth PS, et al. OLA-Simple: A software-guided HIV-1 drug resistance test for low-resource laboratories. EBioMedicine. 2019;50: 34–44. pmid:31767540
- 50. Panpradist N, Beck IA, Chung MH, Kiarie JN, Frenkel LM, Lutz BR. Simplified Paper Format for Detecting HIV Drug Resistance in Clinical Specimens by Oligonucleotide Ligation. PLoS One. 2016;11: e0145962. pmid:26751207
- 51. Panpradist N, Beck IA, Ruth PS, Ávila-Ríos S, García-Morales C, Soto-Nava M, et al. Near point-of-care, point-mutation test to detect drug resistance in HIV-1: a validation study in a Mexican cohort. AIDS. 2020;34: 1331–1338. pmid:32205723
- 52. MacLeod IJ, Rowley CF, Essex M. PANDAA intentionally violates conventional qPCR design to enable durable, mismatch-agnostic detection of highly polymorphic pathogens. Commun Biol. 2021;4: 227. pmid:33603155
- 53. Kouamou V, Manasa J, Katzenstein D, McGregor AM, Ndhlovu CE, Makadzange T. Diagnostic Accuracy of Pan-Degenerate Amplification and Adaptation Assay for HIV-1 Drug Resistance Mutation Analysis in Low- and Middle-Income Countries. J Clin Microbiol. 2020;58. pmid:32522826
- 54. Kouamou V, Ndhlovu CE, Katzenstein D, Manasa J. Rapid HIV-1 drug resistance testing in a resource limited setting: the Pan Degenerate Amplification and Adaptation assay (PANDAA). Pan Afr Med J. 2021;40: 57. pmid:34795836
- 55. Maruapula D, MacLeod IJ, Moyo S, Musonda R, Seatla K, Molebatsi K, et al. Use of a mutation-specific genotyping method to assess for HIV-1 drug resistance in antiretroviral-naïve HIV-1 Subtype C-infected patients in Botswana. AAS open Res. 2020;3: 50. pmid:34036243
- 56. Gomez-Martinez J, Foulongne V, Laureillard D, Nagot N, Montès B, Cantaloube J-F, et al. Near-point-of-care assay with a visual readout for detection of HIV-1 drug resistance mutations: A proof-of-concept study. Talanta. 2021;231: 122378. pmid:33965042
- 57.
Johnson K, Nouhin J, LaPrade E, Pinsky BA, Ebert J, Van T, et al. Simultaneous HIV quantification and HIVDR detection by a semiconductor biochip system. Conference on Retroviruses and Opportunistic Infections (CROI) Abstract no 436. 2021. Available from: https://www.croiconference.org/wp-content/uploads/sites/2/resources/2021/vCROI-2021-Abstract-eBook.pdf (accessed December 19, 2022)
- 58. Kapoor A, Jones M, Shafer RW, Rhee SY, Kazanjian P, Delwart EL. Sequencing-based detection of low-frequency human immunodeficiency virus type 1 drug-resistant mutants by an RNA/DNA heteroduplex generator-tracking assay. J Virol. 2004;78: 7112–7123. pmid:15194787
- 59. Lee JH, Hachiya A, Shin SK, Lee J, Gatanaga H, Oka S, et al. Restriction fragment mass polymorphism (RFMP) analysis based on MALDI-TOF mass spectrometry for detecting antiretroviral resistance in HIV-1 infected patients. Clin Microbiol Infect. 2013;19: E263–70. pmid:23480551
- 60. Marzinke MA, Grinsztejn B, Fogel JM, Piwowar-Manning E, Li M, Weng L, et al. Characterization of Human Immunodeficiency Virus (HIV) Infection in Cisgender Men and Transgender Women Who Have Sex With Men Receiving Injectable Cabotegravir for HIV Prevention: HPTN 083. J Infect Dis. 2021;224: 1581–1592. pmid:33740057
- 61. Eshleman SH, Fogel JM, Halvas EK, Piwowar-Manning E, Marzinke MA, Kofron R, et al. HIV RNA Screening Reduces Integrase Strand Transfer Inhibitor Resistance Risk in Persons Receiving Long-Acting Cabotegravir for HIV Prevention. J Infect Dis. 2022;226: 2170–2180. pmid:36240386
- 62. Smith J, Bansi-Matharu L, Cambiano V, Dimitrov D, Bershteyn A, van de Vijver D, et al. Predicted effects of the introduction of long-acting injectable cabotegravir pre-exposure prophylaxis in sub-Saharan Africa: a modelling study. lancet HIV. 2023. pmid:36642087