We evaluated the sensitivity and specificity of the WHO immunological criteria for detecting antiretroviral therapy (ART) treatment failure in a cohort of Vietnamese patients. We conducted a stratified analysis to determine the effects of BMI, peer support, adherence to antiretroviral (ARV) drugs, age, and gender on the sensitivity and specificity of the WHO criteria.
We conducted a retrospective cohort study of 605 HIV-infected patients using data previously collected from a cluster randomized control trial study. We compared the sensitivity and specificity of CD4+ counts to the gold standard of virologic testing as a diagnostic test for ART failure at different time points of 12, 18, and 24 months.
The sensitivity [95% confidence interval (CI)] of the WHO immunological criteria based on a viral load ≥ 1000 copies/mL was 12% (5%-23%), 14% (2%-43%), and 12.5% (2%-38%) at 12, 18, and 24 months, respectively. In the same order, the specificity was 93% (90%-96%), 98% (96%-99%), and 98% (96%-100%). The positive predictive values (PPV) at 12, 18, and 24 months were 22% (9%-40%), 20% (3%-56%), and 29% (4%-71%); the negative predictive values (NPV) at the same time points were 87% (84%-90%), 97% (95%-98%), and 96% (93%-98%). The stratified analysis revealed similar sensitivities and specificities.
Citation: Le NK, Riggi E, Marrone G, Vu TV, Izurieta RO, Nguyen CKT, et al. (2017) Assessment of WHO criteria for identifying ART treatment failure in Vietnam from 2007 to 2011. PLoS ONE 12(9): e0182688. https://doi.org/10.1371/journal.pone.0182688
Editor: Giuseppe Vittorio De Socio, Azienda Ospedaliera Universitaria di Perugia, ITALY
Received: February 14, 2017; Accepted: July 20, 2017; Published: September 6, 2017
Copyright: © 2017 Le et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Surveillance of HIV antiretroviral therapy failure has been challenging in resource-limited settings. This has resulted in suboptimal identification of treatment failure . In settings lacking support for the gold standard of routine viral load (VL) monitoring, countries have adopted the World Health Organization (WHO) clinical and immunological criteria for detection of treatment failure [2–5]. These guidelines define clinical treatment failure as occurrence or recurrence of stage 4 diseases or conditions after at least 6 months of therapy.
Early identification of ART treatment failure allows patients a higher chance of success when switching to a second line ART . Mounting evidence has shown that the WHO criteria for ART monitoring has poor sensitivity and specificity for detecting treatment failure, especially for higher baseline CD4+ cell counts, when compared to the gold standard of VL monitoring [7–14]. (The gold standard is the recommended conventional method of diagnosing a particular disease, or in this case, ART treatment failure. Any new test needs to be compared against the gold standard. The information obtained by comparing a new diagnostic test with the gold standard is conventionally summarized in a two-by-two table.) The Vietnam Guidelines define virologic failure as plasma VL > 5,000 copies/mL, while the WHO virologic criteria defines it as plasma VL ≥ 1,000 copies/mL [15, 16].
In the past 15 years, Vietnam has increased its investment in HIV prevention, care, and treatment with the support of international aid agencies. This effort has been mainly targeted at high risk populations, which include people who inject drugs . The national prevalence of injecting drug use, the leading mode of HIV transmission in Vietnam, has been decreasing from 26% in 2011 to an estimate of 23% in 2015 . Despite this progress, high HIV prevalence among people who inject drugs persists in some cities and provinces, such as Quang Ninh (56% in 2013), where our study took place [17, 18].
On October 25, 2014, Vietnam became the first country in Asia to commit to expanding HIV treatment by adopting the UNAIDS 90-90-90 targets . This aims to have 90% of all people living with HIV to be aware of their HIV status, 90% of all people with diagnosed HIV infection to receive sustained antiretroviral therapy, and 90% of all people receiving antiretroviral therapy to have viral suppression by 2020 .
The Vietnam Ministry of Health (MOH) adopted the WHO clinical and immunological criteria, described previously, for their guidelines. Despite the addition of routine VL testing every 6 months, the test is only performed in a few select laboratories in large cities like Ha Noi and Ho Chi Minh City [4, 21, 22]. Furthermore, public international programs may not support routine VL monitoring unless patients meet the WHO clinical and immunological treatment failure criteria . Even with this targeted VL strategy for confirming suspected treatment failure, this approach still has the potential to delay treatment switching .
This study sought to determine the sensitivity and specificity of the WHO immunological criteria for identifying ART treatment failure in resource-limited settings. As VL testing is not routinely done in Vietnam, there isn’t much published data on the effectiveness of the Vietnam National Guidelines . This study also investigated the effects of BMI, peer support, adherence to ARV, age, and gender on the sensitivity and specificity of the WHO immunological criteria.
This retrospective cohort study collected information from HIV-infected patients on first-line ART from a cluster randomized controlled trial carried out in a rural resource-limited setting of Quang Ninh, Vietnam between July 2007 and November 2011 . The inclusion criteria for the 605 patients of this study was ART-naïve HIV-infected patients. Data extracted from a 24 month follow up included CD4+ levels, viral load levels, adherence to ARV, gender, BMI, peer support, and age.
For the purposes of this analysis, WHO immunologic failure was diagnosed if the participant met one of the following criteria:
- CD4+ counts that return to or fall below pre-therapy baseline level,
- 50% decline of CD4+ from the on-treatment peak value after at least 6 months of the initiation of ART,
- CD4+ count <100 cells/μL after a year without any increase [3, 15].
The current Vietnam guidelines for viral load defines treatment failure at viral load > 5000 copies/mL . However, the current WHO guidelines define treatment failure at VL ≥ 1000 copies/mL . Data were analyzed using these two different virologic failure thresholds as the gold standard.
We presented descriptive continuous data as median and interquartile range (IQR) and listed categorical variables as numbers and percentages. We determined the sensitivity and specificity for predicting various definitions of virologic failure mentioned previously at 12, 18, and 24 months after initiation of ART. We determined the positive and negative predictive values of the immunologic failure criteria as well. In addition, we adjusted the diagnostic test analysis with both VL > 5000 copies/mL and VL ≥ 1000 copies/mL, for several variables such as gender, age, BMI, peer support, and adherence to ARV. The results are presented in the tables with the corresponding 95% confidence interval (CI). The confidence intervals were based on formulae provided by Simel et al .
BMI was stratified between below 18 kg/m2 and above 18 kg/m2. Patients were stratified into groups that have or don’t have peer support. Peer support involved home-based adherence counseling by fellow HIV-infected peer supporters . Adherence to ARV was stratified into no missed doses and one or more missed doses. Age was split between above and below 32 years (the median age of patients in this study was 31.90 years), while gender was divided into male and female. The analysis was carried out using R software . The package used to compute the confidence intervals was “epiR” .
The study was approved by the Institutional Review Boards of Hanoi Medical University, Ministry of Health, Vietnam (numbers 26/IRB, 66/HMURB, 59/HMURB, and 98/HMURB), the Regional Board for Ethics Review from Karolinska Institutet in Stockholm, Sweden (number 2006/1367-31/4), and the Institutional Review Board (no. Pro00027277) at the University of South Florida.
This study included the baseline characteristics of a total of 605 HIV-positive patients (Table 1). These patients ranged from 20 to 56 years of age.
Fig 1 represents the frequency of ART treatment failure in our sample based on virologic criteria (VL > 5000 copies/mL and VL ≥ 1000 copies/mL) and WHO immunological criteria (CD4+).
Among the different definitions, the proportions of ART treatment failure were less than the proportions of NO ART treatment failure. The virologic criterion VL ≥ 1000 copies/mL got the highest proportion of ART treatment failure at different times.
The viral load definitions were considered as gold standard, and the WHO criteria from CD4+ as the new test.
Diagnostic test analysis
As shown in Fig 2, all of this information was collected based on treatment failure defined by the Vietnam guidelines (VL > 5000 copies/mL) and WHO Guidelines (VL ≥ 1000 copies/mL), both considered as gold standards, with the overall WHO immunological criteria, 12, 18, and 24 months after the start of treatment.
The sensitivity, based on treatment failure at viral load > 5000 copies/mL and the overall WHO immunological criteria 12 months after the start of treatment, was 30% and the specificity was 93%. However, among the people who tested positive for WHO immunological criteria, only 9% actually had treatment failure (the corresponding PPV). For those that tested negative, 98% did not have the treatment failure (NPV).
At 18 months, the sensitivity and specificity were 12.5% and 98%, respectively, while the PPV and NPV were 10% and 98%, respectively.
On the contrary, at 24 months after treatment initiation, the sensitivity was 22%. The PPV, among patients that tested positive, was 29% that had ART treatment failure. All the indexes are reported in Table 2.
Moving to the two-by-two table between WHO immunological criteria and VL ≥ 1000 copies/mL, the sensitivity indexes were lower compared to those mentioned previously at the 12th and 24th months, while at 18 months, it was slightly increased (Table 2). The specificity indexes were the same, except for at 24 months after the start of treatment.
As previously mentioned, the diagnostic test analysis was stratified at three different times for several variables including gender, age, BMI, peer support, and adherence to ARV. We summarized the results comparing the two gold standards and the CD4+ test with detecting ART treatment failure in Table 3, using the different strata. Similar to the results in Table 2, the sensitivities ranged from 0–50% and the specificities ranged from 92–100%.
We found that the WHO immunological criteria have a very low sensitivity and high specificity. The stratified analysis also didn't obtain results in favor of the CD4+ test. Due to low sensitivity of the criteria, it was not possible to accurately detect treatment failure. Therefore, the CD4+ diagnostic test is poor for detecting ART failure, and patients’ immune competence would have declined unnoticed as they progressed faster towards clinical failure and AIDS. This indicates that the WHO immunological criteria has too low a sensitivity to be used as a first line screening method. Based on this, we recommend for the WHO to change the treatment failure guidelines to be based solely on viral load in resource limited settings.
To the best of our knowledge, this is the first study to report the sensitivities and specificities of the WHO immunological criteria compared to the gold standard of viral load testing in Vietnam. Some countries have a targeted approach to viral load testing (e.g. Cambodia, India, and Vietnam) where patients are only tested if treatment failure is suspected using WHO clinical and immunological criteria [15, 28, 29]. Despite being less expensive than routine testing in the short term, this approach risks delaying treatment failure identification . With earlier identification of treatment failure and earlier interventions to improve adherence, the more timely switch to second line ART could decrease the immunological detrition as well as prevent accumulation of resistance mutations [4, 30]. This would decrease the risk of disease progression, ARV drug resistance, and further HIV transmission . In the long run, it may be more cost effective to reduce these incidences through a more robust test for treatment failure, as delaying its identification can have high long-term costs including more expensive second-line drug regimens and an increased risk of transmitting drug resistant HIV strains.
Viral load testing accurately and precisely identifies treatment failure as well as non-adherence . Such an approach would prevent misdiagnosis of treatment failure and avoid the unnecessary change to a more expensive second line regimen [10, 11, 13]. By maintaining low viral loads, partners and children would also be protected from horizontal and vertical transmission [31, 32]. Patients would also be protected from the progression to AIDS and associated coinfections. In doing so, we can reduce both mortality and healthcare costs for developing countries [33, 34].
A major downside of relying on CD4+ levels to detect treatment failure is the inability to determine the functionality of the T cells being produced. If the patient was co-infected with HTLV (Human T-lymphotropic virus), patients’ CD4+ levels could increase, but many of the CD4+ cells may actually be nonfunctional . This could camouflage treatment failure, further delaying effective drug regimen switches and lead to a faster progression of AIDS .
Historically, there has been resistance to switching to routine viral load testing due to high costs . However, there are cheaper viral load testing options, like the ExaVirTM Load (a simple reverse transcriptase assay), that have the same efficacy as other, more expensive viral load tests .
Countries, like Uganda, have successfully switched to using solely viral load testing to determine treatment failure . Countries like South Africa and Thailand have implemented routine viral load testing in addition to the CD4+ tests [39–41]. This shows that routine viral load testing is feasible and the WHO should adopt this as the new guideline. We believe that Vietnam and all countries, in general, should follow these steps and update their treatment guidelines to phase out CD4+ tests in exchange for viral load testing.
One limitation of our study is the low number of patients with true treatment failure. Also, two different hospital laboratories measured CD4+ counts, which could have led to bias in the estimation of immunologic failure. This study did not control for ART treatment during the management of patients. If patients were found to have treatment failure, they were assessed in relation to adherence. If they had good adherence and genotyping showed specific resistance mutations, they were switched to a different treatment regimen. We were also limited to the variables provided in the dataset. For example, the BMI was set at either below and above 18 kg/m2. We couldn’t adjust BMI to the cut off for normal and underweight BMI (<18.5 kg/m2. Certain variables were only assessed once during the study: BMI at baseline and adherence to ARV after 24 months. This presents a challenge in a causal-relationship type of analysis as we do not have information about how they changed over time. In addition, the findings should be assessed in a prospective study with a larger sample size to further confirm or refute the results.
Finally, we hope our study has shed light on the importance of implementing routine viral load testing as the required test for treatment failure in resource-limited settings.
We wish to acknowledge the support and contribution from the board of directors and colleagues at Uong Bi Hospital. We also want to acknowledge the teams’ work at the outpatient clinics at the Provincial Hospital in Quang Ninh, Health Centre in Ha Long, and Yen Hung district hospital. In addition, we would like to acknowledge the CHAIN EU FP7, Global Fund, CDC-Lifegap Project, and Health System Research Project of Hanoi Medical University in Vietnam for providing financial and technical support for the original clinical trial. We are grateful to Dr. Nguyen Phuong Hoa, Ms. Nguyen Binh Minh, Dr. Tran Thanh Do, Dr. Nguyen Phuong Thanh, Dr. Hoang Thi Thao, Dr. Nguyen Thi Tuyet Mai, Ms. Pham Thi Tuoi, Mr. Tran Chi Thanh, Prof. Anders Sönnerborg, Prof. Vinod Diwan, all colleagues, health staff, external supporters, and patients in the DOTARV Project. We want to give a special thanks to the study participants as well as to their families for their valuable contribution to the study. Lastly, we would like to thank the Scholarly Concentrations Program at USF Health Morsani College of Medicine for their continued support.
- 1. Estill J, Ford N, Salazar-Vizcaya L, Haas AD, Blaser N, Habiyambere V, et al. The need for second-line antiretroviral therapy in adults in sub-Saharan Africa up to 2030: a mathematical modelling study. Lancet HIV. 2016;3(3):e132–9. pmid:26939736.
- 2. Lynen L, Van Griensven J, Elliott J. Monitoring for treatment failure in patients on first-line antiretroviral treatment in resource-constrained settings. Curr Opin HIV AIDS. 2010;5(1):1–5. pmid:20046141.
- 3. WHO. Antiretroviral Therapy for HIV Infection in Adults and Adolescents: Recommendations for a Public Health Approach: 2010 Revision 2010 [cited 2016 August 1]. Available from: http://apps.who.int/iris/bitstream/10665/44379/1/9789241599764_eng.pdf.
- 4. Calmy A, Ford N, Hirschel B, Reynolds SJ, Lynen L, Goemaere E, et al. HIV viral load monitoring in resource-limited regions: optional or necessary? Clin Infect Dis. 2007;44(1):128–34. pmid:17143828.
- 5. Estill J, Egger M, Johnson LF, Gsponer T, Wandeler G, Davies MA, et al. Monitoring of antiretroviral therapy and mortality in HIV programmes in Malawi, South Africa and Zambia: mathematical modelling study. PLoS One. 2013;8(2):e57611. pmid:23469035; PubMed Central PMCID: PMCPMC3585414.
- 6. Group A-LoIS, Keiser O, Tweya H, Boulle A, Braitstein P, Schecter M, et al. Switching to second-line antiretroviral therapy in resource-limited settings: comparison of programmes with and without viral load monitoring. AIDS. 2009;23(14):1867–74. pmid:19531928; PubMed Central PMCID: PMCPMC2956749.
- 7. Rutherford GW, Anglemyer A, Easterbrook PJ, Horvath T, Vitoria M, Penazzato M, et al. Predicting treatment failure in adults and children on antiretroviral therapy: a systematic review of the performance characteristics of the 2010 WHO immunologic and clinical criteria for virologic failure. AIDS. 2014;28 Suppl 2:S161–9. pmid:24849476.
- 8. Castelnuovo B, Sempa J, Agnes KN, Kamya MR, Manabe YC. Evaluation of WHO Criteria for Viral Failure in Patients on Antiretroviral Treatment in Resource-Limited Settings. AIDS Res Treat. 2011;2011:736938. pmid:21541225; PubMed Central PMCID: PMCPMC3085383.
- 9. Meya D, Spacek LA, Tibenderana H, John L, Namugga I, Magero S, et al. Development and evaluation of a clinical algorithm to monitor patients on antiretrovirals in resource-limited settings using adherence, clinical and CD4 cell count criteria. J Int AIDS Soc. 2009;12:3. pmid:19261189; PubMed Central PMCID: PMCPMC2664320.
- 10. Kantor R, Diero L, Delong A, Kamle L, Muyonga S, Mambo F, et al. Misclassification of first-line antiretroviral treatment failure based on immunological monitoring of HIV infection in resource-limited settings. Clin Infect Dis. 2009;49(3):454–62. pmid:19569972; PubMed Central PMCID: PMCPMC4859427.
- 11. Moore DM, Awor A, Downing R, Kaplan J, Montaner JS, Hancock J, et al. CD4+ T-cell count monitoring does not accurately identify HIV-infected adults with virologic failure receiving antiretroviral therapy. J Acquir Immune Defic Syndr. 2008;49(5):477–84. pmid:18989232.
- 12. Reynolds SJ, Nakigozi G, Newell K, Ndyanabo A, Galiwongo R, Boaz I, et al. Failure of immunologic criteria to appropriately identify antiretroviral treatment failure in Uganda. AIDS. 2009;23(6):697–700. pmid:19209067; PubMed Central PMCID: PMCPMC2720562.
- 13. Mee P, Fielding KL, Charalambous S, Churchyard GJ, Grant AD. Evaluation of the WHO criteria for antiretroviral treatment failure among adults in South Africa. AIDS. 2008;22(15):1971–7. pmid:18784460.
- 14. Laurent C, Kouanfack C, Laborde-Balen G, Aghokeng AF, Mbougua JB, Boyer S, et al. Monitoring of HIV viral loads, CD4 cell counts, and clinical assessments versus clinical monitoring alone for antiretroviral therapy in rural district hospitals in Cameroon (Stratall ANRS 12110/ESTHER): a randomised non-inferiority trial. Lancet Infect Dis. 2011;11(11):825–33. pmid:21831714.
- 15. MOH. Vietnam National Guidelines for HIV/AIDS Diagnosis and Treatment, published with Decision No. 3003/Qð-BYT dated 19/8/2009 of the Minister of Health 2009 [cited 2016 August 1]. Available from: http://www.who.int/hiv/pub/guidelines/vietnam_art.pdf?ua=1.
- 16. WHO. Consolidated Guidelines On The Use Of Antiretroviral Drugs For Treating And Preventing HIV Infection (2nd ed.) 2016 [cited 2016 August 1]. Available from: http://apps.who.int/iris/bitstream/10665/208825/1/9789241549684_eng.pdf?ua=1.
- 17. Viet Nam Authority of HIV/AIDS Control MoH. Vietnam HIV/AIDS Estimates and Projections 2011–2015 2012 [cited 2016 August 1]. Available from: https://www.fhi360.org/sites/default/files/media/documents/FHI-LayoutUoctinhvaDubao2011–2015_FINAL.pdf.
- 18. MOH. Vietnam AIDS Response Progress Report 2014: Following Up the 2011 Political Declarations on HIV AIDS. Ha Noi: March 2014. Report No.
- 19. Viet Nam is the first country in Asia to commit to new HIV treatment targets 2014 [cited 2016 October 5]. Available from: https://unaids-ap.org/2014/10/26/viet-nam-is-the-first-country-in-asia-to-commit-to-new-hiv-treatment-targets/.
- 20. UNAIDS. 90-90-90 An ambitious treatment target to help end the AIDS epidemic 2014 [cited 2016 August 1]. Available from: http://www.unaids.org/sites/default/files/media_asset/90-90-90_en_0.pdf.
- 21. Trinh TT, Montague BT, Flanigan TP, Gerard HM. HIV Suppression among Patients on Treatment in Vietnam: A Review of HIV Viral Load Testing in a Public Urban Clinic in Ho Chi Minh City. AIDS Res Treat. 2011;2011:230953. pmid:21490776; PubMed Central PMCID: PMCPMC3066628.
- 22. Huong DT, Bannister W, Phong PT, Kirk O, Peters L. Factors associated with HIV-1 virological failure in an outpatient clinic for HIV-infected people in Haiphong, Vietnam. Int J STD AIDS. 2011;22(11):659–64. pmid:22096052.
- 23. Fhi360 V, UNAIDS, & PEPFAR. Results from the Vietnam ART Cascade Completion Study 2015 [cited 2016 August 1]. Available from: https://www.fhi360.org/sites/default/files/media/documents/art-cascade-completion-study-usaid-smart-ta-project-fhi-360-vietnam.pdf.
- 24. Cuong DD, Sonnerborg A, Van Tam V, El-Khatib Z, Santacatterina M, Marrone G, et al. Impact of peer support on virologic failure in HIV-infected patients on antiretroviral therapy—a cluster randomized controlled trial in Vietnam. BMC Infect Dis. 2016;16(1):759. pmid:27986077.
- 25. Simel DL, Samsa GP, Matchar DB. Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol. 1991;44(8):763–70. pmid:1941027.
- 26. R Core Team. R: A language and environment for statistical computing Vienna, Austria: R Foundation for Statistical Computing; 2016. Available from: https://www.r-project.org/.
- 27. Stevenson M, Nunes T, Heuer C, Marshall J, Sanchez J, Thornton R, et al. epiR: Tools for the Analysis of Epidemiological Data 2016. R package version 0.9–79:[Available from: https://cran.r-project.org/package=epiR.
- 28. Ministry of Health. National Guidelines for the use of Antiretroviral Therapy in Adults and Adolescents. Cambodia: National Center for HIV/AIDS, Dermatology and STI 2007.
- 29. Rewari BB, Bachani D, Rajasekaran S, Deshpande A, Chan PL, Srikantiah P. Evaluating patients for second-line antiretroviral therapy in India: the role of targeted viral load testing. J Acquir Immune Defic Syndr. 2010;55(5):610–4. pmid:20890211.
- 30. Sungkanuparph S, Manosuthi W, Kiertiburanakul S, Piyavong B, Chumpathat N, Chantratita W. Options for a second-line antiretroviral regimen for HIV type 1-infected patients whose initial regimen of a fixed-dose combination of stavudine, lamivudine, and nevirapine fails. Clin Infect Dis. 2007;44(3):447–52. pmid:17205457.
- 31. Attia S, Egger M, Muller M, Zwahlen M, Low N. Sexual transmission of HIV according to viral load and antiretroviral therapy: systematic review and meta-analysis. AIDS. 2009;23(11):1397–404. pmid:19381076.
- 32. Dao H, Mofenson LM, Ekpini R, Gilks CF, Barnhart M, Bolu O, et al. International recommendations on antiretroviral drugs for treatment of HIV-infected women and prevention of mother-to-child HIV transmission in resource-limited settings: 2006 update. Am J Obstet Gynecol. 2007;197(3 Suppl):S42–55. pmid:17825650.
- 33. Petersen ML, van der Laan MJ, Napravnik S, Eron JJ, Moore RD, Deeks SG. Long-term consequences of the delay between virologic failure of highly active antiretroviral therapy and regimen modification. AIDS. 2008;22(16):2097–106. pmid:18832873; PubMed Central PMCID: PMCPMC2597677.
- 34. Rangarajan S, Donn JC, Giang le T, Bui DD, Hung Nguyen H, Tou PB, et al. Factors associated with HIV viral load suppression on antiretroviral therapy in Vietnam. J Virus Erad. 2016;2(2):94–101. pmid:27482442; PubMed Central PMCID: PMCPMC4965252.
- 35. Gudo ES, Bhatt NB, Bila DR, Abreu CM, Tanuri A, Savino W, et al. Co-infection by human immunodeficiency virus type 1 (HIV-1) and human T cell leukemia virus type 1 (HTLV-1): does immune activation lead to a faster progression to AIDS? BMC Infect Dis. 2009;9:211. pmid:20028500; PubMed Central PMCID: PMCPMC2813852.
- 36. Petti CA, Polage CR, Quinn TC, Ronald AR, Sande MA. Laboratory medicine in Africa: a barrier to effective health care. Clin Infect Dis. 2006;42(3):377–82. pmid:16392084.
- 37. Do Duy Cuong EA, Nguyen Thi Kim Chuc, Michele Santacatterina, Anders Sönnerborg, Mattias Larsson. Monitoring the efficacy of antiretroviral therapy by a simple reverse transcriptase assay in HIV-infected adults in rural Vietnam. Future Virology. 2012;7(9):923–31.
- 38. HEPS-Uganda. Viral load testing for HIV treatment monitoring in Uganda. 2015.
- 39. Frontières MS. Getting to Undetectable: Usage of HIV Viral Load Monitoring in Five Countries. MSF Access Campaign. 2014;5.
- 40. Ford N, Stinson K, Davies MA, Cox V, Patten G, Cragg C, et al. Is it safe to drop CD4+ monitoring among virologically suppressed patients: a cohort evaluation from Khayelitsha, South Africa. AIDS. 2014;28(14):2003–5. pmid:25102088.
- 41. Roberts T, Cohn J, Bonner K, Hargreaves S. Scale-up of Routine Viral Load Testing in Resource-Poor Settings: Current and Future Implementation Challenges. Clin Infect Dis. 2016;62(8):1043–8. pmid:26743094; PubMed Central PMCID: PMCPMC4803106.