Affordable strategies to prevent treatment failure on first-line regimens among HIV patients are essential for the long-term success of antiretroviral therapy (ART) in sub-Saharan Africa. WHO recommends using routinely collected data such as adherence to drug-refill visits as early warning indicators. We examined the association between adherence to drug-refill visits and long-term virologic and immunologic failure among non-nucleoside reverse transcriptase inhibitor (NNRTI) recipients in South Africa.
In 2008, 456 patients on NNRTI-based ART for a median of 44 months (range 12–99 months; 1,510 person-years) were enrolled in a retrospective cohort study in Soweto. Charts were reviewed for clinical characteristics before and during ART. Multivariable logistic regression and Kaplan-Meier survival analysis assessed associations with virologic (two repeated VL>50 copies/ml) and immunologic failure (as defined by WHO).
After a median of 15 months on ART, 19% (n = 88) and 19% (n = 87) had failed virologically and immunologically respectively. A cumulative adherence of <95% to drug-refill visits was significantly associated with both virologic and immunologic failure (p<0.01). In the final multivariable model, risk factors for virologic failure were incomplete adherence (OR 2.8, 95%CI 1.2–6.7), and previous exposure to single-dose nevirapine or any other antiretrovirals (adj. OR 2.1, 95%CI 1.2–3.9), adjusted for age and sex. In Kaplan-Meier analysis, the virologic failure rate by month 48 was 19% vs. 37% among adherent and non-adherent patients respectively (logrank p value = 0.02).
Citation: El-Khatib Z, Katzenstein D, Marrone G, Laher F, Mohapi L, Petzold M, et al. (2011) Adherence to Drug-Refill Is a Useful Early Warning Indicator of Virologic and Immunologic Failure among HIV Patients on First-Line ART in South Africa. PLoS ONE 6(3): e17518. https://doi.org/10.1371/journal.pone.0017518
Editor: Gary Maartens, University of Cape Town, South Africa
Received: November 18, 2010; Accepted: February 4, 2011; Published: March 9, 2011
Copyright: © 2011 El-Khatib et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was funded by the Swedish International Development Cooperation Agency to National Institute for Communicable Diseases (NICD) and Karolinska Institutet; The Karolinska Institutet (PhD student grant to ZEK and senior research grant to AME); Sven Gard's Fund for Virology Research, African Programme for Training in HIV/TB Research Fogarty International Center/NIH 2 U2R TW006878 and the Freeman-Spogli Institute at Stanford University to ZEK. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Antiretroviral treatment (ART) has saved millions of lives by transforming HIV infection from a fatal into a chronic disease  and the vast majority (97%) of patients in sub-Saharan Africa receive a non-nucleoside reverse transcriptase (NNRTI) based regimen as first-line treatment . Given the costs associated with second-line protease inhibitors, the long-term sustainability of ART in many of low- and some middle-income countries depends on finding feasible ways for early detection of treatment failure to maintain patients on first-line regimens , .
Since viral load (VL) monitoring is not currently accessible in most resource-limited high-endemic contexts , , patients are often continued on first-line ART until the emergence of clinical symptoms or until any of the World Health Organization (WHO) criteria for immunologic failure are met. Although virologic failure and drug resistance usually precede immunologic failure, these measures are not always well correlated at clinical follow-up , , . To routinely assess the effectiveness of ART at HIV treatment clinics and to minimize preventable HIV drug resistance (HIVDR), WHO recommends using available site-based data from medical and pharmacy records, e.g. on-time adherence to monthly ART drug pick-up and clinic appointment-keeping , , as an early warning indicator (EWI) of inconsistent drug exposure. Failure to pick up drugs on time serves as a proxy for treatment interruption and suboptimal drug concentrations, which are associated with virologic failure and the evolution of drug resistance , , .
Earlier reports from resource-limited settings have defined virologic failure as a VL of >400, >1,000 or >5,000 copies/ml at one or two repeated visits , . However, drug resistance mutations can emerge at lower VL levels  and in high-income countries, monitoring guidelines recommend using VL >50 copies/ml as an indicator of virologic failure for patients on ART . As more robust, sensitive and lower cost assays are developed, ART programmes in low- and middle-income may be able to adopt lower threshold values for virologic failure. Thus, we assessed the proportion of repeated VL >50 copies/ml, immunologic failure and median CD4 cell count gains in a cohort of long-term, first-line recipients in Soweto, who had been on NNTRI-based regimens for up to eight years. We also assessed the relationship between cumulative adherence to drug-refill visits and treatment failure.
Setting and study population
At the time of the study, more than 1,500 patients were receiving ART at this clinic. Aiming for a precision of +/− 5% for a proportion of 50% using 95% confidence interval, a sample size of 384 patients was required . Adding a margin to the minimum required sample size, a cohort of 458 participants on long-term ART (range 12 to 99 months) were enrolled during March-September 2008  for a cross-sectional assessment and a retrospective review of their medical charts. The inclusion criteria were: being on NNRTI-containing regimen for ≥12 months; consent to an interviewer-mediated questionnaire; medical record review; and withdrawal of 10ml of blood. The study, named South African Virologic Evaluation (SAVE) , was performed at the Perinatal HIV Research Unit (PHRU) adult HIV clinic at the Chris Hani Baragwanath Hospital, in the Soweto township outside Johannesburg, South Africa. The study site  and a cross-sectional description of viremia and drug resistance have been described in depth previously , .
Patients were interviewed at study enrolment to obtain demographics, socioeconomic characteristics, reasons for missing doses and the strategies used to remember taking their pills on time. The retrospective review included: year of HIV diagnosis; pre-ART initiation characteristics (VL, CD4 cell count, pre-exposure to single-dose nevirapine (sdNVP) or other antiretroviral drugs (ARVs); current and previous TB therapy; dates for drug refill visits; and treatment interruptions. VL and CD4 counts had been measured every six months on average. For two of the patients, medical records were not available and they were excluded from the longitudinal analysis, leaving 456 patients for data analyses. A survey form, called Medical Records-SAVE (MR.SAVE©), was developed, piloted and modified  for data collection. EpiData ,  was used for data entry.
The clinic uses a private diagnostic laboratory service that provides VL measures with the Versant HIV-1 RNA 3.0 (Siemens Deerfield, IL, USA) based on bDNA technology, with a lower limit of detection of 50 copies/ml. Virologic failure was defined as two repeated VL >50 copies/ml at any time after three months on ART. Immunologic failure was defined according to the WHO guidelines as having either (i) a CD4 cell count of <100 cells/µl post six months on ART, (ii) a CD4 cell count of less or equal to CD4 pre-ART after six months on ART or (iii) >50% reduction from the on-ART peak CD4 cell count . Patients were dispensed ART monthly and at scheduled doctor's visits. They were also given projected monthly pharmacy refill dates and the date of the next doctor's appointment. At each refill visit, pharmacy staff dispensed pills and recorded the date. To estimate adherence, we calculated the total number of days that the patient was late for the drug-refill visits divided by the total duration on ART. The formula was: [The number of days late for drug-refill visit = (Date when the patient came for drug refill - Date of the pre-scheduled appointment indicated on the patient's medical record)]. The results were then summarized for repeated refill visits to obtain the cumulative number of days coming late per client. To estimate adherence, the following formula was used [The cumulative number of days coming late ×100)/Total number of days the patient was assumed to be exposed to ART given the dispensed number of pills]. Appointment dates were censored after the date of virologic failure.
Incomplete versus complete adherence was defined as a cumulative adherence to drug refill visits of < and ≥95% respectively. Treatment interruption was defined as a reported and/or planned history of stopping and resuming therapy, identified through chart review.
Descriptive analyses including median (IQR) for numerical variables, frequencies and proportions for categorical variables were performed. Bivariate analyses to assess risk factors for virologic and immunologic failure were performed using Pearson Chi Square and Fisher's exact tests. Thereafter variables with a p-value ≤0.10 were added into a multivariate logistic regression model and those with a p-value <0.05 were considered significant in the final multivariate model, calculating odds ratios (OR) and 95% confidence intervals (CIs). However, the variables sex and age were always maintained in the final multivariate models to account for possible remaining confounders.
Kaplan Meier survival analysis was done using months as the time unit in order to assess time to virologic and immunologic failure on ART among all patients.
Known pre-ART risk factors, exposure to sdNVP , ,  or any type of ARVs, CD4 cell count and age , ,  were adjusted using Cox regression analysis for virologic failure. For immunologic failure, Cox regression analysis was done by adjusting for the same above-mentioned variables and any virologic failure. Due to collinearity between sex and pre-ART CD4 count, sex was not included in the final survival model.
Finally, we assessed the median gain in CD4 cell count during ART on a six-monthly basis (range +/−3 months) among 1) patients with incomplete vs. complete cumulative drug-refill adherence, and 2) patients with virologic failure vs. suppression up to 36 months on ART only, due to data availability.
Stata/SE College Station, Texas (version 10.1)  and Graphpad Prism (version 4.0c)  were used for data analysis. In the survival analysis, the command sts graph in STATA was used. Adjusting for covariates, the command fits separate Cox regression models for each group, and the separately calculated baseline survivor was then retrieved.
Ethical approval for this study was obtained from the research ethics committees at the University of the Witwatersrand in Johannesburg, South Africa, and the Regional Medical Ethics Board in Stockholm, Sweden. Written informed consent was obtained from all patients.
Results and Discussion
A total of 456 patient records were reviewed. Most patients (79%) were diagnosed with HIV between 2001-2004 (median 2003), 14% before 2000 and the remaining 7% between 2005 and 2008. Pre-ART initiation, 51% (222/434) had a CD4 cell count of ≤100 cell/µl and 41% (172/421) had a VL of ≥100 000 copies/ml (Table 1). Overall, the median time on ART was 44 months (IQR 38–48; 1,510 person-years) and 77% (349/456) were women (Table 1). Eighteen percent (80/445) had been exposed to ARVs previously; 15% of the women (52/349) had received sdNVP for the prevention of mother-to-child transmission (PMTCT) with a median time before ART initiation of 15 months, and 6% of all patients (28/446) had received ART before starting the current ART regimen. Approximately half (48%, 199/414) had been treated for tuberculosis (TB) before ART initiation. At the time of study enrolment, the patients spent a median of 40 minutes (IQR 30–60) travelling to the clinic by mini-van (90%), walking (5%) and using their own car (4%).
Overall, 19% (88/456) met the criteria for virologic failure. In bivariate analysis, being exposed to any type of ARVs including sdNVP prior to ART initiation or incomplete adherence was significantly associated with virologic failure (p = 0.04) (Table 1a). These two factors remained significant after adjustment for confounding by age and sex in the multivariable analysis model. The odds ratio of virologic failure among patients with incomplete adherence almost tripled (adjusted OR 2.8, 95%CI 1.2–6.7) and doubled among those exposed to any type of ARVs prior to ART initiation (adj. OR 2.1, 95%CI 1.2–3.9). However, exposure to sdNVP alone did not reach statistical significance. Neither the level of CD4 cell count nor VL at pre-ART initiation was significantly associated with subsequent virologic failure on ART in bivariate analyses, and therefore was not included in the multivariable model.
In a separate analysis, there was no significant association between incomplete adherence and any of the patients' demographic, socioeconomic or clinical data (not shown).
Planned treatment interruptions were not part of the clinical guidelines at this clinic. Of the 456 patients, 132 (29%) had a reported history of treatment interruption registered in their medical charts, 98% of these (129/132) only once. Three patients were reported to have experienced treatment interruption twice but were not found to fail virologically during the study period. The median duration of treatment interruption was longer among patients with, compared to those without, virologic failure; 45 days (IQR 27–97) vs. 36 days (IQR 19–63) respectively, although this difference was not statistically significant (p = 0.12).
Analysing the risk of virologic failure over time using Kaplan Meier survival analysis, the virologic failure rate was 23% up until month 99 (Figure 1a). There was a significant difference in time to virologic failure between patients with complete vs. incomplete adherence. By month 12 on ART, the failure rate was similar (7% vs 8% among patients with complete and incomplete adherence respectively) but by month 48, the difference in failure rates had reached statistical significance between the groups, 19% vs. 37% respectively (logrank p value = 0.02) (Figure 1a). Following adjustment for CD4 cell count, age and exposure to any ARVs pre-ART initiation in a Cox regression analysis, there was a significant difference in virologic failure rates already at month 12 on ART; 2% vs 11%, and at month 48. This difference was even more pronounced, 18% vs. 43%, among patients with complete vs incomplete adherence respectively (logrank p value <0.01) (Figure 1b).
Overall, 87/456 (19%) of the patients met one or more of the definitions of immunologic failure based on CD4 cell count . In bivariate analysis, immunologic failure was associated with incomplete adherence (p = 0.04), gender (p = 0.03), and low education level (p = 0.03) (Table 1). However, none of these variables remained significant in the final multivariate logistic regression model. More than one third (37%; 32/87) of patients failing immunologically were also found to be viremic. Among those with immunologic failure, there was no significant difference in CD4 cell count or VL, pre-ART initiation, between the 32 viremic and 55 non-viremic patients (data not shown).
Kaplan Meier survival analysis demonstrated an overall immunologic failure rate of 27% by month 48 (Figure 2a). The risk of immunologic failure was 41% vs 19% among those with incomplete and complete adherence respectively after 48 months on ART (logrank p value = 0.02). After adjustment for CD4 cell count, age and exposure to any ARVs pre-ART initiation and for virologic failure in the Cox regression analysis, patients with incomplete adherence had an immunologic failure rate of 90% at month 48, while the corresponding figure among patients with complete adherence was only 11% (Figure 2b) (logrank p value<0.01).
Immunologic response to ART
There was a significant difference in CD4 cell count gain during ART between patients with complete vs incomplete adherence at almost all of the clinical visits (p≤0.04) (Figure 3). As expected, patients initiating ART with a CD4 cell count of >100 cells/µl had a significantly higher median CD4 cell count in comparison to patients started on ART at a CD4 cell count of ≤100 cells/µl throughout the follow-up period (Figure 4). The median CD4 cell count was also significantly higher among patients with continuous virologic suppression patients as compared to those with virologic rebound up to at least three years on ART (months 18, 24, 30 and 36, p≤0.03) (Figure 5).
Barriers and facilitators for adherence
When all patients were asked about the reasons for missing pills, the three main reasons stated were: being away from home (32%); simply forgetting (20%); and being busy with other things (10%) (Figure 6). Eleven other reasons were reported but all with a prevalence of ≤6%.
Patients used a combination of methods to remember their medication; mobile phone alarms (49%), relying on their own memory (49%), a close friend/relative (20%) or a partner (8%) to remind them, or pill-boxes (1%).
All interviewees denied any intentional non-adherence in order to maintain eligibility for disability support. This was despite 39% of the patients reporting that their primary source of financial support was the social welfare disability grant provided in South Africa for HIV-infected patients with a CD4 cell count below 200 cells/µl.
Antiretroviral therapy is a life-long undertaking and finding feasible and affordable means for early detection of treatment failure is crucial to sustain first-line therapy effectiveness. Our study found that the estimated proportion of patients failing virologically was 2–3 times higher among patients who were late for their drug-refill visits compared to those with an adherence to drug refill above 95%. This provides evidence that failure to collect ART may serve as a proxy for reduced drug exposure over time.
According to WHO , , monitoring the extent to which ART sites function through EWIs such as adherence to on-time drug refills is of high priority in order to minimize preventable HIVDR. The usefulness and importance of the on-time drug refill indicator became most obvious in the Cox regression analysis over time. It showed a significant difference in first-year failure rates (2% vs 11%) among patients with complete adherence vs incomplete adherence to drug refill already after 12 months on treatment. This difference became even more visible after 4 years on ART (18% vs 43% virologic failure rate respectively) adjusting for CD4 cell count at ART initiation, age and exposure to any ARVs pre-ART initiation.
The cumulative proportion with virologic failure in our study is comparable to similar cohorts of long-term ART-recipients in urban South African townships including other studies from an urban site in Johannesburg , and from Khayelitsha . Similarly high failure rates have also been reported from Switzerland , England , , France, Spain, Germany and Canada .
Apart from <95% adherence to drug refills, previous exposure to other ARVs was the only significant risk factor associated with an increased risk of virologic failure in our multivariable analysis, supporting ample existing evidence that sdNVP , , ,  or other ARVs  may predispose to virologic failure and the emergence of HIVDR mutations among women treated with NNRTI-based ARVs.
During the first year on ART, CD4 T-cell restoration can be slow , but we found that the rate of CD4 cell count gain up to 36 months on ART was the same regardless of the initial level of CD4. Thus, patients starting ART with advanced immuno-suppression and very low CD4 cell counts (<100 cells/µl) maintained a significantly lower CD4 cell count level throughout the study period. This put them at risk of increased morbidity for a number of years post-ART initiation , , and provides further justification to initiate ART earlier, as embodied in the recent WHO recommendations . The gain in CD4 cell count was significantly dependent on high adherence to drug refill and viral suppression supporting the findings by Bisson and co-workers . However, in our study, nearly two thirds of patients failing immunologically were virologically suppressed at clinical assessment. Thus CD4 cell count is a poor predictor of virologic outcomes , , ,  and the use of immunological criteria only for monitoring treatment responses may jeopardize clinical management.
All study participants in this study had been on ART for at least 12 months, and over 90% had achieved a CD4 cell count of >200 cells/µl. There is an ongoing debate in South Africa where some have suggested that HIV patients may keep their CD4 counts at <200 cells/µl by intentionally missing doses ,  to retain eligibility for disability grants. However, this was firmly denied by our participants, who rather ascribed missing doses to being away from home or simply forgetting to take their pills. The interesting fact that half of our patients used their mobile phones as a medication reminder opens up future opportunities of systematic adherence support through text reminders since cell phone access and usage are rapidly increasing throughout sub-Saharan Africa . Additionally, dispensing ART for more than 30 days at a time may also reduce the risk of missed doses.
VL measurements are rarely available in most resource-limited settings and where measured, virologic failure has often been defined as VL >400, >1,000 or even >5,000 copies/ml , , . In this study, a more sensitive and conservative definition for virologic failure was used, >50 copies/ml. While the fact that some patients with intermittent viremia (blips) were included may cause some concern, 85% (75/88) were confirmed viremic in two sequential assessments >50 copies/ml. In this study, we used <95% as a conservative cut-off point for incomplete adherence. In early adherence studies, including unboosted protease inhibitors (PIs), a 95% adherence level was shown to be associated with high virologic suppression , a greater increase in CD4 cell count, and lower hospitalization rates , . More recent studies have indicated that moderate adherence levels (70–90%) may be enough to achieve acceptable virologic suppression with antiretroviral regimens containing boosted PIs or NNRTIs. However, at the 95% level we can be quite certain that a very small proportion of individuals on NNRTI are likely to fail virologically , , . The aim of the current study was to look at treatment failure among long-term recipients of ART, i.e. excluded those with <12 months of ART . However, our retrospective assessment of medical charts went back and traced all virologic failures, including the first year on treatment, enabling us to assess the risk of failure from treatment start-up to a maximum follow-up of over 8 years. However, with this design, we missed those who first failed virologically and then dropped out of the programme before reaching 12 months on treatment. Given that a substantial proportion of patients enrolled in ART in similar urban settings are expected to drop out early , this would lead to an underestimation of the true virologic failure rate among NNRTI recipients in the current assessment.
Finally, the lack of a significant association between longer documented treatment interruptions and virologic failure is likely due to incomplete clinical data since we only had access to reported interruptions recorded in the medical charts.
In summary, there was a strong association between cumulative reduced adherence to drug-refill visits and both virologic and immunologic failure. One in five failed virologically, the majority within the first two years on ART. On-time ART pick-up appears to be a feasible tool to identify individuals at risk, and if followed by prompt and targeted interventions, it could be used to reduce the rate of virologic failure.
We would like to thank Ms. Albertina Dambuza, Belinda Dambuza and Johanna Ledwaba for assisting in reviewing medical records; Ms Ntshebo Mirriam Moeketsi and Alina Malebye for conducting interviews, and Noreen Boikanyo, Rebecca Phofa, Catherine Lephoto, Agnes Ramashiga and Fikile Mbatha for study logistics. We are grateful to all patients for sharing their experiences with us.
Conceived and designed the experiments: ZE-K DK LM MP FL LM AME. Performed the experiments: ZE-K DK FL MP LM. Analyzed the data: ZE-K DK GM MP AME. Contributed reagents/materials/analysis tools: ZE-K FL LM MP DK LM AME. Wrote the paper: ZE-K DK GM LM MP FL LM AME.
- 1. World Health Organization (WHO), Joint United Nations Programme on HIV/AIDS, UNICEF (2008) Towards universal access: Scaling up priority HIV/AIDS interventions in the health sector. Progress report. pp. 1–77.
- 2. Harries AD, Zachariah R, van Oosterhout JJ, Reid SD, Hosseinipour MC, et al. (2010) Diagnosis and management of antiretroviral-therapy failure in resource-limited settings in sub-Saharan Africa: challenges and perspectives. Lancet Infect Dis 10: 60–65.
- 3. Simon V, Ho DD, Karim QA (2006) HIV/AIDS epidemiology, pathogensis, prevention, and treatment. Lancet 368:
- 4. Kuritzkes DR (2004) Preventing and managing antiretroviral resistance. AIDS Patient Care STDs 18: 259–273.
- 5. Calmy A, Ford N, Hirschel B, Reynolds SJ, Lynen L, et al. (2007) HIV viral load monitoring in resource-limited regions: optional or necessary? Clin Infect Dis 44: 128–134.
- 6. Rewari B, Bachani D, Rajasekaran S, Deshpande A, Chan P, et al. (2010) Evaluating patients for second-line antiretroviral therapy in India: the role of targeted viral load testing. J Acquir Immune Defic Syndr Oct 1 [Epub ahead of print].
- 7. Kantor R, Diero L, Delong A, Kamle L, Muyonga S, et al. (2009) Misclassification of first-line antiretroviral treatment failure based on immunological monitoring of HIV infection in resource-limited settings. Clin Infect Dis 49: 454–462.
- 8. Hosseinipour MC, van Oosterhout JG, Weigel R, Phiri S, Kamwendo D, et al. (2009) The public health approach to identify antiretroviral therapy failure: high-level nucleoside reverse transcriptase inhibitor resistance among Malawians failing first-line antiretroviral therapy. AIDS 23: 1127–1134.
- 9. World Health Organization (WHO) (2006) HIV drug resistance early warning indicators (HIVDR-EWI).
- 10. Hedt BL, Wadonda-Kabondo N, Makombe S, Harries AD, Schouten EJ, et al. (2008) Early warning indicators for HIV drug resistance in Malawi. Antivir Ther 13: Suppl 269–75.
- 11. Nachega JB, Hislop M, Dowdy DW, Lo M, Omer S, et al. (2006) Adherence to highly active antiretroviral therapy assessed by pharmacy claims predicts survival in HIV-infected South African adults. J Acquir Immune Defic Syndr 43: 78–84.
- 12. Cambiano V, Lampe F, Rodger A, Smith C, Geretti A, et al. (2010) Use of a prescription-based measure of antiretroviral therapy adherence to predict viral rebound in HIV-infected individuals with viral suppression. HIV Med 11: 216–224.
- 13. Parienti JJ, Massari V, Descamps D, Vabret A, Bouvet E, et al. (2004) Predictors of virologic failure and resistance in HIV-infected patients treated with nevirapine- or efavirenz-based antiretroviral therapy. Clin Infect Dis 38: 1311–1316.
- 14. Barth RE, van der Loeff MF, Schuurman R, Hoepelman AI, Wensing AM (2010) Virological follow-up of adult patients in antiretroviral treatment programmes in sub-Saharan Africa: a systematic review. Lancet Infect Dis 10: 155–166.
- 15. El-Khatib Z, Ekstrom AM, Ledwaba J, Mohapi L, Laher F, et al. (2010) Viremia and drug resistance among HIV-1 patients on antiretroviral treatment: a cross-sectional study in Soweto, South Africa. AIDS 24: 1679–1687.
- 16. Hatano H, Delwart EL, Norris PJ, Lee TH, Neilands TB, et al. (2010) Evidence of persistent low-level viremia in long-term HAART-suppressed, HIV-infected individuals. AIDS.
- 17. Hammer SM, Eron JJ J, Reiss P, Schooley RT, Thompson MA, et al. (2008) Antiretroviral treatment of adult HIV infection: 2008 recommendations of the International AIDS Society-USA panel. JAMA 300: 555–570.
- 18. Rothman KJ, Boice J (1982) Epidemiologic analysis with a programmable calculator, 2nd ed. Newton, MA, Epidemiology resources.
- 19. El-Khatib Z, Ekstrom AM, Ledwaba J, Mohapi L, Laher F, et al. (2010) Viremia and drug resistance among HIV-1 patients on antiretroviral treatment – a cross-sectional study in Soweto, South Africa. AIDS 24:
- 20. Martinson NA, Morris L, Johnson J, Gray GE, Pillay V, et al. (2009) Women exposed to single-dose nevirapine in successive pregnancies: effectiveness and nonnucleoside reverse transcriptase inhibitor resistance. AIDS 23: 809–816.
- 21. El-Khatib Z, DeLong AK, Katzenstein D, Ekstrom AM, Ledwaba J, et al. (2010) Drug resistance patterns and virus re-suppression among HIV-1 subtype C infected patients receiving non-nucleoside reverse transcriptase inhibitors in South Africa. In review.
- 22. El-Khatib Z, Ekstrom AM, Laher F, Karstaedt AS, Petzold M, et al. (2009) Medical review-South African adherence and virologic evaluation (MR. SAVE) tool. 1.0 ed. Stockholm: Creative Commons (CC); email@example.com.
- 23. El-Khatib Z (2004) Questionnaire design and data entry in EpiData (http://onkpat.ki.se/1?node=47234). Stockholm, Sweden: Division of Clinical Cancer Epidemiology - Karolinska Institutet.
- 24. EpiData foundation (2008) EpiData for data entry and documentation (www.epidata.dk). Denmark.
- 25. World Health Organization (WHO) (2004) Scaling up antiretroviral therapy in resource-limited settings: treatment guidelines for a public health approach: 2003 revision. Geneva, Switzerland: WHO.
- 26. Paredes R, Clote B, Ruiz L (2004) Comparison of the efficacy of HAART: single, dual or triple-class antiretroviral therapy. In: De Clercq E, Vandamme AM, editors. Combination therapy of AIDS. Birkhauser Verlag/Switzerland. pp. 53–71.
- 27. Datay MI, Boulle A, Mant D, Yudkin P (2010) Associations with virologic treatment failure in adults on antiretroviral therapy in South Africa. J Acquir Immune Defic Syndr 54: 489–495.
- 28. Coovadia A, Hunt G, Abrams EJ, Sherman G, Meyers T, et al. (2009) Persistent minority K103N mutations among women exposed to single-dose nevirapine and virologic response to Nonnucleoside Reverse-Transcriptase Inhibitor-based therapy. Clin Infect Dis 48: 462–472.
- 29. Ford N, Darder M, Spelman T, Maclean E, Mills E, et al. (2010) Early adherence to antiretroviral medication as a predictor of long-term HIV virological suppression: five-year follow up of an observational cohort. PLoS One 5: e10460.
- 30. Boulle A, Van Cutsem G, Hilderbrand K, Cragg C, Abrahams M, et al. (2010) Seven-year experience of a primary care antiretroviral treatment programme in Khayelitsha, South Africa. AIDS 24: 563–572.
- 31. StataCorp LP (2008) Stata/SE 10.1, College Station, TX 77845 USA.
- 32. Prism G (2005) version 4.0c. La Jolla, CA 92037 USA.
- 33. World Health Organization (WHO) (2010) Antiretroviral therapy for HIV infection in adults and adolescents. Geneve.
- 34. Sanne IM, Westreich D, Macphail AP, Rubel D, Majuba P, et al. (2009) Long-term outcomes of antiretroviral therapy in a large HIV/AIDS care clinic in urban South Africa: a prospective cohort study. J Int AIDS Soc 12: 38.
- 35. Keiser O, Orrell C, Egger M, Wood R, Brinkhof MW, et al. (2008) Public-health and individual approaches to antiretroviral therapy: Township South Africa and Switzerland compared. PLoS Med 5: e148.
- 36. Lampe FC, Harding R, Smith CJ, Phillips AN, Johnson M, et al. (2010) Physical and psychological symptoms and risk of virologic rebound among patients with virologic suppression on antiretroviral therapy. J Acquir Immune Defic Syndr.
- 37. Lampe FC, Gatell JM, Staszewski S, Johnson MA, Pradier C, et al. (2006) Changes over time in risk of initial virological failure of combination antiretroviral therapy: a multicohort analysis, 1996 to 2002. Arch Intern Med 166: 521–528.
- 38. Phillips AN, Pradier C, Lazzarin A, Clotet B, Goebel FD, et al. (2001) Viral load outcome of non-nucleoside reverse transcriptase inhibitor regimens for 2203 mainly antiretroviral-experienced patients. AIDS 15: 2385–2395.
- 39. Datay M, Boulle A, Mant D, Yudkin P (2010) Associations with virologic treatment failure in adults on antiretroviral therapy in South Africa. Journal of Acquired Immune Deficiency Syndromes 54: 489–495.
- 40. Jackson JB, Becker-Pergola G, Guay LA, Musoke P, Mracna M, et al. (2000) Identification of the K103N resistance mutation in Ugandan women receiving nevirapine to prevent HIV-1 vertical transmission. AIDS 14: F111–115.
- 41. Eshleman S, Hoover D, Chen S, Hudelson S, Guay L, et al. (2005) Resistance after single-dose nevirapine prophylaxis emerges in a high proportion of Malawian newborns. AIDS 19: 2167–2169.
- 42. Madge S, Smith C, Lampe F, Sabin C, Youle M, et al. (2008) An audit of viral load in one clinical population to describe features of viraemic patients on antiretroviral therapy. HIV Med 9: 208–213.
- 43. Taiwo BO, Murphy RL (2008) Clinical applications and availability of CD4+ T cell count testing in sub-Saharan Africa. Clinical Cytometry 74B: S11–S18.
- 44. Egger M (2007) Outcomes of antiretroviral treatment in resource limited and industrialized countries. CROI. Los Angeles, USA.
- 45. Bisson G, Gross R, Bellamy S, Chittams J, Hislop M, et al. (2008) Pharmacy refill adherence compared with CD4 count changes for monitoring HIV-infected adults on antiretroviral therapy. PLoS Med 5: e109.
- 46. Mee P, Fielding KL, Charalambous S, Churchyard GJ, Grant AD (2008) Evaluation of the WHO criteria for antiretroviral treatment failure among adults in South Africa. AIDS 22: 1971–1977.
- 47. Badri M, Lawn S, Wood R (2008) Utility of CD4 cell counts for early prediction of virological failure during antiretroviral therapy in a resource-limited setting. BMC Infect Dis 8:
- 48. Kagee A, Remien RH, Berkman A, Hoffman S, Campos L, et al. (2010) Structural barriers to ART adherence in Southern Africa: challenges and potential ways forward. Glob Public Health. pp. 1–15.
- 49. Nattrass N (2006) AIDS, science and governance: the battle over antiretroviral therapy in post-apartheid South Africa. Southern African Journal of HIV Medicine Accessed http://www.aidstruth.org/documents/nattrass.pdf.
- 50. Richard T, Lester PR, Mills EdwardJ, Kariri Antony, Karanja Sarah, Chung MichaelH, et al. (2010) Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet. DOI:https://doi.org/10.1016/S0140-6736(10)61997-6.
- 51. Paterson DL, Swindells S, Mohr J, Brester M, Vergis EN, et al. (2000) Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med 136: 21–30.
- 52. Low-Beer S, Yip B, O'Shaughnessy M, Hogg R, Montaner J (2000) Adherence to triple therapy and viral load response. J Acquir Immune Defic Syndr 23: 360–361.
- 53. Nachega JB, Mills EJ, Schechter M (2010) Antiretroviral therapy adherence and retention in care in middle-income and low-income countries: current status of knowledge and research priorities. Curr Opin HIV AIDS 5: 70–77.
- 54. Shuter J, Sarlo J, Kanmaz T, Rode R, Zingman B (2007) HIV-infected patients receiving lopinavir/ritonavir-based antiretroviral therapy achieve high rates of virologic suppression despite adherence rates less than 95%. J Acquir Immune Defic Syndr 45: 4–8.
- 55. Nachega JB, Hislop M, Dowdy DW, Chaisson RE, Regensberg L, et al. (2007) Adherence to nonnucleoside reverse transcriptase inhibitor-based HIV therapy and virologic outcomes. Ann Intern Med 146: 564–574.
- 56. Martin M, Del Cacho E, Codina C, Tuset M, De Lazzari E, et al. (2008) Relationship between adherence level, type of the antiretroviral regimen, and plasma HIV type 1 RNA viral load: A prospective cohort study. AIDS Res Hum Retrovirus 24: 1263–1268.
- 57. Unge C, Sodergard B, Marrone G, Thorson A, Lukhwaro A, et al. (2010) Long-term adherence to antiretroviral treatment and program drop-out in a high-risk urban setting in sub-Saharan Africa: a prospective cohort study. PLoS One 5: e13613.