Most HIV treatment programs in resource-limited settings utilize multiple facilitators of adherence and retention in care but there is little data on the efficacy of these methods. We performed an observational cohort analysis of a treatment program in Kenya to assess which program components promote adherence and retention in HIV care in East Africa.
Patients initiating ART at A.I.C. Kijabe Hospital were prospectively enrolled in an observational study. Kijabe has an intensive program to promote adherence and retention in care during the first 6 months of ART that incorporates the following facilitators: home visits by community health workers, community based support groups, pharmacy counseling, and unannounced pill counts by clinicians. The primary endpoint was time to treatment failure, defined as a detectable HIV-1 viral load; discontinuation of ART; death; or loss to follow-up. Time to treatment failure for each facilitator was calculated using Kaplan-Meier analysis. The relative effects of the facilitators were determined by the Cox Proportional Hazards Model.
301 patients were enrolled. Time to treatment failure was longer in patients participating in support groups (448 days vs. 337 days, P<0.001), pharmacy counseling (480 days vs. 386 days, P = 0.002), pill counts (482 days vs. 189 days, P<0.001) and home visits (485 days vs. 426 days, P = 0.024). Better adherence was seen with support groups (89% vs. 82%, P = 0.05) and pill counts (89% vs. 75%, P = 0.02). Multivariate analysis using the Cox Model found significant reductions in risk of treatment failure associated with pill counts (HR = 0.19, P<0.001) and support groups (HR = 0.43, P = 0.003).
Unannounced pill counts by the clinician and community based support groups were associated with better long term treatment success and with better adherence.
Citation: Achieng L, Musangi H, Ong'uti S, Ombegoh E, Bryant L, Mwiindi J, et al. (2012) An Observational Cohort Comparison of Facilitators of Retention in Care and Adherence to Anti-Eetroviral Therapy at an HIV Treatment Center in Kenya. PLoS ONE 7(3): e32727. doi:10.1371/journal.pone.0032727
Editor: Matthew P. Fox, Boston University, United States of America
Received: September 30, 2011; Accepted: January 31, 2012; Published: March 9, 2012
Copyright: © 2012 Achieng et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was funded by the Gilead Foundation and by the University of Texas Medical Branch. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The roll out of anti-retroviral therapy in resource-limited setting has resulted in millions of individuals now receiving life saving therapy . The U.S. Presidents Emergency Plan for AIDS Relief was initially envisioned as an emergency response to a humanitarian crisis. As anti-retroviral medications are reaching increasing numbers of HIV infected persons, the focus of this program has shifted to sustaining these efforts . Sustainability of systems of HIV care has many facets but retention in care and adherence to anti-retroviral medication are critical to the maintenance of these endeavors.
There is a need to identify effective methods to retain patients in care and promote adherence to HIV regimens –. A recent meta-analysis of published reports found that only 60% of patients started on anti-retroviral drugs remained on therapy after 2 years . Identification of approaches that optimize adherence to therapy remains a key challenge . Data from developed countries have shown that missing 10% to 15% of doses of anti-retroviral drugs is linked to incomplete suppression of viral replication, declining CD4 cell counts, progression to AIDS, and the emergence of antiretroviral drug resistance , .
In sub-Saharan Africa, a number of evidence based interventions to retain patients in care and to foster adherence to HIV medications have been reported –. These interventions were designed to address stigma, isolation, lack of community support and poor health literacy, all of which have all been shown to contribute to poor adherence retention into care. Community based programs are widely used to support patients in taking anti-retroviral drugs, encourage attendance at clinics and to find treatment defaulters , , , , . Intensive patient education by community health workers, pharmacists and clinical care providers is used both before and during therapy , , . “Real Time” monitoring of pill taking by clinicians and pharmacists can also identify individuals with adherence difficulties that may require additional counseling , , .  Most program evaluations are uni-dimensional and do not examine the overlapping effect of the multiple approaches to improve retention into care and anti-retroviral adherence. Similarly, many studies focus on a single endpoint and do not evaluate other important outcomes such as retention in the program, virologic success and survival. Etienne et al studied a tiered approach to retention in care and adherence in 27 countries and found that those centers that utilized community programs, intensive adherence education and active monitoring of pill taking had the best results when compared to centers that only offered basic patient education .
We performed a prospective, observational cohort analysis of a single medical center that utilizes tiered approach retention in care and adherence promotion . As a precondition to participation into the program, patients agree to participate all of the treatment and adherence activities. In reality, many patients only participate in some, allowing for an evaluation of the relative, individual contribution of each of the interventions on the long-term patient outcomes through a multivariate analysis. Thus we can identify the most effective, easily scalable, practices that will support sustainability of the anti-retroviral effort in resource limited settings.
AIC Kijabe Hospital is a 265 bed hospital located 60 kilometers northwest of Nairobi, Kenya. It follows approximately 6000 patients on anti-retroviral therapy at six locations in Central Kenya. Kenya utilizes a catchment system of care for HIV patients and thus only those who live within a 40 km radius of the hospital are eligible for enrollment into the treatment program. The program utilizes a wide array of personnel to provide care that include consultant physicians, medical officers and clinical officers. Nurses assist in care in the clinics and coordinate community health workers. A community heath program using nurses and community health workers acts as a liaison between the clinics and the patients and manages community-based facilitators of adherence and retention into care. All medications are dispensed by the Kijabe pharmacy by a pharmacist. Medical records are abstracted and entered into an electronic database.
The Kijabe HIV program utilizes the highest tiered approach to facilitate adherence and promote retention into care described by Etienne et. al. A schematic of the treatment program and of the study are shown in Figure 1. The nature of adherence support and training of staff are described in the prior publication. . During the first six months of HIV therapy, patients must agree to participate in all adherence activities as a condition for receiving medication. Specific elements of the program include:
The HIV program is divided into 3 distinct activities, HIV testing, Treatment Preparation, and Antiretroviral treatment that includes both community and clinic based facilitators. For entry into the study, subjects must be HIV positive and complete all treatment preparation activities. The study period begins with initiation of ART and evaluates the effects of treatment facilitators on treatment success.
Treatment Preparation Classes
Patients learn about HIV infection, treatment, the importance of adherence and of programmatic requirements. There are three required classes over 3 weeks, each lasting about one hour.
Patients are required to identify a treatment buddy who is typically someone who has already been in treatment to encourage and assist with medication adherence.
Patients sign a contract agreeing to participate in both the community program and in the medical care provided by the program.
- Home Visits. Within one month of initiating ART, community health workers visit patients in their homes and assess barriers to care, patient adherence to medication and overall health status. Patients are referred back to the clinic if acute medical problems are encountered. Repeat visits are scheduled each month as need.
- Support Groups Meetings. Support group meetings are held monthly in each of the six local communities where there are clinic sites. Meetings are typically held in local churches. Community health workers organize the support group. Patients attend with their treatment buddies. There are open discussions of both problems and successes associated with HIV therapy.
Patients must come to the clinic on a monthly basis for the first six months. They undergo a medical evaluation by their care provider.
- Unannounced Pill Counts. Patient providers count pills to assess their adherence and to provide a context for adherence counseling.
- Pharmacy Counseling. After the care provider visit, the patient meets with a pharmacist to discuss any difficulties in taking medication and to further address adherence issues discovered during the provider visits.
Study participants were recruited from AIC Kijabe Hospital's HIV Program.
Eligibility requirements for the study were:
- HIV positive by Kenyan National AIDS and STI Control Program Criteria.
- Age greater than 18 years old.
- Anti-retroviral naïve with the exception of women who had previously received medication as part of prevention of mother to child transmission.
- Completion of anti-retroviral treatment preparation course.
- Identification of a Treatment buddy.
- Signed treatment contract.
- Providing informed consent.
This study was approved by the A.I.C. (African Inland Church) Kijabe Hospital Ethics Board, and the Kenya Medical Research Institute National Ethics Committee and the University of Texas Medical Branch Institutional Review Board. All subjects provided written informed consent prior enrollment into the study. Consent forms were available in both English and Swahili. For subjects who could not read either language, the consent form was explained to them by native speakers in their mother tongues.
This was a prospective, observational cohort study that did not involve an intervention.
The objective of this study was to compare the relative effect of participation in ongoing facilitators of retention into care and adherence that occur after treatment initiation on time to treatment failure. Specific facilitators evaluated were:
- Home visits
- Support Groups Meetings
- Pharmacy Counseling
- Un-announced Pill Counts
The primary outcome was defined as time to treatment failure from date of initiation of anti-retroviral medication. Treatment failure was defined as any one of the following:
- Virologic failure: defined as failure to achieve an HIV-1 RNA less than 200 copies/ml at 6 months or an HIV-1 RNA greater than 200 copies/ml at one year after achieving an undetectable viral load.
- Lost to Follow Up: Defined as not appearing for any treatment program activities for 90 days and inability of the community health workers to find the subject.
- Discontinuation of Therapy: Defined as not picking up prescriptions for ninety days.
- Death: verified by clinical personnel or by community health workers performing home visits.
Participants were followed for one year after initiation of ART. Data was primarily collected from the patient medical record. Demographic data was collected from participant charts at baseline. CD4 counts were performed at initiation of therapy following standard of care. Viral loads were measured on study participants at baseline, 6 months, and 12 months. Data was managed using Microsoft Access. Dispensation of anti-retroviral drugs was collected from months 1 to 12. Participation in each of the key activities of the study was collected at each month.
Kijabe utilizes patient treatment logs for both clinical and administrative purposes and these were used to confirm patient participation in study activities. All participants in support groups were required to sign an attendance sheet at the beginning of each meeting. Confirmation of home visits was confirmed by reviewing travel receipts for community health workers. Pharmacists confirm counseling visits in the dispensation record. Pill counts were solely recorded in the clinic record at the time the patient was seen by the clinician.
Blood samples were drawn from participants at baseline, 6 months, and 12 months. Serum was separated and stored in a −80 freezer for batched HIV-1 RNA testing. HIV-1 RNA testing was performed at AIC Kijabe Hospital using the ExaVir HIV-1 RT assay (Cavidi, Uppsala Sweden). This is an HIV-1 RT assay that correlates well with standard HIV-1 PCR and is widely used in resource-limited setting . Samples were stored in a −20 freezer until they could be run in batches. HIV CD4 testing was performed using FACSCount (BD, UK).
Preliminary data from a quality improvement project performed in 2008 found that 85% of HIV positive adults at Kijabe who had been on anti-retroviral therapy from 9–18 months had an undetectable HIV-1 viral load. The same study found a drop out rate of 10% for subjects who were initiated on anti-retroviral therapy. From this data, we assumed that 25% of subjects would be treatment failures in our study. Based on this, 280 subjects would provide an 80% power at a significance level of 0.05 when 5 independent variables are included; corresponding to an odds ratio of 2.5.
The primary endpoint was time to clinical failure. Failure was defined as being lost to follow-up, death, or having a detectable viral load at the end of study follow-up. The relationship between each patient activity and treatment success or failure was evaluated using Pearson's CHI squared test, Fishers exact test or student t test where appropriate. Adherence to medication was collected by review of pharmacy refill records for each participant using the method described by El-Khatib . Time to failure was modeled using Kaplan-Meier plots.
The effects of participation in study activities on treatment failure were compared in two ways: first as a (Yes/No) and then a cut point between the differences in the medians between of treatment successes and failures. Those factors that were statistically significant (P<0.05) were further evaluated by comparing time to treatment failure. Significant differences between treatment failure and success were further evaluated using Cox Proportional Hazard regression models. The level of statistical significance utilized was p<0.05
Participant Flow is shown in Table 1. Subjects were enrolled between November 1, 2009 and April 20, 2010. There were 351 subjects screened. Of these 50 (14%) were ineligible because of age, prior ART or a subsequent negative HIV test. This latter group is of interest because all came to the study with reports of positive HIV test. Repeat HIV testing were negative in all of these including a negative HIV viral load. There were 301 subjects enrolled. Of these, 10 transferred out of care and their data was censored. Of the remaining 291 subjects, 85 (29%) were treatment failures and 206 were treatment successes. Only 40% of subjects participated in all of the required adherence activities.
Table 2 compares the baseline characteristics between the treatment successes and treatment failures. There were no differences between the groups with regard to age at initiation of therapy, baseline CD4 cell counts, baseline viral load, employment status or distance to clinic. Treatment successes were more likely to be female (74% vs. 61%, P = 0.027, Pearsons Chi square test). Adherence as measured by pharmacy refill history was better in the treatment successes than the failures (90% vs. 82%, P = 0.043, Pearsons Chi square test). Successes were more likely to attend support group meetings (median 3 vs. 2, P = 0.001, Fisher's exact test), to have pharmacy counseling (median 2 vs. 1, P = 0.01, Fisher's exact test), to have a pill count performed by their clinician at a clinic visit (median 4 vs. 3, P = 0.001, Fisher's exact test) and to have attended all six of their clinic visits within the first 6 months of therapy (median 6 vs. 5, P = 0.001, Fisher's exact test). There was no difference in the median number of home visits between treatment successes and failures.
Figure 2 compares the percent adherence between the treatment successes and failures by median number of patient activities. The cut points for each of the interventions were based on the medians shown in Table 2. Adherence was significantly higher in those who participated in 3 or more support group meetings (90% vs. 83%, P<0.05), who had pill counts performed by their clinician (90% vs. 76%, P = 0.001, and who attended all clinic visits (90% vs. 72% P = 0.001). Homes visits and pharmacy counseling were not associated with differences in adherence.
Rates of adherence in treatment successes and failures is shown by each intervention: 1) greater than one home visit; 2) participation in two or more support groups; 3) having four or more unannounced pill counts by primary care provider; 4) having two or more counseling sessions by a pharmacist; 5) completing six or more clinic visits.
Time to treatment failure is shown in Figure 3. There was a significantly shortened time to treatment failure associated with having home visits (463 days vs. 394 days), having four or more pill counts by their provider (481 days vs. 355 days), participating in three or more support groups (480 days vs. 425 days), and participating in 2 or more pharmacy counseling sessions (461 days vs. 338 days). Each of these comparisons were statistically significant with P<0.05 by log-rank test.) However, when time to treatment failure was analyzed based on whether subjects had ever participated in any of the adherence activities (yes vs. no) only participation support groups, ever having a pill count performed or completing all six clinic visits were statistically significant. We analyzed the whether the total number of activities that the subjects participated in was predictive of outcome but could find no significant associations.
Kaplan Meier plots of time to treatment failure stratified by: A) participation in two or more support group meetings; B) having four or more unannounced pill counts by primary care provider; C) at least one home visit; D) having two or more counseling sessions by a pharmacist.
Multivariate analysis of the time to treatment failure using the Cox Proportional Hazards model is shown in Table 3. The baseline characteristics that were considered for inclusion into the model are listed in paragraph one and in Table 2. In addition, we also tested CD4 cell count, log of viral model as these have been previously shown to affect time to failure. In the multivariate analysis, CD4 and viral load were not significant and were not significant in comparison of baseline differences in outcomes and were ultimately not included in the model. Tests of co-linearity between clinic visits, pill counts, and pharmacy visits were not significant (p>0.05 for all comparisons) On multivariate analysis, there was a significant reduction in risk of failure with completion of all clinic visits (HR = 0.46, p = 0.003), participation in 3 or more support groups (HR = 0.54, p = 0.014) and having 4 or more pill counts performed by the subjects clinicians (HR = 0.57, p = 0.026).
There is an urgent need to identify effective facilitators of adherence and retention to care in resource limited settings. Observational studies can help identify potentially effective means of promoting successful treatment outcomes and can direct future investigations. Many studies are retrospective and/or use retention in care as the primary endpoint –, , –. The high lost to follow up rates in such analysis had led to the call for better methods to assess vital status in resource limited settings –. In this study, we sought to determine the elements of a treatment program that were associated with successful HIV care. The setting for the study included both community and hospital based activities and utilized multiple, evidence based interventions to promote adherence to HIV care. Although subjects agreed to participate in all of these activities as a precondition to entry, only 40% of subjects were 100 percent compliant, thus allowing for an evaluation of the relative, individual contribution of each of the interventions on the long-term patient outcomes through a multivariate analysis. The prospective nature of this analysis meant that we were able to account for all but seven percent of the patients who enrolled in the study, a percentage that is significantly lower than reported in other studies. Our use of multiple viral load tests allowed for earlier recognition of failure of anti-retroviral medications. Had we solely relied on CD4 count declines, it may have taken several years before individuals had reached a clinical endpoint. Of the facilitators evaluated, we found participation in community based support groups, and unannounced pill counts performed by the patients care provider in front of the patient were associated with improved adherence and decreased risks of treatment failure. We also found that women were more likely to be successfully retained in care and treated, a finding that has been seen in other studies .
A significant finding of this study is that pill counts were associated with better treatment outcomes. Although pill counts have been widely studied as tool to measure adherence, there has been little evaluation of their use as facilitators of adherence. In our study, we examined only whether a pill count was performed but did not collect data on what the actual pill count was. We found that the number of times a pill count was performed as associated with both better adherence and better treatment outcomes, suggesting that intermittent pill counts may have a motivational effect on patients that result in better outcomes. In addition, pill counts are easy to perform, do not require special technology and are easily implemented across a wide spectrum of settings.
Our data has important implications for future research and for allocation of both clinical and research resources. Performance of pill counts by the clinician would seem to be a relatively easy and effective method for promoting adherence. Community based support groups require planning, personnel and travel, but also have a demonstrated clinical benefit. On the other hand, counseling by a pharmacist was not associated with clinical benefit nor did regular home visits seem to improve outcomes. The pharmacy counseling requires the time of a pharmacist and home visits require both community health workers time and travel. It may be that these interventions are not necessary for routine patient care and are best targeted for patients who have specific needs.
The results must be interpreted with caution. The study design is observational and thus there is potential for un-measured biases that could affect the outcome. An underlying assumption of the study was that each of the facilitators evaluated were independent predictors of treatment outcome. We were able to demonstrate associations between these interventions and did not find any interaction between significant facilitators on multivariate analysis. There was also no association between the total number of facilitators that subjects participated in and outcome, suggesting that the results were due to the individual factors evaluated and not to the total system of care. In addition, the study was performed within a single organization with multiple sites in rural Kenya and it is not clear how generalizable the results would be to other systems of care in other settings. We also did not perform a cost benefit analysis hence any discussion of cost effectiveness of the interventions would be speculative.
However, statistical associations do not demonstrate causality and further evaluations of our findings are warranted. The best way to evaluate the effectiveness of these interventions would be with a cluster-randomized trial using multiple sites. In such a design, one site would perform pill counts, another would perform have support groups in the community setting and a third would perform post clinic pharmacy counseling. The effect on clinical failure of each intervention would be determined. This would also allow for qualitative and quantitative assessments of the social, cultural and spiritual influencers on adherence and test interventions to address those influencers on the markers of failure and success.
A formal cost analysis could also be performed and the cost benefit of each intervention could be determined. Such a strategy would allow for the identification of the most cost effective interventions that could then be replicated in other settings.
Conceived and designed the experiments: LA PK SO NS JM. Performed the experiments: LA HM SO EO. Analyzed the data: LA PK LB. Wrote the paper: LA LB NS PK.
- 1. Anon. “Sixth Annual Report to Congress on PEPFAR Program Results” (2010) Available: http://www.pepfar.gov/press/sixth_annual_report/ Accessed 2011 Apr 28.
- 2. Anon. “JOINT WHO-UNICEF-UNAIDS- PEPFAR CAPACITY-BUILDING WORKSHOP: STRENGTHENING REPORTING AND MONITORING IN THE HEALTH SECTOR FOR THE AFRICA REGION” (2010) Available: http://whqlibdoc.who.int/publications/2011/9789241501323_eng.pdf. Accessed 2011 Apr 28.
- 3. Ekouevi DK, Balestre E, Ba-Gomis FO, Eholie SP, Maiga M, et al. (2010) Low retention of HIV-infected patients on antiretroviral therapy in 11 clinical centres in West Africa. Tropical Medicine & International Health 15: 34–42.
- 4. Rosen S, Fox MP, Gill CJ (2007) Patient Retention in Antiretroviral Therapy Programs in Sub-Saharan Africa: A Systematic Review. PLoS Med 4: e298.
- 5. Fox MP, Rosen S (2010) Patient retention in antiretroviral therapy programs up to three years on treatment in sub-Saharan Africa, 2007–2009: systematic review. Tropical Medicine & International Health 15: 1–15.
- 6. Bendavid E, Bhattacharya J (2009) The President's Emergency Plan for AIDS Relief in Africa: An Evaluation of Outcomes. Annals of Internal Medicine 150: 688–695.
- 7. Chalker J, Wagner A, Tomson G, Laing R, Johnson K, Wahlström R, et al. (2010) Urgent Need for Coordination in Adopting Standardized Antiretroviral Adherence Performance Indicators. JAIDS Journal of Acquired Immune Deficiency Syndromes 53: 159–161.
- 8. Bangsberg DR, Hecht FM, Charlebois ED, Zolopa AR, Holodniy M, et al. (2000) Adherence to protease inhibitors, HIV-1 viral load, and development of drug resistance in an indigent population. AIDS 14: 357–366.
- 9. Bangsberg DR, Perry S, Charlebois ED, Clark RA, Roberston M, Zolopa AR, et al. (2001) Non-adherence to highly active antiretroviral therapy predicts progression to AIDS. AIDS 15: 1181–1183.
- 10. Chung MH, Richardson BA, Tapia K, Benki-Nugent S, Kiarie JN, Simoni JM, et al. (2011) A Randomized Controlled Trial Comparing the Effects of Counseling and Alarm Device on HAART Adherence and Virologic Outcomes. PLoS Med 8: e1000422.
- 11. Jerome G, Ivers LC (2010) Community health workers in health systems strengthening: a qualitative evaluation from rural Haiti. AIDS 24: S67–S72. [cited 2011 Mar 14.
- 12. Krebs DW, Chi BH, Mulenga Y, Morris M, Cantrell RA, et al. (2008) Community-based follow-up for late patients enrolled in a district-wide programme for antiretroviral therapy in Lusaka, Zambia. AIDS Care 20: 311–317.
- 13. Ford N, Nachega JB, Engel ME, Mills EJ (2009) Directly observed antiretroviral therapy: a systematic review and meta-analysis of randomised clinical trials. Lancet 374: 2064–2071.
- 14. Chang LW, Kagaayi J, Nakigozi G, Ssempijja V, Packer AH, et al. (2010) Effect of Peer Health Workers on AIDS Care in Rakai, Uganda: A Cluster-Randomized Trial. PLoS ONE 5: e10923.
- 15. Mugusi F, Mugusi S, Bakari M, Hejdemann B, Josiah R, et al. (2009) Enhancing adherence to antiretroviral therapy at the HIV clinic in resource constrained countries; the Tanzanian experience. Trop Med Int Health 14: 1226–1232.
- 16. Muyingo SK, Walker AS, Reid A, Munderi P, Gibb DM, et al. (2008) Patterns of individual and population-level adherence to antiretroviral therapy and risk factors for poor adherence in the first year of the DART trial in Uganda and Zimbabwe. J Acquir Immune Defic Syndr 48: 468–475.
- 17. Fairley CK, Levy R, Rayner CR, Allardice K, Costello K, et al. (2003) Randomized trial of an adherence programme for clients with HIV. Int J STD AIDS 14: 805–809.
- 18. Nachega JB, Knowlton AR, Deluca A, Schoeman JH, Watkinson L, et al. (2006) Treatment supporter to improve adherence to antiretroviral therapy in HIV-infected South African adults. A qualitative study. J Acquir Immune Defic Syndr 43: S127–133.
- 19. Nellen JFJB, Nieuwkerk PT, Burger DM, Wibaut M, Gras LA, et al. (2009) Which method of adherence measurement is most suitable for daily use to predict virological failure among immigrant and non-immigrant HIV-1 infected patients? AIDS Care 2009 21: 842–850.
- 20. Pearson CR, Micek MA, Simoni JM, Hoff PD, Matediana E, et al. (2007) Randomized control trial of peer-delivered, modified directly observed therapy for HAART in Mozambique. J Acquir Immune Defic Syndr 46: 238–244.
- 21. Haberer JE, Kahane J, Kigozi I, Emenyonu N, Hunt P, et al. (2010) Real-time adherence monitoring for HIV antiretroviral therapy. AIDS Behav 14: 1340–1346.
- 22. Etienne M, Burrows L, Osotimehin B, Macharia T, Hossain B, et al. (2010) Situational analysis of varying models of adherence support and loss to follow up rates; findings from 27 treatment facilities in eight resource limited countries. Trop Med Int Health 1: 76–81.
- 23. Stevens G, Rekhviashvili N, Scott LE, Gonin R, Stevens W (2005) Evaluation of Two Commercially Available, Inexpensive Alternative Assays Used for Assessing Viral Load in a Cohort of Human Immunodeficiency Virus Type 1 Subtype C-Infected Patients from South Africa. J Clin Microbiol 43: 857–861.
- 24. El-Khatib Z, Katzenstein D, Marrone G, Laher F, Mohapi L, et al. (2011) Adherence to Drug-Refill Is a Useful Early Warning Indicator of Virologic and Immunologic Failure among HIV Patients on First-Line ART in South Africa. PLoS ONE 6: e17518.
- 25. Dalal RP, Macphail C, Mqhayi M, Wing J, Feldman C, et al. (2008) Characteristics and outcomes of adult patients lost to follow-up at an antiretroviral treatment clinic in johannesburg, South Africa. J Acquir Immune Defic Syndr 47: 101–107.
- 26. Bassett IV, Wang B, Chetty S, Mazibuko M, Bearnot B, et al. (2009) Loss to care and death before antiretroviral therapy in Durban, South Africa. J Acquir Immune Defic Syndr 51: 135–139.
- 27. Klausner JD, Serenata C, O'Bra H, Mattson CL, Brown JW, et al. (2011) Scale-up and continuation of antiretroviral therapy in South African treatment programs, 2005–2009. J Acquir Immune Defic Syndr 56: 292–295.
- 28. Anglaret X, Toure S, Gourvellec G, Tchehy A, Zio L, et al. (2004) Impact of vital status investigation procedures on estimates of survival in cohorts of HIV-infected patients from Sub-Saharan Africa. J Acquir Immune Defic Syndr 35: 320–323.
- 29. Geng EH, Glidden DV, Emenyonu N, Musinguzi N, Bwana MB, et al. (2010) Tracking a sample of patients lost to follow-up has a major impact on understanding determinants of survival in HIV-infected patients on antiretroviral therapy in Africa. Trop Med Int Health 15: 63–69.
- 30. Geng EH, Bangsberg DR, Musinguzi N, Emenyonu N, Bwana MB, et al. (2010) Understanding reasons for and outcomes of patients lost to follow-up in antiretroviral therapy programs in Africa through a sampling-based approach. J Acquir Immune Defic Syndr 53: 405–411.