Retention of patients in ART care is a major challenge in sub-Saharan programs. Retention is also one of the key indicators to evaluate the success of ART programs.
Methods and Findings
A retrospective review of 1500 randomly selected medical charts of adult ART patients from a local non-governmental (NGO) supported ART program in the Democratic Republic of Congo (DRC). Retention was defined as any visit to the clinic in the 4 months prior to the abstraction date. Retention over time and across different sites was described. The relationship between patient characteristics and retention rates at 1 year was also examined. 1450 patients were included in the analysis. The overall retention rates were 81.4% (95% CI: 79.3–83.4), 75.2% (95% CI: 72.8–77.3), 65.0% (95% CI: 62.3–67.6) and 57.2% (95% CI: 54.0–60.3) at 6 months, 1 year, 2 years and 3 years respectively. The retention rates between sites varied between 62.1% and 90.6% at 6 months and between 55.5% and 86.2% at 1 year. During multivariable analysis weight below 50 kg (aHR: 1.33, 95%CI: 1.05–1.69), higher WHO stage at initiation (aHR: 1.22, 95%CI 0.85–1.76 for stage 3 and aHR: 2.98, 95%CI: 1.93–4.59 for stage 4), and male sex (aHR: 1.32, 95%CI: 1.05–1.65) remained as significant risk factors for attrition during the first year after ART initiation. Other independent risk factors were year of initiation (aHR: 1.73, 95%CI: 1.26–2.38 for the year 2007 and aHR: 3.06, 95%CI: 2.26–4.14 for the period 2008–2009), and site.
Retention is a major problem in DRC, while coverage of patients on ART is still very low. With the flattening of funding for HIV care and treatment in sub-Saharan Africa, and with decreasing funding worldwide, maximizing retention during the much needed scaling-up will even be more important.
Citation: Koole O, Kalenga L, Kiumbu M, Menten J, Ryder RW, Mukumbi H, et al. (2012) Retention in a NGO Supported Antiretroviral Program in the Democratic Republic of Congo. PLoS ONE 7(7): e40971. doi:10.1371/journal.pone.0040971
Editor: Patricia Kissinger, Tulane University, United States of America
Received: November 23, 2011; Accepted: June 19, 2012; Published: July 17, 2012
Copyright: © 2012 Koole et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The study was funded by the Flemish Interuniversity Council (ZRDC 2007 MP037). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Access to antiretroviral therapy (ART) continues to expand rapidly, especially in Sub-Saharan Africa. At the end of 2009 about 5.25 million people were receiving ART worldwide, and ART coverage reached about 36%.  However long term retention of patients in ART care remains a major challenge in sub-Saharan programs.  Results from a meta-analysis showed that only 75% of patients started on ART were still in care after 1 year, and about 61% after 2 years.  The major causes of non-retention (or attrition) are death and loss to follow-up (LTFU). –.
Retention is also one of the key indicators to evaluate the success of ART programs. .
Improved retention in HIV programs is also one of the goals of the Treatment 2.0 initiative.  The Treatment 2.0 initiative, aims at further scaling up treatment over the next decade while maximizing the efficiency and effectiveness of HIV treatment.
There are currently no data available on retention in ART programs in the Democratic Republic of Congo (DRC). The objective of this study was to estimate the level of retention of patients in the AmoCongo ART program across different sites in the Democratic Republic of Congo (DRC). The study also examined the relationship between patient characteristics and retention rates.
Design and Settings
AmoCongo is a Congolese non-governmental organization (NGO), that began in 1993 with providing support for orphans and vulnerable children in Kinshasa. Over the years the NGO expanded its activities to several provinces and included voluntary counseling and testing, and provision of HIV care to adults.
In 2005 AmoCongo started with the provision of ART care in their Ambulatory Treatment Centers (ATCs), which are standalone clinics that offer counseling and testing, and HIV care. At the moment of the study AmoCongo received substantial funding from abroad (GFATM), which enabled them to use a doctor-based approach with assistance of registry clerks, counselors, and nurses, and with regular laboratory monitoring and free OI drugs and ART.
These centers have played a major role in the scaling up process of ART in the DRC. At the end of 2009, AmoCongo had ATCs in 27 health zones and had about 11,000 patients on ARVs, about one third of the patients on ART in the DRC at that moment.
A retrospective cohort study of patients started on ART in the period 2005–2009 was conducted in the Democratic Republic of Congo (DRC) at six AmoCongo ART treatment centers. To ensure a balanced geographical spread study, sites were selected from different provinces: Kinshasa Province (Ndjili and Kasavubu), Katanga Province (Lubumbashi), Bas-Congo Province (Matadi), Kasaï-Occidental province (Kananga) and Equatorial Province (Mbandaka ) (Figure 1). Only sites with at least 300 patients on ART at the moment of data abstraction were considered for inclusion in the study.
Patients who were at least 18 years of age at ART initiation and who initiated ART treatment (combination of 3 ARVs) at least six months prior to the data collection were included in the study. Patients who started ART before 1st of January 2005 were excluded.
During the period September-December 2009 a retrospective chart review of 1500 medical charts was conducted. In each of the six research sites a random sample of 250 medical charts was selected from a sampling frame that consisted of all patients ever started on ART at that site. The sampling frame was prepared by the site supervisor; the list of the medical files to be selected was generated by the data analyst using a computerized random number generator (‘sample’ function in Stata). Randomly selected patients that were not eligible for the study were replaced by the next patient in the sampling frame.
Data abstraction was done by a team of 3 trained data abstractors per site and the site supervisor.
Data Management and Analysis
A random sample of 250 ART-treated patients in each site was needed to allow the estimation of the retention rate to be measured with a precision of 5%, assuming the retention rate was at least 80%.
In the AmoCongo program, patients receive a supply of ART for 1 up to 3 months (depending on their clinical status, adherence and external factors as distance to the clinic). Retention in the ART program was defined as any visit to the clinic (for a clinical visit, or laboratory monitoring, or for drug refill at the pharmacy) in the 4 months prior to the abstraction date.
Retention rates overall and in each site were estimated using survival analysis methods: Kaplan-Meier survivor curves were constructed with 6 months, 1 year, 2 year and 3 year retention rates. The time origin was the date of ART initiation. Conform with the major causes of non-retention (or attrition) and published literature , , , the primary outcome was defined as death or loss to follow-up. As in the AmoCongo program some patients on ART received up to 3 months of supply of ART, the event of interest was defined as a reported death or no visit to the clinic in the 4 months prior to the abstraction date while not being transferred out. Patients retained in the program or patients who were transferred out were censored at their last visit. For patients who were reported dead (by the relatives or caregivers), the date of death was used to determine the time in the program, for patients who were considered not retained in the program (no visit in the 4 months prior to the abstraction date) the date of the last visit was used.
Consistent with the majority of studies reporting on risk factors for mortality and attrition – multivariable Cox-regression models were used to describe the associations between attrition during the first 1 year after ART initiation and individual characteristics. The predictor analysis was limited to 1 year after ART initiation because attrition is highest during this period , and because the association between baseline values and the outcome wanes after this period. Predictor variables evaluated were age, gender, civil status, prior ART experience at another site, weight (instead of BMI because height was not available in the medical files), WHO clinical stage and CD4 count at start of ART, distance from the clinic, the ART regimen (NVP or EFV based) and the year ART began. Variables associated with retention with a p-value ≤0.10 were considered for multivariable analysis. The model was reduced by backward stepwise elimination until all variables had a p-value ≤0.05. All associations were tested using likelihood-ratio tests. Site was included in the model as a fixed effect. As Kasavubu (Kinshasa) was the eldest and most experienced site, this site was considered as the reference site. This site was also used as training center for health care workers from the other sites.
For variables with less than 10% missing values conditional imputation was used and for variables with at least 10% missing data the missing indicator method (in which a separate category is generated for patients with data missing for a certain predictor).
During a sensitivity analysis the association between risk factors and attrition was examined while censoring the reported deaths.
Because of the limited number of study sites, the relationship between key site characteristics and attrition was investigated as a purely explorative objective. A Cox-proportional hazards model, adjusted for clustering at the site (using a shared frailty approach) was used.
Data were entered centrally in a research database using EpiData Entry 3.1 (EpiData Association, Odense, Denmark, Europe). All statistical analyses were performed using Stata software, version 11.2. (Stata Corporation, College Station, TX, USA).
Due to the nature of the study it was not possible and feasible to obtain informed consent from the patients whose medical charts were abstracted for the study. Data were extracted from routine records, and were analyzed anonymously.
The study protocol and data collection forms were approved by the Institutional Review Board (IRB) of the School of Public Health in Kinshasa, by the IRB of the Institute of Tropical Medicine in Antwerp and by the Ethics Committee University Hospital Antwerp.
A total of 1,500 medical files were abstracted. Of these 50 were excluded: 2 patients were below 18 years at ART initiation, 29 had a missing date of ART initiation and 19 patients started ART before 2005. 1450 patients were included in the analysis (Figure 2).
Patients started ART in the period between January 2005 and March 2009. The number of patients initiated on ART increased over the years. Two thirds of patients were women, the mean age at start of ART was 40 years (range: 18–74), the mean weight was 56.9 kg (SD: 13.6). Only 525 patients (36.2%) had a CD4 cell count and only 446 patients (30.8%) had a total lymphocyte count before starting ART. The median CD4 cell count was 150 cells/µl (IQR: 171–238). About two thirds (67.3%) of patients were in WHO stage 3 or 4. All except 5 patients were started on a NNRTI-based regimen (Table 1).
The six study sites started providing ART between 2005 and 2006. Kinshasa (with 2 sites), Lubumbashi and Matadi are urban sites, while Mbandaka and Kananga can be considered as semi-urban sites. At the time of the study, the semi-urban sites had less patients in follow-up and received fewer supervisions compared to the urban sites. Supervisions consisted of a visit of an experienced HIV physician and nurse to provide clinical support and support to the data collection process.
Four of the sites contributed data to the IeDEA Central Africa database and had access to an electronic data management system (DMS), and standardized data collection forms. However at the time of the study none of the four sites were able to use the reporting tool for patient care purposes (Table 2).
CD4 cell count was available at three of the six sites, in one site (Matadi) samples for CD4 were referred to a private lab.
Distance or time to travel to the clinic was available for 4 sites only, data on this variable was unavailable for the 2 semi-urban sites: 86% of patients were living within 2 hours traveling, 12% >2 hours and 2% had no data (data not shown).
The overall retention rates were 81.4% (95% CI: 79.3–83.4), 75.2% (95% CI: 72.8–77.3), 65.0% (95% CI: 62.3–67.6) and 57.2% (95% CI: 54.0–60.3) at 6 months, 1 year, 2 years and 3 years respectively (Figure 3). The median follow-up time overall was 19 months, ranging from 15.3 months at Mbandaka to 24.2 months in Kasavubu (Kinshasa). The retention rates between sites varied between 62.1% and 90.6% at 6 months and between 55.5% and 86.2% at 1 year (Figure 4). During the first year 350 patients were lost from the program (Figure 2), 88 of them (25.1%) were reported dead and 262 (74.9%) were lost to follow-up.
Risk Factors for Attrition
During multivariable analysis weight and WHO stage at initiation, gender, site and year of initiation remained as significant independent risk factors for attrition during the first year after ART initiation (Table 3). Patients who started ART in 2007 (aHR: 1.73, 95%CI: 1.26–2.38), and in 2008–2009 (aHR: 3.06, 95%CI: 2.26–4.14) were more likely to experience higher attrition (Figure 5) using the 2005–2006 cohort as a reference. Patients from the semi-urban sites (Kananga, aHR: 1.41, 95%CI: 0.95–2.11 and Mbandaka, aHR: 2.85, 95%CI: 1.91–4.25) experienced higher attrition compared to the cohort of Kasavubu, the center that was considered as the reference center. Male patients (aHR: 1.32, 95%CI: 1.05–1.65) were more likely to suffer from attrition. Weight below 50 kg (aHR: 1.33, 95%CI: 1.05–1.69) and a higher WHO clinical stage (aHR: 1.22, 95%CI 0.85–1.76 for stage 3 and aHR: 2.98, 95%CI: 1.93–4.59 for stage 4) were also independent risk factors.
During sensitivity analysis considering only LTFU as the outcome, the same risk factors were found as for attrition.
During the explorative analysis a high degree of collinearity between the site characteristics was found. Because of this and the limited number of study sites the model building only considered three plausible site predictors for attrition (reflecting different aspects of quality of care): number of providers, number of supervisions and CD4 availability at the health facility. The final model consisted of the same patient characteristics as the ones retained in the final fixed effect model (with similar effect sizes), and retained the number of supervisions (aHR for each additional supervision per 6 months: 0.84, 95%CI: 0.75–0.95) as site characteristic variable (data not shown).
As far as we know this is the first study on retention in the DRC across different sites, using a standardized data extraction tool. The overall retention rates in this local NGO supported ART program in DRC were 81.4% (95% CI: 79.3–83.4), 75.2% (95% CI: 72.8–77.3), 65.0% (95% CI: 62.3–67.6) and 57.2% (95% CI: 54.0–60.3) at 6 months, 1 year, 2 years and 3 years respectively. These low retention rates demonstrate that retention is a major challenge. Although these results seem comparable to those from other studies in sub-Saharan Africa settings , , we need to be cautious in interpreting these numbers. Whereas most of the sub-Saharan countries managed to scale up their coverage of patients on ART (with an average coverage of 36% at the end of 2009) , the DRC is lagging behind with a reported coverage of only 12.4% in 2010.  In other words, these low retention rates are even more sobering when considering the limited scaling up of ART in the DRC. Furthermore these results come from a local NGO program, which might not be representative of the situation in the public sector in the country.
There was a wide variability of retention rates between the different sites, (between 62.1% and 90.6% at 6 months and between 55.5% and 86.2% at 1 year). Retention rates were significantly lower in the 2 semi-urban sites. These 2 centers were smaller treatment centers with smaller number of health care providers and patients in HIV care. These findings contrast somehow with other studies reporting better retention in rural and decentralised sites because of greater access to services and better integration of services. – Probably other factors contributed to this: these centers did not have access to CD4 cell count, were not participating in the IeDEA Central Africa database (and thus did not receive the same level of support), they also received less supervisory visits. This emphasises the need for timely monitoring of key indicators (such as mortality, retention) and regular supervisory visits for training and mentoring.
Patients who started ART during the scaling up process (2007–2009) were more at risk to be lost to follow-up compared to patients starting ART during the early years (2005–2006), a finding that concurs with results from other studies. ,  Rapid scaling-up may have compromised the organisation and quality of care. In the six study sites the number of patients on ART increased from 1570 in 2006 to about 7800 in 2009. This again demonstrates the need for an electronic database system with a user-friendly reporting tool enabling programs to actively and timely track patients not showing up for their scheduled appointment. An active defaulter system will also improve the reliability of mortality data of a cohort. In our study, 25% of patients not retained in the first year consisted of reported deaths, meaning that LTFU was the dominant contributor to attrition. This is consistent with findings from other ART programs in sub-Saharan Africa. ,  Other studies have shown that more than 50% of patients LTFU have, in fact, died. ,  Due these high mortality rates among patients LTFU after ART, and to avoid overestimation of success of ART programs, it is recommended to use attrition (death and LTFU) instead of mortality only to evaluate the success of programs. .
Male sex, weight below 50 kg and higher WHO stage at initiation were independent risk factors for attrition, a finding that concurs with results from other studies from sub-Saharan Africa. , ,  Attrition was highest in the first months on ART. This can be explained by the elevated early mortality as demonstrated by others, , , ,  and this in turn is due to the late presentation of patients in an advanced stage. During multivariable analysis CD4 cell count was not an independent risk factor but this could be due to the limited availability of CD4 cell count. The fact that more than half of the patients included in the study did not have a baseline CD4 cell count demonstrates the limited availability of CD4 cell count in the DRC. The limited access to ART and OI drugs for opportunistic infections (OI) in the country have resulted in persisting waiting lists for ART. WHO  recommends that ART should be started at a CD4 count of 350 cells/µl. However today many treatment centers in DRC are decreasing their threshold for ART even below 200 CD4 cells/µl because of insufficient access to ART. Limited CD4 cell count availability, reluctance to initiate ART without CD4 cell count (despite the WHO guidelines), the cost of laboratory tests and X-rays further hinder the scaling-up of ART in DRC.
Increasing CD4 cell count availability mainly for determining eligibility for ART, and less for clinical monitoring should be one the priorities. The DART study  showed that a greater public health effect would be gained from widening access to ART rather than providing routine laboratory monitoring for patients already receiving ART. In a resource-limited setting as the DRC, clinical monitoring during the first two years on treatment might be more cost-effective instead of the routine laboratory monitoring which is currently in practice.
Distance or time to travel was not an independent risk factor for attrition in our study, contrary to other studies  but this could be due to unavailability of this data in two of our study sites.
Limitations of the study are related to the limitations of a retrospective chart review and consist mainly of incomplete data and absence of certain variables at some of the sites. For example more than 10% of data were missing for WHO clinical stage and weight at baseline, numbers that are similar as the findings by May et al.  The quality of the data varied a lot amongst the sites, Forster et al found that poor quality data was associated with poor retention.  This was similar in this study, however the sites with lower retention did receive a lot less support in general (funding, clinical mentoring, administrative support).
This study shows that, also in DRC, retention is a major problem, while coverage of patients on ART is still very low.
With the flattening of funding for HIV care and treatment in sub-Saharan Africa, and with decreasing funding worldwide , , maximizing retention during the much needed scaling-up will even be more important.
Conceived and designed the experiments: OK JM HM RC. Analyzed the data: OK LK JM. Wrote the paper: OK LK MK JM RR HM RC.
- 1. WHO (2010) Towards universal access: scaling up priority HIV/AIDS interventions in the health sector. Progress report 2010. WHO website. Accessed: 2011 Nov 8.
- 2. Rosen S, Fox MP, Gill CJ (2007) Patient retention in antiretroviral therapy programs in sub-Saharan Africa: a systematic review. PLoS Med 4: e298. PLoS Medicine website. Accessed: 2011 Nov 8.
- 3. Yu JK, Chen SC, Wang KY, Chang CS, Makombe SD, et al. (2007) True outcomes for patients on antiretroviral therapy who are “lost to follow-up” in Malawi. Bull World Health Organ 85: 550–554. WHO website. Accessed: 2011 Nov 8.
- 4. Bisson GP, Gaolathe T, Gross R, Rollins C, Bellamy S, et al. (2008) Overestimates of survival after HAART: implications for global scale-up efforts. PLoS ONE 3: e1725. PLoS ONE website. Accessed: 2011 Nov 8.
- 5. Giordano TP, Gifford AL, White AC Jr, Suarez-Almazor ME, Rabeneck L, et al. (2007) Retention in care: a challenge to survival with HIV infection. Clin Infect Dis 44: 1493–1499.
- 6. WHO (2011) The treatment 2.0 framework for action: catalysing the next phase of treatment, care and support. WHO website. Accessed: 2011 Nov 8.
- 7. Ministère du plan et Macro International (2007) Enquête Démographique et de Santé. Ministry of Health - Democratic Republic of Congo website. Accessed: 2011 Nov 8.
- 8. Tassie JM, Baijal P, Vitoria MA, Alisalad A, Crowley SP, et al. (2010) Trends in retention on antiretroviral therapy in national programs in low-income and middle-income countries. J Acquir Immune Defic Syndr 54: 437–441.
- 9. Coetzee D, Hildebrand K, Boulle A, Maartens G, Louis F, et al. (2004) Outcomes after two years of providing antiretroviral treatment in Khayelitsha, South Africa. AIDS 18: 887–895.
- 10. Braitstein P, Brinkhof MW, Dabis F, Schechter M, Boulle A, et al. (2006) Mortality of HIV-1-infected patients in the first year of antiretroviral therapy: comparison between low-income and high-income countries. Lancet 367: 817–824.
- 11. Ferradini L, Jeannin A, Pinoges L, Izopet J, Odhiambo D, et al. (2006) Scaling up of highly active antiretroviral therapy in a rural district of Malawi: an effectiveness assessment. Lancet 367: 1335–1342.
- 12. Cornell M, Grimsrud A, Fairall L, Fox MP, van Cutsem G, et al. (2010) Temporal changes in programme outcomes among adult patients initiating antiretroviral therapy across South Africa, 2002–2007. AIDS 24: 2263–2270.
- 13. Boulle A, Bock P, Osler M, Cohen K, Channing L, et al. (2008) Antiretroviral therapy and early mortality in South Africa. Bull World Health Organ 86: 678–687. WHO website. Accessed: 2011 Nov 8.
- 14. Programme National Multisectoriel de Lutte contre le Sida (PNMLS) (2010) Rapport national de suivi de la Déclaration d’engagement (UNGASS). National Multisectoral Programme to control AIDS and STI website. Accessed: 2011 Nov 8.
- 15. MacPherson P, Moshabela M, Martinson N, Pronyk P (2009) Mortality and loss to follow-up among HAART initiators in rural South Africa. Trans R Soc Trop Med Hyg 103: 588–593.
- 16. Boyles TH, Wilkinson LS, Leisegang R, Maartens G (2011) Factors influencing retention in care after starting antiretroviral therapy in a rural South african programme. PLoS ONE 6: e19201. PLoS ONE website. Accessed: 2011 Nov 8.
- 17. Massaquoi M, Zachariah R, Manzi M, Pasulani O, Misindi D, et al. (2009) Patient retention and attrition on antiretroviral treatment at district level in rural Malawi. Trans R Soc Trop Med Hyg 103: 594–600.
- 18. Brinkhof MW, Dabis F, Myer L, Bangsberg DR, Boulle A, et al. (2008) Early loss of HIV-infected patients on potent antiretroviral therapy programmes in lower-income countries. Bull World Health Organ 86: 559–567. WHO website. Accessed: 2011 Nov 8.
- 19. Fox MP, Rosen S (2010) Patient retention in antiretroviral therapy programs up to three years on treatment in sub-Saharan Africa, 2007–2009: systematic review. Trop Med Int Health 15: 1–15.
- 20. Calmy A, Pinoges L, Szumilin E, Zachariah R, Ford N, et al. (2006) Generic fixed-dose combination antiretroviral treatment in resource-poor settings: multicentric observational cohort. AIDS 20: 1163–1169.
- 21. Stringer JS, Zulu I, Levy J, Stringer EM, Mwango A, et al. (2006) Rapid scale-up of antiretroviral therapy at primary care sites in Zambia: feasibility and early outcomes. JAMA 296: 782–793.
- 22. WHO (2010) Antiretroviral therapy for HIV infection in adults and adolescents: recommendations for a public health approach. Revision 2010. WHO website. Accessed: 2011 Nov 8.
- 23. Mugyenyi P, Walker AS, Hakim J, Munderi P, Gibb DM, et al. (2010) Routine versus clinically driven laboratory monitoring of HIV antiretroviral therapy in Africa (DART): a randomised non-inferiority trial. Lancet 375: 123–131.
- 24. Charurat M, Oyegunle M, Benjamin R, Habib A, Eze E, et al. (2010) Patient retention and adherence to antiretrovirals in a large antiretroviral therapy program in Nigeria: a longitudinal analysis for risk factors. PLoS ONE 5: e10584. PLoS ONE website. Accessed: 2011 Nov 8.
- 25. May M, Boulle A, Phiri S, Messou E, Myer L, et al. (2010) Prognosis of patients with HIV-1 infection starting antiretroviral therapy in sub-Saharan Africa: a collaborative analysis of scale-up programmes. Lancet 376: 449–457.
- 26. Forster M, Bailey C, Brinkhof MW, Graber C, Boulle A, et al. (2008) Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. Bull World Health Organ 86: 939–947. WHO website. Accessed: 2011 Nov 8.
- 27. MSF Campaign for access to essential medicines (2009) Punishing success? Early signs of a retreat from commitment to HIV/AIDS care and treatment. MSF Access Campaign website. Accessed: 2011 Nov 8.
- 28. MSF Campaign for access to essential medicines (2010) The ten consequences of AIDS treatment delayed, deferred, or denied. MSF Access Campaign website. Accessed: 2011 Nov 8.