Data from HIV treatment programs in resource-limited settings show extensive rates of loss to follow-up (LTFU) ranging from 5% to 40% within 6 mo of antiretroviral therapy (ART) initiation. Our objective was to project the clinical impact and cost-effectiveness of interventions to prevent LTFU from HIV care in West Africa.
Methods and Findings
We used the Cost-Effectiveness of Preventing AIDS Complications (CEPAC) International model to project the clinical benefits and cost-effectiveness of LTFU-prevention programs from a payer perspective. These programs include components such as eliminating ART co-payments, eliminating charges to patients for opportunistic infection-related drugs, improving personnel training, and providing meals and reimbursing for transportation for participants. The efficacies and costs of these interventions were extensively varied in sensitivity analyses. We used World Health Organization criteria of <3× gross domestic product per capita (3× GDP per capita = US$2,823 for Côte d'Ivoire) as a plausible threshold for “cost-effectiveness.” The main results are based on a reported 18% 1-y LTFU rate. With full retention in care, projected per-person discounted life expectancy starting from age 37 y was 144.7 mo (12.1 y). Survival losses from LTFU within 1 y of ART initiation ranged from 73.9 to 80.7 mo. The intervention costing US$22/person/year (e.g., eliminating ART co-payment) would be cost-effective with an efficacy of at least 12%. An intervention costing US$77/person/year (inclusive of all the components described above) would be cost-effective with an efficacy of at least 41%.
Interventions that prevent LTFU in resource-limited settings would substantially improve survival and would be cost-effective by international criteria with efficacy of at least 12%–41%, depending on the cost of intervention, based on a reported 18% cumulative incidence of LTFU at 1 y after ART initiation. The commitment to start ART and treat HIV in these settings should include interventions to prevent LTFU.
Citation: Losina E, Touré H, Uhler LM, Anglaret X, Paltiel AD, Balestre E, et al. (2009) Cost-Effectiveness of Preventing Loss to Follow-up in HIV Treatment Programs: A Côte d'Ivoire Appraisal. PLoS Med 6(10): e1000173. https://doi.org/10.1371/journal.pmed.1000173
Academic Editor: John Bartlett, Duke University Medical Center, United States of America
Received: May 8, 2009; Accepted: September 18, 2009; Published: October 27, 2009
Copyright: © 2009 Losina et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Supported by the US National Institute of Allergy and Infectious Diseases (R01 AI058736, K24 AI062476, P30 AI 060354 Harvard University Center for AIDS Research, and 5U01AI069919 ART-LINC of IeDEA), the French Agence Nationale de Recherches sur le SIDA et les hépatites (ANRS 12 138 ART-LINC LTFU), the Office of AIDS Research (National Institutes of Health), the National Cancer Institute, the Eunice Kennedy Shriver National Institute of Child Health & Human Development, and the Doris Duke Charitable Foundation, Clinical Scientist Development Award (to RPW). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: ART, antiretroviral therapy; CEPAC, Cost-Effectiveness of Preventing AIDS Complications; GDP, gross domestic product; LTFU, loss to follow-up; OI, opportunistic infection; SD, standard deviation; YLS, year of life saved
Acquired immunodeficiency syndrome (AIDS) has killed more than 25 million people since the first reported case in 1981. Currently, about 33 million people are infected with the human immunodeficiency virus (HIV), which causes AIDS. Two-thirds of people infected with HIV live in sub-Saharan Africa. HIV infects and destroys immune system cells, thereby weakening the immune system and rendering infected individuals susceptible to infection. There is no cure for HIV/AIDS. Combination antiretroviral therapy (ART), a mixture of antiretroviral drugs that suppress the replication of the virus in the body, is used to treat and prevent HIV infection. ART is expensive but major international efforts by governments, international organizations, and funding bodies have increased ART availability. According to World Health Organization (WHO) estimates, at least 9.7 million people in low- and middle-income countries need ART and as of 2007, 3 million of those people had reliable access to the drugs.
Why Was This Study Done?
Although ART is an effective treatment for HIV, a large number of individuals who initiate ART do not receive long-term follow-up care. These patients are generally sicker and have a worse long-term outcome than those who receive follow-up care. Loss to follow up (LTFU) is a significant problem that can undermine the benefits of expanding ART availability. Strategies to improve follow up concentrate on bringing lost patients back into the health care system, but such patients often die before they can be contacted. Prevention of LTFU might be a better strategy to improve HIV care after ART initiation, but there is little information available on which specific interventions might best accomplish this goal.
What Did the Researchers Do and Find?
Given the lack of reported data on the actual costs and effectiveness of LTFU prevention, the researchers used a model to estimate the clinical impact and cost-effectiveness of several possible strategies to prevent LTFU in HIV-infected persons receiving ART in Côte d'Ivoire, West Africa. The researchers used the previously developed Cost-Effectiveness of Preventing AIDS Complications (CEPAC) computer simulation model and combined it with data from a program of ART delivery in Abidjan, Côte d'Ivoire. They then projected the clinical benefits and the cost required to attain a given level of benefit (cost-effectiveness ratio) of different LTFU-prevention strategies from the perspective of the payer (the organization that pays all the medical costs to provide care). Several interventions were considered, including reducing costs to patients (eliminating patient co-payments and paying for transportation) and increasing services to patients at their visits (improving staff training in HIV care, and providing meals at clinic times). LTFU was predicted to cause a 54.3%–58.3% reduction in the estimated life expectancy beyond age 37; patients continuing HIV care were predicted to live a further 144.7 months whie those lost to follow up by 1 year after ART initiation were predicted to live only for a further 73.9–80.7 months. LTFU-prevention strategies in the Côte d'Ivoire were deemed to be cost-effective if they cost less than $2,823 (which is 3× gross domestic product per capita) per year of life saved. The efficacy and cost of the different LTFU-prevention strategies varied in the analyses; stopping ART co-payment alone would be cost-effective at a cost of $22/person/year if it reduced LTFU rates by 12%, while including all the LTFU-prevention strategies described would be cost-effective at $77/person/year if they reduced LTFU-rates by 41%.
What Do These Findings Mean?
The findings suggest that moderately effective strategies for preventing LTFU in resource-limited settings would improve survival, provide good value for money, and should be used to improve HIV treatment programs. Although modeling is valuable to explore the costs and effectiveness of LTFU-prevention strategies it cannot replace the need for more reported data to shed light on problems leading to LTFU and the prevention strategies required to combat it. Also, Côte d'Ivoire might not be representative of all West African countries or resource-limited settings. A similar analysis using data from other ART programs in different countries would be useful to provide better understanding of the impact of LTFU in HIV treatment programs. Finally, the research highlights the cost of second-line ART (a new antiretroviral drug combination for patients in whom first-line treatment fails) as a crucial issue. It is estimated that 5% of all people receiving ART in low- and middle-income countries receive second-line ART and these numbers are expected to increase. Second-line ART had major effects on cost-effectiveness, and a reduction in the cost of this treatment is critical in order to guarantee continued access to HIV treatment.
Please access these Web sites via the online version of this summary at http://dx.doi.org/10.1371/journal.pmed.1000173.
- This study is further discussed in a PLoS Medicine Perspective by Gregory Bisson and Jeffrey Stringer
- WHO provides information on disease prevention, treatment, and HIV/AIDS programs and projects
- The UN Millennium Development Goals project site contains information on worldwide efforts to halt the spread of HIV/AIDS
- aidsmap, a nonprofit, nongovernmental organization, provides information on HIV and supporting those living with HIV
Antiretroviral therapy (ART) has been proven to be highly effective at reducing HIV/AIDS-related morbidity and mortality in resource-limited settings –. Despite initial concerns about practicality and operational feasibility, major international efforts have been committed to expanding ART availability in sub-Saharan Africa, where two-thirds of the HIV-infected persons in the world reside . As a result of this scaling-up process, the number of HIV-infected persons treated with ART in sub-Saharan Africa increased from only 100,000 in 2003 to 2.1 million by the end of 2007—a 20-fold expansion over 4 y –.
The benefits of the ART roll-out have been limited by a substantial problem with loss to follow-up (LTFU) ,. A large proportion of HIV-infected patients initiating ART—up to 59% in some settings—are lost to follow-up at some point after ART initiation ,,–. Poor retention in HIV care not only can undermine the impact of scale-up, but can also lead to overstating the performance of HIV programs, because individuals lost to follow-up are generally sicker than those who are retained in care and may therefore experience poorer long-term outcomes than those who remain in care ,. Moreover, mortality estimates produced by active or passive surveillance programs are dramatically different, often leading to overly optimistic results from programs with passive follow-up ,,,.
Strategies to improve follow-up generally focus on efforts to bring lost patients back into the health care system (e.g., by outreach teams and collaboration with community organizations). These measures to reverse LTFU have shown that many patients identified as lost have already died –. Preventing LTFU may, therefore, be more effective at improving outcomes. Because such prevention programs may require sustained, long-term investment, their economic feasibility is an important issue. Given the lack of reported data on the actual intervention cost and efficacy of LTFU prevention, we frame this analysis as a “what if” study to provide targets, in terms of both efficacy and cost, to understand how the results of interventions to prevent LTFU might fit into the broader context of HIV treatment . We sought to estimate the long-term clinical benefits and cost-effectiveness of several plausible LTFU-preventive strategies among HIV-infected persons receiving ART in Côte d'Ivoire, West Africa.
We coupled data from the Aconda program, an Abidjan-based nongovernmental organization providing ART delivery in Côte d'Ivoire , with the Cost-Effectiveness of Preventing AIDS Complications (CEPAC) International simulation model of HIV disease and treatment –. We examined the effectiveness and cost-effectiveness of alternative strategies to prevent LTFU in HIV-infected persons initiating ART in Côte d'Ivoire. We considered several interventions with different levels of effectiveness and costs, ranging from solely eliminating patient co-payments for ART, to multimodal interventions that remove co-payment for ART and medications used to treat AIDS-defining illnesses, improve health care provider training, provide meals at clinic visits, and offer transportation reimbursement. We compared these interventions to the current standard of care in Abidjan. We evaluated cost-effectiveness from the payer perspective, wherein all direct medical costs accruing to the organization providing care (e.g., a health center making treatment available) were considered in the analysis.
We used the model to project life expectancy and total costs of care for HIV-infected persons treated with ART and who remained in care, as well as for those who discontinued care at 1, 3, 6, or 12 mo after ART initiation. We estimated the effectiveness of LTFU prevention interventions as the additional survival benefits resulting from fewer HIV-infected persons discontinuing ART prematurely. We estimated the cost-effectiveness of the LTFU prevention interventions as the difference in costs divided by the difference in life expectancy of the strategies, with and without each LTFU prevention intervention. All costs were reported in 2006 US$ using country-specific gross domestic product (GDP) deflators  and the 2006 mean exchange rate between the CFA franc and the US$ (US$1 = CFA 540) (GDP and 3× GDP are per capita) . All costs and life expectancies were discounted 3% per year . We utilized guidelines from the Commission on Macroeconomics and Health of the World Health Organization (WHO) to determine whether specific LTFU prevention interventions might be considered “cost-effective.” By these guidelines, an intervention is considered “cost-effective” if its cost-effectiveness ratio is below 3× the per capita GDP in a country (US$2,823 in 2006 for Côte d'Ivoire) and “very cost-effective” if the cost-effectiveness ratio is below 1× the annual per capita GDP (US$941) ,.
The CEPAC International Model
The CEPAC International model is a widely published computer simulation model of HIV disease that portrays natural history and treatment strategies for HIV-infected individuals in resource-limited settings –. In the model, each patient from a simulated cohort of HIV-infected individuals transitions among health states defined by CD4 count, HIV RNA level, history of opportunistic infections (OIs), and ART use. In the absence of ART, the natural history of HIV disease is determined by CD4 count decline, stratified by HIV RNA level, and CD4-specific rates of HIV morbidity and mortality . Monthly probabilities of OIs and mortality rates are derived from the Agence Nationale de Recherches sur le Sida et les Hépatites Virales (ANRS) 1203 Cotrame and the ANRS 1220 Primo-CI cohorts in Côte d'Ivoire ,,. ART reduces HIV RNA levels, increases CD4 counts, and thereby confers a decrease in OI incidence and HIV-related mortality . In this analysis, the model assumes availability of two lines of ART for persons in care. Patients receive first-line non-nucleoside reverse transcriptase inhibitor (NNRTI)-based ART consisting of nevirapine/lamivudine/stavudine and second-line protease inhibitor (PI)-based ART consisting of lopinavir/ritonovir/tenofovir/emtricitabine . The standard of care includes clinic visits every 3 mo, as well as in the month of any acute OI.
Each simulated patient is assigned a CD4 count and HIV RNA level at the time of entry into HIV care and is followed until the time of death. Results from large numbers of these individual simulations are aggregated to develop stable population estimates of outcomes. Additional details on the model structure have been published elsewhere ,.
Input Parameters for the Model
Initial cohort characteristics in the model are based on the demographic characteristics of HIV-infected patients from the Aconda program sites in Abidjan, Côte d'Ivoire, a cohort participating in the international ANRS/National Institutes of Health (NIH)-funded collaboration ART-LINC of IeDEA . The Aconda program relies on two different types of HIV care delivery: (1) the CePReF clinic, a clinical research study center entirely dedicated to HIV care, and (2) public and private health care facilities, which include general medical care as well as HIV-specific care. In this analysis, we focused on people receiving HIV care at the public and private general health care facilities. Patients receiving HIV treatment at these facilities had a mean age of 37 y (standard deviation [SD], 9 y) and a mean CD4 count of 140/µl (SD, 116/µl) at the time of ART initiation; 70% of them were female (Table 1).
Efficacy of ART.
Virologic suppression with first-line, NNRTI-based ART is estimated at 80.4% (unpublished data, Côte d'Ivoire). After 12 mo, patients switch to second-line therapy if they experience a severe OI (excluding tuberculosis and bacterial diseases), or if their CD4 count is observed to decrease ≥50% from initial CD4 count or peak on-treatment CD4 . In the absence of specific data from Côte d'Ivoire, we assumed that virologic suppression on second-line, protease inhibitor-based therapy was similar to that of first-line therapy (80.4% at 24 wk). Patients on ART face the possibility of developing minor or major toxicities, and patients who achieve virologic suppression have the possibility of experiencing later virologic failure . We assumed that ART-related toxicities led to a drug substitution but not discontinuation of treatment. In the base case, we assumed that patients continued receiving second-line ART even after clinical failure, until death.
Rates of LTFU.
Patients were considered lost to follow-up if (1) they were not known to be deceased, (2) they were not known to have transferred to another care center, and (3) for patients receiving ART, the time since last contact with the Aconda site exceeded 3 mo . For the base case estimate of LTFU rates, we used the average cumulative incidence of 18% LTFU after 1 y from the 18 Aconda program general care centers (excluding CePReF) . Among patients lost to follow-up, 12% were lost during the first month, 19% between months 1–3, 25% between months 3–6, and 44% between months 6–12 (Table 1). We used the LTFU rate at CePReF (cumulative 1 y incidence of 11%), as the basis for estimating the LTFU prevention program efficacy, since this is an example of an HIV specialty center with community outreach to patients at risk of being lost to follow-up . We used this reduction in LTFU rates (from 18% to 11%, or 40% efficacy, [18%–11%]/18%) as the anchor for basing the efficacy of the different interventions. We examined a range of 10% to 75% efficacy to assess the impact on the outcomes.
We assumed that patients who were lost to follow-up discontinued ART and experienced an accelerated CD4 count decline until their HIV RNA returned to its pretreatment set point, at which time their CD4 count continued to decline on the basis of the natural history of HIV disease ,. During this time they were at increased risk of morbidity and mortality compared to those patients not lost to follow-up.
We assumed that HIV-infected patients who are lost re-enter care when they develop a WHO Stage 3–4 OI (excluding tuberculosis and bacterial diseases) . Since those who are lost to care are subject to higher morbidity and mortality, only a fraction of them will be able to return to care. By recognizing that some patients will eventually re-enter care, even in the absence of specific interventions, we deliberately introduce a conservative bias against the LTFU-prevention programs in terms of the benefits derived from retention in care .
Interventions for Preventing LTFU under Consideration
We considered four alternative interventions to prevent LTFU (Table 1). These interventions are incremental in their content: each subsequent intervention adds components and costs to the previous one. The first intervention consists of shifting the costs that patients pay (the patient's co-pay in Côte d'Ivoire of about US$2/month, US$22/year) to the center providing ART. The second intervention also eliminates the cost to patients for medications to treat OIs. Non-ART drugs are currently fully charged to the patients. This cost can impose a major financial burden on HIV-infected patients; a recent study carried out in the same setting revealed that on average the cost of the OI-related drugs represents 11.8% of the family income . These drugs include but are not limited to cotrimoxazole, nystatin, paracetamol, imodium, ibuprofen, and fluconazole . The third intervention adds the resources required to improve HIV care skills among health care workers in public general health centers to the level of those at the HIV-treatment center (CePReF). The fourth intervention adds provision of breakfast or lunch and reimbursement of transportation costs for patients attending scheduled appointments.
The costs of the LTFU prevention programs were derived from the UNAIDS/UNFPA Rapport National de la Côte d'Ivoire as well as personnel costs from the clinics and estimated real costs in Abidjan. The costs per person per year for the four interventions were US$22, US$41, US$53, and US$77 (Table 1 and Text S1 for details) .
Cost of HIV care.
The costs of ART regimens were based on the lowest generic drug prices available for lower-income countries for the most common first- and second-line regimens used in Côte d'Ivoire (US$4.98/month for first-line ART and US$55.98/month for second-line ART, Table 1) . The cost of co-trimoxazole prophylaxis was estimated at US$1.81/month . The cost of a CD4 count was estimated at US$25/test, with tests performed every 6 mo, at scheduled clinic visits . Routine care costs in addition to these specific items include outpatient visits, laboratory tests, procedures including x-rays, and pharmacy . Costs of office visits and hospital stays were obtained from Yopougon University Hospital in Abidjan . The average cost per year per person on ART is US$820, which includes the cost of ART, prophylaxis, clinic visits, and laboratory monitoring, including CD4 cell count.
We varied several key parameters in the model across wide ranges to examine which had the greatest effect on survival, cost, and cost-effectiveness. We examined increases and decreases in the efficacy of both first- and second-line ART, and evaluated different strategies following second-line ART failure, including remaining on failed second-line therapy, discontinuing second-line ART after failure, or recycling first-line drugs. We also examined the assumption that patients who were lost to follow-up re-enter care at the time of a severe OI by considering that those lost to follow-up never re-enter care, that they re-enter care upon the occurrence of any OI, or that they re-enter with CD4 count <50/µl. In addition, we conducted a sensitivity analysis in which we evaluated the role of HIV RNA monitoring on the cost-effectiveness of LTFU prevention interventions. With respect to costs, we increased as well as decreased the cost of first- and second-line ART, the cost of treating OIs, and routine care costs. We also varied baseline rates of LTFU.
Per-Person Life Expectancy Losses Due to LTFU
The projected undiscounted life expectancy for an HIV-infected patient initiating ART at age 37 y with CD4 140/µl and remaining in care without LTFU is 201.5 mo (16.8 y, Table 2). For patients lost to follow-up after 1, 3, 6, or 12 mo on ART, projected life expectancy is estimated at 84.0, 87.3, 88.4, or 92.1 mo, respectively. The life expectancy loss due to LTFU therefore ranges from 117.5 mo to 109.4 mo, or 58.3% to 54.3% of life expectancy, depending on the timing of being lost. The projected life expectancy of a typical patient lost to follow-up in the Aconda program is estimated at 89.3 mo (7.4 y), which represents a loss of 112.2 mo (9.4 y) compared to an ideal retention rate of 100%.
Community Impact of LTFU on Life Expectancy
With an 18% LTFU rate for the 6,704 patients receiving ART through Aconda sites, 1,206 patients are lost by 1 y after ART initiation. If each patient loses an average of 9.4 y of life, the total life expectancy loss for the cohort of HIV-infected patients currently in Aconda community clinics due to LTFU would reach 11,336 y.
Cost-Effectiveness of Interventions Focused on LTFU Prevention
As the efficacy in preventing LTFU increases, projected discounted life expectancy increases, from 132.4 mo with 10% efficacy to 141.3 mo with 75% efficacy. Because patients remain in treatment longer on average with better retention, total lifetime costs also increase. For the LTFU prevention program costing US$22/person/year, per person lifetime costs range from US$9,100 if the intervention is 10% effective to US$9,900 if the intervention is 75% effective (Table 3). The cost-effectiveness ratios of the LTFU intervention, compared to no intervention, vary depending on the efficacy of the LTFU intervention. For the US$22/person/year intervention the cost-effectiveness ratios range from US$3,100 per year of life saved (YLS) at 10% efficacy to US$1,200/YLS at 75% efficacy. Cost-effectiveness ratios for the other LTFU prevention programs are presented in Table 3.
Guidance for the Prospective Evaluation of LTFU Prevention Programs
Figure 1 shows the minimal efficacy at which a LTFU prevention program might be considered cost-effective using three different cost-effectiveness thresholds: 2×, 3×, and 4× per capita GDP . In settings with 18% LTFU at baseline, and using 3× per capita GDP as a threshold for “cost-effectiveness,” the LTFU prevention program that costs US$22/person/year would be considered cost-effective with an efficacy of at least 12%. LTFU programs that cost US$53 or US$77 would be considered cost-effective at a 3× per capita GDP threshold if they could reduce LTFU rates by at least 28% and 41% (dashed line). At a 4× per capita GDP cost-effectiveness threshold, the LTFU prevention intervention costing US$22/person/year would be considered cost-effective if it could reduce LTFU rates by at least 8%, and the intervention costing US$77/person/year would be considered cost-effective at 27% efficacy (dotted line). At a 2× GDP per capita threshold, these interventions would be considered cost-effective at efficacies of 23% and 86% (solid line).
This figure describes threshold efficacy for alternative willingness to pay thresholds, shown in blue (2× per capita GDP), green (3× per capita GDP), and orange (4× per capita GDP). Triangles represent efficacy thresholds for LTFU interventions at US$22/person/year, squares at US$41/person/year, circles at US$53/person/year, and diamonds at US$77/person/year. The vertical axis shows the per person discounted life expectancy and the horizontal axis shows the per person discounted lifetime cost. The red dot in the lower left corner represents the per person life expectancy and lifetime cost in a program with no LTFU intervention.
Furthermore, Figure 1 shows that the intervention that costs US$22/person/year and that provides a 12% reduction in rates of LTFU would provide similar value as the more expensive (US$77/person/year) intervention that is 41% efficacious, but the more expensive strategy would provide more benefits compared to the less expensive intervention, increasing overall life expectancy by 5.6 versus 1.6 discounted mo (unpublished data).
We varied key parameters in the model to determine those with the biggest impact on the results. We found that the cost of second-line ART is the most important factor affecting the cost-effectiveness of LTFU prevention interventions. Reducing the cost of second-line ART to that of the cost of first-line ART (US$4.98/month) decreased all cost-effectiveness ratios, so that the US$41/person/year intervention would be cost-effective by the <3× per capita GDP criterion, if it were at least 20% effective (Figure 2A). When we assumed that patients stopped treatment after second-line ART failure, instead of assuming that they continued for the rest of their lives, the US$41/person/year intervention would be cost-effective by the <3× per capita GDP criterion, provided that it was at least 25% effective (Figure 2B).
(A and B) Represent the cost-effectiveness of LTFU prevention strategies as a function of cost (columns) and efficacy (rows). (A) Illustrates the scenario where the cost of second-line ART is decreased to the cost of first-line ART (US$4.98/month, excluding patient co-payment). (B) Shows the scenario of stopping second-line ART after failure instead of continuing ineffective therapy. The light blue areas represent combinations of cost and efficacy of LTFU prevention strategies under each ART cost composition that ensure cost-effectiveness of LTFU strategies below 2× per capita GDP. The yellow area represents combinations of cost and efficacy of LTFU interventions that produce cost-effectiveness ratios between 2× and 3× per capita GDP. The red area represents scenarios where the cost-effectiveness ratios of LTFU interventions exceed 3× per capita GDP.
Sensitivity analysis with HIV RNA monitoring available resulted in slight increases in the cost-effectiveness ratios of LTFU prevention strategies. The cost-effectiveness ratios increased by 6%–20%; the magnitude of the increase depended on the efficacy and cost of the intervention, but the ratios remained within the same thresholds for cost-effectiveness as the base case analysis results.
The baseline rate of LTFU affects the cost-effectiveness of LTFU prevention interventions. Figure 3 shows the cost-effectiveness of four interventions of various efficacies and costs at cumulative incidences of LTFU ranging from 5%–40% over 1 y. For example, in a program with 20% LTFU over 1 y, an intervention with 10% efficacy at preventing LTFU that costs US$22/person/year has a cost-effectiveness ratio less than 3× per capita GDP (Figure 3A). In the same setting, if the efficacy of the LTFU intervention was increased to 25%, an intervention costing US$41 or US$53/person/year would have a cost-effectiveness ratio less than 3× per capita GDP (Figure 3B). At 50% or 75% efficacy of reducing LTFU, an intervention of any cost considered (US$22–US$77/person/year) would have a cost-effectiveness ratio less than 3× per capita GDP (Figure 3C, 3D).
This figure shows the cost-effectiveness ratios of interventions ranging in efficacy from 10%–75%, stratified by cost (US$22, US$41, US$53, and US$77/person/year) and at cumulative incidences of LTFU ranging from 5%–40% over 1 y.
We also varied the assumptions about the behavior and outcomes of patients who are lost to follow-up. In the base case, all patients who are lost to follow-up re-enter care upon the occurrence of a severe OI. This assumption results in 56.4% of those lost to follow-up dying without returning to care. If all patients re-enter care with any OI, the cost-effectiveness ratio for the US$41/person/year intervention with 50% efficacy increases from US$1,800/YLS to US$4,200/YLS. If all patients lost to follow-up re-enter care when their CD4 count drops below 50 cells/µl, the cost-effectiveness ratio of the US$41/person/year intervention (at 50% efficacy) is equivalent to that of the base case (US$1,800/YLS). If those who are lost to follow-up never re-enter care, their life expectancy is decreased to 2.5 y and the cost-effectiveness ratio decreases to US$1,400/YLS.
Using a simulation model for HIV treatment in Abidjan, Côte d'Ivoire, we estimate that LTFU from HIV treatment programs leads to substantial losses in projected life expectancy—112.2 mo on average for those lost during the first year of treatment. For a program with about 6,700 patients, like the Aconda program in Abidjan, these per patient numbers translate into over 11,000 y of life lost—more than 1.5 y of life lost per person in the program. A substantial proportion of these lost years of life could be saved by implementing an effective LTFU prevention intervention. While evidence on the efficacy of interventions to prevent LTFU is only now beginning to accumulate , we find that such interventions, if they cost less than US$22–US$53/person/year, would be highly cost-effective under plausible assumptions of efficacy.
ART treatment programs in many resource-limited settings are now reporting increasing problems with LTFU ,,. Evidence is also accumulating with regard to the causes of LTFU in resource-limited settings and programs to reduce LTFU have focused on either reducing costs to patients (ART co-payments, OI costs, transportation costs) or increasing the benefits to patients for their visits (free lunch, improved service because of better trained personnel). Although the WHO has recommended free access to ART, many countries have been unable to deliver such programs ,. Data from the ART-LINC Collaboration, including the cohorts in Côte d'Ivoire, as well as programs in Botswana and Tanzania, have found that charging a fee for care is associated with increased LTFU and increased mortality ,,,. Recent data from Cameroon show that patients' self-reported financial difficulty in purchasing ART was associated with lower adherence and lower CD4 count after 6 mo on treatment . In a meta-analysis on LTFU from ART programs, Rosen et al. found that programs that did not require patients to pay for treatment had higher retention rates at 6 mo compared to programs requiring partial or full payment . Recent data from Kenya suggest that providing ART free to patients led to a 57% decrease in LTFU . On the basis of these recent data from Kenya, in August 2008, the government of Côte d'Ivoire mandated ART free to all patients . Transportation costs may also play an important role in determining outcomes in those living farther from their site of care –. Studies in Burkina Faso and Mali found decreased viral suppression in patients living farther from the clinic, suggesting follow-up as a major determinant of success . Food insecurity also poses a challenge to HIV-infected patients who have competing priorities of securing food as well as HIV treatment. Providing food at the time of the clinic visit may encourage some patients to attend their clinic appointment or to get their medications .
For example, the CePReF center in the Aconda program, which utilized a team of social workers and people living with HIV/AIDS to make telephone calls or home visits to patients who did not keep their scheduled appointments, had rates of LTFU at 1 y that were 40% lower than the general health care centers in the program. At an intervention cost of US$22–US$53/person/year, the cost-effectiveness ratio of such an intervention is less than US$2,800/YLS, which is <3× the per capita GDP in Côte d'Ivoire.
Since the efficacy of each individual component of the LTFU prevention interventions considered in the analyses reported here is unknown, we have ordered the interventions in terms of what may be most effective and feasible. However, parts of each intervention (or interventions not specified here) could be implemented individually or in different combinations than we proposed. We prioritized eliminating ART co-payments as the first step because this has been previously shown to be associated with better outcomes in several studies in Africa, and because it is increasingly considered feasible.
The LTFU prevention interventions considered in this analysis focused on reducing costs to the patient and improving health care workers' skills, but other strategies to prevent LTFU may also be considered as part of an effective LTFU prevention intervention. For example, health care workers may send patients text messages to remind them of their upcoming clinic appointments, or make phone calls to patients who have recently missed appointments. Another possible intervention would involve assigning a health system navigator to patients to provide personalized support and help coordinate their care, including ongoing clinic visits. One recently presented study showed the positive impact of frequent monitoring by dedicated nurses on mortality reduction in the early months of ART among high-risk patients initiating treatment in resource-limited settings .
We found that settings with higher rates of LTFU have the most to gain from LTFU prevention interventions. However, this analysis shows that even in settings with moderate LTFU rates, interventions to decrease LTFU may be cost-effective. However, it is critical to ensure that, from a programmatic perspective, decision makers not reward poor rates of follow-up with greater resources because of the perverse incentive such a policy might create. Cost-effectiveness can inform programmatic resource allocation, but should not be the only factor governing such decisions.
In sensitivity analyses, the cost of ART, particularly expensive second-line ART, affected cost-effectiveness the most. One of the determinants of the importance of the cost of second-line ART is the fact that in the base case analysis, patients continue receiving second-line ART, even after clinical failure. In this analysis we assumed that ART is continued after second-line failure for its independent protective effect, and this strategy was cost-effective. Decisions about potentially stopping ART after clinical failure, particularly in areas where drug supply may be insufficient, should be the focus of additional investigation.
As of 2007, only 5% of all people receiving ART in low- and middle-income countries were estimated to be receiving a second-line regimen . However, these numbers are expected to increase greatly in future years as programs continue to be rolled out and patients have been on first-line regimens longer. The WHO recommends that countries establish national treatment guidelines with specific second-line regimens, and they specified the highest priority second-line regimen to consist of a ritonavir-boosted PI (lopinavir or atazanavir) and two nucleoside reverse transcriptase inhibitors (NRTIs, abacavir/didanosine or tenofovir/emtricitabine). In order to ensure continued access to life-saving HIV treatment, decreasing the costs of second-line ART should be a major priority.
While this analysis showed that LTFU prevention strategies carry substantial survival benefits and can be cost-effective according to international standards, it is critical to combine these interventions with programs that maximize timely linkage to care and ART initiation in patients newly diagnosed with HIV.
The CEPAC model estimate of life expectancy in HIV-infected individuals of 16.8 y (undiscounted) receiving ART may seem high at first glance, but it lies within the plausible values for Côte d'Ivoire. According to the most recent WHO life tables (2006) , the average additional life expectancy for someone 35–39 y old (the range that includes the mean age at ART initiation used in the current analysis) is 30.2 y, which includes both HIV-infected and HIV-uninfected individuals. This positions the CEPAC-based estimate for HIV-infected individuals well within the plausible range. In contrast, HIV-infected patients who initiate ART at an average age of 37 y with a CD4 cell count of 140 cells/µl who are lost to follow-up during the first year after ART initiation and did not return to care, have an estimated life expectancy of only 2.6 y (undiscounted).
There are several limitations to this study. First, the data are from sites in Abidjan, Côte d'Ivoire, and may not be generalizable to all West African countries or all resource-limited settings. Second, our effort to estimate the impact of adding infrastructure to treatment programs with higher LTFU rates, to achieve the lower rates seen at HIV-specific centers, may not fully capture the skills that exist at specialty centers, which allow them to achieve better outcomes. In this analysis, we did not account for any benefits associated with improved health care workers' skills beyond patient retention. More broadly, because of the lack of data on interventions to prevent LTFU and the efficacy of such interventions, this remained a “what if” analysis, with wide-ranging intervention-projected efficacies of 10%–75%. More data on the actual efficacies of LTFU prevention interventions are needed to help decision makers better understand the impact of such interventions in their treatment programs.
While in reality, characteristics of patients who are lost to follow-up may differ from those who remain in treatment, the current analysis assumed that all patients had an equal probability of being lost to follow-up, independent of age, gender, and stage of HIV disease. We also did not account for LTFU occurring more than 1 y after ART initiation, since it has been shown that the highest rates of LTFU occur soon after ART initiation.
LTFU is a critically important problem in many HIV treatment programs in resource-limited settings. We found that interventions to prevent LTFU, using specific strategies and cost data from Côte d'Ivoire, are likely to provide excellent value if they are moderately effective, and would lead to important survival benefits. The development, testing, and dissemination of effective programs to prevent LTFU from HIV treatment programs in resource-limited settings should be a major priority.
The ART-LINC Collaboration of IeDEA include:
Principal Investigators: François Dabis, Matthias Egger, Mauro Schechter.
Central Team: Eric Balestre, Martin Brinkhof, Claire Graber, Olivia Keiser, Catherine Seyler, Hapsatou Touré, Charlotte Lewden.
Steering Group: Kathryn Anastos (Kigali); David Bangsberg (Mbarara/Kampala); Andrew Boulle (Cape Town); Jennipher Chisanga (Lusaka); Eric Delaporte (Dakar); Diana Dickinson (Gaborone); Ernest Ekong (Lagos); Kamal Marhoum El Filali (Casablanca); Mina Hosseinipour (Lilongwe); Silvester Kimaiyo (Eldoret); Mana Khongphatthanayothin (Bangkok); N Kumarasamy (Chennai); Christian Laurent (Yaounde); Ruedi Luthy (Harare); James McIntyre (Johannesburg); Timothy Meade (Lusaka); Eugène Messou (Abidjan); Denis Nash (New York); Winstone Nyandiko Mokaya (Eldoret); Margaret Pascoe (Harare); Larry Pepper (Mbarara); Papa Salif Sow (Dakar); Sam Phiri (Lilongwe); Mauro Schechter (Rio de Janeiro); John Sidle (Eldoret); Eduardo Sprinz (Porto Alegre); Besigin Tonwe-Gold (Abidjan); Siaka Touré (Abidjan); Stefaan Van der Borght (Amsterdam); Ralf Weigel (Lilongwe); Robin Wood (Cape Town).
Advisory Committee: Zackie Achmat, Chris Bailey, Kevin de Cock, Wafaa El-Sadr, Kenneth Freedberg, Helene Gayle, Charlie Gilks, Catherine Hankins, Tony Harries, Elly Katabira, Jonathan Sterne, Mark Wainberg.
The CEPAC-International investigators include:
Massachusetts General Hospital, Harvard Medical School (Boston, Massachusetts): Melissa Bender, John Chiosi, Jennifer Chu, Sarah Chung, Andrea Ciaranello, Mariam O. Fofana, Kenneth A. Freedberg, Heather E. Hsu, Zhigang Lu, Bethany Morris, Brandon Morris, Erin Rhode, Caroline Sloan, Callie A. Scott, Lauren Uhler, Rochelle P. Walensky.
Brigham and Women's Hospital (Boston, Massachusetts): Elena Losina.
Harvard School of Public Health (Boston, Massachusetts): Kara Cotich, Sue J. Goldie, April D. Kimmel, Marc Lipsitch, Chara Rydzak, George R. Seage III, Milton C. Weinstein.
Centre Hospitalier de Tourcoing (Tourcoing, France): Yazdan Yazdanpanah.
INSERM U897 (Bordeaux, France): Xavier Anglaret, Roger Salamon.
Programme PAC-CI (Abidjan, Côte d'Ivoire): Christine Danel, Thérèse N'Dri-Yoman, Eugène Messou, Raoul Moh, Eric Ouattara, Siaka Touré, Catherine Seyler.
Y.R. Gaitonde Centre for AIDS Research & Education (Chennai, India): Nagalingeswaran Kumarasamy, A.K. Ganesh.
University of Cape Town (Cape Town, South Africa): Robin Wood.
Perinatal HIV Research Unit, WITS Health Consortium (Johannesburg, South Africa): Glenda Gray, James McIntyre, Neil A. Martinson, Lerato Mohapi.
Miriam Hospital (Providence, Rhode Island): Timothy Flanigan, Kenneth Mayer.
Yale University (New Haven, Connecticut): A. David Paltiel.
ICMJE criteria for authorship read and met: EL HT LMU XA ADP EB RPW EM MCW FD KAF. Agree with the manuscript's results and conclusions: EL HT LMU XA ADP EB RPW EM MCW FD KAF. Designed the experiments/the study: EL HT XA FD. Analyzed the data: EL RPW KAF. Collected data/did experiments for the study: HT XA. Wrote the first draft of the paper: EL HT. Contributed to the writing of the paper: EL LMU XA ADP RPW MCW FD KAF. Conducted model analyses: LMU. Assisted in model development and updating: ADP. Provided methodologic guidance and helped developed the model: MCW. Co-developed the model: KAF.
- 1. Seyler C, Anglaret X, Dakoury-Dogbo N, Messou E, Toure S, et al. (2003) Medium-term survival, morbidity and immunovirological evolution in HIV-infected adults receiving antiretroviral therapy, Abidjan, Cote d'Ivoire. Antivir Ther 8: 385–393.
- 2. Akileswaran C, Lurie MN, Flanigan TP, Mayer KH (2005) Lessons learned from use of highly active antiretroviral therapy in Africa. Clin Infect Dis 41: 376–385.
- 3. Ivers LC, Kendrick D, Doucette K (2005) Efficacy of antiretroviral therapy programs in resource-poor settings: a meta-analysis of the published literature. Clin Infect Dis 41: 217–224.
- 4. Sow PS, Otieno LF, Bissagnene E, Kityo C, Bennink R, et al. (2007) Implementation of an antiretroviral access program for HIV-1-infected individuals in resource-limited settings: clinical results from 4 African countries. J Acquir Immune Defic Syndr 44: 262–267.
- 5. Hammond R, Harry TC (2008) Efficacy of antiretroviral therapy in Africa: effect on immunological and virological outcome measures – a meta-analysis. Int J STD AIDS 19: 291–296.
- 6. UNAIDS (2007) AIDS epidemic update: December 2007. Geneva: Joint United Nations Programme on HIV/AIDS (UNAIDS) and World Health Organization (WHO).
- 7. Bekker LG, Myer L, Orrell C, Lawn S, Wood R (2006) Rapid scale-up of a community-based HIV treatment service: programme performance over 3 consecutive years in Guguletu, South Africa. S Afr Med J 96: 315–320.
- 8. Ferradini L, Jeannin A, Pinoges L, Izopet J, Odhiambo D, et al. (2006) Scaling up of highly active antiretroviral therapy in a rural district of Malawi: an effectiveness assessment. Lancet 367: 1335–1342.
- 9. Stringer JS, Zulu I, Levy J, Stringer EM, Mwango A, et al. (2006) Rapid scale-up of antiretroviral therapy at primary care sites in Zambia: feasibility and early outcomes. JAMA 296: 782–793.
- 10. Ojikutu B, Makadzange AT, Gaolathe T (2008) Scaling up ART treatment capacity: lessons learned from South Africa, Zimbabwe, and Botswana. Curr HIV/AIDS Rep 5: 94–98.
- 11. Toure S, Kouadio B, Seyler C, Traore M, Dakoury-Dogbo N, et al. (2008) Rapid scaling-up of antiretroviral therapy in 10,000 adults in Cote d'Ivoire: 2-year outcomes and determinants. AIDS 22: 873–882.
- 12. WHO/UNAIDS/UNICEF (2008) Towards Universal Access: Scaling up priority HIV/AIDS interventions in the health sector. Progress Report, 2008. Geneva: World Health Organization.
- 13. Braitstein P, Brinkhof MW, Dabis F, Schechter M, Boulle A, et al. (2006) Mortality of HIV-1-infected patients in the first year of antiretroviral therapy: comparison between low-income and high-income countries. Lancet 367: 817–824.
- 14. Rosen S, Fox MP, Gill CJ (2007) Patient retention in antiretroviral therapy programs in sub-Saharan Africa: a systematic review. PLoS Med 4: e298.
- 15. Laurent C, Meilo H, Guiard-Schmid JB, Mapoure Y, Noel JM, et al. (2005) Antiretroviral therapy in public and private routine health care clinics in Cameroon: lessons from the Douala antiretroviral (DARVIR) initiative. Clin Infect Dis 41: 108–111.
- 16. Lawn SD, Myer L, Harling G, Orrell C, Bekker LG, et al. (2006) Determinants of mortality and nondeath losses from an antiretroviral treatment service in South Africa: implications for program evaluation. Clin Infect Dis 43: 770–776.
- 17. van Oosterhout JJ, Bodasing N, Kumwenda JJ, Nyirenda C, Mallewa J, et al. (2005) Evaluation of antiretroviral therapy results in a resource-poor setting in Blantyre, Malawi. Trop Med Int Health 10: 464–470.
- 18. Wools-Kaloustian K, Kimaiyo S, Diero L, Siika A, Sidle J, et al. (2006) Viability and effectiveness of large-scale HIV treatment initiatives in sub-Saharan Africa: experience from western Kenya. AIDS 20: 41–48.
- 19. Brown DM, Thorne JE, Foster GL, Duncan JL, Brune LM, et al. (2006) Factors affecting attrition in a longitudinal study of patients with AIDS. AIDS Care 18: 821–829.
- 20. Touloumi G, Pocock SJ, Babiker AG, Darbyshire JH (2002) Impact of missing data due to selective dropouts in cohort studies and clinical trials. Epidemiology 13: 347–355.
- 21. Anglaret X, Toure S, Gourvellec G, Tchehy A, Zio L, et al. (2004) Impact of vital status investigation procedures on estimates of survival in cohorts of HIV-infected patients from Sub-Saharan Africa. J Acquir Immune Defic Syndr 35: 320–323.
- 22. Bisson GP, Gaolathe T, Gross R, Rollins C, Bellamy S, et al. (2008) Overestimates of survival after HAART: implications for global scale-up efforts. PLoS One 3: e1725.
- 23. Dalal RP, Macphail C, Mqhayi M, Wing J, Feldman C, et al. (2008) Characteristics and outcomes of adult patients lost to follow-up at an antiretroviral treatment clinic in johannesburg, South Africa. J Acquir Immune Defic Syndr 47: 101–107.
- 24. Maskew M, MacPhail P, Menezes C, Rubel D (2007) Lost to follow up: contributing factors and challenges in South African patients on antiretroviral therapy. S Afr Med J 97: 853–857.
- 25. Yu JK, Chen SC, Wang KY, Chang CS, Makombe SD, et al. (2007) True outcomes for patients on antiretroviral therapy who are “lost to follow-up” in Malawi. Bull World Health Organ 85: 550–554.
- 26. Goldie SJ, Paltiel AD, Weinstein MC, Losina E, Seage GR 3rd, et al. (2003) Projecting the cost-effectiveness of adherence interventions in persons with human immunodeficiency virus infection. Am J Med 115: 632–641.
- 27. Freedberg KA, Losina E, Weinstein MC, Paltiel AD, Cohen CJ, et al. (2001) The cost effectiveness of combination antiretroviral therapy for HIV disease. N Engl J Med 344: 824–831.
- 28. Paltiel AD, Weinstein MC, Kimmel AD, Seage GR 3rd, Losina E, et al. (2005) Expanded screening for HIV in the United States–an analysis of cost-effectiveness. N Engl J Med 352: 586–595.
- 29. Weinstein MC, Goldie SJ, Losina E, Cohen CJ, Baxter JD, et al. (2001) Use of genotypic resistance testing to guide HIV therapy: clinical impact and cost-effectiveness. Ann Intern Med 134: 440–450.
- 30. International Monetary Fund (2007) World Economic Outlook Database. Washington (D.C.): International Monetary Fund.
- 31. OANDA (2008) FXHistory: historical currency exchange rates. Available: http://www.oanda.com/.
- 32. Gold MR, Siegel JE, Russell LB, Weinstein MC, editors. (1996) Cost effectiveness in health and medicine. New York: Oxford University Press.
- 33. World Health Organization (2001) Macroeconomics and health: investing in health for economic development. Geneva: World Health Organization.
- 34. Losina E, Anglaret X, Yazdanpanah Y, Wang B, Toure S, et al. (2006) Impact of opportunistic diseases on chronic mortality in HIV-infected adults in Cote d'Ivoire. S Afr Med J 96: 526–529.
- 35. Minga A, Danel C, Abo Y, Dohoun L, Bonard D, et al. (2007) Progression to WHO criteria for antiretroviral therapy in a 7-year cohort of adult HIV-1 seroconverters in Abidjan, Cote d'Ivoire. Bull World Health Organ 85: 116–123.
- 36. Losina E, Yazdanpanah Y, Deuffic-Burban S, Wang B, Wolf LL, et al. (2007) The independent effect of highly active antiretroviral therapy on severe opportunistic disease incidence and mortality in HIV-infected adults in Cote d'Ivoire. Antivir Ther 12: 543–551.
- 37. Goldie SJ, Yazdanpanah Y, Losina E, Weinstein MC, Anglaret X, et al. (2006) Cost-effectiveness of HIV treatment in resource-poor settings–the case of Cote d'Ivoire. N Engl J Med 355: 1141–1153.
- 38. Yazdanpanah Y, Losina E, Anglaret X, Goldie SJ, Walensky RP, et al. (2005) Clinical impact and cost-effectiveness of co-trimoxazole prophylaxis in patients with HIV/AIDS in Cote d'Ivoire: a trial-based analysis. AIDS 19: 1299–1308.
- 39. Dabis F, Balestre E, Braitstein P, Miotti P, Brinkhof WG, et al. (2005) Cohort Profile: Antiretroviral Therapy in Lower Income Countries (ART-LINC): international collaboration of treatment cohorts. Int J Epidemiol 34: 979–986.
- 40. World Health Organization (2006) Antiretroviral therapy for HIV infection in adults and adolescents: recommendations for a public health approach. Geneva: World Health Organization.
- 41. Danel C, Moh R, Anzian A, Abo Y, Chenal H, et al. (2006) Tolerance and acceptability of an efavirenz-based regimen in 740 adults (predominantly women) in West Africa. J Acquir Immune Defic Syndr 42: 29–35.
- 42. Mata RC, Viciana P, de Alarcon A, Lopez-Cortes LF, Gomez-Vera J, et al. (2005) Discontinuation of antiretroviral therapy in patients with chronic HIV infection: clinical, virologic, and immunologic consequences. AIDS Patient Care STDS 19: 550–562.
- 43. Mellors JW, Munoz A, Giorgi JV, Margolick JB, Tassoni CJ, et al. (1997) Plasma viral load and CD4+ lymphocytes as prognostic markers of HIV-1 infection. Ann Intern Med 126: 946–954.
- 44. Mocroft A, Kirk O, Aldins P, Chies A, Blaxhult A, et al. (2008) Loss to follow-up in an international, multicentre observational study. HIV Med 9: 261–269.
- 45. Beaulière A, Pouhé A, Touré H, Anglaret X, Dabis F (2008) Access to care for people living with HIV/AIDS: assessing the financial burden in Côte d'Ivoire, ANRS 12137 Study, Oral Presentation, December 5, Session (SOE05); Costs of treatment and care.
- 46. Nombela N, Kouadio B, Toure S, Seyler C, Flori YA, et al. (2006) Nonantiretroviral drug consumption by CD4 cell count in HIV-infected adults: a 5-year cohort study in Cote d'Ivoire. J Acquir Immune Defic Syndr 41: 225–231.
- 47. (2008) Suivi de la déclaration d'engagement sur le VIH/SIDA (UNGASS): Rapport National de la Côte d'Ivoire. Abidjan: Ministère de la Lutte contre le Sida (with joint support from UNAIDS and UNFPA). 47 p.
- 48. Médecins Sans Frontières (2008) Untangling the web of antiretroviral price reductions, 11th edition. Available: http://www.msfaccess.org/fileadmin/user_upload/diseases/hiv-aids/Untangling_the_Web/Untanglingtheweb_July2008_English.pdf. Accessed 20 August 2008.
- 49. Forster M, Bailey C, Brinkhof MW, Graber C, Boulle A, et al. (2008) Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. Bull World Health Organ 86: 939–947.
- 50. Brinkhof MW, Dabis F, Myer L, Bangsberg DR, Boulle A, et al. (2008) Early loss of HIV-infected patients on potent antiretroviral therapy programmes in lower-income countries. Bull World Health Organ 86: 559–567.
- 51. World Health Organization (2005) WHO Discussion Paper: the practice of charging user fees at the point of service delivery for HIV/AIDS treatment and care. Geneva: World Health Organization.
- 52. Gilks CF, Crowley S, Ekpini R, Gove S, Perriens J, et al. (2006) The WHO public-health approach to antiretroviral treatment against HIV in resource-limited settings. Lancet 368: 505–510.
- 53. Bisson GP, Frank I, Gross R, Lo Re V 3rd, Strom JB, et al. (2006) Out-of-pocket costs of HAART limit HIV treatment responses in Botswana's private sector. AIDS 20: 1333–1336.
- 54. Ramadhani HO, Thielman NM, Landman KZ, Ndosi EM, Gao F, et al. (2007) Predictors of incomplete adherence, virologic failure, and antiviral drug resistance among HIV-infected adults receiving antiretroviral therapy in Tanzania. Clin Infect Dis 45: 1492–1498.
- 55. Boyer S, Marcellin F, Ongolo-Zogo P, Abega S, Nantchouang R, et al. (2009) Financial barriers to HIV treatment in Yaounde, Cameroon: first results of a national cross-sectional survey. Bull World Health Organ 87: 279–287.
- 56. Zachariah R, Van Engelgem I, Massaquoi M, Kocholla L, Manzi M, et al. (2008) Payment for antiretroviral drugs is associated with a higher rate of patients lost to follow-up than those offered free-of-charge therapy in Nairobi, Kenya. Trans R Soc Trop Med Hyg 102: 288–293.
- 57. (2008) Arrêté du 20 août 2008: Portant gratuité du traitement antirétroviral dans les établissements sanitaires publics. Abidjan, Côte d'Ivoire: Le Ministre de la Santé et de l'Hygiène Publique.
- 58. Brikci N, Philips M (2007) User fees or equity funds in low-income countries. Lancet 369: 10–11.
- 59. Djohan G, Kouakoussui A, Msellati P (2005) [Direct cost related to management and care provision for HIV-infected children in the asymptomatic stage in Abidjan, Cote d'Ivoire]. Santé Publique 17: 627–636.
- 60. Zachariah R, Harries AD, Manzi M, Gomani P, Teck R, et al. (2006) Acceptance of anti-retroviral therapy among patients infected with HIV and tuberculosis in rural Malawi is low and associated with cost of transport. PLoS One 1: e121.
- 61. Boileau C, Nguyen VK, Sylla M, Machouf N, Chamberland A, et al. (2008) Low prevalence of detectable HIV plasma viremia in patients treated with antiretroviral therapy in Burkina Faso and Mali. J Acquir Immune Defic Syndr 48: 476–484.
- 62. Mamlin J, Kimaiyo S, Lewis S, Tadayo H, Jerop FK, et al. (2008) Integrating nutrition support for food-insecure patients and their dependents into an HIV care and treatment program in Western Kenya. Am J Public Health 99: 215–221.
- 63. Braitstein P, Siika A, Hogan J, Kosgei R, Sang E, et al. (2009) High risk express care: a novel care model to reduce early mortality among high risk HIV-infected patients initiating combination antiretroviral treatment.
- 64. The Global Fund (2009) Forecasting demand for ARVs, 2008–2010. Available: www.theglobalfund.org/documents/psm/communication/2009_February_Forecasting-DemandARVs2008-2010.ppt. Accessed 13 September 2008.
- 65. World Health Organization (2006) Life tables for WHO member states. Geneva: World Health Organization.