https://orcid.org/0000-0002-8906-6879
Figures
Abstract
Background
Global HIV treatment programs have sought to lengthen the interval between clinical encounters for people living with HIV (PLWH) who are established on antiretroviral treatment (ART) to reduce the burden of seeking care and to decongest health facilities. The overall effect of reduced visit frequency on HIV treatment outcomes is however unknown. We conducted a systematic review and meta-analysis to evaluate the effect of implementation strategies that reduce the frequency of clinical appointments and ART refills for PLWH established on ART.
Methods and findings
We searched databases between 1 January 2010 and 9 November 2021 to identify randomized controlled trials (RCTs) and observational studies that compared reduced (6- to 12-monthly) clinical consultation or ART refill appointment frequency to 3- to 6-monthly appointments for patients established on ART. We assessed methodological quality and real-world relevance, and used Mantel–Haenszel methods to generate pooled risk ratios (RRs) with 95% confidence intervals for retention, viral suppression, and mortality. We evaluated heterogeneity quantitatively and qualitatively, and overall evidence certainty using GRADE. Searches yielded 3,955 records, resulting in 10 studies (6 RCTs, 3 observational studies, and 1 study contributing observational and RCT data) representing 15 intervention arms with 33,599 adults (≥16 years) in 8 sub-Saharan African countries. Reduced frequency clinical consultations occurred at health facilities, while reduced frequency ART refills were delivered through facility or community pharmacies and adherence groups. Studies were highly pragmatic, except for some study settings and resources used in RCTs. Among studies comparing reduced clinical consultation frequency (6- or 12-monthly) to 3-monthly consultations, there appeared to be no difference in retention (RR 1.01, 95% CI 0.97–1.04, p = 0.682, 8 studies, low certainty), and this finding was consistent across 6- and 12-monthly consultation intervals and delivery strategies. Viral suppression effect estimates were markedly influenced by under-ascertainment of viral load outcomes in intervention arms, resulting in inconclusive evidence. There was similarly insufficient evidence to draw conclusions on mortality (RR 1.12, 95% CI 0.75–1.66, p = 0.592, 6 studies, very low certainty). For ART refill frequency, there appeared to be little to no difference in retention (RR 1.01, 95% CI 0.98–1.06, p = 0.473, 4 RCTs, moderate certainty) or mortality (RR 1.45, 95% CI 0.63–3.35, p = 0.382, 4 RCTs, low certainty) between 6-monthly and 3-monthly visits. Similar to the analysis for clinical consultations, although viral suppression appeared to be better in 3-monthly arms, effect estimates were markedly influence by under-ascertainment of viral load outcomes in intervention arms, resulting in overall inclusive evidence. This systematic review was limited by the small number of studies available to compare 12- versus 6-monthly clinical consultations, insufficient data to compare implementation strategies, and lack of evidence for children, key populations, and low- and middle-income countries outside of sub-Saharan Africa.
Conclusions
Based on this synthesis, extending clinical consultation intervals to 6 or 12 months and ART dispensing intervals to 6 months appears to result in similar retention to 3-month intervals, with less robust conclusions for viral suppression and mortality. Future research should ensure complete viral load outcome ascertainment, as well as explore mechanisms of effect, outcomes in other populations, and optimum delivery and monitoring strategies to ensure widespread applicability of reduced frequency visits across settings.
Author summary
Why was this study done?
- Global HIV services have moved toward differentiated service delivery (DSD) models that decrease the frequency of unneeded contact with the health system for patients established on antiretroviral treatment (ART) and ensure alignment between needs and services.
- It remains unclear, however, whether increasing ART clinical consultation intervals beyond 3 months, to 6 or 12 months, results in comparable treatment outcomes to 3-monthly visits.
What did the researchers do and find?
- We conducted a systematic review and meta-analysis to identify studies that compared reduced (6- or 12-monthly) clinical consultation or ART refill appointment frequency to 3- or 6-monthly appointments for patients established on ART.
- We identified 10 studies representing 15 intervention arms with 33,599 adults in 8 sub-Saharan African countries, including 6 randomized controlled trials, 3 cohort studies, and 1 study contributing both observational and randomized data. The methodological quality of the randomized controlled trials was generally high, and cohort data were of high, fair, and poor quality.
- Among 8 studies comparing reduced clinical consultation frequency (6- or 12-monthly) to 3-monthly consultations, there appeared to be no difference in retention in care, and this result was consistent across study design and visit frequency. There was poor viral load outcome ascertainment in reduced frequency study arms; as a result, when including all randomized study participants, viral suppression appeared higher in 3-monthly compared to reduced frequency arms for RCTs, but when analyses were restricted to only patients with viral load measurement, there appeared to be no difference in viral suppression.
- Among studies comparing 6-monthly to 3-monthly ART refill frequency, there similarly appeared to be no difference in retention in care or mortality. Viral suppression also appeared higher in 3-monthly compared to reduced frequency refill arms but showed no difference when analysis was restricted to patients with viral load measurement.
What do these findings mean?
- Extending clinical consultation intervals from 3 months to 6 or 12 months and ART dispensing intervals from 3 months to 6 months may result in similar outcomes for retention in care, with less robust conclusions for viral suppression and mortality.
- Future studies should aim to obtain more complete viral load outcome ascertainment in all study arms.
- To increase the applicability of these findings, further implementation research should explore other population groups, mechanisms of effect, and optimum delivery and monitoring strategies.
Citation: Le Tourneau N, Germann A, Thompson RR, Ford N, Schwartz S, Beres L, et al. (2022) Evaluation of HIV treatment outcomes with reduced frequency of clinical encounters and antiretroviral treatment refills: A systematic review and meta-analysis. PLoS Med 19(3): e1003959. https://doi.org/10.1371/journal.pmed.1003959
Academic Editor: Marie-Louise Newell, University of Southampton, UNITED KINGDOM
Received: October 29, 2021; Accepted: March 4, 2022; Published: March 22, 2022
Copyright: © 2022 Le Tourneau et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: EHG is supported by the Bill and Melinda Gates Foundation (OPP1215984), Viiv Healthcare and the NIH (K24 AI134413). IEW is supported by the NIH (KL2 TR002346). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: EHG is a member of PLOS Medicine’s editorial board. The other authors have declared that no competing interests exist.
Abbreviations: ART, antiretroviral treatment; CI, confidence interval; DSD, differentiated service delivery; LMICs, low- and middle-income countries; PLWH, people living with HIV; RCT, randomized controlled trial; RR, risk ratio; WHO, World Health Organization
Introduction
For people living with HIV (PLWH) in low- and middle-income countries (LMICs) and on antiretroviral treatment (ART), unnecessary clinic and pharmacy appointments impose an avoidable burden on both patients and providers. Efforts to decrease the frequency of unneeded contact with the health system represent a central pillar of the movement toward differentiated service delivery (DSD) models [1,2]. There is, however, concern that reduced frequency might also compromise meaningful clinical and psychosocial interactions with the health system and potentially, paradoxically, increase missed appointments or non-adherence over the long term. Most existing data support the hypothesis that longer intervals reduce obstacles to attending services for PLWH, including structural challenges such as the time and travel required to attend appointments and pick up medications—which result in considerable direct and indirect costs—as well as psychosocial barriers such as stigma [3–7].
Based on these early observations, and consistent with World Health Organization (WHO) recommendations issued in 2016, global HIV programs have moved away from monthly appointments (which were the norm for many years) to 3-monthly appointments. Questions have turned to whether extending appointment intervals beyond 3 months to 6 or 12 months may be safe and effective. Early data syntheses suggesting that outcomes are equivalent for 3- versus 1-monthly appointments [8,9] do not automatically apply to further extensions. Qualitative, survey, and preference data indicate that PLWH value DSD models that include lengthened appointment intervals [4,10,11], but also that some PLWH do prefer more frequent psychosocial support from interactions with their providers [3]. Implementation of reduced visit frequency has accelerated pace in the past 2 years as it has become a practical necessity during the COVID-19 pandemic to decongest health facilities and limit physical contact [12,13]. Understanding how visit frequency impacts HIV treatment outcomes and under what conditions differences in outcomes manifest could further inform the implementation of this DSD strategy.
To support the 2021 update of the WHO service delivery guidelines [14], we undertook a systematic review and meta-analysis, including observational studies and randomized controlled trials (RCTs), in which we explicitly examined outcomes for clinical and ART refill visit intervals of 6 months or greater compared to 3 months. We present the data that contributed to the WHO guideline update as well as recently published studies. Such syntheses regarding further reductions in appointment frequency not only inform normative guidance on evolving DSD approaches but have particular salience for healthcare in the era of a pandemic.
Methods
The protocol is registered in PROSPERO (CRD42019128609).
Eligibility criteria
We included individual and cluster RCTs, comparative observational studies, cross-sectional studies, and single arm intervention studies without a comparison group. We included studies that enrolled PLWH established on first-line ART in LMICs. The definition of being established on ART varied by study (see Results). We included studies that reported outcomes of retention in care, viral suppression, and mortality. Eligible interventions included those with any component of less frequent clinical consultation or less frequent ART dispensing visits (e.g., 6- or 12-monthly) compared to 3- or 6-month frequency intervals (Table 1). Studies reporting 2-month comparison intervals were classified as 3-monthly for the purposes of this review.
Search strategy and selection criteria
We searched MEDLINE (PubMed), Embase (OVID), Cochrane Central Register of Controlled Trials, WHO International Clinical Trials Registry Platform (ICTRP), and ClinicalTrials.gov from 1 January 2010 through 9 November 2021, as well as Conference on Retroviruses and Opportunistic Infections (CROI) from 2017 to 2021 and International AIDS Society (IAS) conferences from 2016 to 2021. We additionally reviewed references, consulted experts in the field, and reviewed the IAS DSD resources [15].
Data extraction and quality assessment
Abstracts and titles were screened by 2 authors (NL, AG, RRT) in duplicate in Covidence [16], with any discrepancies resolved by a third author (IEW). Data on the study setting and population, intervention, and outcomes of eligible studies were extracted into an online database platform Airtable (https://airtable.com), with quality assurance of data done by a second author (NL or AG). Outcomes were extracted with numerators and denominators, as well as measures of association when possible. Reporting of study outcome quality was also extracted in Airtable. We assessed risk of bias using the Cochrane risk of bias tool (RoB-1) for RCTs and additionally judged risk of bias for each outcome as “low risk,” “high risk,” or “some concerns” [17,18]. We applied the Newcastle–Ottawa Scale to observational studies, with studies categorized with regard to risk of bias as “good quality,” “poor quality,” or “fair quality” [19]. We evaluated heterogeneity qualitatively and quantitatively through stratified analysis, and used GRADE to evaluate overall evidence certainty. We used PRECIS-2 criteria to assess how pragmatic or explanatory included studies were.
Intervention categorization
Increased spacing of clinical assessments and ART refills was frequently a component of broader DSD interventions. We therefore characterized interventions according to the frequency of clinical assessment, the location of clinical assessment, the health worker providing the clinical assessment, the frequency of ART refills, the location of refills, the delivery method of refills, and who was providing refills. We conducted separate analyses to evaluate outcomes associated with (1) reduced clinical appointment frequency and (2) reduced ART refill dispensing frequency.
Outcome definition
The primary outcome was retention in care, defined as the proportion of individuals retained on ART and in care at last available follow-up. Secondary outcomes were documented viral suppression at last available follow-up, and mortality. The viral load threshold for defining viral suppression was determined by the authors of each study reporting viral suppression. Planned secondary outcomes of adherence and morbidity were not assessed due to limited reporting in included studies.
Statistical analysis
We conducted pairwise meta-analysis comparing (1) reduced clinical assessment frequency with either 3-monthly or 6-monthly clinical assessments and (2) reduced ART refill dispensing frequency with 3-monthly ART refill frequency. For studies with more than 1 treatment arm, we split the comparison arm if both treatment arms were included in the pooled estimate. For analysis, we included numerators and denominators reported from individual studies and cluster-adjusted estimates for cluster RCTs based on intraclass correlation coefficients (ICCs) from the literature [20–23], according to methodology outlined in Cochrane guidelines [17], to generate overall risk ratios (RRs) with 95% confidence intervals (CIs) by study design. When adjusted measures of associations were available, we pooled relative data for studies reporting time-to-event data as hazard ratios (HRs). Data were synthesized using R programming (packages “metafor” and “metabin”) using Mantel–Haenszel methods for pooling and random effects. Subgroup analyses with pooled RRs were performed where appropriate, including for different frequencies of refills or clinical consultations and different delivery strategies.
Results
Search and screening results
Searches yielded 3,955 records after deduplication; these 3,955 records underwent title and abstract screening. In total, 207 full-text articles were assessed for eligibility, and 20 records representing 10 studies with 15 intervention study arms met the criteria for inclusion in our review (Fig 1).
Included studies
The 10 eligible studies including 15 intervention arms included 6 RCTs, 3 comparative observational studies, and 1 study that contributed both observational and randomized data. All studies were conducted in sub-Saharan Africa, with a total of 33,599 participants across all studies. Two studies included PLWH aged ≥16 years, the rest included PLWH aged ≥18 years. We detected substantial clinical heterogeneity, including variability in the intervention components, the contexts in which reduced visit frequency was delivered, and the interval lengths between clinical consultations and ART refills. Eight intervention study arms with 6-monthly clinical consultations and 7 intervention study arms with 12-monthly clinical consultations were included. Four studies had intervention study arms with 6-monthly ART dispensing intervals. Characterization of the intervention strategies to reduce facility contact included 3 studies with ART dispensation at the clinic, 6 studies with ART dispensation in the community, and 4 studies with ART dispensation in the community or clinic. The majority of the studies (n = 8) included an “adherence club” component as part of the reduced appointment frequency strategy, where PLWH met in either a community or clinic setting. Other interventions included ART dispensation in private pharmacies and venues in the community and ART dispensation at home visits. Individual study and intervention details are summarized in Tables 2 and 3. Ten studies contributed to meta-analyses of reduced clinical consultation frequency (with 15 intervention study arms in total), and 4 studies contributed to meta-analyses of reduced ART refill frequency (4 intervention study arms). There was substantial methodological heterogeneity with regard to study design, risk of bias, and outcome assessment measures.
Risk of bias
As assessed by risk of bias tools, data from RCTs were generally judged as having high methodological quality (low risk of bias) or some concerns, and data from the 3 observational studies were judged as having high quality, fair quality, and poor quality (Tables 4 and S3). Data from cohort studies were considered fair or poor quality primarily due to the comparison arm comprising a patient population with different eligibility than the intervention arm (e.g., different levels of “stability”) [32,37]. RCTs were judged as having some concerns when those enrolled did not meet eligibility criteria [25], those eligible for the intervention did not necessarily receive it [20], or there was high withdrawal in the intervention arm [31].
PRECIS-2 score
Overall, studies were highly pragmatic as they were conducted in real-world settings with few additional measures to guarantee adherence to ART beyond what would occur in routine practice (Table 5). RCTs were on average less pragmatic than cohort studies. Studies were downgraded when they required extensive expertise or organization to deliver the intervention of reduced frequency clinical assessments or reduced frequency ART refills, such as in the case of home visits or group adherence clubs. Studies were less pragmatic when the intervention was delivered at clinical sites associated with research or at a single site.
Reduced clinical consultation frequency
Retention in care.
We identified 9 comparative studies including 2 cohort studies, 6 randomized trials, and 1 study contributing both observational and RCT data (contributing 14 intervention arms in total) that reported retention in care and were included in the pairwise meta-analysis. Retention outcomes were reported by electronic health records and/or chart review, with the definition of retention in care provided by the authors (S1 Table). Among 8 studies with 13 total intervention arms comparing reduced clinic consultation frequency (>3-monthly) to 3-monthly clinical consultations, there appeared to be no difference in retention among all randomized individuals (RR 1.01, 95% CI 0.97–1.04, p = 0.682), consistent in both RCTs and observational data (RR 1.00, 95% CI 0.95–1.04, p = 0.917, and RR 1.02, 95% CI 0.97–1.09, p = 0.434, respectively) (Fig 2A). These findings were also consistent when stratified by 6- or 12-monthly clinical consultations (RR 1.03, 95% CI 0.98–1.08, p = 0.313, and RR 0.99, 95% CI 0.94–1.04, p = 0.672, respectively) (Fig 2B) and delivery strategy (S1 Fig). There was substantial statistical heterogeneity in study design and clinical consultation frequency subgroups, in part due to the inclusion of 1 study with high withdrawal from the intervention (community-based care) arm [31]. Among studies rated as high quality or having low risk of bias, heterogeneity remained substantial (S2 Fig). In exploration of the heterogeneity of study-specific definitions of established-on-ART patient populations, there remained substantial statistical heterogeneity across subgroups of required time spent on ART (12 months, 6 months, or other) for eligibility (S3 Fig).
(A) By study design. (B) By clinical consultation frequency. Goodrich 2021 had high withdrawal from the intervention (community-based care) arm; it was unclear if those who withdrew reengaged in care at the health facility. Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; ND, not described; P, pharmacy; RCT, randomized controlled trial; RF, reduced frequency; RR, risk ratio.
Only 1 study compared 12-monthly clinical consultations to 6-monthly consultations [25]; this study reported similar retention in care at 24 months for 12- and 6-monthly clinical consultations (RR 0.99, 95% CI 0.96–1.01, p = 0.363) (Fig 3).
*Cluster-adjusted RR. 6 MO, 6-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; RF, reduced frequency; RR, risk ratio.
Viral suppression.
We identified 6 comparative studies—1 cohort study, 4 randomized trials, and 1 study contributing both observational and RCT data (contributing 9 total arms for comparison)—that reported viral suppression for inclusion in the pairwise meta-analysis. Viral suppression outcomes were reported by electronic health records and/or chart review using variable thresholds (<400 copies/ml and <1,000 copies/ml) (S1 Table). RCT meta-analysis suggested decreased viral suppression for reduced frequency of clinical consultations compared to 3-monthly clinical consultations (RR 0.74, 95% CI 0.59–0.94, p = 0.015), while cohort studies showed slightly greater viral suppression for reduced frequency of clinical consultations compared to 3-monthly clinical consultations (RR 1.40, 95% CI 0.95–2.08, p = 0.093) (Fig 4A). Within RCT and cohort subgroup analyses, substantial statistical heterogeneity persisted (Fig 4A), markedly influenced by 1 RCT where only 7.3% of the reduced frequency arm received viral load testing and 1 cohort study with substantially higher viral suppression among those in the reduced frequency arm (there were substantial baseline imbalances between study arms in this study, with those receiving reduced visit frequency on ART for longer periods than those in the 3-monthly arm) [27,32] (S2 Table). As estimates differed by study design, overall estimates were not pooled across RCTs and cohort studies in subgroup analyses for clinical consultation frequency (6- or 12-monthly) and delivery strategy (S4 and S6 Figs).
(A) Among those randomized or enrolled. (B) Among those with viral load testing. Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; ND, not described; P, pharmacy; RCT, randomized controlled trial; RF, reduced frequency; RR, risk ratio.
In an available case analysis (including only those who received viral load testing), there appeared to be similar viral suppression in the arms for reduced frequency and 3-monthly clinical consultations among RCTs (RR 1.00, 95% CI 0.92–1.08, p = 0.916), and possible improved viral suppression for reduced frequency clinical consultations compared to 3-monthly clinical consultations among cohort studies (RR 1.44, 95% CI 1.24–1.66, p < 0.001) (Fig 4B). Due to differences in the pooled estimates in RCTs and cohorts, estimates were not pooled across study designs in subgroup analyses for clinical consultation frequency (6- or 12-monthly) (S5 and S7 Figs).
In the single study comparing 12-monthly to 6-monthly clinical consultations, among all individuals randomized, viral suppression was higher in the arm with 12-monthly versus 6-monthly clinical consultations (RR 1.06, 95% CI 1.02–1.10, p = 0.004) (Fig 5A). Among those who received viral load testing, there was no difference in viral suppression for 12-monthly compared to 6-monthly clinical consultations (RR 0.99, 95% CI 0.97–1.01, p = 0.391) (Fig 5B).
(A) Among those randomized. (B) Among those with viral load testing. *Cluster-adjusted RR. 6 MO, 6-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; RF, reduced frequency; RR, risk ratio.
Mortality.
Seven comparative studies (9 comparisons), including 1 cohort study and 6 RCTs, contributed to the mortality meta-analysis. There was no evidence of a difference in mortality between reduced clinical consultations and 3-monthly consultations among these studies (overall RR 1.12, 95% CI 0.75–1.66, p = 0.592) (Fig 6A). This was consistent for 6-monthly clinical consultations and 12-monthly clinical consultations compared to 3-monthly consultations, though these estimates have wide confidence intervals due to the small numbers of events (Fig 6B). There was also no evidence of a difference in mortality when comparing further extended intervals (12-monthly) to 6-monthly clinical consultations (RR 0.80, 95% CI 0.13–4.78, p = 0.807) (Fig 7), though this comparison consists of only 1 study [25].
(A) By study design. (B) By clinical consultation frequency. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; P, pharmacy; RCT, randomized controlled trial; RF, reduced frequency; RR, risk ratio.
*Cluster-adjusted RR. 6 MO, 6-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; RF, reduced frequency; RR, risk ratio.
Reduced ART refill dispensing frequency
Retention in care.
Among the 4 studies (all cluster RCTs) investigating reduced ART refill frequency, there appeared to be no difference in retention in care between increased (6 month) refill intervals and 3-monthly refill frequency (RR 1.01, 95% CI 0.98–1.06, p = 0.473) (Fig 8). No studies assessed ART refills at intervals greater than 6 months.
*Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; RF, reduced frequency; RR, risk ratio.
Viral suppression.
Among all PLWH enrolled in the 3 RCTs comparing reduced (6-monthly) ART dispensing frequency to 3-monthly dispensing, viral suppression appeared better among those in the 3-monthly dispensing arms (RR 0.60, 95% CI 0.41–0.88, p = 0.009) (Fig 9A). This comparison had substantial statistical heterogeneity, influenced by 2 studies with under-ascertainment of viral load in intervention arms [27,38] (S2 Table). The available case analysis, including only PLWH who received viral load testing, showed no difference between intervention arms for 6-monthly refills compared to 3-monthly refills (RR 0.99, 95% CI 0.98–1.00, p = 0.235) (Fig 9B).
(A) Among those randomized. (B) Among those with viral load testing. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; P, pharmacy; RF, reduced frequency; RR, risk ratio.
Mortality.
In the 4 studies (all RCTs) comparing 6-monthly refill frequency to 3-monthly refills, there was no evidence of a difference in mortality between reduced (6-monthly) ART dispensing frequency and 3-monthly refills (RR 1.45, 95% CI 0.63–3.35, p = 0.382) (Fig 10).
*Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; P, pharmacy; RF, reduced frequency; RR, risk ratio.
Certainty of evidence (GRADE)
The certainty of the evidence (a combined assessment of strength of association, methodological quality, heterogeneity, and external validity) for the pooled data for the primary outcomes of retention, viral suppression, and mortality was assessed as very low to moderate quality (Tables 6 and 7). Effect estimates were downgraded due to high risk of bias in the contributing studies and heterogeneity in the contributing effect estimates. For clinical visit frequency comparisons, the certainty of evidence for retention in care was ranked overall as moderate, and viral suppression and mortality were rated as having very low quality evidence, largely due to imprecision and/or high risk of bias for contributing studies. Regarding the overall estimates for ART refill dispensing frequency comparisons, the outcome of retention in care was ranked as having moderate certainty, while viral suppression was ranked as having very low certainty, and mortality was ranked as having low certainty, also due to high risk of bias and imprecision.
These evidence rankings contribute to statements and assumptions that can be made about the evidence contributing to this review. The very low quality evidence for viral load and mortality lead to final assessments of insufficient evidence to draw meaningful conclusions for these outcomes.
Discussion
In this systematic review we found among the 10 included studies (6 RCTs, 3 observational studies, and 1 study contributing both observational and RCT data)—with 15 study arms with 33,599 adults in 8 countries in sub-Saharan Africa—that reduced frequency of clinical consultations and ART dispensing appeared to have comparable HIV treatment outcomes to 3-monthly clinical or dispensing visits. For reduced frequency clinical consultations, there was no evidence of a difference in retention in care, when comparing reduced frequency (i.e., 6- or 12-monthly) clinical consultations to 3-monthly consultation visits. For clinical consultations, viral load results were inconsistent, and it was not possible to discern the effect of reduced clinical consultation frequency on viral suppression due to marked under-ascertainment of viral load in reduced frequency intervention arms. Similarly, conclusions could not be drawn on the effects on mortality, due to the overall small number of events and very low quality evidence. A single study that compared 12-monthly to 6-monthly clinical consultations showed similar retention in care and viral suppression between study arms. When comparing 6-monthly to 3-monthly ART dispensing frequency, there appeared to be little to no difference in retention in care. For ART refill frequency, evidence quality ratings for viral suppression and mortality were similarly very low; it was therefore not possible to draw conclusions for these outcomes.
Visit frequency was reduced through a variety of implementation strategies: In most cases clinical consultations occurred at the health facility, and ART dispensing was facilitated through adherence clubs at the health facility or in the community, with individual club members, lay staff, or nurses distributing ART. Other community ART delivery strategies included distribution at community venues, private pharmacies, or mobile health units, or directly in the homes of PLWH, though there were relatively few studies to compare across delivery strategies. Overall, included studies were highly pragmatic. There was, however, marked heterogeneity of effects, study designs, risk of bias, implementation strategies, and outcome measurement time points—this contributed to the low-certainty evidence ratings for several outcomes. The definition of the established-on-ART patient population varied by study; however, no studies included data on children or key population groups, or were from outside of the sub-Saharan African region.
While we found overall little difference in clinical outcomes for reduced visit frequency, there are other potential benefits of reduced visits, including decongestion of health facilities, reduced provider workload, prioritization of care for new or clinically unstable PLWH, and reduced transmission of COVID-19 in health centers [5,13,41–44]. Reducing visit frequency has been reported to be one of the easiest DSD models to implement and aligns strongly with the care preferences of PLWH by reducing the economic costs of attending frequent appointments, reducing stigma, and allowing PLWH to normalize HIV [3,4,10,11,45,46]. HIV services, however, need to remain flexible enough to accommodate return to facilities for those who opt back into standard care or when clinical requirements change [27]. Further research is needed to develop strategies that allow for transition between models of care and provide psychosocial support between extended visits (e.g., virtual visits or group models) [3,47]. As many countries, in response to COVID-19, have expanded multi-month dispensing for patients who have not previously been considered established on ART [12], it will be essential to explore outcomes in those less “established” on ART, as well as to develop strategies to align and integrate non-communicable disease care with these models and to identify optimum models of care for key populations, other regions, and children, to ensure the utility of these models for all PLWH [5,48].
Ongoing successful scale-up of multi-month scripting and sustainability will depend on well-functioning drug supply chains. To date, 3-monthly ART dispensing visits and 6-monthly clinical consultations have been widely adopted in LMICs, and the COVID-19 epidemic has accelerated the adoption of even longer intervals, with 11 countries providing 6-monthly ART refills and 6 countries providing 12-monthly clinical consults as of June 2021 [12,49–51]. The reliability of supply chains to maintain multi-month dispensing remains a concern, however, with drug stock-outs common, particularly in the sub-Saharan African region [4,52]. At this time, local drug supply chains and pharmacy capacity should be robust to ensure that PLWH do not experience barriers to obtaining at minimum 3-monthly refills [53,54].
In addition to ensuring adequate ART supply, incorporating well-functioning treatment monitoring strategies into differentiated models of care will be crucial. While there were too few studies within subgroups to compare outcomes by delivery strategy, reducing facility visits reduces opportunities for viral load measurement at centralized locations, and viral load monitoring, in particular, appeared to be a challenge in treatment arms providing primarily community-based services with infrequent facility visits. Strengthening facility-based laboratory systems as well as establishing reliable decentralized viral load monitoring strategies (e.g., point-of-care or community-based sample collection) represent further areas for investigation to support reduced clinical and ART dispensing visit frequency [55–57].
Limitations and strengths
This synthesis was strengthened by inclusion of a wide range of pragmatic trial data and programmatic observational data providing real-world insights into the effect of reducing dispensing and clinical visit intervals. There were, however, also several limitations of the data included in the review. First, we acknowledge that pooling heterogenous studies cannot generate one true effect estimate relevant to all contexts; however, such syntheses can give insights into the broader question of whether an intervention results in benefit or harm, which was the overarching goal of this synthesis. Second, there was a lack of evidence for children, key populations, and LMICs outside of sub-Saharan Africa, limiting the generalizability of the findings. Third, few studies contributed to comparisons of 12- versus 6-monthly clinical consultations, and therefore no firm conclusions could be generated on the relative effect of such consultation intervals. Fourth, there were insufficient data to compare and stratify by reduced visit interval implementation strategies. Lastly, there were no data on how increasing visit intervals impacts management of other comorbid illnesses such as diabetes and hypertension.
Conclusion
Based on data from this synthesis, extending clinical consultation intervals beyond 3 months and ART dispensing intervals to 6 months likely results in similar retention in care compared to 3-monthly intervals, with uncertain effects on mortality and viral suppression. As countries shift toward 6-monthly clinical consultations and extended ART dispensation intervals, research should identify which delivery strategies are most efficient in accommodating both patient preferences and pragmatic concerns regarding cost and logistical health system capabilities. Ongoing monitoring of emerging evidence on the scale-up of reduced visit interval strategies will be critical to inform future HIV service delivery guidelines.
Supporting information
S1 Appendix. Deviations from protocol listed in PROSPERO.
https://doi.org/10.1371/journal.pmed.1003959.s001
(DOCX)
S1 Fig. Retention in care: Reduced frequency versus 3-monthly clinical consultations, by delivery strategy.
Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; ND, not described; P, pharmacy; RF, reduced frequency.
https://doi.org/10.1371/journal.pmed.1003959.s003
(TIF)
S2 Fig. Retention in care: Reduced frequency versus 3-monthly clinical consultations, by risk of bias assessment.
Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; ND, not described; P, pharmacy; RF, reduced frequency.
https://doi.org/10.1371/journal.pmed.1003959.s004
(TIF)
S3 Fig. Retention in care: Reduced frequency versus 3-monthly clinical consultations, by time on ART for established-on-ART patient population.
Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; ND, not described; P, pharmacy; RF, reduced frequency.
https://doi.org/10.1371/journal.pmed.1003959.s005
(TIF)
S4 Fig. Viral suppression among those enrolled: Reduced frequency versus 3-monthly clinical consultations, by clinical consultation frequency.
Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; ND, not described; P, pharmacy; RF, reduced frequency.
https://doi.org/10.1371/journal.pmed.1003959.s006
(TIF)
S5 Fig. Viral suppression among those with viral load testing: Reduced frequency versus 3-monthly clinical consultations, by clinical consultation frequency.
Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; RF, reduced frequency.
https://doi.org/10.1371/journal.pmed.1003959.s007
(TIF)
S6 Fig. Viral suppression among those enrolled: Reduced frequency versus 3-monthly clinical consultations, by delivery strategy.
Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; RF, reduced frequency.
https://doi.org/10.1371/journal.pmed.1003959.s008
(TIF)
S7 Fig. Viral suppression among those with viral load testing: Reduced frequency versus 3-monthly clinical consultations, by delivery strategy.
Fox 2019a and Fox 2019b were separated into an RCT and cohort design, respectively, based on the analysis described by the authors, where randomization was not preserved in the intervention arm in Fox 2019b. *Cluster-adjusted RR. 3 MO, 3-monthly; AC, adherence club; Comm, community; e, number of events; n, number of participants; RF, reduced frequency.
https://doi.org/10.1371/journal.pmed.1003959.s009
(TIF)
S2 Table. Ascertainment of viral suppression by study.
https://doi.org/10.1371/journal.pmed.1003959.s012
(DOCX)
References
- 1. Grimsrud A, Bygrave H, Doherty M, Ehrenkranz P, Ellman T, Ferris R, et al. Reimagining HIV service delivery: the role of differentiated care from prevention to suppression. J Int AIDS Soc. 2016;19:21484. pmid:27914186
- 2. Huber A, Pascoe S, Nichols B, Long L, Kuchukhidze S, Phiri B, et al. Differentiated service delivery models for HIV treatment in Malawi, South Africa, and Zambia: a landscape analysis key findings. Glob Health Sci Pract. 2021;9:296–307. pmid:34234023
- 3. Zakumumpa H, Makobu K, Ntawiha W, Maniple E. A mixed-methods evaluation of the uptake of novel differentiated ART delivery models in a national sample of health facilities in Uganda. PLoS ONE. 2021;16:e0254214. pmid:34292984
- 4. Keene CM, Zokufa N, Venables EC, Wilkinson L, Hoffman R, Cassidy T, et al. Only twice a year: a qualitative exploration of 6-month antiretroviral treatment refills in adherence clubs for people living with HIV in Khayelitsha, South Africa. BMJ Open. 2020;10:e037545. pmid:32641338
- 5. Hubbard J, Phiri K, Moucheraud C, McBride K, Bardon A, Balakasi K, et al. A qualitative assessment of provider and client experiences with 3- and 6-month dispensing intervals of antiretroviral therapy in Malawi. Glob Health Sci Pract. 2020;8:18–27. pmid:32015007
- 6. Tafuma TA, Mahachi N, Dziwa C, Moga T, Baloyi P, Muyambo G, et al. Barriers to HIV service utilisation by people living with HIV in two provinces of Zimbabwe: results from 2016 baseline assessment. South Afr J HIV Med. 2018;19:721. pmid:30214827
- 7. Tuller DM, Bangsberg DR, Senkungu J, Ware NC, Emenyonu N, Weiser SD. Transportation costs impede sustained adherence and access to HAART in a clinic population in Southwestern Uganda: a qualitative study. AIDS Behav. 2010;14:778–84. pmid:19283464
- 8. Mutasa-Apollo T, Ford N, Wiens M, Socias ME, Negussie E, Wu P, et al. Effect of frequency of clinic visits and medication pick-up on antiretroviral treatment outcomes: a systematic literature review and meta-analysis. J Int AIDS Soc. 2017;20(Suppl 4):21647. pmid:28770599
- 9. Long L, Kuchukhidze S, Pascoe S, Nichols B, Cele R, Govathson C, et al. Differentiated models of service delivery for antiretroviral treatment of HIV in sub-Saharan Africa: a rapid review protocol. Syst Rev. 2019;8:314. pmid:31810482
- 10. Eshun-Wilson I, Mukumbwa-Mwenechanya M, Kim HY, Zannolini A, Mwamba CP, Dowdy D, et al. Differentiated care preferences of stable patients on antiretroviral therapy in Zambia: a discrete choice experiment. J Acquir Immune Defic Syndr. 2019;81:540–6. pmid:31021988
- 11. Zanolini A, Sikombe K, Sikazwe I, Eshun-Wilson I, Somwe P, Bolton Moore C, et al. Understanding preferences for HIV care and treatment in Zambia: evidence from a discrete choice experiment among patients who have been lost to follow-up. PLoS Medicine. 2018;15:e1002636. pmid:30102693
- 12. Grimsrud A, Wilkinson L. Acceleration of differentiated service delivery for HIV treatment in sub-Saharan Africa during COVID-19. J Int AIDS Soc. 2021;24:e25704. pmid:34105884
- 13. Wilkinson L, Grimsrud A. The time is now: expedited HIV differentiated service delivery during the COVID-19 pandemic. J Int AIDS Soc. 2020;23:e25503. pmid:32378345
- 14.
World Health Organization. Consolidated guidelines on HIV prevention, testing, treatment, service delivery and monitoring: recommendations for a public health approach. Geneva: World Health Organization; 2021.
- 15.
International AIDS Society. It’s time to deliver differently. Stockholm: International AIDS Society; 2021 [cited 2021 Mar 7]. Available from: https://www.differentiatedservicedelivery.org.
- 16.
Veritas Health Innovation. Covidence systematic review software. Melbourne: Veritas Health Innovation; 2021.
- 17.
Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M, et al., editors. Cochrane handbook for systematic reviews of interventions. Version 6.2. London: Cochrane Collaboration; 2021.
- 18. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. pmid:22008217
- 19.
Wells G, Shea B, O’Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in meta-analyses. Ottawa: Ottawa Hospital Research Institute; 2021 [cited 2021 Sep 7]. Available from: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp.
- 20. Fox MP, Pascoe S, Huber AN, Murphy J, Phokojoe M, Gorgens M, et al. Adherence clubs and decentralized medication delivery to support patient retention and sustained viral suppression in care: results from a cluster-randomized evaluation of differentiated ART delivery models in South Africa. PLoS Med. 2019;16:e1002874. pmid:31335865
- 21. Amanyire G, Semitala F, Namusobya J, Katuramu R, Kampiire L, Wallenta J, et al. Effects of a multicomponent intervention to streamline initiation of antiretroviral therapy in Africa: a stepped-wedge cluster-randomised trial. Lancet HIV. 2016;3:e539–48. pmid:27658873
- 22. Fatti G, Jackson D, Goga AE, Shaikh N, Eley B, Nachega JB, et al. The effectiveness and cost-effectiveness of community-based support for adolescents receiving antiretroviral treatment: an operational research study in South Africa. J Int AIDS Soc. 2018;21(Suppl 1):e25041. pmid:29485714
- 23. Washington S, Owuor K, Turan JM, Steinfeld RL, Onono M, Shade SB, et al. Implementation and operational research: effect of integration of HIV care and treatment into antenatal care clinics on mother-to-child HIV transmission and maternal outcomes in Nyanza, Kenya: results from the SHAIP cluster randomized controlled trial. J Acquir Immune Defic Syndr. 2015;69:e164–71. pmid:25886930
- 24. Lebelo K, Cassidy T, Grimsrud A, Keene C, Ndlovu S, Hayes H, et al. Twenty-four month retention and viral load outcomes from a non-inferiority cluster randomized trial of extending ART dispensing intervals to 6-monthly in adherence clubs. J Int AIDS Soc. 2019; LBPED36.
- 25. Cassidy T, Grimsrud A, Keene C, Lebelo K, Hayes H, Orrell C, et al. Twenty-four-month outcomes from a cluster-randomized controlled trial of extending antiretroviral therapy refills in ART adherence clubs. J Int AIDS Soc. 2020;23:e25649. pmid:33340284
- 26. Wilkinson L, Grimsrud A, Cassidy T, Orrell C, Voget J, Hayes H, et al. A cluster randomized controlled trial of extending ART refill intervals to six-monthly for anti-retroviral adherence clubs. BMC Infect Dis. 2019;19:674. pmid:31362715
- 27. Fatti G, Ngorima-Mabhena N, Mothibi E, Muzenda T, Choto R, Kasu T, et al. Outcomes of three- versus six-monthly dispensing of antiretroviral treatment (ART) for stable HIV patients in community ART refill groups: a cluster-randomized trial in Zimbabwe. J Acquir Immune Defic Syndr. 2020; 84:162–72. pmid:32097252
- 28. Fatti G, Ngorima-Mabhena N, Tiam A, Tukei BB, Kasu T, Muzenda T, et al. Community-based differentiated service delivery models incorporating multi-month dispensing of antiretroviral treatment for newly stable people living with HIV receiving single annual clinical visits: a pooled analysis of two cluster-randomized trials in Southern Africa. J Int AIDS Soc. 2021;24(Suppl 6):e25819. pmid:34713614
- 29. Fatti G, Lopes J, Mabhena-Ngorima N, Tiam A, Tukei B, Pisa P, et al. Community multimonth art provision: pooled analysis of 2 cluster-randomized trials. Top Antiv Med. 2021;29:58–9.
- 30.
Goodrich S, Siika A, Mwangi A, Spira T, Bateganya M, Toroitich-Ruto C, et al. Effectiveness of a community-based model of HIV care in western Kenya. 22nd International AIDS Conference; 2018 Jul 23–27; Amsterdam, the Netherlands.
- 31. Goodrich S, Siika A, Mwangi A, Nyambura M, Naanyu V, Yiannoutsos C, et al. Development, assessment, and outcomes of a community-based model of antiretroviral care in Western Kenya through a cluster-randomized control trial. J Acquir Immune Defic Syndr. 2021;87:e198–206. pmid:33492018
- 32. Grimsrud A, Lesosky M, Kalombo C, Bekker LG, Myer L. Community-based adherence clubs for the management of stable antiretroviral therapy patients in Cape Town, South Africa: a cohort study. J Acquir Immune Defic Syndr. 2016;71:e16–23. pmid:26473798
- 33. Grimsrud A, Sharp J, Kalombo C, Bekker LG, Myer L. Implementation of community-based adherence clubs for stable antiretroviral therapy patients in Cape Town, South Africa. J Int AIDS Soc. 2015;18:e19984. pmid:26022654
- 34. Hoffman RM, Moyo C, Balakasi KT, Siwale Z, Hubbard J, Bardon A, et al. Multimonth dispensing of up to 6 months of antiretroviral therapy in Malawi and Zambia (INTERVAL): a cluster-randomised, non-blinded, non-inferiority trial. Lancet Glob Health. 2021;9:e628–38. pmid:33865471
- 35. Hoffman R, Bardon A, Rosen S, Fox M, Kalua T, Xulu T, et al. Varying intervals of antiretroviral medication dispensing to improve outcomes for HIV patients (The INTERVAL Study): study protocol for a randomized controlled trial. Trials. 2017;18:476. pmid:29029644
- 36. Nichols BE, Cele R, Jamieson L, Long LC, Siwale Z, Banda P. Community-based delivery of HIV treatment in Zambia: costs and outcomes. AIDS. 2021;35:299–306. pmid:33170578
- 37. Pasipamire L, Nesbitt RC, Ndlovu S, Sibanda G, Mamba S, Lukhele N, et al. Retention on ART and predictors of disengagement from care in several alternative community-centred ART refill models in rural Swaziland. J Int AIDS Soc. 2018;21:e25183. pmid:30225946
- 38. Tukei BB, Fatti G, Tiam A, Ngorima-Mabhena N, Tukei VJ, Tshabalala I, et al. Twelve-month outcomes of community-based differentiated bodels of bultimonth dispensing of ART among stable HIV-infected adults in Lesotho: a cluster-randomized noninferiority trial. J Acquir Immune Defic Syndr. 2020;85:280–91. pmid:32665460
- 39. Nichols BE, Cele R, Lekodeba N, Tukei B, Ngorima-Mabhena N, Tiam A, et al. Economic evaluation of differentiated service delivery models for HIV treatment in Lesotho: costs to providers and patients. J Int AIDS Soc. 2021;24:e25692. pmid:33838012
- 40. Woodd SL, Grosskurth H, Levin J, Amuron B, Namara G, Birunghi J, et al. Home-based versus clinic-based care for patients starting antiretroviral therapy with low CD4+ cell counts: findings from a cluster-randomized trial. AIDS. 2014;28:569–76. pmid:24468997
- 41. Prust ML, Banda CK, Nyirenda R, Chimbwandira F, Kalua T, Jahn A, et al. Multi-month prescriptions, fast-track refills, and community ART groups: results from a process evaluation in Malawi on using differentiated models of care to achieve national HIV treatment goals. J Int AIDS Soc. 2017;20:e21650. pmid:28770594
- 42. Pascoe SJS, Scott NA, Fong RM, Murphy J, Huber AN, Moolla A, et al. “Patients are not the same, so we cannot treat them the same”—a qualitative content analysis of provider, patient and implementer perspectives on differentiated service delivery models for HIV treatment in South Africa. J Int AIDS Soc. 2020;23:e25544. pmid:32585077
- 43. Dudhia R, Kagee A. Experiences of participating in an antiretroviral treatment adherence club. Psychol Health Med. 2015;20:488–94. pmid:25168720
- 44. Traub AM, Ifafore-Calfee T, Phelps BR. Multimonth dispensing of antiretroviral therapy protects the most vulnerable from 2 pandemics at Once. Glob Health Sci Pract. 2020;8:176–7. pmid:32606089
- 45. Grimsrud A, Wilkinson L, Eshun-Wilson I, Holmes C, Sikazwe I, Katz IT. Understanding engagement in HIV programmes: how health services can adapt to ensure no one is left behind. Curr HIV/AIDS Rep. 2020;17:458–66. pmid:32844274
- 46. Lujintanon S, Amatavete S, Sungsing T, Seekaew P, Peelay J, Mingkwanrungruang P, et al. Client and provider preferences for HIV care: implications for implementing differentiated service delivery in Thailand. J Int AIDS Soc. 2021;24:e25693. pmid:33792192
- 47. Roy M, Bolton Moore C, Sikazwe I, Holmes CB. A review of differentiated service delivery for HIV treatment: effectiveness, mechanisms, targeting, and scale. Curr HIV/AIDS Rep. 2019;16:324–34. pmid:31230342
- 48. Ehrenkranz P, Grimsrud A, Holmes CB, Preko P, Rabkin M. Expanding the vision for differentiated service delivery: a call for more inclusive and truly patient-centered care for people living with HIV. J Acquir Immune Defic Syndr. 2021;86:147–52. pmid:33136818
- 49.
International AIDS Society. DSD dashboard: maximum duration of ART refills for adults within DSD for HIV treatment. Stockholm: International AIDS Society; 2021 [cited 2021 Dec 27]. Available from: https://differentiatedservicedelivery.org/Resources/Resource-Library/DSD_Policy_Dashboards.
- 50.
International AIDS Society. DSD dashboard: frequency of clinical consultations among those in DSD for HIV treatment. Stockholm: International AIDS Society; 2021 [cited 2021 Dec 27]. Available from: https://differentiatedservicedelivery.org/Resources/Resource-Library/DSD_Policy_Dashboards.
- 51.
International AIDS Society. IAS 2021 knowledge toolkits. Stockholm: International AIDS Society; 2021 [cited 2021 Dec 28]. Available from: https://www.iasociety.org/Membership/Toolkit-archive.
- 52. Gils T, Bossard C, Verdonck K, Owiti P, Casteels I, Mashako M, et al. Stockouts of HIV commodities in public health facilities in Kinshasa: barriers to end HIV. PLoS ONE. 2018;13:e0191294. pmid:29351338
- 53. Zakumumpa H, Rujumba J, Kwiringira J, Katureebe C, Spicer N. Understanding implementation barriers in the national scale-up of differentiated ART delivery in Uganda. BMC Health Serv Res. 2020;20:222. pmid:32183796
- 54. Rewari BB, Mangadan-Konath N, Sharma M. Policy and practice impact of COVID-19 on the global supply chain of antiretroviral drugs: a rapid survey of Indian manufacturers. WHO South East Asia J Public Health. 2020;9:126–33. pmid:32978345
- 55. Drain PK, Dorward J, Violette LR, Quame-Amaglo J, Thomas KK, Samsunder N, et al. Point-of-care HIV viral load testing combined with task shifting to improve treatment outcomes (STREAM): findings from an open-label, non-inferiority, randomised controlled trial Paul. Lancet HIV. 2020;7:e229–37. pmid:32105625
- 56. Dorward J, Drain PK, Garrett N. Point-of-care viral load testing and differentiated HIV care. Lancet HIV. 2018;5:e8–9. pmid:29290227
- 57.
Jain V, Owaraganise A, Black D, Twinamatsiko B, Ayebare M, Wandera B, et al. RAPID-VL intervention improves viral load ordering, results turnaround time and viral suppression: a cluster randomized trial in HIV clinics in Uganda. 11th IAS Conference on HIV Science; 2021 Jul 18–21; Berlin, Germany. 2021 [cited 2022 Mar 17]. Available from: https://theprogramme.ias2021.org/Abstract/Abstract/2418.