Effective health system interventions may help address the disproportionate burden of diabetes in low- and middle-income countries (LMICs). We assessed the impact of health system interventions to improve outcomes for adults with type 2 diabetes in LMICs.
Methods and findings
We searched Ovid MEDLINE, Cochrane Library, EMBASE, African Index Medicus, LILACS, and Global Index Medicus from inception of each database through February 24, 2020. We included randomized controlled trials (RCTs) of health system interventions targeting adults with type 2 diabetes in LMICs. Eligible studies reported at least 1 of the following outcomes: glycemic change, mortality, quality of life, or cost-effectiveness. We conducted a meta-analysis for the glycemic outcome of hemoglobin A1c (HbA1c). GRADE and Cochrane Effective Practice and Organisation of Care methods were used to assess risk of bias for the glycemic outcome and to prepare a summary of findings table. Of the 12,921 references identified in searches, we included 39 studies in the narrative review of which 19 were cluster RCTs and 20 were individual RCTs. The greatest number of studies were conducted in the East Asia and Pacific region (n = 20) followed by South Asia (n = 7). There were 21,080 total participants enrolled across included studies and 10,060 total participants in the meta-analysis of HbA1c when accounting for the design effect of cluster RCTs. Non-glycemic outcomes of mortality, health-related quality of life, and cost-effectiveness had sparse data availability that precluded quantitative pooling. In the meta-analysis of HbA1c from 35 of the included studies, the mean difference was −0.46% (95% CI −0.60% to −0.31%, I2 87.8%, p < 0.001) overall, −0.37% (95% CI −0.64% to −0.10%, I2 60.0%, n = 7, p = 0.020) in multicomponent clinic-based interventions, −0.87% (−1.20% to −0.53%, I2 91.0%, n = 13, p < 0.001) in pharmacist task-sharing studies, and −0.27% (−0.50% to −0.04%, I2 64.1%, n = 7, p = 0.010) in trials of diabetes education or support alone. Other types of interventions had few included studies. Eight studies were at low risk of bias for the summary assessment of glycemic control, 15 studies were at unclear risk, and 16 studies were at high risk. The certainty of evidence for glycemic control by subgroup was moderate for multicomponent clinic-based interventions but was low or very low for other intervention types. Limitations include the lack of consensus definitions for health system interventions, differences in the quality of underlying studies, and sparse data availability for non-glycemic outcomes.
In this meta-analysis, we found that health system interventions for type 2 diabetes may be effective in improving glycemic control in LMICs, but few studies are available from rural areas or low- or lower-middle-income countries. Multicomponent clinic-based interventions had the strongest evidence for glycemic benefit among intervention types. Further research is needed to assess non-glycemic outcomes and to study implementation in rural and low-income settings.
Why was this study done?
- Approximately 80% of the 463 million adults with type 2 diabetes worldwide live in low- and middle-income countries (LMICs).
- Evidence-based treatments for diabetes exist, but health systems in LMICs have difficulty meeting diabetes patients’ needs.
- Health system interventions can help address this gap by improving the delivery of diabetes care within health systems.
What did the researchers do and find?
- We conducted a systematic review and meta-analysis of 39 health system interventions aiming to improve outcomes of glycemic (i.e., blood glucose) control, mortality, quality of life, or cost-effectiveness for people with type 2 diabetes in LMICs.
- We found that health system interventions for type 2 diabetes may be effective in improving glycemic control in LMICs, but few studies were available from rural areas or low- or lower-middle-income countries.
- Among intervention types, multicomponent clinic-based interventions had the strongest evidence for improving glycemic control.
What do these findings mean?
- Our findings support the scaling up of diabetes health system interventions to improve patients’ glycemic control in LMICs.
- Further research is needed to assess other outcomes beyond glycemic control, especially in rural areas and in low- or lower-middle-income countries.
Citation: Flood D, Hane J, Dunn M, Brown SJ, Wagenaar BH, Rogers EA, et al. (2020) Health system interventions for adults with type 2 diabetes in low- and middle-income countries: A systematic review and meta-analysis. PLoS Med 17(11): e1003434. https://doi.org/10.1371/journal.pmed.1003434
Academic Editor: Andre P. Kengne, South African Medical Research Council, SOUTH AFRICA
Received: April 28, 2020; Accepted: October 19, 2020; Published: November 12, 2020
This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Data Availability: The study’s dataset and statistical code are available through Dataverse at: https://doi.org/10.7910/DVN/NIESKT.
Funding: DF is supported by the National Clinician Scholars Program at the University of Michigan Institute for Healthcare Policy & Innovation. BHW is supported by grant number K01MH110599 from the National Institute of Mental Health. EAR is supported by the National Institute of Diabetes and Digestive and Kidney Diseases of the National Institutes of Health under award number K23DK118207. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: EPOC, Effective Practice and Organisation of Care; HbA1c, hemoglobin A1c; HICs, high-income countries; LMICs, low- and middle-income countries; RCT, randomized controlled trial; SMS, short message service
Type 2 diabetes disproportionately affects people in low- and middle-income countries (LMICs). Of the estimated 463 million adults worldwide with type 2 diabetes, approximately 80% reside in LMICs . The absolute number of adults and percentage of the population with diabetes have increased more quickly in LMICs than in high-income countries (HICs) . Despite the existence of cost-effective and evidence-based clinical treatments for type 2 diabetes , health systems in LMICs have difficulty meeting the rising need for quality care . Improving and scaling up care in LMICs is an urgent global health priority.
Health system interventions can help address this priority. In contrast to clinical therapies for individual patients, health system interventions emphasize the behavior of health workers and the way healthcare is practiced and delivered . Examples of health system interventions include quality and safety programs, health information systems, health worker incentives, and changes in scope of practice . Effective health system interventions are needed to implement type 2 diabetes care in settings with different resources, cultures, and population risk factors .
While health system interventions improve type 2 diabetes outcomes in HICs [7–9], the evidence from LMICs is limited. A 2012 meta-analysis of 142 randomized trials primarily conducted in HICs found that interventions targeting the health system rather than healthcare providers or patients alone were most effective . However, health system interventions designed and tested in HICs may not be generalizable to LMICs . In LMICs, prior reviews draw from diverse study designs and together suggest a modest yet increasing number of studies on the implementation of evidence-based type 2 diabetes care into health systems in LMICs [11–13]. To our knowledge, no review has systematically assessed evidence from randomized controlled trials (RCTs) or conducted a meta-analysis.
Therefore, we conducted a systematic review and meta-analysis to examine the impact of health system interventions that aimed to improve outcomes of glycemic (i.e., blood glucose) change, mortality, health-related quality of life, or cost-effectiveness for adults with type 2 diabetes in LMICs.
This systematic review and meta-analysis was conducted based on guidance from Cochrane Effective Practice and Organisation of Care (EPOC), a group focusing on reviews of the delivery of health services . We registered the review in PROSPERO (CRD42018106765; S1 Appendix) and followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines (S2 Appendix) . Ethical approval was not required as the research used publicly available data.
Search strategy and selection criteria
We performed systematic searches in several bibliographic databases. The search strategy was built and tested for sensitivity in Ovid MEDLINE (S3 Appendix) and translated to 5 other bibliographic databases: Cochrane Library, EMBASE, African Index Medicus, LILACS, and Global Index Medicus. Databases were chosen to be inclusive of international and interdisciplinary literature. The search strategy was built in English, and no language filters were applied. We also hand-searched the references of included studies, related systematic reviews, and the websites of major international diabetes organizations. To ensure high search quality, a second reference librarian peer-reviewed the search terms. The search dates were from database inception through February 24, 2020.
We included RCTs of health system interventions targeting non-pregnant, ambulatory adults with type 2 diabetes in LMICs. We defined LMICs using the 2019 World Bank income groups. Included studies reported at least 1 of the following outcomes: glycemic change, mortality, health-related quality of life, or cost-effectiveness. Given our interest in durable health system interventions, we prespecified that studies enroll 100 or more participants, with follow-up of at least 24 weeks. No date or language restrictions were applied.
We used the EPOC review group’s definition of health system interventions as those designed to “improve the professional practice and the delivery of effective health services” through changes in healthcare delivery, financing, governance, and implementation [5,14]. Consistent with EPOC, we excluded studies of patient behavior change alone if the intervention did not primarily target healthcare professionals . For example, an intervention training healthcare professionals on diabetes education was included; however, an intervention aiming to improve outcomes solely through individualized diabetes education was excluded . We defined “healthcare professional” broadly to encompass physicians, nurses, pharmacists, and other allied health workers.
A medical librarian (SJB) downloaded all records, removed duplicates, and imported records to the review management tool Covidence. Two authors (DF and JH) independently screened studies by title and abstract and, subsequently, by full-text review. Disagreements were resolved first by consensus and, if needed, in consultation with another author (PR). We used language proficiency among the members of our review team and Google Translate to abstract data from non-English trials . Multiple reports from the same study were identified by reviewing the country setting, intervention details, and authorship list. When multiple reports were identified, we linked the reports together for extraction and analysis. We used the TIDieR checklist and EPOC template to structure extraction . We extracted study elements including the 4 outcomes, country, setting, duration and follow-up, number of participants enrolled, intervention description, and comparator. One author (DF) extracted summary data into a customized electronic spreadsheet, and 2 other authors (JH and MD) independently verified the extracted data. We classified each study by EPOC domain (S4 Appendix)  and then grouped interventions into similar types. Our main unit of analysis was at the level of intervention type. If outcomes were missing or not reported, we contacted authors twice to obtain data. We used GRADE and EPOC guidance to assess risk of bias for the glycemic outcome and to prepare a summary of findings table [18–21].
As quantitative data were reliably reported for only 1 of our 4 included outcomes, we limited our meta-analysis to the glycemic outcome of hemoglobin A1c (HbA1c) change. The meta-analysis was performed with random effects using the DerSimonian–Laird method for mean between-group HbA1c difference. Prespecified subgroup analyses were done by intervention type. Sample sizes for cluster RCTs were adjusted to account for the design effect using the intracluster correlation coefficient (ICC) . We inferred an ICC from the literature if one was not reported in the study or its trial protocol . We followed the methodology recommended in the Cochrane handbook to calculate within-group mean and standard deviation when this information was not directly reported in the study or made available by authors . To provide a range of the effects of individual studies, we calculated an overall prediction interval .
We conducted 2 sensitivity analyses. First, we excluded studies with high risk of bias. Second, we assessed the influence of individual studies by using the leave-one-out method to recalculate estimates omitting 1 study at a time . Heterogeneity was explored by calculating I2 and T2, and we report 95% confidence intervals for I2 if 3 or more studies are pooled . Publication bias was assessed by visual inspection of funnel plots and the Egger test. The trim-and-fill method was also applied to impute the number of studies potentially missing from the meta-analysis and to re-estimate an overall effect size accounting for publication bias . We analyzed data in Stata (version 16.0).
Overview of results
Our search strategy identified 12,921 references (Fig 1). After removing 1,093 duplicates, we screened 11,828 references by title and abstract and assessed 322 full-text articles for eligibility. Of the 283 articles excluded after full-text review, 103 articles were excluded due to the type of intervention, and 94 articles were excluded due to incomplete data. We included 39 trials in the narrative review and 35 trials in the meta-analysis of glycemic change.
Of the 39 studies included in the narrative review, 19 were cluster RCTs and 20 were individual RCTs (Table 1; S5 Appendix). There were 21,080 total participants enrolled across included studies. The greatest number of studies were conducted in the East Asia and Pacific region, followed by South Asia. Twenty-nine studies were conducted in upper-middle-income countries as defined by the World Bank, and only 1 trial included a site in a low-income country. All but 1 of the studies were published in the year 2010 or after . The study setting was primarily urban in 27 trials and primarily rural in 5 trials. The median study duration was 10 months (interquartile range 6 to 12). Most interventions involved the EPOC domains of delivery arrangements and implementation strategies. Only 1 intervention incorporated a change in governance , and no study tested changes in financial arrangements. The comparator group in most studies was usual care as defined by the local program or setting of care. Two studies described the comparator group as enhanced usual care, where the enhancement consisted of clinical training for health professionals [30,31], and in 1 study the medical fees were waived in the comparator arm .
Narrative description of interventions
Multicomponent clinic-based interventions.
Eight trials were classified as clinic-based multicomponent interventions, which we defined as studies involving multiple types of health workers implementing a bundle of quality improvement or health system strengthening interventions [30,31,58–63]. Most studies incorporated primary care doctors in a team-based intervention [30,31,59,60,62,63], and the study by Ali and colleagues incorporated endocrinologists . Each intervention included self-management education or support delivered by peers , non-physician care coordinators , clinicians [30,59,60,62,63], or an automated short message service (SMS) text-messaging system . Other components in the bundles included health record establishment , electronic decision support [31,58], physician education [30,59,60,62,63], care coordination or case management [58,62], clinical information systems [30,60,62,63], and clinical audit and feedback [62,63]. Three studies were based on the Chronic Care Model [60,62,63].
Pharmacist task-sharing interventions.
Fourteen studies were classified as pharmacist task-sharing interventions, which we defined as studies in which patients received activities performed by pharmacists such as care coordination, medication review and counseling, and prescription suggestions to physicians [28,33–35,37,38,41,42,47,48,50,51,55,57]. All pharmacist task-sharing interventions incorporated diabetes self-management education, but no trial included education alone. Seven interventions included counseling and reminders through telephone calls or text messages [34,35,38,39,41,55,57], and a study in Iran incorporated only telephone calls with no face-to-face encounters . No intervention involved pharmacists independently prescribing or titrating medications. All 11 of the studies that described the study setting were conducted in an urban area [33,35,37,38,41,42,48,50,51,55,57]. The intensity of interventions was incompletely reported but ranged from 3 to 16 telephone calls or face-to-face visits.
Diabetes education or support alone.
Nine studies involved health workers primarily implementing diabetes education or support without additional services [32,39,40,43,46,49,53,54,56]. We defined these interventions as diabetes education or support alone. Six of the studies primarily involved in-person delivery [32,40,43,46,49,56], and 3 studies delivered the intervention in group format [46,49,56]. The health workers in these studies varied between and within studies and included peers [49,53,56], community health workers [43,46,53], nurses [32,39,40,53,54], psychologists , and physicians [32,39,54]. Face-to-face encounters were supplemented with telephone calls in 2 studies [32,54] and by computer-assisted instruction in another study . Motivational interviewing techniques were incorporated in 2 studies [32,46]. The intensity of the in-person interventions ranged from 4 to 24 total face-to-face encounters.
Other intervention types with fewer studies.
Two studies involved nursing case management interventions. In these trials, a nurse  or nurse–community health worker team  facilitated patient support and care coordination. Both trials varied intervention intensity by a patient’s risk factors. DePue and colleagues conducted a cluster RCT in American Samoa that primarily used home visits and individual rather than group sessions . In the trial conducted by Tutino and colleagues in China, both the intervention and comparator arms included implementation of a web-based clinical information portal, and the intervention arm received additional nurse-led care coordination .
Two health system interventions involved physician clinical training alone [65,66]. Akturan and colleagues trained physicians on a therapeutic interviewing technique . Reutens and colleagues trained physicians in multiple countries on diabetes guidelines using 2 in-person sessions and reminders .
One study was classified as a nurse task-sharing intervention . Conducted in South Africa, this intervention involved authorizing, training, and supporting nurses to independently prescribe a set of drugs for several noncommunicable diseases including diabetes using an algorithmic management tool .
One study was classified as an mHealth screening and quality improvement intervention . This trial involved an intervention for diabetes and hypertension involving SMS educational messages and appointment reminders, community-based screening, and deployment of electronic clinical tools for physicians and nurses .
Two studies tested glucose telemonitoring interventions in which participants uploaded glucose data to an online system and then received feedback from health workers regarding treatment changes to improve glycemic control [44,45].
Summary of outcomes
We describe outcomes of glycemic change, mortality, quality of life, and cost-effectiveness by study in S5 Appendix. Glycemic changes were reported based on HbA1c values in 36 studies and based on fasting glucose alone in 3 trials. Among studies reporting fasting glucose only, 2 trials of multicomponent clinic-based interventions found glycemic improvement [56,61], while there was no improvement in a trial of diabetes education or support alone . The primary outcome involved change in HbA1c or the proportion of participants meeting HbA1c goals in 23 studies.
Outcomes of mortality, health-related quality of life, and cost-effectiveness were reported in 19, 11, and 5 studies, respectively. Of the 19 studies reporting mortality, 14 studies had 10 or fewer deaths combined in the intervention and comparator groups (S6 Appendix). Studies with larger numbers of deaths appeared to have generally similar mortality between trial arms though a formal meta-analysis was not conducted due to sparseness of data [29,31,53,58]. No study’s primary outcome was mortality.
Of the 11 studies reporting quality of life, 6 studies reported no significant differences between the intervention and comparator arms [29,32,45,46,52,59], and 5 studies showed improved quality of life in the intervention arm [33,40,51,58,62]. Seven different scales were used to assess quality of life, and only the EuroQol EQ-5D was used in more than 1 study [29,45,46,52,58]. Only 1 study reported quality of life as a primary outcome .
Cost-effectiveness was reported as an incremental cost-effectiveness ratio (ICER) in 5 studies. An ICER of $1,121 per 1% decrease in HbA1c was reported in the trial by DePue and colleagues  and $1,850 in the study by Ali and colleagues . The study by Mash et al. reported an ICER of $1,862 per quality-adjusted life year (QALY) based on improvements in blood pressure . Two other trials calculated an ICER between trial arms [33,59]. No study reported cost-effectiveness as a primary outcome.
In the meta-analysis of HbA1c in 35 trials, there were 10,060 total participants when accounting for the design effect of cluster RCTs (5,240 in intervention arms and 4,820 in comparator arms). The overall between-arm HbA1c mean change was −0.46% (95% CI −0.60% to −0.31%, I2 87.8% [95% CI 84.0% to 90.6%]; Fig 2). Within subgroups of intervention type, mean HbA1c difference was −0.37% (95% CI −0.64% to −0.10%, I2 60.0% [95% CI 8.2% to 82.6%], n = 7) in multicomponent clinic-based interventions, −0.87% (95% CI −1.20% to −0.53%, I2 91.0% [95% CI 86.5% to 94.0%], n = 13) in pharmacist task-sharing studies, and −0.27% (95% CI −0.50% to −0.04%, I2 64.1% [95% CI 18.8% to 84.1%], n = 7) in trials of diabetes education or support alone. The effect sizes of other intervention types with 2 or fewer studies reporting HbA1c are summarized in Fig 2. The overall HbA1c prediction interval was −1.19% to 0.28%.
Studies are listed in the figure by first author [28–36,38–42, 44–55,57–60,62–66]. The intervention arms were combined in the study by Anzaldo-Campos and colleagues . Only the health literacy intervention arm was included in the study by Wang and colleagues . The proportion of participants from low- and middle-income countries was inferred to be 60% in the study by Reutens and colleagues . Participant numbers in cluster RCTs are adjusted for design effect as described in the Methods. The prediction interval is depicted as the horizontal whiskers intersecting the overall effect diamond marker.
Risk of bias and sensitivity analysis
Eight studies were at low risk of bias for the summary assessment of glycemic control, 15 studies were at unclear risk, and 16 studies were at high risk (S7 Appendix). The overall funnel plot and Egger test for the HbA1c meta-analysis suggested possible bias (Egger p < 0.001; S8 Appendix), but there was little evidence of bias within subgroups of intervention types (S9 Appendix). Using the trim-and-fill method, we estimated that there were 8 missing studies, and inclusion of these imputed studies resulted in an estimated overall HbA1c mean difference of −0.28% (95% CI −0.43% to −0.13%; S10 Appendix). In the sensitivity analysis of studies not at high risk of bias (n = 21 trials), the overall HbA1c mean difference was −0.20% (95% CI −0.32% to −0.08%, I2 71.8% [95% CI 56.2% to 81.8%]; S11–S13 Appendices). In the sensitivity analysis using the leave-one-out method, we found that exclusion of the study with the largest effect size  would result in a HbA1c mean difference of −0.39% (95% CI −0.52% to −0.26%, I2 84.5%; S14 Appendix).
The certainty of evidence using the GRADE/EPOC approach for glycemic control by subgroup was moderate for multicomponent clinic-based interventions but was low or very low for other intervention types (S15 Appendix). The most common reasons for downgrading the certainty of evidence for intervention types were concerns regarding risk of bias or inconsistency across studies (S16 Appendix). For example, in the case of pharmacist task-sharing interventions, 9 of the 14 studies were classified as being at high risk of bias, 5 were at unclear risk of bias, and none were at low risk of bias. The absence of high-quality trials resulted in a low certainty of evidence for pharmacist task-sharing studies despite their sizeable pooled HbA1c estimate in the meta-analysis. Conversely, in the case of multicomponent clinic-based interventions, only 1 of the 8 studies was deemed to be at high risk of bias, and 3 of the studies were at low risk of bias. The result was a moderate certainty of evidence for the glycemic outcome for these interventions despite a lower pooled HbA1c estimate than for the pharmacist-led studies.
We systematically reviewed the literature and identified 39 RCTs of health system interventions for adults with type 2 diabetes in LMICs that assessed glycemic control, mortality, health-related quality of life, or cost-effectiveness. Most included studies were conducted in upper-middle-income countries, and few studies were carried out in rural areas or low- or lower-middle-income countries. Mirroring global patterns , this research disparity is discordant with epidemiologic evidence showing a substantial diabetes burden in low-income countries and in rural areas of LMICs [68,69]. The EPOC domains of delivery arrangements and implementation strategies were most commonly involved in the included interventions. In the overall meta-analysis of HbA1c from 35 trials, we found that health system interventions modestly improved glycemic control on average. At the same time, the wide prediction interval overlapping 0 in the meta-analysis of HbA1c showed that there was a wide range of effectiveness across studies, and some health system interventions may not be effective in all settings. Non-glycemic outcomes of mortality, health-related quality of life, and cost-effectiveness were less frequently reported. There was considerable heterogeneity in the overall pooled analysis that was partially explained by intervention type and baseline HbA1c. Within intervention types, multicomponent clinic-based interventions had moderate evidence of glycemic benefit, but the certainty of evidence was low or very low for other intervention types.
Our review complements prior meta-analyses of studies primarily from HICs showing the benefit of systems-level quality improvement interventions on surrogate outcomes such as HbA1c, blood pressure, and cholesterol [7–9]. However, these prior reviews have included few trials outside of HICs, which limits generalizability to health systems in LMICs. In LMICs, published reviews of health system interventions for diabetes care have explored diabetes care models , integrated hypertension and diabetes care , and interventions with a lifestyle component . Incorporating heterogeneous study designs, these previous reviews have surveyed the limited evidence and described various approaches that have been implemented in LMICs. Our review adds to the literature by focusing on clinical and patient-oriented outcomes from the increasing number of randomized trials conducted in these settings.
The most common intervention types we identified were multicomponent clinic-based interventions, pharmacist task-sharing interventions, and interventions of diabetes education or support alone. Multicomponent clinic-based interventions were modestly effective in improving glycemic control, with moderate certainty of evidence. At the same time, multiple well-conducted trials had null results [30,31,62]. These findings may reflect differences in participants, setting, or the implementation of different components in the bundle. Of note, the comparator arm in 2 of these well-conducted multicomponent clinic-based trials consisted of enhanced usual care [30,31], potentially causing an attenuation of effect size. In HICs, components with the largest effect sizes have been team change, patient education or patient self-management, electronic registries, and promotion of patient–provider communication .
Interventions focusing solely on implementing diabetes education or support within the health system also were effective in improving glycemic control, but the certainty of evidence was low. All 3 trials judged as low risk of bias had null results [32,43,46]. One potential explanation for inconsistent findings is the relatively low contact intensity of many studies. In HICs, a dose-dependent relationship has been observed between contact intensity and glycemic effectiveness, with interventions with 10 or fewer hours found to be ineffective . Another consideration is that research trial infrastructure in resource-limited settings may catalyze the delivery of standard clinical care across trial arms. This revitalization of underlying care may make it difficult to detect modest differences attributable to education or support alone. A dramatic example of this effect was the Happy Life Club trial in China, in which both trial arms experienced 3.7% within-group HbA1c improvement over 18 months . Both the intervention and comparator arm in this trial had out-of-pocket medical fees waived, which may have contributed to catalyzing participants to seek medical care. Importantly, we included diabetes education or support trials that primarily changed the behavior of health workers within the health system, and we excluded lifestyle trials focusing on patient behavior alone without systems-level change.
Task sharing was a common thread across intervention types. Distinct from task shifting, task sharing emphasizes the shared responsibility for a task between the health workers’ different levels and types of training . Previous reviews of trials predominantly conducted in HICs have suggested task sharing with pharmacists as an effective strategy . We found that pharmacist task-sharing interventions appeared to improve glycemic control in the pooled analysis, but the certainty of evidence was low for these types of interventions, primarily due to concerns about studies’ risk of bias.
Task sharing also was a fundamental component in the nurse-led intervention by Fairall and colleagues in South Africa , a nurse care coordination trial , and multicomponent clinic-based studies [31,58,59]. We observed differences across studies relating to task sharing such as type of health worker, training, and assigned tasks. Prior reviews of task shifting for chronic diseases in LMICs have identified few trials in type 2 diabetes [72,73]. A 2019 meta-analysis by Anand and colleagues concluded that task-sharing interventions were effective in improving blood pressure in LMICs . Our review shows an increase in research incorporating task sharing into health system interventions for type 2 diabetes in these settings.
Our review should be considered in the context of the movement to strengthen health systems in LMICs . Diabetes has been referred to as a “tracer condition” for assessing the strength of health systems , and inadequate diabetes care has been reported in nationally representative surveys in many LMICs . RCTs are not the only form of evidence generation in the field of health policy and research , and diverse research strategies are needed in conditions like type 2 diabetes that have a strong clinical evidence base yet weak evidence on implementation [3,78]. Logistical challenges in conducting randomized studies within health systems likely explain why we identified few interventions testing financial or governance arrangements. An advantage of including only RCTs is that we are able to offer robust evidence of the impact of health system interventions on glycemic control and reveal the limited data on other outcomes. Further studies in LMICs are needed to assess non-glycemic outcomes and, given the wide prediction intervals, to determine the specific components and details of health system interventions most likely to promote effectiveness and limit potential harms. Excellent examples of implementation research include the portfolio of ongoing projects funded by the Global Alliance for Chronic Disease .
Our review has limitations. Defining a health system intervention is challenging, and there is no consensus definition. We justify our use of the EPOC definition as reasonable given its use in prior Cochrane EPOC reviews on health systems in LMICs. We excluded non-randomized study designs given the challenge in attributing causality for outcomes and inconsistent reporting of these designs in pilot searches. Randomized designs in health system research have limitations, including the possible attenuation of effect sizes . There was statistical evidence for publication bias and substantial differences in the quality of underlying studies that limited the certainty of evidence of glycemic benefit for intervention types including pharmacist task-sharing interventions. We did not assess blood pressure outcomes given our primary interest in the evidence of interventions attempting to achieve glycemic control and prior meta-analyses supporting the effectiveness of health system interventions for blood pressure control [74,81]. The only outcome in our review for which a meta-analysis was conducted, HbA1c, is only a surrogate outcome, but it is commonly used in meta-analyses of systems-level interventions for diabetes [7,9]. Our review was restricted to studies with at least 6 months of follow-up and 100 enrolled participants. Multiple trials were included within some countries, but we did not formally account for a potential lack of independence among studies conducted within the same health system context. This aspect reflects a limitation of the evidence generated rather than one of the analysis itself. We also did not systematically assess important implementation science outcomes such as reach, fidelity, or acceptability. Finally, although there were substantial similarities within intervention types, individual studies varied by setting and population, limiting our ability to make conclusions with high degrees of certainty.
This review has notable strengths. We synthesized evidence of outcomes by focusing on RCTs and performing a meta-analysis of HbA1c. Our comprehensive search strategy facilitated this choice as we identified a larger number of trials in LMICs than previous reviews. Our review was supplemented with unpublished data received from multiple study authors, and we were able to pool HbA1c statistical estimates reported differently across studies.
In conclusion, we found that health system interventions for type 2 diabetes may be effective in improving glycemic control in LMICs, but few studies were available from rural areas or low- or lower-middle-income countries. Multicomponent clinic-based interventions had the strongest evidence for glycemic benefit among intervention types. Data were generally limited for non-glycemic outcomes such as mortality, quality of life, and cost-effectiveness. Our findings imply a need for implementation research to investigate the details of health system interventions that confer durable improvements in clinical and patient-centered outcomes in LMICs, especially in rural areas and in low- and lower-middle-income countries.
S1 Appendix. PROSPERO registration and final review protocol.
S4 Appendix. Main domains of the EPOC taxonomy of health systems.
S5 Appendix. Characteristics of included studies.
S6 Appendix. Forest plot of overall deaths by study.
S8 Appendix. Overall funnel plot (all studies).
S9 Appendix. Funnel plot by intervention type (all studies).
S10 Appendix. Funnel plot generated using trim-and-fill method.
S11 Appendix. Forest plot for meta-analysis of HbA1c (%) mean difference excluding studies at high risk of bias.
S12 Appendix. Overall funnel plot excluding studies at high risk of bias.
S13 Appendix. Funnel plot by intervention type excluding studies at high risk of bias.
S14 Appendix. Forest plot generated using leave-one-out method.
We thank the following authors of included studies for contributing supplementary information used in this review: María Cecilia Anzaldo-Campos, MD, MBA; Anna Chapman, PhD; Jeroen De Man; Shaun Wen Huey Lee, PhD; Aditya Khetan, MD; Professor Dr. Anis Safura Ramli; Professor Hong-Mei Wang, PhD; and Xuefeng Zhong, MD, MPH, PhD.
The content is solely the responsibility of the authors and does not necessarily represent the official views of the funders.
- 1. International Diabetes Federation. IDF diabetes atlas. 9th edition. Brussels: International Diabetes Federation; 2019.
- 2. NCD Risk Factor Collaboration. Worldwide trends in diabetes since 1980: a pooled analysis of 751 population-based studies with 4.4 million participants. Lancet. 2016;387(10027):1513–30. pmid:27061677
- 3. Ali MK, Siegel KR, Chandrasekar E, Tandon R, Ascher Montoya P, Mbanya JC, et al. Diabetes: an update on the pandemic and potential solutions. In: Prabhakaran D, Anand S, Gaziano TA, Mbanya JC, Wu Y, Nugent R, editors. Disease control priorities. 3rd edition. Volume 5: cardiovascular, respiratory, and related disorders. Washington (DC): World Bank; 2017.
- 4. Manne-Goehler J, Geldsetzer P, Agoudavi K, Andall-Brereton G, Aryal KK, Bicaba BW, et al. Health system performance for people with diabetes in 28 low- and middle-income countries: a cross-sectional study of nationally representative surveys. PLoS Med. 2019;16(3):e1002751. pmid:30822339
- 5. Effective Practice and Organisation of Care. EPOC taxonomy—topics list. Oxford: Effective Practice and Organisation of Care; 2015 [cited 2020 Mar 17]. Available from: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/taxonomy/epoc_taxonomy.pdf.
- 6. Atun R, Davies JI, Gale EAM, Barnighausen T, Beran D, Kengne AP, et al. Diabetes in sub-Saharan Africa: from clinical care to health policy. Lancet Diabetes Endocrinol. 2017;5(8):622–67. pmid:28688818
- 7. Lim LL, Lau ESH, Kong APS, Davies MJ, Levitt NS, Eliasson B, et al. Aspects of multicomponent integrated care promote sustained improvement in surrogate clinical outcomes: a systematic review and meta-analysis. Diabetes Care. 2018;41(6):1312–20. pmid:29784698
- 8. Ong SE, Koh JJK, Toh SES, Chia KS, Balabanova D, McKee M, et al. Assessing the influence of health systems on type 2 diabetes mellitus awareness, treatment, adherence, and control: a systematic review. PLoS ONE. 2018;13(3):e0195086. pmid:29596495
- 9. Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, Galipeau J, et al. Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. Lancet. 2012;379(9833):2252–61. pmid:22683130
- 10. Miranda JJ, Zaman MJ. Exporting ‘failure’: why research from rich countries may not benefit the developing world. Rev Saude Publica. 2010;44(1):185–9. pmid:20140343
- 11. Afable A, Karingula NS. Evidence based review of type 2 diabetes prevention and management in low and middle income countries. World J Diabetes. 2016;7(10):209–29. pmid:27226816
- 12. Correia JC, Lachat S, Lagger G, Chappuis F, Golay A, Beran D, et al. Interventions targeting hypertension and diabetes mellitus at community and primary healthcare level in low- and middle-income countries: a scoping review. BMC Public Health. 2019;19(1):1542. pmid:31752801
- 13. Esterson YB, Carey M, Piette JD, Thomas N, Hawkins M. A systematic review of innovative diabetes care models in low-and middle-income countries (LMICs). J Health Care Poor Underserved. 2014;25(1):72–93. pmid:24509014
- 14. Effective Practice and Organisation of Care. Scope of our work. Oxford: Effective Practice and Organisation of Care; 2020 [cited 2020 Mar 17]. Available from: https://epoc.cochrane.org/scope-our-work.
- 15. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. pmid:19621072
- 16. Jackson JL, Kuriyama A, Anton A, Choi A, Fournier JP, Geier AK, et al. The accuracy of Google Translate for abstracting data from non-English-language trials for systematic reviews. Ann Intern Med. 2019;171(9):677–9. pmid:31357212
- 17. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. pmid:24609605
- 18. Effective Practice and Organisation of Care. Suggested risk of bias criteria for EPOC reviews. Oxford: Effective Practice and Organisation of Care; 2017 [cited 2020 Oct 22]. Available from: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources-for-authors2017/suggested_risk_of_bias_criteria_for_epoc_reviews.pdf.
- 19. Effective Practice and Organisation of Care. Summary assessments of the risk of bias. Oxford: Effective Practice and Organisation of Care; 2017 [cited 2020 Oct 22]. Available from: http://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources-for-authors2017/summary_assessments_of_the_risk_of_bias.pdf.
- 20. Effective Practice and Organisation of Care. EPOC resources for review authors: worksheets for preparing a Summary of Findings tables using GRADE. Oxford: Effective Practice and Organisation of Care; 2020 [cited 2020 Oct 22]. Available from: http://epoc.cochrane.org/resources/epoc-resources-review-authors.
- 21. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6. pmid:18436948
- 22. Higgins J, Green S, editors. Cochrane handbook for systematic reviews of interventions. Version 5.1.0. London: Cochrane Collaboration; 2011.
- 23. Littenberg B, MacLean CD. Intra-cluster correlation coefficients in adults with diabetes in primary care practices: the Vermont Diabetes Information System field survey. BMC Med Res Methodol. 2006;6(1):20. pmid:16672056
- 24. Riley RD, Higgins JP, Deeks JJ. Interpretation of random effects meta-analyses. BMJ. 2011;342:d549. pmid:21310794
- 25. Wallace BC, Schmid CH, Lau J, Trikalinos TA. Meta-Analyst: software for meta-analysis of binary, continuous and diagnostic data. BMC Med Res Methodol. 2009;9:80. pmid:19961608
- 26. Borenstein M, Hedges LV, Higgins JP, Rothstein HR. Introduction to meta-analysis. West Sussex (UK): John Wiley & Sons; 2009.
- 27. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63. pmid:10877304
- 28. Phumipamorn S, Pongwecharak J, Soorapan S, Pattharachayakul S. Effects of the pharmacist’s input on glycaemic control and cardiovascular risks in Muslim diabetes. Prim Care Diabetes. 2008;2(1):31–7. pmid:18684418
- 29. Fairall LR, Folb N, Timmerman V, Lombard C, Steyn K, Bachmann MO, et al. Educational outreach with an integrated clinical tool for nurse-led non-communicable chronic disease management in primary care in South Africa: a pragmatic cluster randomised controlled trial. PLoS Med. 2016;13(11):e1002178. pmid:27875542
- 30. Khan MA, Walley JD, Khan N, Hicks J, Ahmed M, Khan SE, et al. Effectiveness of an integrated diabetes care package at primary healthcare facilities: a cluster randomised trial in Pakistan. BJGP Open. 2018;2(4):bjgpopen18X101618. pmid:30723803
- 31. Prabhakaran D, Jha D, Prieto-Merino D, Roy A, Singh K, Ajay VS, et al. Effectiveness of an mHealth-based electronic decision support system for integrated management of chronic conditions in primary care: the mWellcare cluster-randomized controlled trial. Circulation. 2018 Nov 10. pmid:30586732
- 32. Chapman A, Browning CJ, Enticott JC, Yang H, Liu S, Zhang T, et al. Effect of a health coach intervention for the management of individuals with type 2 diabetes mellitus in China: a pragmatic cluster randomized controlled trial. Front Public Health. 2018;6:252. pmid:30283767
- 33. Adibe MO, Obinna UP, Uchenna IN, Michael UC, Aguwa CN. Effects of an additional pharmaceutical care intervention versus usual care on clinical outcomes of type 2 diabetes patients in Nigeria: a comparative study. Sci Res Essays. 2014;9(12):548–56.
- 34. Ayadurai S, Sunderland VB, Tee LBG, Md Said SN, Hattingh HL. Structured tool to improve clinical outcomes of type 2 diabetes mellitus patients: a randomized controlled trial. J Diabetes. 2018;10(12):965–76. pmid:29877609
- 35. Chung WW, Chua SS, Lai PS, Chan SP. Effects of a pharmaceutical care model on medication adherence and glycemic control of people with type 2 diabetes. Patient Prefer Adherence. 2014;8:1185–94. pmid:25214772
- 36. DePue JD, Dunsiger S, Seiden AD, Blume J, Rosen RK, Goldstein MG, et al. Nurse-community health worker team improves diabetes care in American Samoa: results of a randomized controlled trial. Diabetes Care. 2013;36(7):1947–53. pmid:23393217
- 37. Gillani SW. Determining effective diabetic care; a multicentre—longitudinal interventional study. Curr Pharm Des. 2016;22(42):6469–76. pmid:27526787
- 38. Goruntla N, Mallela V, Nayakanti D. Impact of pharmacist-directed counseling and message reminder services on medication adherence and clinical outcomes in type 2 diabetes mellitus. J Pharm Bioallied Sci. 2019;11(1):69–76. pmid:30906142
- 39. Guo Z, Liu J, Zeng H, He G, Ren X, Guo J. Feasibility and efficacy of nurse-led team management intervention for improving the self-management of type 2 diabetes patients in a Chinese community: a randomized controlled trial. Patient Prefer Adherence. 2019;13:1353–62. pmid:31616135
- 40. Jaipakdee J, Jiamjarasrangsi W, Lohsoonthorn V, Lertmaharit S. Effectiveness of a self-management support program for Thais with type 2 diabetes: evaluation according to the RE-AIM framework. Nurs Health Sci. 2015;17(3):362–9. pmid:25818472
- 41. Jarab AS, Alqudah SG, Mukattash TL, Shattat G, Al-Qirim T. Randomized controlled trial of clinical pharmacy management of patients with type 2 diabetes in an outpatient diabetes clinic in Jordan. J Manag Care Pharm. 2012;18(7):516–26. pmid:22971205
- 42. Javaid Z, Imtiaz U, Khalid I, Saeed H, Khan RQ, Islam M, et al. A randomized control trial of primary care-based management of type 2 diabetes by a pharmacist in Pakistan. BMC Health Serv Res. 2019;19(1):409. pmid:31234840
- 43. Khetan A, Zullo M, Rani A, Gupta R, Purushothaman R, Bajaj NS, et al. Effect of a community health worker-based approach to integrated cardiovascular risk factor control in India: a cluster randomized controlled trial. Glob Heart. 2019;14(4):355–65. pmid:31523014
- 44. Kim HS, Sun C, Yang SJ, Sun L, Li F, Choi IY, et al. Randomized, open-label, parallel group study to evaluate the effect of internet-based glucose management system on subjects with diabetes in China. Telemed J E Health. 2016;22(8):666–74. pmid:26938489
- 45. Lee JY, Chan CKY, Chua SS, Ng CJ, Paraidathathu T, Lee KKC, et al. Telemonitoring and team-based management of glycemic control on people with type 2 diabetes: a cluster-randomized controlled trial. J Gen Intern Med. 2020;35(1):87–94. pmid:31512187
- 46. Mash RJ, Rhode H, Zwarenstein M, Rollnick S, Lombard C, Steyn K, et al. Effectiveness of a group diabetes education programme in under-served communities in South Africa: a pragmatic cluster randomized controlled trial. Diabet Med. 2014;31(8):987–93. pmid:24766179
- 47. Mourao AO, Ferreira WR, Martins MA, Reis AM, Carrillo MR, Guimaraes AG, et al. Pharmaceutical care program for type 2 diabetes patients in Brazil: a randomised controlled trial. Int J Clin Pharm. 2013;35(1):79–86. pmid:23161124
- 48. Neto PR, Marusic S, de Lyra Junior DP, Pilger D, Cruciol-Souza JM, Gaeti WP, et al. Effect of a 36-month pharmaceutical care program on the coronary heart disease risk in elderly diabetic and hypertensive patients. J Pharm Pharm Sci. 2011;14(2):249–63. pmid:21733413
- 49. Paz-Pacheco E, Sandoval MA, Ardena GJ, Paterno E, Juban N, Lantion-Ang FL, et al. Effectiveness of a community-based diabetes self-management education (DSME) program in a rural agricultural setting. Prim Health Care Res Dev. 2017;18(1):35–49. pmid:27640303
- 50. Sarayani A, Mashayekhi M, Nosrati M, Jahangard-Rafsanjani Z, Javadi M, Saadat N, et al. Efficacy of a telephone-based intervention among patients with type-2 diabetes; a randomized controlled trial in pharmacy practice. Int J Clin Pharm. 2018;40(2):345–53. pmid:29435911
- 51. Sriram S, Chack LE, Ramasamy R, Ghasemi A, Ravi TK, Sabzghabaee AM. Impact of pharmaceutical care on quality of life in patients with type 2 diabetes mellitus. J Res Med Sci. 2011;16(Suppl 1):S412–8. pmid:22247727
- 52. Tutino GE, Yang WY, Li X, Li WH, Zhang YY, Guo XH, et al. A multicentre demonstration project to evaluate the effectiveness and acceptability of the web-based Joint Asia Diabetes Evaluation (JADE) programme with or without nurse support in Chinese patients with type 2 diabetes. Diabet Med. 2017;34(3):440–50. pmid:27278933
- 53. Van Olmen J, Kegels G, Korachais C, de Man J, Van Acker K, Kalobu JC, et al. The effect of text message support on diabetes self-management in developing countries—a randomised trial. J Clin Transl Endocrinol. 2017;7:33–41. pmid:29067248
- 54. Wang L, Fang H, Xia Q, Liu X, Chen Y, Zhou P, et al. Health literacy and exercise-focused interventions on clinical measurements in Chinese diabetes patients: a cluster randomized controlled trial. EClinicalMedicine. 2019;17:100211. pmid:31891144
- 55. Wishah RA, Al-Khawaldeh OA, Albsoul AM. Impact of pharmaceutical care interventions on glycemic control and other health-related clinical outcomes in patients with type 2 diabetes: randomized controlled trial. Diabetes Metab Syndr. 2015;9(4):271–6. pmid:25301007
- 56. Zhong X, Wang Z, Fisher EB, Tanasugarn C. Peer support for diabetes management in primary care and community settings in Anhui Province, China. Ann Fam Med. 2015;13(Suppl 1):S50–8. pmid:26304972
- 57. Shen M, Zhao H, Sun K, Lu Y, Wang Z. Influence of pharmaceutical care intervention on type 2 diabetes patients with multi-drug therapy in the community. Pharm Care Res. 2016;16(3):170–4.
- 58. Ali MK, Singh K, Kondal D, Devarajan R, Patel SA, Shivashankar R, et al. Effectiveness of a multicomponent quality improvement strategy to improve achievement of diabetes care goals: a randomized, controlled trial. Ann Intern Med. 2016;165(6):399–408. pmid:27398874
- 59. Anzaldo-Campos MC, Contreras S, Vargas-Ojeda A, Menchaca-Diaz R, Fortmann A, Philis-Tsimikas A. Dulce Wireless Tijuana: a randomized control trial evaluating the impact of Project Dulce and short-term mobile technology on glycemic control in a family medicine clinic in northern Mexico. Diabetes Technol Ther. 2016;18(4):240–51. pmid:26914371
- 60. Barcelo A, Cafiero E, de Boer M, Mesa AE, Lopez MG, Jimenez RA, et al. Using collaborative learning to improve diabetes care and outcomes: the VIDA project. Prim Care Diabetes. 2010;4(3):145–53. pmid:20478753
- 61. Chao J, Yang L, Xu H, Yu Q, Jiang L, Zong M. The effect of integrated health management model on the health of older adults with diabetes in a randomized controlled trial. Arch Gerontol Geriatr. 2015;60(1):82–8. pmid:25456892
- 62. Kong JX, Zhu L, Wang HM, Li Y, Guo AY, Gao C, et al. Effectiveness of the chronic care model in type 2 diabetes management in a community health service center in China: a group randomized experimental study. J Diabetes Res. 2019;2019:6516581. pmid:30719455
- 63. Ramli AS, Selvarajah S, Daud MH, Haniff J, Abdul-Razak S, Tg-Abu-Bakar-Sidik TM, et al. Effectiveness of the EMPOWER-PAR intervention in improving clinical outcomes of type 2 diabetes mellitus in primary care: a pragmatic cluster randomised controlled trial. BMC Fam Pract. 2016;17(1):157. pmid:27842495
- 64. Saleh S, Farah A, Dimassi H, El Arnaout N, Constantin J, Osman M, et al. Using mobile health to enhance outcomes of noncommunicable diseases care in rural settings and refugee camps: randomized controlled trial. JMIR Mhealth Uhealth. 2018;6(7):e137. pmid:30006326
- 65. Akturan S, Kaya CA, Unalan PC, Akman M. The effect of the BATHE interview technique on the empowerment of diabetic patients in primary care: a cluster randomised controlled study. Prim Care Diabetes. 2017;11(2):154–61. pmid:28122690
- 66. Reutens AT, Hutchinson R, Van Binh T, Cockram C, Deerochanawong C, Ho LT, et al. The GIANT study, a cluster-randomised controlled trial of efficacy of education of doctors about type 2 diabetes mellitus management guidelines in primary care practice. Diabetes Res Clin Pract. 2012;98(1):38–45. pmid:22784926
- 67. Viergever RF, Li K. Trends in global clinical trial registration: an analysis of numbers of registered clinical trials in different parts of the world from 2004 to 2013. BMJ Open. 2015;5(9):e008932. pmid:26408831
- 68. Dagenais GR, Gerstein HC, Zhang X, McQueen M, Lear S, Lopez-Jaramillo P, et al. Variations in diabetes prevalence in low-, middle-, and high-income countries: results from the prospective urban and rural epidemiological study. Diabetes Care. 2016;39(5):780–7. pmid:26965719
- 69. Seiglie JA, Marcus ME, Ebert C, Prodromidis N, Geldsetzer P, Theilmann M, et al. Diabetes prevalence and its relationship with education, wealth, and BMI in 29 low- and middle-income countries. Diabetes Care. 2020;43(4):767–75. pmid:32051243
- 70. Pillay J, Armstrong MJ, Butalia S, Donovan LE, Sigal RJ, Vandermeer B, et al. Behavioral programs for type 2 diabetes mellitus: a systematic review and network meta-analysis. Ann Intern Med. 2015;163(11):848–60. pmid:26414227
- 71. Meara JG, Leather AJM, Hagander L, Alkire BC, Alonso N, Ameh EA, et al. Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet. 2015;386(9993):569–624. pmid:25924834
- 72. Joshi R, Alim M, Kengne AP, Jan S, Maulik PK, Peiris D, et al. Task shifting for non-communicable disease management in low and middle income countries—a systematic review. PLoS ONE. 2014;9(8):e103754. pmid:25121789
- 73. Ogedegbe G, Gyamfi J, Plange-Rhule J, Surkis A, Rosenthal DM, Airhihenbuwa C, et al. Task shifting interventions for cardiovascular risk reduction in low-income and middle-income countries: a systematic review of randomised controlled trials. BMJ Open. 2014;4(10):e005983. pmid:25324324
- 74. Anand TN, Joseph LM, Geetha AV, Prabhakaran D, Jeemon P. Task sharing with non-physician health-care workers for management of blood pressure in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Glob Health. 2019;7(6):e761–71. pmid:31097278
- 75. Hafner T, Shiffman J. The emergence of global attention to health systems strengthening. Health Policy Plan. 2013;28(1):41–50. pmid:22407017
- 76. Nolte E, Bain C, McKee M. Diabetes as a tracer condition in international benchmarking of health systems. Diabetes Care. 2006;29(5):1007–11. pmid:16644629
- 77. Gilson L, editor. Health policy and systems research: a methodology reader. Geneva: World Health Organization; 2012.
- 78. Owolabi MO, Yaria JO, Daivadanam M, Makanjuola AI, Parker G, Oldenburg B, et al. Gaps in guidelines for the management of diabetes in low- and middle-income versus high-income countries—a systematic review. Diabetes Care. 2018;41(5):1097–105. pmid:29678866
- 79. Daivadanam M, Ingram M, Sidney Annerstedt K, Parker G, Bobrow K, Dolovich L, et al. The role of context in implementation research for non-communicable diseases: answering the ‘how-to’ dilemma. PLoS ONE. 2019;14(4):e0214454. pmid:30958868
- 80. English M, Schellenberg J, Todd J. Assessing health system interventions: key points when considering the value of randomization. Bull World Health Organ. 2011;89(12):907–12. pmid:22271948
- 81. Uthman OA, Hartley L, Rees K, Taylor F, Ebrahim S, Clarke A. Multiple risk factor interventions for primary prevention of cardiovascular disease in low- and middle-income countries. Cochrane Database Syst Rev. 2015;(8):CD011163. pmid:26272648