Low- and middle-income countries (LMICs) are facing a combined affliction from both tuberculosis (TB) and noncommunicable diseases (NCDs), which threatens population health and further strains the already stressed health systems. Integrating services for TB and NCDs is advantageous in tackling this joint burden of diseases effectively. Therefore, this systematic review explores the mechanisms for service integration for TB and NCDs and elucidates the facilitators and barriers for implementing integrated service models in LMIC settings.
Methods and findings
A systematic search was conducted in the Cochrane Library, MEDLINE, Embase, PubMed, Bibliography of Asian Studies, and the Global Index Medicus from database inception to November 4, 2021. For our search strategy, the terms “tuberculosis” AND “NCDs” (and their synonyms) AND (“delivery of healthcare, integrated” OR a range of other terms representing integration) were used. Articles were included if they were descriptions or evaluations of a management or organisational change strategy made within LMICs, which aim to increase integration between TB and NCD management at the service delivery level. We performed a comparative analysis of key themes from these studies and organised the themes based on integration of service delivery options for TB and NCD services. Subsequently, these themes were used to reconfigure and update an existing framework for integration of TB and HIV services by Legido-Quigley and colleagues, which categorises the levels of integration according to types of services and location where services were offered. Additionally, we developed themes on the facilitators and barriers facing integrated service delivery models and mapped them to the World Health Organization’s (WHO) health systems framework, which comprises the building blocks of service delivery, human resources, medical products, sustainable financing and social protection, information, and leadership and governance.
A total of 22 articles published between 2011 and 2021 were used, out of which 13 were cross-sectional studies, 3 cohort studies, 1 case–control study, 1 prospective interventional study, and 4 were mixed methods studies. The studies were conducted in 15 LMICs in Asia, Africa, and the Americas. Our synthesised framework explicates the different levels of service integration of TB and NCD services. We categorised them into 3 levels with entry into the health system based on either TB or NCDs, with level 1 integration offering only testing services for either TB or NCDs, level 2 integration offering testing and referral services to linked care, and level 3 integration providing testing and treatment services at one location. Some facilitators of integrated service include improved accessibility to integrated services, motivated and engaged providers, and low to no cost for additional services for patients. A few barriers identified were poor public awareness of the diseases leading to poor uptake of services, lack of programmatic budget and resources, and additional stress on providers due to increased workload. The limitations include the dearth of data that explores the experiences of patients and providers and evaluates programme effectiveness.
Integration of TB and NCD services encourages the improvement of health service delivery across disease conditions and levels of care to address the combined burden of diseases in LMICs. This review not only offers recommendations for policy implementation and improvements for similar integrated programmes but also highlights the need for more high-quality TB–NCD research.
Why was this study done?
- Low- and middle-income countries (LMICs) are facing a high prevalence of tuberculosis (TB) and noncommunicable diseases (NCDs).
- TB and NCDs share multiple risk factors and programmes that integrate both TB and NCD services that can potentially serve to tackle both TB and NCDs simultaneously.
- This study aims to provide a review of the programmes that integrate TB and NCD services in LMICs to provide recommendations to researchers and policymakers for future implementation.
What did the researchers do and find?
- Through the articles searched, a framework that illustrates the different levels of integration and entry points into the health system was developed.
- There is a total of 3 levels of integration, with the deepest level of integration offering services that includes both screening and treatment services within one facility as compared to lower levels of integration that either only offers to screen or onwards referral for treatment.
- The World Health Organization’s (WHO) health systems framework was employed to map the facilitators and barriers in implementing TB and NCD integrated programmes through the dimensions of health service delivery, human resources, medical products and vaccines, sustainable financing and social protection, information, and leadership and governance.
What do these findings mean?
- The findings revealed the potential applicability of programmes with the deepest levels of integration for implementation in LMICs to confer the most benefits to patients and the health system when TB and NCDs are tackled simultaneously within the same facility.
- Researchers and policymakers need to bear in mind the barriers and facilitators for the implementation of future TB and NCD integrated programmes in order to tackle both fronts concurrently and effectively.
- The dearth of evidence on TB–NCD integration has highlighted the urgency for high-quality TB–NCD research to provide robust data for formal programmatic evaluation of integrated programmes in order to provide evidence-guided lessons for future reference and deployment.
Citation: Foo CD, Shrestha P, Wang L, Du Q, García-Basteiro AL, Abdullah AS, et al. (2022) Integrating tuberculosis and noncommunicable diseases care in low- and middle-income countries (LMICs): A systematic review. PLoS Med 19(1): e1003899. https://doi.org/10.1371/journal.pmed.1003899
Academic Editor: Amitabh Bipin Suthar, PLOS Medicine Editorial Board, UNITED STATES
Received: September 8, 2021; Accepted: December 22, 2021; Published: January 18, 2022
Copyright: © 2022 Foo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This study was funded by two grants. The Asia Pacific Observatory on Health Systems and Policies (APO) (Purchase Order: HSD/APO 202525686-2) which funds ASA, LW and DQ, and by the National Medical Research Council (NMRC) and Ministry of Health (MOH), The Centre Grant Programme Singapore Population Health Improvement Center (Funding Number: NMRC/CG/C026/2017_NUHS) which funds CDF, PS and HLQ. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: BCG, Bacillus Calmette–Guérin; CKD, chronic kidney disease; CVD, cardiovascular disease; DM, diabetes mellitus; DPM, district-level programme manager; DOT, direct observation therapy; HbA1c, hemoglobin; IPU, integrated practice unit; JBI, Joanna Briggs Institute; LMIC, low- and middle-income country; MDR-TB, multidrug-resistant tuberculosis; MHI, mental health illness; MHP, mental health practitioner; NCD, noncommunicable disease; NGO, nongovernmental organisation; NTP, National Tuberculosis Programme; OOP, out-of-pocket; PHQ-9, Patient Health Questionnaire-9; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; SES, Socios En Salud; SIGN, Scottish Intercollegiate Guidelines Network; STEPS, STEPwise Approach to NCD Risk Factor Surveillance; TB, tuberculosis; UHC, universal health coverage; WHO, World Health Organization
Tuberculosis (TB), an infectious disease derived from various species of the genus Mycobacteria, remains a global threat to public health . Although preventable and treatable, with 1.5 million deaths every year, TB is still on the world’s top list of infectious killer diseases . Furthermore, with the advent of multidrug-resistant tuberculosis (MDR-TB), first-line drugs have been rendered ineffective [2,3]. An estimated 10 million active TB cases were recorded in 2020, which consisted of 5.6 million men, 3.3 million women, and 1.1 million children . More than 95% of TB deaths occurred in low- and middle-income countries (LMICs), with 8 LMICs accounting for two-thirds of the total cases, with India having the highest number of cases, followed by Indonesia, China, the Philippines, Pakistan, Nigeria, Bangladesh, and South Africa .
As the global population ages, LMICs will face an increasing brunt derived from noncommunicable diseases (NCDs). As defined by the World Health Organization (WHO), NCDs are chronic diseases lasting for a long duration and are a result of a combination of genetic, physiological, environmental, and behavioural factors . NCDs, such as diabetes mellitus (DM), cardiovascular disease (CVD), chronic lung disease, cancer, and mental health illness (MHI) among others, are increasing in prevalence . Each year, 41 million people die from NCDs, with 85% of these deaths taking place in LMICs . In particular, CVDs account for 17.9 million deaths, followed by cancer at 9.3 million and DM at 1.5 million .
Global population health data posit that progress towards meeting TB control targets, including the expansion of TB intervention programmes, is hindered by the synergistic relationship between TB and NCDs [7,8]. This is strongly attributed to NCDs and their associated risk factors such as CVD, DM, and smoking and alcohol abuse being risk factors for TB, consequently impacting the burden of TB at the population level [7,9].
At the societal level, the TB and NCDs share numerous underlying social determinants, such as high levels of poverty, poor health literacy, social and cultural values, and lack of social protection [10–13]. Additionally, coexisting communicable and NCDs increases the risk or effect of each other . However, the current healthcare systems of LMICs might not have sufficient resources to respond to this combined burden of diseases derived from communicable and NCDs . At the same time, disease-specific interventions are not the most effective approach for tackling these afflictions [16,17].
A known example is DM, which significantly increases the risk of TB and vice versa. The tight interplay between disease conditions at the biological level complicates the management of TB and contributes to poor TB treatment outcomes . Concomitantly, TB can increase the risk of or aggravate DM status . Other known linkages between TB and NCD typologies include that of CVD and TB , chronic lung disease and TB , MHI and TB [22,23], and cancer and TB . These mutual predispositions necessitate better integration of health services to place TB and NCDs under control in LMICs after accounting for specific disease burdens within each country context.
Therefore, there are multiple ways in which service integration can be manifested. Integration covers disease-specific (vertical) programmes and system-wide (horizontal) pillars and initiatives, overlaying intersecting disease services (e.g., DM and TB treatment services), across community and tertiary level interventions, and between health and nonhealth sectors. This review focuses on integrating service delivery for diseases that are usually delivered separately but often affect the same types of end users. We also acknowledge that service integration goes across and beyond the status quo of a single healthcare entity or stakeholder and have therefore not only consolidated information on the different models of service integration but also provide practical steps (incorporating facilitators and avoiding barriers) when implementing TB and NCD integrated programmes.
Despite the increasing burden of disease derived from TB and NCDs in LMICs and the need for TB and NCD integrated programmes, most systematic reviews on TB service integration investigate the integration of TB- and HIV-related services or the health outcomes of TB and NCD comorbidities, their syndemic interactions, and prevalence [25–34]. Therefore, there remains a dearth of information regarding the mechanism of integration of TB and NCDs related services in LMICs, which this systematic review aims to address. Hereafter, this systematic review will present integration models that bring together the different services for TB and NCDs; points of service delivery; process modifications; and change management strategies through a quantitative and qualitative lens.
A protocol for this study has been registered on the PROSPERO international prospective register of systematic reviews (registration number: PROSPERO CRD42020202745). This study is reported as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (S1 and S2 Checklists) and illustrated in a flowchart below.
First, the findings from the literature review will be summarised based on its depth of integration, from least to most integrated, with each being delved into detail. A framework that illustrates the models of service integration will be developed from this step. Second, using our organised findings from the first step, WHO’s 6 operational “building blocks” of a health system, a well-established framework that identifies health system facilitators and constraints will be used to understand the facilitators and barriers for each integration model . This step involves mapping various integration characteristics derived from the literature review to each dimension of the framework.
Drawing on the definitions proposed by Atun and colleagues , Dudley and Garner , and Legido-Quigley and colleagues , we operationally define programmatic integration as managerial or operational reorganising of health systems components to consolidate inputs, delivery, management, and organisation of particular service functions as a means to improve coverage, access, quality, acceptability, and (cost)-effectiveness . For the purposes of this review, we consider the various tenets of integration that encompass the integration of service provision for both TB- and NCD-related services in terms of physical point-of-care delivery and types of services that include screening, testing or referral, and nonmedically related services like financial and social support.
Type of chronic conditions.
To be considered for inclusion in the current review, the studies had to integrate TB with NCDs. The list of NCDs included are chronic CVDs (coronary heart disease, cerebrovascular disease, peripheral arterial disease, and hypertension), DM (type 1 and 2), cancers (breast cancer, cervical cancer, colorectal cancer, prostatic cancer, and lung cancer), chronic obstructive pulmonary disease (asthma, chronic bronchitis, and emphysema), and mental health conditions (depressive disorders, vascular dementia, and Alzheimer disease but exclusive of alcohol and substance misuse). We have focused on the integration of care of the established diseases and excluded the risk factors of the diseases for this study.
Publications were included if they described or evaluated management or organisational change strategy made within an existing health system to increase integration between TB and NCD management at the service delivery level in LMICs. Services could be provided in health facilities or the community. Reports had to describe the experience of integration, not a theoretical account of how integration might be implemented. We included articles that studied populations of all age groups at the community, primary, secondary, or tertiary care level or venues that we have detailed in the tables below. We also included articles irrespective of drug sensitivities. The extracted articles included both qualitative and quantitative studies and their subcategories, including but not limited to retrospective and prospective cohort, cross-sectional, case–control, ethnographic, randomised control, and observational studies. We also reviewed studies conducted in languages other than English.
To ensure a comprehensive descriptive review, we did not exclude studies based on their design or absence of outcome measures. Health promotion or disease prevention papers were excluded even if the activity was delivered in a TB or NCD treatment setting. We excluded opinion, editorial, and correspondence pieces on care integration without actual implementation of integrated programmes. Studies not conducted in the LMICs were also excluded.
The search strategy was developed to be consistent with methods used by other authors for systematic reviews of integration of health services. We searched databases such as the Cochrane Library, MEDLINE, Embase, PubMed, Bibliography of Asian Studies, and the Global Index Medicus from their inception to November 4, 2021. The search terms used for these databases are shown in Box 1.
Box 1. Search strategy used for the Cochrane Library <1945 to November 4, 2021>, Ovid MEDLINE(R) <1946 to November 4, 2021>, Embase <1974 to November 4, 2021>PubMed<1950 to November 4, 2021>, Bibliography of Asian Studies <1946 to November 4, 2021>, and the Global Index Medicus <inception to November 4, 2021>
- (vertical or horizontal or integrat* or coordinat* or co-ordinat*).tw. or delivery of healthcare, integrated/ or primary healthcare/ or secondary healthcare / or tertiary healthcare/ or community healthcare.tw.
- exp Tuberculosis/ or (tuberculo* or tb).tw.
- (All introduced in a separate line) (chronic disease or (chronic* adj3 (disease* or disab* or ill* or condition* or health condition* or medical condition*)) or (noncommunicable disease* or noncommunicable disease* or NCD or NCDs)).tw. or *cerebrovascular disorders/ or (cerebrovascular disease* or cerebrovascular disorder* or brain ischaemia or cerebral infarction or carotid artery disease* or stroke).tw. or exp myocardial ischemia/ or (myocardial isch* or ischaemic heart disease or ischemic heart disease or angina or coronary disease* or coronary heart disease* or coronary artery disease* or myocardial infarction).tw. or exp heart failure/ or heart failure.tw. or hypertention.tw. or high blood pressure.tw. or *Diabetes Mellitus, Type 1/ or *Diabetes Mellitus, Type 2/ or exp lung diseases obstructive/ or (obstructive lung disease* or obstructive pulmonary disease* or asthma or bronchitis).tw. or exp emphysema/ or exp pulmonary emphysema/ or emphysema.tw. or exp neoplasms/ or (cancer* or oncolog* or neoplasm* or carcinom* or tumor* or malignan*).tw. or exp mental disorder/ or mental health.tw. or depression*.tw. or exp dementia/ or (dementia or alzheimer*).tw. or exp anxiety/ or anxiety*.tw. or exp epilepsy/ or epilep*.tw.
- 1, 2, and 3.
We conducted hand searching and consulted expert reviewers to check the completeness of the electronic searches and included additional papers as appropriate. The World Bank List of Economies 2019 was utilised as reference of the LMICs for the study . The list of the LMICs was not included in the search term, but articles resulting from the database search were reviewed for LMICs during the assessment of the full articles.
Search and retrieval of studies
Two reviewers (PS and LT) independently went through the list of articles from the electronic database search results to identify articles relevant to this systematic review based on title or title and abstract. If either of the 2 reviewers considered a study potentially eligible, the full article was retrieved for further assessment. Further potential studies were also identified by screening the reference lists of included articles. Two reviewers assessed the full texts independently to evaluate whether they met the inclusion criteria for this review. Any disagreements concerning studies to be included were resolved by consensus or by discussion with a third reviewer (QD). There were no language restrictions.
A data extraction format was developed in Microsoft Excel. Data were extracted from each study on the country, study setting, duration of integration programme, model of integration, entry into the health system, screening tools used, study methods, outcomes, and facilitators and barriers to programme implementation. Data extraction was performed independently by 2 reviewers (PS and LT) and compared. To further ensure accuracy, a third reviewer (CDF) not involved in searching and retrieving studies checked for disparities. Erroneous and inconsistent data sets reported in the studies were excluded. However, no discrepancies in data were identified.
Quality assessment (risk of bias)
Included studies were independently assessed for quality and risk of bias by 3 reviewers (PS, QD, and CDF). The quality (risk bias) assessment tools used were selected and adapted from a review of tools performed by Ma and colleagues, which provides an overview of the relevant tools to evaluate methodological quality for different types of studies . Therefore, Newcastle–Ottawa Quality Assessment Form for Cohort Studies was employed for retrospective and prospective cohort studies . For case–control studies, Scottish Intercollegiate Guidelines Network (SIGN) critical appraisal checklists for case–control studies was used . For cross-sectional studies, Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Analytical Cross-Sectional Studies tool was deployed . For mixed methods studies, the Mixed Methods Appraisal Tool was used . The most relevant and salient features extracted from each study based on the aforementioned tools are reported in the tables below.
Data analysis and synthesis of results
First, we presented the relevant quantitative and qualitative findings in the tables below. As such, we reported the quantitative indicators such as relative risks, odds ratios, prevalence ratios, and prevalence with their associated 95% confidence intervals and number needed to screen and number needed to test where appropriate. We also reported qualitative findings that included the perspectives and accounts of patients and providers regarding the TB and NCD integration programmes, which they were a part of.
Second, 4 reviewers (PS, LT, QD, and CDF) reviewed the data and organised the findings to develop a new framework of integrated services for TB and NCDs through relevant themes extracted from the reviewed studies. To that end, a previously published and validated framework for integrating TB and HIV service delivery by Legido-Quigley and colleagues was reconfigured and updated to address the salient features of integrative TB- and NCD-related services . In the original framework by Legido-Quigley and colleagues, users enter the health system through TB services, where in the least integrated model, the users are referred to other sites for HIV testing and subsequent care. With closer integration, TB clinics can also test for HIV on-site but continue to refer to another service for HIV treatment. Where users enter through HIV services, in the least integrated model, the users are referred to a TB clinic for screening for active TB; in a more integrated model, TB screening is undertaken within the HIV clinic, but users are referred to other sites for TB treatment services. In the most integrated model, treatment for both HIV and TB is provided in one health facility. Hence, the different levels of integration and the types of services provided were concepts drawn from the original framework and incorporated into the newly synthesised TB and NCDs framework below.
Third, the 4 reviewers (PS, LT, QD, and CDF) reanalysed the data thematically to derive themes on the facilitators and barriers for TB and NCD service integration and subsequently mapped the themes into WHO’s 6 operational “building blocks” of a health system framework.
However, given the significant heterogeneity in study designs, participants, contexts, and outcomes reported in each study, we were unable to perform meta-analyses. Instead, a descriptive synthesis was performed.
Overview of included studies
The screening process of this review adapted the PRISMA flowchart (Fig 1). Our database search yielded 4,906 articles. After the removal of duplicates, 3,484 articles were screened for titles and abstracts. A total of 184 full articles on integration of care of TB and NCDs were further assessed for eligibility, and 22 articles met the inclusion criteria for this review.
Characteristics of included studies
Of the 22 articles included, 13 were cross-sectional studies, 3 were cohort studies, 1 was a case–control study, 1 prospective interventional study, and 4 were mixed methods studies. A brief summary of the key characteristics of each study is provided in Table 1 below. Seven studies had a low risk of bias, 11 studies had a moderate risk of bias, 3 studies had a high risk of bias, and 1 study did not have enough data for risk bias analysis (elaborated in Tables 2–6).
Seven studies were conducted in Asia, 11 in Africa, and 4 in the Americas (Fig 2). Studies conducted in Africa and Asia focused more on the integration of mental health care in TB patients, whereas studies from South America explored the integration of services for NCDs such as DM and hypertension in TB patients.
Synthesised model of integration based on literature review
A new framework of integrated care for TB and NCDs was developed where the depth of integration is stratified according to distinct levels 1, 2, and 3 in order to distinguish the integration of an additional service from the ones that are preexisting and/or stand-alone. The higher the numerical value, the deeper the level of service integration. Models of integration ranged from the type of services provided and point of entry into the healthcare system via TB or NCDs or both. We identified 7 models of integrated care and illustrated them in the framework below (Fig 3).
Illustrated summary of different models of integration using either TB or NCD as points of entry into the health system. Numbers in brackets represent the number of studies reporting the respective model of integration. NCD, noncommunicable disease; TB, tuberculosis.
At level 1, the least integrated model, (i) patients entering the system via TB service are offered the additional service for screening for NCDs, and likewise (ii) the patients entering via NCDs service are screened for TB.
At level 2, moderate level of integration, (iii) patients entering from TB services are screened for NCDs and patients with potential or positive diagnosis are referred for care at appropriate healthcare facilities, and likewise (iv) patients entering the system from NCD services are screened and referred for TB treatment. Another model is also identified at this level, where (v) patients enter the system via both TB and NCDs services and are referred for the necessary additional TB- or NCD-related care after bidirectional screening is performed.
At level 3, the highest level of integration, (vi) patients entering the system via TB services are screened for NCDs, and (vii) patients entering the system via NCDs services are screened for TB and both models provide treatment or care management for both TB and NCDs at the same location (colocation).
The number of articles found at each level of integration is expressed in brackets, and entry points differentiated based on underlying known condition, be it TB or NCDs.
Level 1 integration
Entry via TB service, testing for NCDs.
This model was described in 8 studies whereby patients who entered the system by TB services were screened for 1 or more NCDs to establish the presence of comorbidity between TB and NCDs. In all 8 studies, existing and/or new TB patients were screened for NCDs at the location where patients received care for TB. A total of 5 studies screened for single NCDs, of which 4 screened for MHIs and 1 for DM. Three other studies screened TB patients for multiple NCDs such as DM, hypertension, and chronic kidney disease (CKD).
This integration model was reported in a case–control study by Byrne and colleagues in Peru, which explored the feasibility of screening for NCDs in patients receiving treatment for TB. In this study, the programme offered point-of-care screening for NCDs such as DM, hypertension, and CKD to 177 TB patients and 161 controls through the provision of detailed medical history taking, obtaining anthropometric measurements, clinical assessment with standardised measurements of resting blood pressure, and urinalysis. The authors reported the possibility of missing the diagnosis of CKD as the urinalysis procedures used offered only a moderate specificity of 53% as a shortfall in the study .
Similar issues of screening accuracy were raised in a cross-sectional study by Restrepo and colleagues in Mexico. This study aimed to estimate the risk of TB attributable to DM and identify opportunities for TB prevention among patients with TB and DM. This study employed EDTA-treated blood and batch tested it for glycosylated hemoglobin (HbA1c) to test for DM for 333 TB patients. However, the study reported overestimation of prevalence of DM from transient hyperglycemia triggered by TB .
Dasa and colleagues in Ethiopia recognised that the cost of screening and treatment was a barrier to patients seeking health services. The cross-sectional study assessed the prevalence and associated factors for depression among TB patients and highlighted the difficulty in covering costs indirectly related to treatment, despite anti-TB drugs being provided for free, which hindered the effectiveness of TB programmes. This was due to the expenses for additional nutritional needs and transportation costs that might result in other knock-on effects such as missed workdays due to fatigue, chest pain, and symptoms of TB, which meant lower earnings and, in turn, heightened psychological distress . Closely related to the concept of financial support, the study conducted in Manila, Philippines by Masumoto and colleagues stated the use of social support scale (Duke-UNC Functional Social Support Questionnaire) being deployed to understand the level of social support received when measuring the depressive states of 561 TB patients .
The relatively low number of TB patients needed to be screened for a positive diagnosis such as 24 for hypertension and 5 for proteinuria had been illustrated by Byrne and colleagues as a potentially feasible screening protocol for an integrated TB and NCD model . We acknowledge that the absence of process indicators for evaluating the programme’s feasibility for other NCDs, such as the number needed to screen for MHIs, prevents us from concluding the programme’s feasibility for all NCDs. However, level 1 integration models assist in the early detection of cases otherwise missed. The low cost of implementation, by virtue of using simple and easily deployable screening tools and existing human resources, empowered this integration model [45,47].
The validity of the screening tools used and the probability of socially desirable responses provided by the participants for questionnaire type screening tools were concerns identified by some authors [45,48–50]. Some studies also reiterated other weaknesses of this model such as the lack of confirmatory tools for definitive diagnosis of NCDs after an initial round of positive screening and having heavier workloads on healthcare teams due to additional integrated services could compromise existing TB programmes . However, the authors of 3 studies reported that despite the lack of accuracy of screening tools used, the ease and practicability of screening for multiple NCDs simultaneously proved beneficial for patient management [45,48,51].
Other challenges to the level 1 integration model include the lack of human resources and poor data collection systems for providers, whereas the cost of the added services and logistical barriers (repeated visits) deterred patients from enrolling into the integrated programmes [45,51].
Level 2 integration
Entry via TB service, testing and referral for NCD treatment services.
Two studies described this integration model where patients entered the system via TB programmes. One study screened for DM and hypertension and the other for DM and MHIs. Both studies included the assessment of risk factors for NCDs and referred the patients for required treatments at appropriate care facilities.
This model was observed in a cross-sectional study by Contreras and colleagues in Peru. Here, TB Cero, a collaborative programme between the Health Ministry and a nongovernmental organisation (NGO) “Socios En Salud” (SES), screened for NCDs such as DM and MHI, and HIV for 192 TB patients. The programme mobilised a field team that functioned using case managers and patient advocates that connected TB patients with appropriate public health facilities for DM and MHI treatment. The costs of treatment were covered by the NGO and TB patients also received social assistance for their unmet basic needs .
In the mixed methods study by Anand and colleagues in India, a 2-staged integrated screening for NCDs such as DM and hypertension and their risk factors among 410 TB patients was conducted to assess the yield, feasibility, and acceptability of the programme using process indicators. The patients diagnosed with the DM and/or hypertension were referred to the NCD clinic within the hospital .
Manpower and training regarding the screening for NCDs as well as making appropriate referrals were essential for this model to succeed. The collaboration and partnership between the involved healthcare facilities (NCD and TB clinics) are the strengths of this model . Both the patients and the providers appreciated this model of care integration as the added services led to the diagnosis of NCDs otherwise missed [49,50]. Incorporating such services was deemed relevant and important in controlling the TB epidemic as studies have shown comorbidities with NCDs and their risk factors such as low socioeconomic status affect TB treatments and patient outcomes [49,50].
The model by Contreras and colleagues in Peru mentioned above had incorporated an additional yet salient module of managing TB and NCDs, which addressed certain social aspects of patients. This encompassed the provision of food vouchers and home-based treatment support. The lack of social support and basic necessities such as food are known risk factors for TB and NCDs, making this aspect a crucial area that will be delved further in our discussion section . However, the providers indicated the absence of standardised reporting for NCDs services in TB clinics to be a weakness in this integration model. Limitations within the health facilities also affected service delivery as reported by Contreras and colleagues and included the lack of a separate room for NCD screening, which raised privacy concerns among patients and which impeded the uptake of NCD screening services .
Other barriers to the level 2 integration model were much like the barriers found in the level 1 integration model, which included long waiting time for screening and referrals, and out-of-pocket (OOP) cost for patients, whereas the challenges for the providers were the additional workload, lack of training to conduct integrated screening services, and shortage of staff and medical supplies for NCD screening.
Entry via NCDs, testing and referral for TB treatment services.
Three studies elaborated on this model of care integration whereby patients entered the system via NCDs and were subsequently referred to TB clinics for necessary treatment. Patients with DM were screened in 2 studies and 1 study explored the presence of TB in patients with MHIs.
In a study by Zhang and colleagues in China, a specific timeline was allocated for elderly patients with DM from different counties to participate in a free TB screening programme embedded within a health examination exercise conducted at the village level primary care facilities. A total of 93,094 elderly residents from 3 counties participated in the health examinations. The large number of participants enrolling into the programme at the same time overwhelmed the hospital and providers, lowering overall screening quality for TB. This led to a higher possibility of missing out on potential participants requiring the TB treatment service. Many patients also dropped out of the programme and were lost to follow-up due to a weak referral mechanism .
A cross-sectional study by Qader and colleagues in Afghanistan noted a 20% higher prevalence of TB among patients with MHIs as compared to the general population. The trained nurses screened 8,073 patients with MHIs for TB during their regular follow-up visits. The patients with presumptive TB were then provided with a sputum test, and all patients with a positive diagnosis of TB were enrolled in nearby direct observation therapy (DOT) centre for further examination and treatment .
As this level 2 integration model aims to establish confirmatory diagnosis of TB suspects through further assessments at TB clinics, a more definitive diagnostic tool was not required at the point of entry at NCD clinics. The providers at the NCD clinics could effectively run this integration model after receiving basic training to conduct the TB screening services. This integrated screening and referral model reiterates the impetus for integrated services in settings facing a high prevalence of TB among patients with DM and MHIs [51–53]. The ability to provide opportunistic screening when patients present themselves for NCDs is deemed a key gateway into TB-related interventions, which can help mitigate the spread of TB in LMICs [51,52].
Cross-testing and referral for both TB and NCDs treatment services.
Three studies describe this model of care integration whereby screening was performed for both TB and NCDs within the same health facility and patients with positive screening results were referred to other care facilities for treatment. Two studies included screening services for DM and 1 study included screening services for multiple NCDs such as DM and hypertension in addition to TB screening services. Two of the studies also screened for HIV, which is of relatively high prevalence in LMICs where the studies were conducted. HIV, however, is not included in our review.
The study by Jerene and colleagues in Ethiopia focused on the lack of the health system’s ability to detect prospective DM cases. This cross-sectional study conducted a tridirectional screening to detect previously missed or undiagnosed TB and DM among 3,439 participants. The study stated that 32.4% of TB patients had abnormal blood sugar suggestive of DM, but the existing health system had detected only 3.5% of these cases, reemphasising the urgency for such integrated screening processes into existing TB or NCD programmes. The same study also highlighted the weakness in its model for TB diagnosis as it was mainly done through symptom screening followed by sputum microscopy. Since most DM patients with TB are asymptomatic, Jerene and colleagues acknowledged the potential underestimation of TB diagnosis among patients with DM .
The study by Govindasamy and colleagues in South Africa screened 9,806 participants for TB and HIV and NCDs such as DM and hypertension using a mobile testing unit. The nurses in the mobile testing unit provided the participants that screened positive for TB and/or NCDs with a referral letter to link to healthcare facilities for treatment and follow-up management . Similar to the challenges facing other models, this study also observed a significant loss of continuity of care due to patients losing referral letters or failing to attend follow-up sessions at referred clinics on weekdays due to work commitments. More flexible clinic hours and patient advocacy to improve understanding of the importance of the referral letter and follow-up care were some recommendations provided by the authors .
This model of screening and referral for both communicable and NCDs was considered an effective platform for diagnosing TB and NCDs concomitantly, especially in resource-limited settings. The need for such a platform is further emphasised in the cross-sectional study by Araia and colleagues in Eritrea, which points out the shared risk factors such as BMI for the development of TB and DM whereby only 54.5% of the patients in the study were aware that they have both conditions . Furthermore, free screening using mobile units was deemed effective to reach participants in rural areas where screening for diabetes was performed using handheld glucometers and screening for hypertension performed with electronic sphygmomanometers . Provision of trained staff for the integrated screening and referral processes and coordination between the involved healthcare facilities was recognised as a facilitator for the success of this model [57,58].
Level 3 integration
Entry via TB service, colocation of testing and treatment for NCDs.
Six studies on this model of integration were found, out of which 5 studies explored the integration of care between TB and various MHIs and 1 study focused on pharmacological care of TB and DM. In this model, the participants entered the system via the TB programme and received care for both TB and NCDs at the same location.
A mixed methods study by Gnanasan and colleagues in Malaysia identified 53 patients with TB and DM comorbidity from their system data and 35 of them that agreed to take part in the study were then provided with a pharmacist-led pharmaceutical care service within the same tertiary hospital to manage their medical conditions. The integrated programme led by pharmacists offered DOT and medication therapy adherence clinical services which were reported to be useful for patients with multiple diseases, namely TB and DM, in managing their medication regiment. This study illustrated that pharmacists could also conduct the integrative services as a form of task sharing. Like other levels of integration, a lack of information flow and coordination was reported. In this study, the disjointed data availability between DM clinics and TB clinics due to the practice of single disease management had made coordination of services across diseases an impediment to integration. In addition, the dilemma of whether to recommend certain monitoring tests or to wait and see if a particular test was ordered by a physician displayed the challenges due to the power dynamics between pharmacists and physicians .
Completion of TB treatment can be promoted in programmes with this level of integration as reported in the study by Pasha and colleagues in Pakistan, whereby the integration of an MHI intervention by assimilating integrated practice units (IPUs) into existing TB treatment facilities showed not only improved symptoms of depression and anxiety, but also a significant increase in proportion of TB patients completing their TB treatment with each subsequent MHI intervention session . Additionally, services that include how to manage social stigma and carry positive dialogue regarding mental health conditions with family and friends proved effective in alleviating the effects of depression in patients with TB. The IPU used a task-shifting approach to service delivery, utilising lay health counsellors for the provision of mental health services. The IPUs were designed to embed mental health screening and counselling services into the existing treatment flow at each facility, so as to not affect normal TB related operations in the facilities .
Resources such as trained health professionals and medical supplies are essential for providing the added care in this integration model. For example, a nurse and 2 medical students were trained for the integrated programme as reported in a study by De Castro-Silva and colleagues in Brazil , and a designated team of pharmacists and physicians worked together to design an individualised pharmaceutical care plan for TB and DM in the study conducted in Malaysia by Gnanasan and colleagues . De Castro-Silva and colleagues had further reported that certain tools such as the Patient Health Questionnaire-9 (PHQ-9), which was originally a self-administered questionnaire had required providers to administer due to the population’s low literacy rate, thus showing the need to train providers to offer tailored services based on requirements of the target population.
A mixed methods study by Walker and colleagues in Nepal had involved the services of an NGO. This study screened 135 patients receiving MDR-TB treatment for MHIs. This integration model enabled Nepal’s National Tuberculosis Programme (NTP) to identify and develop contextually relevant psychosocial interventions that could be delivered within routine NTP services. The services administered were in a stepped-care format. The first step was to provide information and educational materials pertaining to MDR-TB and its treatment options to patients and their family followed by a screening process for NCDs during follow-up monthly visits. Subsequently, brief counselling sessions for overall health based on behavioural activation psychological therapy, group support for selected patients to reduce their negative emotions, and provision of social support for eligible patients were also provide in this integration model. An NGO that delivered mental health services also trained providers to provide group counselling services to patients. However, the authors reported that group counselling was not suitable for all patients as some faced difficulties expressing themselves in a group setting, while others became more worried after hearing the problems faced by fellow patients. Language barriers during counselling sessions also surfaced. The infrastructural limitation due to the lack of an appropriate, private space to conduct the counselling at the centre (which was also the case with screening) often created distractions for the patients and counsellors during the counselling sessions. The counsellors had to improvise and used rooms that were shared with other services or an outside space that provided more privacy to conduct the counselling sessions. Despite the difficulties mentioned, patients had expressed the benefits of hearing experiences of a cured patient during the group counselling sessions .
The mixed methods study by Lovero and colleagues in South Africa evaluated the integration of mental healthcare into TB and maternal–child healthcare services in 4 different districts involving 40 clinics (10 per district) . A stepped-care approach was employed where patients were screened for MHIs and treated at the same clinic or referred to specialised care based on severity of the condition. Additionally, after the patient’s condition was stabilised, a down-referral back to the original primary care clinic was performed. In-depth interviews were conducted with 9 district-level programme managers (DPMs), 17 mental health practitioners (MPHs), and 59 nurses to understand the feasibility and barriers of the programme. This study homed in on more meso and macro-level barriers such as the absence of coordination across health programmes in district-level administration, lack of material and human resources, and low mental health awareness in both the district administration and general population. Low mental health literacy in both the district administration and general population made mental health a low priority for integration into other existing programmes. Providers also highlighted that poor coordination within and across governing bodies and limited understanding of the need for integrated care at the administrative and governance level were weaknesses of this integration model. Therefore, despite TB and NCD services being colocated or within close physical proximity, providers highlighted that poor interprogramme coordination and communication plus conflicting directives from different programmes were areas that required improvement .
Facilitators and barriers to integration of TB and NCD services
Salient and overarching themes regarding facilitators and barriers facing integrated service delivery models were mapped to the WHO health systems framework which comprises six dimensions are summarised in Table 7 below.
This review identified the potential applicability of integrating TB and NCD services in LMICs. Using the data extracted from the included studies, we derived key elements of the different levels of integration for TB and NCD services, followed by categorising them into 3 distinct levels, differentiated according to entry points into the health system. Our findings suggest that higher levels of integration conferred more benefits to patients in terms of managing TB and NCDs. However, we are also cognizant that numerous aspects spanning the 3 levels of integration are overlapping yet differ in certain operational areas depending on the study setting. Due to the pluralistic approaches taken by integration models that vary from how they exploit opportunistic screenings at either point of disease entry to onwards care treatment, the application of a complex systems approach to integrated services planning, delivery, and evaluation is, therefore, central to deciphering intervention implementation and impacts in real-world settings. We accomplished this by mapping the operational features of the various models of integration to WHO health systems framework, which provided a validated structure to organise our findings. As such, we elucidated the overarching facilitators and barriers that fall within the dimensions of service delivery, human resources, sustainable financing and social protection, information, and leadership and governance.
Our findings suggest that care integration is more common with entry via TB to the system, with 19 studies supporting this. Eight studies were conducted at level 1 integration, 8 studies at level 2 integration, and 6 at level 3 integration. A higher level of integration that requires longer chains of care as compared to a lower level of integration, whereby less services or services catering to one disease only is provided, comes with increasing challenges that need to be iteratively surmounted at all levels of the health system. More integrated models need to be mindful that additional integrated services do not compromise the functionality of existing TB or NCD programmes or clinical operations.
Integration aims to address fragmentation in services, enabling better coordinated and more continuous care. In short, integration is achieved by careful planning and financing, with a shared vision centred on a target patient population . All studies pointed to integration as the genesis of structural links between previously separate services, encompassing aspects from organisational modifications, resource planning to physical colocation. At the lowest level of integration, only screening for either TB or NCDs is provided. In most studies, low-cost and straightforward screening techniques for TB and NCDs are used by trained staff. Level 1 integration studies had illuminated that providing point-of-care screening by either disease entry point, but without receiving the needed treatment through onwards referral or in-house treatment is insufficient to mitigate the increase in prevalence of either TB or NCDs effectively. The lack of providing referral to onwards care postscreening could be attributable to reasons such as the lack of comprehensive operational planning since such integrated programmes are relatively new in LMIC settings and cost concerns whereby the funds allocated for such programmes might have limited the prospects of linked care which may be considered unethical and a wasteful expenditure of scarce resources for diagnostic tests without any impact on patient management or outcomes.
Therefore, level 2 integration is more optimal in that regard but has its own challenges. Despite having referrals made to appropriate providers for both TB and NCD treatment postscreening, level 2 integration models face new difficulties that the level 1 integration models did not operationally face. This includes lost to follow-up due to loss of referral documents and patients facing the inconvenience of attending another visit, which might be constrained by work commitments and physical distance to the referred clinic .
Hence, full integration at level 3, whereby screening and treatment occur at the same location, has been shown in our reviewed studies to provide the best point of care for both disease groups and promotes, to an extent, care integration and continuity of care. Several studies have shown that colocation of services derives better health outcomes, follow-up care adherence, and overall higher patient satisfaction [63,64]. High levels of integration have also been shown to reduce fragmentation of care, thus minimising resource wastage and inefficiency by avoiding duplication of services and contradictory decisions by providers . However, as direct outcome measures were not reported in the reviewed studies, we can only surmise that having the deepest levels of service integration confer the most benefits to both patients and the health system.
TB and NCDs control programmes must touch every aspect of a nation’s health system to manage the diseases comprehensively. Herein, we will discuss the facilitators and barriers with the health systems components in mind to further unpack the operational features of a high functioning integration model embedded in the health system of LMICs. Notably, 2 studies highlighted the need to factor in the social and financial elements for integrated models of care. Both factors fall beyond the remit of traditional TB control programmes. As sustainable financing and social protection is one of the dimensions of WHO health systems framework, we will use this as the entry point to delve deeper into other health systems dimensions using the facilitators and barriers summarised in Table 7 above.
First, sustainable financing and social protection is central to the management of TB and NCD integrated programmes as TB and NCDs have close links to poverty and social activation . Hence, integration models will require more from health systems than the traditional medically oriented interventions that do not focus on the financial and social aspects of patients. OOP payment is shown to reduce the uptake of essential health services, where patients in LMICs might prioritise nonmedical yet essential aspects of their lives such as the purchasing of food and shelter. This will, in turn, become a missed opportunity if costs are the limiting factor to the uptake of TB and NCDs services. Therefore, health systems must explore robust financing and social protection mechanisms to promote the uptake of services at all levels of integration to ensure maximum reach and impact of integrated programmes . From the providers and policymakers point of departure, the terms universal health coverage (UHC) and limited fiscal space lie in a luminal space, whereby finite resources need to be allocated to various aspects of the health system . The study by Contreras and colleagues conducted in Peru showed that meeting the high demands for screening services necessitated the engagement of private laboratories where the costs were covered by the programme, while socioeconomic assistance such as transportation reimbursement and food vouchers were rendered to the patients by an NGO . Therefore, having TB and NCD services provided at one facility can potentially reduce transport costs due to multiple visits. However, we are unclear of how the medical costs incurred by the patients will be divided in an integrated programme since certain medical conditions such as TB might already be covered by an existing programme but not others.
More importantly, risk factors for TB and NCDs are often multifaceted, and the most cost-effective way to mitigate both epidemics might be through early detection. Thus, financial attributes of screening services must consider the socioeconomic status of the targeted population and the ability of the country to finance it sustainably. This was further emphasised in another study by Byrne and colleagues in Peru, whereby glycosuria was used as a biomarker for undiagnosed DM and inadequate glycemic control for DM and CKD patients. Despite having moderate sensitivity, the study failed to employ more specific assessment tools for renal function impairment such as serum creatinine, due to cost and implementation feasibility concerns .
Second, at the service delivery level, contextual nuances such as cultural beliefs and preconceptions about a disease condition pose huge hurdles at the personal level and also impede the full functionality of an integrated programme. Poor or lack of public education and awareness of TB and NCDs can create misconceptions about the diseases such as “leaving it to fate.” This holds true not only for patients but also for policymakers, as seen in the disconnect from TB and NCDs agendas mentioned in the study by Lovero and colleagues . A facilitator that can be employed to overcome this is to increase health literacy through community health workers . The deployment of validated guidelines ensures that evidence-based process and outcome indicators are being monitored and fulfilled as cornerstones for effective patient-centred care, especially for TB and NCDs, which require prolonged management . Furthermore, accessibility to care can also pose a barrier due to transportation costs or heightened opportunity costs for informal labourers when attending follow-up services. These challenges can be surmounted by deploying mobile testing units as used in the study by Govindasamy and colleagues in South Africa to meet patients where they are . The lack of conducive space to screen for NCDs and provide counselling services might cause privacy concerns. As a result, patients might be less willing to take up these additional services, be it for mental health treatment or screening for other NCDs where anthropometric measurements are taken. Although not reported in the studies reviewed, colocation with TB services necessitates extra infectious disease precautions to reduce the nosocomial spread of TB when non-TB patients present themselves for NCDs .
Third, at the human resources level, it was apparent in nearly all reviewed studies that the increased workload posed a considerable roadblock to the operations of integrated programmes. This is especially salient in LMIC settings whereby training of health workers typically involve only a particular disease group such as maternal and child health or specific infectious diseases, while cross-training (i.e., TB and NCD services) for more than 1 disease condition is rare . Additionally, the lack of manpower and training or expanded job scope places more stress on existing providers, who are already stretched by their normal clinical operations . The overextending of these providers might lead to screening misses and treatment errors. As such, providers must not only be well trained but also motivated to provide the services. Attitude, professionalism, and commitment create stronger patient–provider relationships, which confer better patient outcomes and, hence, essential elements to any integration model .
Fourth, the availability of medical products and vaccines is essential to the implementation of integration programmes. However, aside from Bacillus Calmette–Guérin (BCG) vaccine, whose effect wanes after childhood, there are effectively no viable vaccines for TB. NCDs are also primarily developed due to genetic or lifestyle predisposition, which can only be prevented through behavioural modifications and medications . Thus, the availability of efficacious medicines for TB, administered mainly through DOT, is an integral element to any TB programme. A break in the medication regime or shortage of medicines at all levels of integration can lead to the generation of MDR-TB . Likewise, the provision of high-quality medication for NCDs is required to ensure optimal management of NCDs, which are often prolonged and require extended medication regimes and monitoring. Additionally, there is also a need for medical resources that aid in screening of patients for TB and NCDs. For example, the availability of handheld glucometers used for screening DM and electronic sphygmomanometers for hypertension as explicated by Govindasamy and colleagues provided a practical way to screen patients for NCDs . Without the provision of medical equipment for screening, linkage to onwards care and treatment will be rendered ineffective in an integrated service delivery model. Although not discussed in the articles reviewed, having integration models that are equipped with adequate medical resources for both TB and NCDs is essential to managing both disease conditions concurrently. This is because the inability to control one might lead to the exacerbation of the other. For example, uncontrolled DM is associated with worsening of TB control as these 2 conditions are closely associated biologically .
Fifth, the information provided within and across healthcare entities is an essential tenet for the smooth running of any health programme, let alone one that integrates services catering to multiple disease conditions across different providers. Many of the studies reviewed highlighted the lack of coordination across providers, especially across different healthcare institutions, which hindered integration on many fronts. There is often a lack of common electronic medical record system or standardised medical information storage platform that tracks process and clinical outcome parameters of the patients and data access to providers within and across echelons of care was also reported to be limited. For example, Gnanasan and colleagues had expressed that certain clinical parameters such as blood pressure were not checked at the TB clinic but could have been extracted from DM or cardiovascular clinic’s records instead in order to give providers a more comprehensive medical history of the patient. However, the lack of coordination across provider settings stymied the exchange of patient data . Furthermore, the information tracked must be evidence informed and relevant for clinical management of the patients’ condition. To this end, validated guidance principles and reporting measures/frameworks need to be deployed by providers. However, many reviewed studies had reported the lack of a former reporting system. Many had to turn to operationalised indicators to track the patient pathway, which might not be optimal. An example is using a modified WHO STEPwise Approach to NCD Risk Factor Surveillance (STEPS) framework that Anand and colleagues reported . Although only pilot tested once in the study’s context, the operationalised questionnaire that screens for NCD predisposition was deemed quick and easy by both patients and providers. Therefore, despite the absence of thorough validation, rapid screening procedures can be deployed in resource constraint settings to streamline protocols to refer patients for onwards care.
Last, leadership and governance are central to implementing any integrated programme vis-à-vis other core functions that ensure the programme’s sustainability and credibility within a health system. Governance also cuts across all other aforementioned health system functions, making transparent, accountable and committed stewardship paramount in TB and NCD control. Good governance will also require taking the lead in upholding newly minted partnerships that include formal and informal productive relationships that span within and beyond the health sector and between the health system, its intermediaries and end users (patient and providers) through the accountable provision of evidence-driven guidelines and adequate and responsible incentivisation. An example of active collaboration is displayed in the study by Contreras and colleagues whereby the TB Cero programme was implemented as an integrative partnership model between public hospitals and an NGO in Peru . At the national level, having a platform to bring together intersectoral actions driven by strong political commitment coupled with a definition of integration that captures an explicit agenda and a clear roadmap for implementation undergirds organisational change towards more assimilated TB and NCD service models. Specifically, governments can also promulgate national TB and NCD plans/guidelines/frameworks and earmark the needed funds to run plans into fruition. This was alluded to in the study by Ekeke and colleagues in Nigeria, whereby patients with DM were screened for TB, in line with the national TB guidelines . Thus, there is a need to update these guidelines to include NCDs to prevent any missed opportunities in identifying NCD cases. Lönnroth and colleagues had also proposed a TB elimination framework to draw key takeaways from prospective TB and NCD integration models. This encompasses universal access to high-quality TB and NCD service with a lens that places groups at the highest risk first and reducing underlying vulnerabilities by incorporating health lenses in all policies, bolstering long-term political will for locally spearheaded integrated programmes, and garnering cross-sectorial and multilevel buy-in for the implementation of global TB and NCD action plans . Finally, governance bodies must be mindful of the interconnectedness of interventions along the “cascade of care” from detection of TB or NCDs to successful completion of treatment or long-term management. This implies that governance bodies must be able to evaluate programmes using both process and clinical outcome measurements in a joined-up rather than a standalone manner to truly ascertain the effectiveness of the integration of TB and NCD services within one programme and at a common locale. As the effectiveness of the integrated programmes go beyond a single entity and across different sectors outside the health system, the need to incorporate systems thinking concepts as well as adopting relevant disciplines such as social sciences and health policy analysis will serve as cornerstones for a joined-up systems approach to evaluation .
This systematic review foregrounds the gaps in both policy and research in the areas of TB and NCD service integration. Policymakers and researchers have focused mainly on integrating TB and HIV services, as seen from the various existing and well-evaluated programmes and systematic reviews performed [33,37,79–82].
The research gaps can be plugged with more monitoring and evaluation works that track the process and clinical outcomes through validated indicators using a prospective or retrospective cohort study, case–control, or randomised control study approaches. Furthermore, the experiences and expectations of patients and providers can be explored through qualitative studies to confer appropriate models of care integration that meet the needs of all stakeholders. The urgency is now more than ever in the face of a swelling TB and NCD burden, and prospective research findings must be able to empower policymakers to drive integration models using implementation science and sustained political will.
Policymakers and programme implementers must recognise that the inability to attain sustainable and effective integration might be less attributed to ineffective programmes per se but rather due to the impediments underlying the health systems building blocks. Hence, integration necessitates stakeholders to envision the channelising of resources and agendas beyond individual programmes and to an extent sectors, while concomitantly investing in all health systems building blocks.
Although there is no magic bullet to achieve a fully integrated configuration for all settings, some actionable steps surfaced. We have summarised the key facilitators to be accounted for and barriers to be avoided during the implementation of integration models in Table 7 above. The high start-up costs to initiate such programmes require policymakers to place long-term returns at the forefront when deciding to allot resources into these models as return on investment in terms of better population health outcomes can only be seen in the longer term. Spillover effects such as better infrastructure and trained manpower can also enhance the health sector and improve access to care for the general population. Uptake must also be sustainable through carefully tailored integration models that account for the needs and preferences of the local population. A salient point that did not appear from our review but is crucial for the uptake of integrated services is the reduction of stigma when seeking care for certain services associated with TB and MHIs, which might affect the extent to which such models of integration are palatable.
This systematic review was limited by the dearth of research exploring the experiences of patients and providers, and specific process indicators that evaluate the feasibility of integrated interventions, as most studies focused on reporting outcomes at a particular time period. Furthermore, the main bibliographic databases used in this review may have had a limited coverage of material from LMICs regarding TB and NCD integrated programmes, and we acknowledge that the databases might have lacked coverage of material not published English [83–85]. In addition, the heterogeneity of the study designs, contexts of study, participants, sample sizes, outcomes, interventions, and diseases studied can potentially limit the generalisability of the study findings. Importantly, this review also revealed that most integration models were contextually bound, with each LMIC having their very own set of healthcare and political agendas writ large. Therefore, our findings have extracted the overarching themes that are cross-cutting and salient to LMICs, particularly in Asia, Africa, and the Americas.
One strength of this review is the usage of a widely deployed health system framework to guide the data analysis and reorganisation of themes for the facilitators and barriers, reducing the variability across research team members. However, we must be cognizant of the oversimplification of intricate process pathways and organisational culture. In practice, many of the key issues span across multiple building blocks, as to be anticipated when employing a health systems lens. However, we managed to utilise this framework for mapping integrated service options to each health system building block to derive high-quality and pragmatic design options for integration elaborated above.
Another strength is the development of a new framework that categorises models of integration according to their depth of integration. This will enable both policymakers and researchers to understand where a country’s TB and NCD programmes lie on the spectrum of integration and, with that knowledge, strive towards the deepest levels of integration by avoiding the barriers and incorporating the facilitators into their programmes.
The burgeoning number of TB and NCD cases has made a strong case for tackling this combined burden of TB and NCD prevalence with a comprehensive and integrated approach commensurate to its disease burden. Limitations notwithstanding, this systematic review provides valuable insights into integrating TB- and NCD-related services into one common programme in LMICs. This has the potential to improve health service delivery across disease conditions and levels of care that can lead to population health benefits.
S1 Checklist. PRISMA 2020 for Abstracts Checklist.
PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
We would like to thank Nima Asgari, Director of the Asia Pacific Observatory (APO) on Health Systems and Policies at WHO Regional Office for Southeast Asia, for his support throughout the project and Mr Tan Wei Kang, who kindly provided us with the statistical expertise in the conduct of this systematic review.
- 1. WHO. Tuberculosis Geneva: World Health Organization. World Health Organization 2020;[27.10.2021]. Available from: https://www.who.int/health-topics/tuberculosis#tab=tab_1.
- 2. Seung KJ, Keshavjee S, Rich ML. Multidrug-Resistant Tuberculosis and Extensively Drug-Resistant Tuberculosis. Cold Spring Harb Perspect Med. 2015;5(9):a017863. pmid:25918181
- 3. Cao Z, Lan Y, Chen L, Xiang M, Peng Z, Zhang J, et al. Resistance To First-Line Antituberculosis Drugs And Prevalence Of pncA Mutations In Clinical Isolates Of Mycobacterium tuberculosis From Zunyi, Guizhou Province Of China. Infect Drug Resist. 2019;12:3093–102. pmid:31686870
- 4. WHO. Tuberculosis Geneva: World Health Organization. World Health Organization 2021; 2021 [27.10.2021]. Available from: https://www.who.int/news-room/fact-sheets/detail/tuberculosis.
- 5. WHO. Noncommunicable diseases Geneva: World Health Organization. World Health Organization 2021;2021 [27.10.2021]. Available from: https://www.who.int/news-room/fact-sheets/detail/noncommunicable-diseases.
- 6. Wang Y, Wang J. Modelling and prediction of global non-communicable diseases. BMC Public Health. 2020;20(1):822. pmid:32487173
- 7. Pan SC, Ku CC, Kao D, Ezzati M, Fang CT, Lin HH. Effect of diabetes on tuberculosis control in 13 countries with high tuberculosis: a modelling study. Lancet Diabetes Endocrinol. 2015;3(5):323–30. pmid:25754415
- 8. Houben R, Menzies NA, Sumner T, Huynh GH, Arinaminpathy N, Goldhaber-Fiebert JD, et al. Feasibility of achieving the 2025 WHO global tuberculosis targets in South Africa, China, and India: a combined analysis of 11 mathematical models. Lancet Global Health. 2016;4(11):e806–e15. pmid:27720688
- 9. Remais JV, Zeng G, Li G, Tian L, Engelgau MM. Convergence of non-communicable and infectious diseases in low- and middle-income countries. Int J Epidemiol. 2013;42(1):221–7. pmid:23064501
- 10. Penaloza R, Navarro JI, Jolly PE, Junkins A, Seas C, Otero L. Health literacy and knowledge related to tuberculosis among outpatients at a referral hospital in Lima, Peru. Res Rep Trop Med. 2019;10:1–10. pmid:30881174
- 11. Tilahun D, Abera A, Nemera G. Communicative health literacy in patients with non-communicable diseases in Ethiopia: a cross-sectional study. Trop Med Health. 2021;49(1):57. pmid:34256862
- 12. Hargreaves JR, Boccia D, Evans CA, Adato M, Petticrew M, Porter JD. The social determinants of tuberculosis: from evidence to action. Am J Public Health. 2011;101(4):654–62. pmid:21330583
- 13. Marmot M, Bell R. Social determinants and non-communicable diseases: time for integrated action. BMJ. 2019;364:l251. pmid:30692093
- 14. Marais BJ, Lönnroth K, Lawn SD, Migliori GB, Mwaba P, Glaziou P, et al. Tuberculosis comorbidity with communicable and non-communicable diseases: integrating health services and control efforts. Lancet Infect Dis. 2013;13(5):436–48. pmid:23531392
- 15. Bygbjerg IC. Double burden of noncommunicable and infectious diseases in developing countries. Science. 2012;337(6101):1499–501. pmid:22997329
- 16. Dudley L, Garner P. Strategies for integrating primary health services in low- and middle-income countries at the point of delivery. Cochrane Database Syst Rev. 2011;2011(7):Cd003318. pmid:21735392
- 17. Atun R, de Jongh T, Secci F, Ohiri K, Adeyi O. A systematic review of the evidence on integration of targeted health interventions into health systems. Health Policy Plan. 2010;25(1):1–14. pmid:19959485
- 18. Noubiap JJ, Nansseu JR, Nyaga UF, Nkeck JR, Endomba FT, Kaze AD, et al. Global prevalence of diabetes in active tuberculosis: a systematic review and meta-analysis of data from 2·3 million patients with tuberculosis. Lancet Glob Health. 2019;7(4):e448–e60. pmid:30819531
- 19. Restrepo BI. Diabetes and Tuberculosis Microbiology spectrum. 2016;4:6.
- 20. Huaman MA, Henson D, Ticona E, Sterling TR, Garvy BA. Tuberculosis and Cardiovascular Disease: Linking the Epidemics. Trop Dis Travel Med Vaccines. 2015;1. pmid:26835156
- 21. Jain NK. Chronic obstructive pulmonary disease and tuberculosis. Lung India. 2017;34(5):468–9. pmid:28869235
- 22. de Araújo GS, Pereira SM, dos Santos DN, Marinho JM, Rodrigues LC, Barreto ML. Common mental disorders associated with tuberculosis: a matched case-control study. PLoS ONE. 2014;9(6):e99551. pmid:24937319
- 23. Sweetland AC, Jaramillo E, Wainberg ML, Chowdhary N, Oquendo MA, Medina-Marino A, et al. Tuberculosis: an opportunity to integrate mental health services in primary care in low-resource settings. Lancet Psychiatry. 2018;5(12):952–4. pmid:30241700
- 24. Shu CC, Liao KM, Chen YC, Wang JJ, Ho CH. The burdens of tuberculosis on patients with malignancy: incidence, mortality and relapse. Sci Rep. 2019;9(1):11901. pmid:31417132
- 25. Creswell J, Raviglione M, Ottmani S, Migliori GB, Uplekar M, Blanc L, et al. Tuberculosis and noncommunicable diseases: neglected links and missed opportunities. Eur Respir J. 2011;37(5):1269–82. pmid:20947679
- 26. Magee MJ, Salindri AD, Gujral UP, Auld SC, Bao J, Haw JS, et al. Convergence of non-communicable diseases and tuberculosis: a two-way street? Int J Tuberc Lung Dis. 2018;22(11):1258–68. pmid:30355404
- 27. Puchner KP, Rodriguez-Fernandez R, Oliver M, Solomos Z. Non-communicable diseases and tuberculosis: Anticipating the impending global storm. Glob Public Health. 2019;14(9):1372–81. pmid:30785858
- 28. Stubbs B, Siddiqi K, Elsey H, Siddiqi N, Ma R, Romano E, et al. Tuberculosis and Non-Communicable Disease Multimorbidity: An Analysis of the World Health Survey in 48 Low- and Middle-Income Countries. Int J Environ Res Public Health. 2021;18(5). pmid:33801381
- 29. Herce ME, Morse J, Luhanga D, Harris J, Smith HJ, Besa S, et al. Integrating HIV care and treatment into tuberculosis clinics in Lusaka, Zambia: results from a before-after quasi-experimental study. BMC Infect Dis. 2018;18(1):536. pmid:30367622
- 30. Hermans SM, Castelnuovo B, Katabira C, Mbidde P, Lange JM, Hoepelman AI, et al. Integration of HIV and TB services results in improved TB treatment outcomes and earlier prioritized ART initiation in a large urban HIV clinic in Uganda. J Acquir Immune Defic Syndr. 2012;60(2):e29–35. pmid:22395671
- 31. Anku PJ, Amo-Adjei J, Doku D, Kumi-Kyereme A. Challenges of scaling-up of TB-HIV integrated service delivery in Ghana. PLoS ONE. 2020;15(7):e0235843. pmid:32645060
- 32. Chehab JC, Vilakazi-Nhlapo AK, Vranken P, Peters A, Klausner JD. Current integration of tuberculosis (TB) and HIV services in South Africa, 2011. PLoS ONE. 2013;8(3):e57791. pmid:23469242
- 33. Ansa GA, Walley JD, Siddiqi K, Wei X. Assessing the impact of TB/HIV services integration on TB treatment outcomes and their relevance in TB/HIV monitoring in Ghana. Infect Dis Poverty. 2012;1(1):13. pmid:23849044
- 34. Anku PJ, Amo-Adjei J, Doku DT, Kumi-Kyereme A. Integration of tuberculosis and HIV services: Exploring the perspectives of co-infected patients in Ghana. Glob Public Health. 2018;13(9):1192–203. pmid:28984493
- 35. WHO. Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies Geneva: World Health Organization; 2010 [03.05.2021]. Available from: https://www.who.int/healthinfo/systems/WHO_MBHSS_2010_full_web.pdf.
- 36. Atun R, de Jongh T, Secci F, Ohiri K, Adeyi O. Integration of targeted health interventions into health systems: a conceptual framework for analysis. Health Policy Plan. 2010;25(2):104–11. pmid:19917651
- 37. Legido-Quigley H, Montgomery CM, Khan P, Atun R, Fakoya A, Getahun H, et al. Integrating tuberculosis and HIV services in low- and middle-income countries: a systematic review. Trop Med Int Health. 2013;18(2):199–211. pmid:23217030
- 38. Watt N, Sigfrid L, Legido-Quigley H, Hogarth S, Maimaris W, Otero-García L, et al. Health systems facilitators and barriers to the integration of HIV and chronic disease services: a systematic review. Health Policy Plan. 2017;32(suppl_4):iv13–26. pmid:28666336
- 39. World Bank list of economies [Internet]. 2019. Available from: https://hupo.org/resources/Documents/World%20Bank%20list%20of%20economies%20(June%202019).pdf.
- 40. Ma LL, Wang YY, Yang ZH, Huang D, Weng H, Zeng XT. Methodological quality (risk of bias) assessment tools for primary and secondary medical studies: what are they and which is better? Mil Med Res. 2020;7(1):7. pmid:32111253
- 41. Lo CK, Mertz D, Loeb M. Newcastle-Ottawa Scale: comparing reviewers’ to authors’ assessments. BMC Med Res Methodol. 2014;14:45. pmid:24690082
- 42. SIGN. Checklists: Healthcare Improvement Scotland 2021 [29.05.2021]. Available from: https://www.sign.ac.uk/what-we-do/methodology/checklists/.
- 43. Institute JB. Critical appraisal tools The University of Adelaide [16.08.2021]. Available from: https://jbi.global/critical-appraisal-tools.
- 44. Pace R, Pluye P, Bartlett G, Macaulay AC, Salsberg J, Jagosh J, et al. Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. Int J Nurs Stud. 2012;49(1):47–53. pmid:21835406
- 45. Byrne AL, Marais BJ, Mitnick CD, Garden FL, Lecca L, Contreras C, et al. Feasibility and yield of screening for non-communicable diseases among treated tuberculosis patients in Peru. Int J Tuberc Lung Dis. 2018;22(1):86–92. pmid:29297431
- 46. Restrepo BI, Camerlin AJ, Rahbar MH, Wang W, Restrepo MA, Zarate I, et al. Cross-sectional assessment reveals high diabetes prevalence among newly-diagnosed tuberculosis cases. Bull World Health Organ. 2011;89(5):352–9. pmid:21556303
- 47. Dasa TT, Roba AA, Weldegebreal F, Mesfin F, Asfaw A, Mitiku H, et al. Prevalence and associated factors of depression among tuberculosis patients in Eastern Ethiopia. BMC Psychiatry. 2019;19(1):82. pmid:30823918
- 48. Masumoto S, Yamamoto T, Ohkado A, Yoshimatsu S, Querri AG, Kamiya Y. Prevalence and associated factors of depressive state among pulmonary tuberculosis patients in Manila, the Philippines. Int J Tuberc Lung Dis. 2014;18(2):174–9. pmid:24429309
- 49. Contreras CC, Millones AK, Santa Cruz J, Aguilar M, Clendenes M, Toranzo M, et al. Addressing tuberculosis patients’ medical and socio-economic needs: a comprehensive programmatic approach. Trop Med Int Health. 2017;22(4):505–11. pmid:28117937
- 50. Anand T, Kishore J, Isaakidis P, Gupte HA, Kaur G, Kumari S, et al. Integrating screening for non-communicable diseases and their risk factors in routine tuberculosis care in Delhi, India: A mixed-methods study. PLoS ONE. 2018;13(8):e0202256. pmid:30138331
- 51. Ekeke N, Aniwada E, Chukwu J, Nwafor C, Meka A, Chukwuka A, et al. Screening diabetes mellitus patients for tuberculosis in Southern Nigeria: A pilot study. Adv Respir Med. 2020;88(1):6–12. pmid:32153002
- 52. Zhang XL, Li SG, Li HT, Li GX, Guo XY, Wang Y, et al. Integrating tuberculosis screening into annual health examinations for the rural elderly improves case detection. Int J Tuberc Lung Dis. 2015;19(7):787–91. pmid:26056102
- 53. Qader G, Seddiq MK, Rashidi KM, Hamim A, Akhgar MH, Ahmad B, et al. Prevalence of tuberculosis among mentally ill patients in conflict-stricken Afghanistan: A cross-sectional study. Int J Infect Dis. 2019;89:45–50. pmid:31449924
- 54. Jerene D, Hiruy N, Jemal I, Gebrekiros W, Anteneh T, Habte D, et al. The yield and feasibility of integrated screening for TB, diabetes and HIV in four public hospitals in Ethiopia. Int Health. 2017;9(2):100–4. pmid:28338880
- 55. Govindasamy D, Kranzer K, van Schaik N, Noubary F, Wood R, Walensky RP, et al. Linkage to HIV, TB and non-communicable disease care from a mobile testing unit in Cape Town, South Africa. PLoS ONE. 2013;8(11):e80017. pmid:24236170
- 56. Araia ZZ, Mesfin AB, Mebrahtu AH, Tewelde AG, Osman R, Tuumzghi HA. Diabetes Mellitus and Its Associated Factors in Tuberculosis Patients in Maekel Region, Eritrea: Analytical Cross-Sectional Study. Diabetes Metab Syndr Obes. 2021;14:515–23. pmid:33568928
- 57. Lovero KL, Lammie SL, van Zyl A, Paul SN, Ngwepe P, Mootz JJ, et al. Mixed-methods evaluation of mental healthcare integration into tuberculosis and maternal-child healthcare services of four South African districts. BMC Health Serv Res. 2019;19(1):83. pmid:30704459
- 58. Walker IF, Khanal S, Hicks JP, Lamichhane B, Thapa A, Elsey H, et al. Implementation of a psychosocial support package for people receiving treatment for multidrug-resistant tuberculosis in Nepal: A feasibility and acceptability study. PLoS ONE. 2018;13(7):e0201163. pmid:30048495
- 59. Gnanasan S, Ting KN, Wong KT, Mohd Ali S, Muttalif AR, Anderson C. Convergence of tuberculosis and diabetes mellitus: time to individualise pharmaceutical care. Int J Clin Pharm. 2011;33(1):44–52. pmid:21365392
- 60. Pasha A, Siddiqui H, Ali S, Brooks MB, Maqbool NR, Khan AJ. Impact of integrating mental health services within existing tuberculosis treatment facilities. Med Access Point Care. 2021;5:23992026211011314.
- 61. Castro-Silva KM, Carvalho AC, Cavalcanti MT, Martins PDS, França JR, Oquendo M, et al. Prevalence of depression among patients with presumptive pulmonary tuberculosis in Rio de Janeiro, Brazil. Braz J Psychiatry. 2019;41(4):316–23. pmid:30365672
- 62. Maruthappu M, Hasan A, Zeltner T. Enablers and Barriers in Implementing Integrated Care. Health Syst Reform. 2015;1(4):250–6. pmid:31519094
- 63. Bonciani M, Schäfer W, Barsanti S, Heinemann S, Groenewegen PP. The benefits of co-location in primary care practices: the perspectives of general practitioners and patients in 34 countries. BMC Health Serv Res. 2018;18(1):132. pmid:29466980
- 64. Sylla L, Bruce RD, Kamarulzaman A, Altice FL. Integration and co-location of HIV/AIDS, tuberculosis and drug treatment services. Int J Drug Policy. 2007;18(4):306–12. pmid:17689379
- 65. Caloyeras JP, Kanter MH, Ives NR, Kim CY, Kanzaria HK, Berry SH, et al. Understanding Waste in Health Care: Perceptions of Frontline Physicians Regarding Time Use and Appropriateness of Care They and Others Provide. Perm J. 2018;22:17–176.
- 66. Wen S, Yin J, Sun Q. Impacts of social support on the treatment outcomes of drug-resistant tuberculosis: a systematic review and meta-analysis. BMJ Open. 2020;10(10):e036985. pmid:33033087
- 67. Andrade KVF, Nery JS, Souza RA, Pereira SM. Effects of social protection on tuberculosis treatment outcomes in low or middle-income and in high-burden countries: systematic review and meta-analysis. Cad Saude Publica. 2018;34(1):e00153116. pmid:29412320
- 68. Fuady A, Houweling TAJ, Mansyur M, Burhan E, Richardus JH. Cost of seeking care for tuberculosis since the implementation of universal health coverage in Indonesia. BMC Health Serv Res. 2020;20(1):502. pmid:32493313
- 69. Woldie M, Feyissa GT, Admasu B, Hassen K, Mitchell K, Mayhew S, et al. Community health volunteers could help improve access to and use of essential health services by communities in LMICs: an umbrella review. Health Policy Plan. 2018;33(10):1128–43. pmid:30590543
- 70. Arsenault C, Roder-DeWan S, Kruk ME. Measuring and improving the quality of tuberculosis care: A framework and implications from the Lancet Global Health Commission. J Clin Tuberc Other Mycobact Dis. 2019;16:100112. pmid:31497655
- 71. Cookson ST, Jarvis WR. Prevention of nosocomial transmission of Mycobacterium tuberculosis. Infect Dis Clin N Am. 1997;11(2):385–409. pmid:9187953
- 72. O’Donovan J, O’Donovan C, Kuhn I, Sachs SE, Winters N. Ongoing training of community health workers in low-income andmiddle-income countries: a systematic scoping review of the literature. BMJ Open. 2018;8(4):e021467. pmid:29705769
- 73. Gorgich EA, Barfroshan S, Ghoreishi G, Yaghoobi M. Investigating the Causes of Medication Errors and Strategies to Prevention of Them from Nurses and Nursing Student Viewpoint. Global J Health Sci. 2016;8(8):54448. pmid:27045413
- 74. Chipidza FE, Wallwork RS, Stern TA. Impact of the Doctor-Patient Relationship. Prim Care Companion CNS Disord. 2015;17(5). pmid:26835164
- 75. Wu BW, Skidmore PM, Orta OR, Faulkner J, Lambrick D, Signal L, et al. Genotype vs. Phenotype and the Rise of Non-Communicable Diseases: The Importance of Lifestyle Behaviors During Childhood. Cureus. 2016;8(1):e458. pmid:26918226
- 76. Tola HH, Tol A, Shojaeizadeh D, Garmaroudi G. Tuberculosis Treatment Non-Adherence and Lost to Follow Up among TB Patients with or without HIV in Developing Countries: A Systematic Review. Iran J Public Health. 2015;44(1):1–11. pmid:26060770
- 77. Lönnroth K, Migliori GB, Abubakar I, D’Ambrosio L, de Vries G, Diel R, et al. Towards tuberculosis elimination: an action framework for low-incidence countries. Eur Respir J. 2015;45(4):928–52. pmid:25792630
- 78. Adam T, Hsu J, de Savigny D, Lavis JN, Røttingen JA, Bennett S. Evaluating health systems strengthening interventions in low-income and middle-income countries: are we asking the right questions? Health Policy Plan. 2012;27(Suppl 4):iv9–19. pmid:23014156
- 79. Owiti P, Onyango D, Momanyi R, Harries AD. Screening and testing for tuberculosis among the HIV-infected: outcomes from a large HIV programme in western Kenya. BMC Public Health. 2019;19(1):29. pmid:30621655
- 80. Kerschberger B, Hilderbrand K, Boulle AM, Coetzee D, Goemaere E, De Azevedo V, et al. The effect of complete integration of HIV and TB services on time to initiation of antiretroviral therapy: a before-after study. PLoS ONE. 2012;7(10):e46988. pmid:23071690
- 81. Uyei J, Coetzee D, Macinko J, Guttmacher S. Integrated delivery of HIV and tuberculosis services in sub-Saharan Africa: a systematic review. Lancet Infect Dis. 2011;11(11):855–67. pmid:22035614
- 82. Kadia BM, Aroke D, Njefi KP, Tochie JN, Tianyi FL, Kadia RS, et al. Systematic review of therapeutic outcomes of multidrug resistant tuberculosis and their predictors in adults receiving integrated treatment of tuberculosis and human immuno-deficiency virus in low- and middle-income countries: a study protocol. Syst Rev. 2020;9(1):228. pmid:33023668
- 83. Shenderovich Y, Eisner M, Mikton C, Gardner F, Liu J, Murray J. Methods for conducting systematic reviews of risk factors in low- and middle-income countries. BMC Med Res Methodol. 2016;16:32. pmid:26979282
- 84. Pilkington K, Boshnakova A, Clarke M, Richardson J. "No language restrictions" in database searches: what does this really mean? J Altern Complement Med. 2005;11(1):205–7. pmid:15750383
- 85. Kieling C, Herrman H, Patel V, Mari JJ. Indexation of psychiatric journals from low- and middle-income countries: a survey and a case study. World Psychiatry 2009;8(1):40–4. pmid:19293959