Figures
Abstract
Estimating effective coverage of childbirth care requires linking population based data sources to health facility data. For effective coverage to gain widespread adoption there is a need to focus on the feasibility of constructing these measures using data typically available to decision makers in low resource settings. We estimated effective coverage of childbirth care in Gombe State, northeast Nigeria, using two different combinations of facility data sources and examined their strengths and limitations for decision makers. Effective coverage captures information on four steps: access, facility inputs, receipt of interventions and process quality. We linked data from the 2018 Nigerian Demographic and Health Survey (NDHS) to two sources of health facility data: (1) comprehensive health facility survey data generated by a research project; and (2) District Health Information Software 2 (DHIS2). For each combination of data sources, we examined which steps were feasible to calculate, the size of the drop in coverage between steps and the resulting estimate of effective coverage. Analysis included 822 women with a recent live birth, 30% of whom attended a facility for childbirth. Effective coverage was low: 2% based on the project data and less than 1% using the DHIS2. Linking project data with NDHS, it was feasible to measure all four steps; using DHIS2 it was possible to estimate three steps: no data was available to measure process quality. The provision of high quality care is suboptimal in this high mortality setting where access and facility readiness to provide care, crucial foundations to the provision of high quality of care, have not yet been met. This study demonstrates that partial effective coverage measures can be constructed from routine data combined with nationally representative surveys. Advocacy to include process of care indicators in facility summary reports could optimise this data source for decision making.
Citation: Exley J, Bhattacharya A, Hanson C, Shuaibu A, Umar N, Marchant T (2022) Operationalising effective coverage measurement of facility based childbirth in Gombe State; a comparison of data sources. PLOS Glob Public Health 2(4): e0000359. https://doi.org/10.1371/journal.pgph.0000359
Editor: Victor Adagi Alegana, KEMRI-Wellcome Trust Research Programme Nairobi, KENYA
Received: November 18, 2021; Accepted: March 22, 2022; Published: April 21, 2022
Copyright: © 2022 Exley et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The comprehensive health facility project data used in this manuscript are freely available through LSHTM Data Compass and can be accessed online: https://doi.org/10.17037/DATA.00001712.
Funding: This work is part of the IDEAS (Informed Decisions for Actions to improve maternal and newborn health) project. IDEAS is funded through a grant from the Bill & Melinda Gates Foundation to the London School of Hygiene & Tropical Medicine. Gates Global Health Grant Number: OPP1149259/INV-007644. TM is the PI of this grant. The funder had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.
Competing interests: I can confirm that the authors have declared that no competing interests exist.
Introduction
Ensuring access to high quality maternal and newborn care is a global priority in efforts to reduce preventable mortality and morbidity [1–5]. Measuring the quality of care delivered to women and newborns is central to supporting this goal, and effective coverage measures are now recommended as best practice [6–9]. Effective coverage combines need, use and quality of care into a single metric to estimate the proportion of a population in need of a service that had a positive health outcome from that service.
There is emerging consensus that effective coverage of maternal, newborn and child health (MNCH) is best conceptualised using a care cascade, which outlines six sequential steps that the target population is anticipated to have to move through to achieve the intended health benefit: 1) service contact; 2) input-adjusted coverage; 3) intervention-adjusted coverage; 4) process quality-adjusted coverage; 5) user-adherence adjusted coverage; and 6) outcome-adjusted coverage [7,10]. For health services, such as childbirth care, during which multiple interventions are delivered and the direct health impacts of specific interventions is challenging to attribute, process quality-adjusted coverage is the recommended measure of effective coverage.
Despite consensus on the concept, research on how to best operationalise the cascade, including which data sets and indicators to use, is limited [11–14]. A recent review of effective coverage of MNCH interventions found no consistent approach to the adjustments made to contact coverage, and examples in the literature were frequently limited to the use of primary sample survey data or use of open-access nationally representative surveys [15]; the review identified only one study that used data from health management information systems (HMIS) to estimate effective coverage of childbirth based on health outcomes [16]. To inform decisions at the country level there is a need to examine the extent to which meaningful effective coverage measures can be developed from alternative data sources that are routinely available to decision makers such as administrative or HMIS data [7].
This study aimed to address this issue by demonstrating whether and how the effective coverage of childbirth care can be generated using two different health facility data sources to adjust population-level data on contact coverage in Gombe State, northeast Nigeria. First, using comprehensive health facility survey data generated by a research project and second we examined the feasibility of replicating that measure using only routine data sources typically available to decisions makers.
Materials and methods
Ethics statement
Ethical approval for this study was obtained from the Nigerian National Health Research Ethics Committee (NHREC/01/01/2007), the State Ministry of Health Gombe State (ADM/S/658/Vol. II/66) and the London School of Hygiene & Tropical Medicine (22330). For the health facility project specific data, all potential participants were provided with a study information sheet and a consent form in English and Hausa. The in-charge of each facility gave written informed consent for the facility survey; written consent was also obtained from the birth attendant interviewed and women observed. Participation was voluntary and participants were free to withdraw at any time.
Study setting
Gombe State is a predominantly rural (80%) and sparsely populated state in northeast Nigeria [17]. It is made up of 11 local government areas (LGAs) and 114 wards; about half of the population live in the State’s central belt, made up of four LGAs.
The northeast region of Nigeria has some of the highest maternal and newborn death rates globally, estimated at 1,549 per 100,000 live births in 2015 and 33 per 1,000 live births in 2017, respectively [18,19]. Healthcare is predominantly delivered via a network of rural primary healthcare clinics (PHCs) run by the Gombe State Primary Healthcare Development Agency (GSPHCDA). In 2017, 460 PHCs and 26 referral facilities provided intrapartum services [20], mainly delivered by community health extension workers (CHEWs), junior CHEWs and community health officers.
Between 2016 and 2019, the GSPHCDA led a maternal and newborn health partnership designed to implement a package of evidence-based interventions to improve access, use and quality of maternal and newborn health services, across the 11 LGAs of Gombe State [21–24]. Throughout this period, actions were taken to strengthen the use of HMIS data for decision making [25], plus detailed primary data was collected to track progress in access to, and supply of, quality maternal and newborn health services.
Data sources
Generating effective coverage of childbirth requires linking care seeking data collected through population based data sources with information from health facilities on the quality of the interventions provided [11]. Two sources of population data representative at the national and State levels in Nigeria had potential for this analysis: the Nigerian Demographic and Health Survey (NDHS) last conducted in 2018 and the Multiple Indicator Cluster Survey (MICS) last carried out in 2016/2017. We used NDHS given it was undertaken most recently. Two sources of facility data were accessed: 1) comprehensive health facility survey data collected as part of the partnership to improve maternal and newborn health services [24]; and 2) HMIS data available through monthly facility reports from District Health Information Software 2 (DHIS2). Previous studies of effective coverage of childbirth have used service provision assessment (SPA) and service availability and readiness assessment (SARA) [12,26–31], but neither of these surveys have been undertaken in Nigeria.
Population data.
The NDHS is conducted every five years using a two-stage stratified cluster sample, designed to be representative at the national and state level [32]. The household survey included face-to-face interviews with all women aged 15 to 49 years in the sampled households, both permanent residents and visitors who stayed in the household the night before the survey. Data was extracted from the birth record for all women in Gombe State aged 15 to 49 who reported a live birth and the place of care seeking in the five years preceding the survey.
Project specific health facility data.
We used health facility survey data from August 2019. Data collection methods are reported in detail elsewhere [33]. Briefly, a health facility survey was completed in a sample of 98 PHCs across the 114 wards of Gombe State and all 18 referral facilities in the State. The health facility survey comprised a readiness assessment that included a checklist of staff, equipment, drugs, and infrastructure items present on the day of survey; data extraction from facility registers on the number and outcomes of all births during the previous six-months; interviews with birth attendants; and the observation of births in a sub-set of facilities. For the purpose of this analysis, facilities handling fewer than one delivery per week (n = 11) were excluded on the grounds that they are not representative of the typical facility women seek childbirth care from.
During the facility survey, observations of childbirth were completed in the 10 PHCs with the highest number of births recorded in the maternity register [34,35]. Observations were completed by clinically trained female data collectors (local midwives, not employed by the facility) over a three-week period, using a structured checklist to record the processes of care and birth attendant-client interactions. The content of the checklist was developed from the USAID-funded Maternal and Child Health Integrated Program’s tool for observing vaginal birth [36].
Routine health facility data.
DHIS2 is an open source software platform used in more than 70 countries [37]. In Gombe, health facilities document care in 13 paper-based registers. Every month a sub-set of data in these registers is sent to the LGA health office and entered into DHIS2 [20]. Monthly aggregated DHIS2 data related to maternal and newborn health were downloaded for the same 6-month period as the project data, from January to July 2019. As with the project data, facilities that recorded fewer than one delivery per week on average were excluded.
Operationalising the effective coverage cascade
We computed both effective coverage measures based on the coverage cascade steps for facility based childbirth care proposed by the Effective Coverage Think Tank Group–a group of experts convened by WHO and UNICEF [7]. Consistent with that cascade, we defined effective coverage as the proportion of all women with a recent live birth (the target population) who progressed through the subsequent four steps: 1) attended a health facility for childbirth care (service contact coverage), 2) that had appropriate inputs available (input-adjusted coverage), 3) where appropriate interventions were provided (intervention-adjusted coverage), and 4) where birth attendants followed recommended processes of care (process quality-adjusted coverage).
Table 1 shows how the effective coverage cascade was operationalised in the two combinations of data sources. For both cascades, the 2018 NDHS was used to estimate service contact coverage (step 1). To define the content of input-adjusted (step 2), intervention-adjusted (step 3) and process quality-adjusted coverage (step 4), we undertook a review of the literature to examine how effective coverage of childbirth has previously been defined [15]. The review identified little consistency between study definitions. We therefore selected the most frequently cited items from the literature that were also recommended by WHO [38–41]. Selected items were mapped against data available in the comprehensive project datasets and the final selection was agreed upon between the authors, including the Executive Secretary of GSPHCDA to ensure relevance to the setting. We attempted to replicate the cascade using only data typically available to decision makers; where information relating to care received was not available in DHIS2, data from NDHS was applied. No items were available in either DHIS2 or NDHS that allowed us to estimate process quality-adjusted coverage. See S1 Table for full details of the individual data items used to define each step of the coverage cascade for the two approaches.
Input-adjusted measures were estimated in the respective health facility dataset (project data or DHIS2) as a binary score calculated for each facility based on: 1) all items available and functioning on the day of the survey in the project data, and 2) not experiencing stock outs of any items in the previous six months in DHIS2. Mean input-adjusted score was calculated, by facility type (PHC or referral), as the percentage of facilities with inputs available. For the project data mean intervention-adjusted and process quality-adjusted measures were estimated in the observation dataset, as the percentage of women observed in a PHC who received all components of care. In the data typically available to decision makers, intervention-adjusted coverage was calculated based on women’s self-reports in the NDHS, as the percentage of women who reported they gave birth in a facility that received all interventions. All items contributed equally to each score and missing data was treated as the item not being present.
Analysis
Similar to previous examples, effective coverage was calculated at the State level using ecological linking methods [11–14,31,42]. For both analysis, the NDHS was used as the basis for creating each linked dataset. Each woman in the NDHS who reported attending a facility for childbirth was assigned the mean input-adjusted score for the type of health facility (PHC or referral) that they reported seeking care from the project data and DHIS2, respectively. Additionally, for the analysis using the project data women were assigned the mean intervention-adjusted and process-adjusted score from the project data. In both analysis, women who reported delivering at home were assigned input-adjusted, intervention-adjusted and process quality-adjusted scores of 0.
From the linked datasets, we calculated each step of the cascade. The first step in the cascade, service contact coverage, was calculated as the percentage of women who reported giving birth in a facility across the State. Subsequent steps were calculated as the product of the prevalence of the step and the prevalence of the proceeding step. The analyses adjusted for the survey design using the svyset and svy commands in STATA version 15.1 (StataCorp, 2017, College Station, TX) and uncertainty of the estimates of effective coverage was assessed using the delta method [14,43]. Missed opportunities (bottlenecks) were identified from the absolute attrition in the proportion between each step of the cascade [44].
Results
The analysis included 822 women who reported a live birth in Gombe State in the five years preceding in the NDHS (2013–2018) (Table 2). The project data included 105 health facilities (87 PHCs and 18 referral), which recorded handling at least one delivery per week and observations of 398 women from 10 PHCs during childbirth. The analysis using data typically available included 271 health facilities (248 PHCs and 23 referral) from DHIS2.
Table 3 presents the characteristics of all women with a recent live birth interviewed in Gombe State in the NDHS. On average women interviewed were 29 years old (sd 4.7) and had received 3 years (sd 4.7) of education. The vast majority of women reported that they were currently married and of Muslim faith; fourteen percent reported they had one child.
In the rest of the results section we first describe the composition of the four steps of the cascade in turn and then present the two effective coverage measures estimated using the different data sources.
Step 1: Service contact
In the NDHS for Gombe State, representing births between 2013–18, the coverage of facility based childbirth was 30%: 19% at PHCs and 11% at a referral facility. We checked for evidence of changes in facility delivery over the period of the NDHS, and found the coverage of women seeking childbirth care at a health facility to be relatively stable over the five-year period: 37% among women who delivered five years preceding the survey, 31% in the three to four years preceding, 32% in two years preceding and 27% among women who delivered in the 12 months preceding the survey.
Step 2: Inputs
The availability of inputs from the two facility data sources (project health facility survey or DHIS2) by facility type is presented in Table 4. Around a quarter of facilities were estimated to have all inputs available in the project health facility data: 18% of PHCs had all inputs compared to 56% of referral facilities. Across all facilities communication equipment and disposable gloves was universally available. Additionally, among referral facilities electricity or light source, presence of a skilled birth attendant, blood pressure machine, delivery pack, infection control supplies, intravenous fluids and infusion set, suction apparatus and uterotonic were also universally available. The items least frequently available in PHCs were source of cleaning running water (56%) and presence of a skilled birth attendant (49%), and in referral facilities source of clean running water and newborn resuscitation equipment (both available in 78% of referral facilities).
The number of input measures it was possible to estimate in the DHIS2 was limited; no information was available on facility infrastructure and data was only captured on three of the 10 supply and commodity items included in the project-based estimate. Less than a fifth of facilities had all inputs available: 18% of PHCs and 22% of referral facilities. No items were universally available. The item most frequently available in PHCs was skilled birth attendant (73%) and uterotonic in referral (83%), while the item least frequently available in PHCs was anticonvulsant (34%) and in referral facilities skilled birth attendant (35%).
Step 3: Receipt of interventions
Over three-quarters of women were observed to receive all three interventions in the project data (see Table 5); ranging from 99% of women receiving a uterotonic to 87% of babies being weighed. Since the DHIS2 did not capture equivalent information, the second effective coverage measure took available data on receipt of interventions from the NDHS. In the NDHS 5% of women reported that they received all interventions; ranging from 75% of women receiving a uterotonic to 13% of babies being weighed.
Step 4: Process of care
Process of care data was available in the project data but not the data typically available to decision makers (see Table 6). Overall, 24% of women were observed to receive all four processes of care. Across the three items undertaken by the birth attendant coverage ranged from 50% observed to take women’s blood pressure to 70% observed explaining a procedure.
Effective coverage of facility based childbirth
Fig 1 presents the coverage cascade for facility based childbirth care in Gombe estimated using project data and datasets typically available to decision makers. NDHS was used in both estimates to estimate service contact (step 1). For the first effective coverage measure using the project data to calculate effective coverage from cascade steps 2 to 4, we observed that 2% of women in Gombe received high quality care during childbirth. The largest bottleneck was in access to a health facility; only 30% of women reported attending a health facility for childbirth. There was also a large reduction from service contact to input-adjusted coverage, with an attrition of 21%. The drop from input-adjusted coverage to intervention-adjusted coverage was relatively small, from 10% to 7%, reflecting the high percentage of women receiving all interventions.
Effective coverage of facility based childbirth in Gombe State, constructed using (a) NDHS and project facility data; and (b) NDHS and DHIS2.
For the second effective coverage measure using data typically available to decision makers in this setting we were able to calculate effective coverage up to cascade step 3. We observed that less than 0.5% of women were estimated to receive high quality care during childbirth. Again the largest bottleneck was in access to a health facility with only 30% of women attending a health facility for childbirth, and there was a large reduction from service contact to input-adjusted coverage, 30% to 6%.
Discussion
Effective coverage measures are recommended as best practice for estimating population-level access to high quality maternal and newborn health care but there has been limited progress to operationalise measures. To maximise utility, there are increasing calls to make better use of routine data systems to generate estimates of effective coverage [7]. In this study, using different health facility data sources to estimate the effective coverage of facility based childbirth, we aimed to determine the feasibility of using data typically available to decision makers in this high mortality setting.
Our first approach linking NDHS to health facility survey data collected through a research project represents the most comprehensive health facility data available in this setting. It included a health facility survey and observations of birth, allowing linking of these different data sources with NDHS to calculate all four recommended cascade steps to estimate process quality-adjusted coverage of childbirth. The analysis revealed that less than 2% of women received effective coverage of childbirth care in Gombe state. Substantial gaps in the provision of high quality care were highlighted; coverage dropped from 30% of women who attended a facility for childbirth to 10% after accounting for the necessary inputs to provide high quality care during childbirth, dropping again to 7% after adjusting for intervention delivery and 2% after finally adjusting for processes of care. This finding adds to the wealth of evidence demonstrating large drops in coverage once some measurement of quality is accounted for [10].
In our second approach, only using data typically available to decision makers in this setting (NDHS and DHIS2) it was possible to measure three of the recommended steps in the cascade, up to intervention-adjusted coverage. This second approach resulted in lower adjusted coverage estimates at each step of the cascade. Differences in coverage estimates between the two combinations of data sources likely reflect differences in data collection methods and timeframes, with two particular areas of divergence. Regarding inputs, DHIS2 is a census of all facilities and availability of inputs was measured over the last six months, while the project health facility sample survey was conducted at one point in time and reflected availability on the day of survey. Regarding content of care, the second approach did not have the benefit of observations of care which might be considered the most reliable method to capture content of care during childbirth. Rather, it relied on NDHS data on women’s reports about care received: this limited the number of items available for the adjustment, plus numerous studies have documented the poor validity of household survey data to assess receipt of interventions [34,45–47].
The results from both approaches highlight that facility readiness to provide care, the second cascade step and a crucial foundation to the provision of high quality of care [6], has not yet been met. Beyond this step the two approaches diverged. While a substantial drop in coverage was estimated from input-adjusted to intervention-adjusted coverage using data typically available in this setting (from 6% to 0.3%) this drop was relatively small in the project data (10% to 7%). And no adjustment for the fourth cascade step, processes of care, was possible using the second approach.
Strengths and limitations of the data typically available to decision makers
It is not appropriate for countries to routinely generate the comprehensive data that a focussed research project can collect. Nonetheless, there is clearly enormous potential to make better use of existing data sources for effective coverage measurement. Data on population need and care seeking is readily available from nationally representative population surveys, both DHS and MICS have been widely implemented in LMIC [48,49]. Importantly, these surveys are also designed to be representative at the State level, and as such are frequently used for benchmarking. However, local decision makers often seek more geographical granularity to inform actions; in Gombe state, for example, there is increasing interest to understand variation by LGA to be able to further examine inequalities in access and provision of high quality care across the State and support ongoing quality improvement initiatives. Further, local decision makers prefer more temporal estimates than retrospective household surveys like DHS or MICS can offer, although in this analysis we observed relative stability in access to care in the recent past. To facilitate analysis at lower levels requires alternative sources of population data and strengthening of administration data systems, for example civil registrations and vital statistics and a programme of household surveys to capture information on care seeking [50–52].
It was not possible to measure any components of the processes quality step in the data currently available to decision makers in this setting. Provision of care can be assessed in nationally representative surveys, such as SPA or SARA [26,30]. However, neither currently include observations of childbirth as standard practice, require additional resources to do so, and are susceptible to the issue of temporality [53]. Unlike nationally representative surveys, DHIS2 is a census of all facilities and is available monthly, which offers opportunities to calculate effective coverage measures at the geographical level most useful to decision makers. Data on content of care is not currently present but could potentially be tracked in DHIS2. For example in Gombe State a number of relevant indicators are already captured at the facility level but are not included in the monthly monitoring reports to DHIS2 (see S1 Table) [34]. Extending HMIS so that data beyond inputs is routinely summarised for managers to track depends on government priorities; this may require more advocacy to promote the need for including measures of the content of care.
Strength and limitations of the approach to measuring effective coverage
The effective coverage cascade is complex and needs further definition. The choice of items included in the effective coverage measure is likely to influence the estimate. Currently there is no standardised list of indicators for measuring quality of maternal and newborn health care [54–56], which poses a challenge to constructing effective coverage as noted by others [15]. Our approach to selecting items to measure each step was highly comprehensive based on a systematic review of the literature, WHO guidelines and cross-checked to ensure relevance to the local context. The measure constructed in the data typically available to decision makers was less comprehensive as not all data items were available (see Table 1), yet the key messages emerging from the analysis were similar.
Once the content of effective coverage measures has been defined (whether comprehensive or pragmatic, according to the data available), the methods for linking datasets for cascade analysis are becoming increasingly clear and accessible. We used validated ecological linking approaches, accounting for facility type, to combine datasets [13,14,42], and variance was estimated using the recommended delta method [43].
Conclusions
Comprehensive project data revealed that effective coverage of childbirth care in Gombe state is low and more attention is needed on this problem. This study also demonstrates that it is already feasible to partially construct effective coverage measures using routine data from HMIS combined with national level population survey sources. Advocacy to include process of care indicators in facility summary reports could optimise this data source for local decision making and take us a step closer to operationalising effective coverage measurement at the country level.
Supporting information
S1 Table. Components used to define each step of the coverage cascade for the two different data sources.
https://doi.org/10.1371/journal.pgph.0000359.s001
(DOCX)
Acknowledgments
The authors would like to thank Data Research and Mapping Consult for coordinating the IDEAS project data collection, the Gombe State Primary Health Care Development Agency (GSPHCDA), Gombe State Ministry of Health and our partners Society for Family Health and Pact Nigeria for their support in carrying out this study. In particularly we would like to thank Christopher Istakis from the GSPHCDA for his support in accessing DHIS2. Finally, we would like to thank all the participants who contributed to our study.
References
- 1. Bhutta ZA, Das JK, Bahl R, Lawn JE, Salam RA, Paul VK, et al. Can available interventions end preventable deaths in mothers, newborn babies, and stillbirths, and at what cost? Lancet (London, England). 2014;384(9940):347–70. Epub 2014/05/24. pmid:24853604.
- 2. Chou VB, Walker N, Kanyangarara M. Estimating the global impact of poor quality of care on maternal and neonatal outcomes in 81 low- and middle-income countries: A modeling study. PLoS Med. 2019;16(12):e1002990. Epub 2019/12/19. pmid:31851685.
- 3. Kruk ME, Gage AD, Joseph NT, Danaei G, Garcia-Saiso S, Salomon JA. Mortality due to low-quality health systems in the universal health coverage era: a systematic analysis of amenable deaths in 137 countries. Lancet (London, England). 2018;392(10160):2203–12. Epub 2018/09/10. pmid:30195398.
- 4. Requejo JH, Bryce J, Barros AJ, Berman P, Bhutta Z, Chopra M, et al. Countdown to 2015 and beyond: fulfilling the health agenda for women and children. Lancet (London, England). 2015;385(9966):466–76. Epub 2014/07/06. pmid:24990815.
- 5. Tunçalp Ӧ, Were W, MacLennan C, Oladapo O, Gülmezoglu A, Bahl R, et al. Quality of care for pregnant women and newborns—the WHO vision. Bjog. 2015;122(8):1045–9. pmid:25929823
- 6. Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the Sustainable Development Goals era: time for a revolution. The Lancet Global health. 2018. pmid:30196093
- 7. Marsh AD, Muzigaba M, Diaz T, Requejo J, Jackson D, Chou D, et al. Effective coverage measurement in maternal, newborn, child, and adolescent health and nutrition: progress, future prospects, and implications for quality health systems. The Lancet Global health. 2020;8(5):e730–e6. pmid:32353320
- 8.
Murray CJL, Evans DB. Technical Consultation on Effective Coverage in Health Systems. Health systems performance assessment: debates, methods and empiricism. Geneva: World Health Organization; 2003. p. 125–34.
- 9. Ng M, Fullman N, Dieleman JL, Flaxman AD, Murray CJL, Lim SS. Effective Coverage: A Metric for Monitoring Universal Health Coverage. PLoS Med. 2014;11(9):e1001730. pmid:25243780
- 10. Amouzou A, Leslie HH, Ram M, Fox M, Jiwani SS, Requejo J, et al. Advances in the measurement of coverage for RMNCH and nutrition: from contact to effective coverage. BMJ Glob Health. 2019;4(Suppl 4):e001297. pmid:31297252
- 11. Do M, Micah A, Brondi L, Campbell H, Marchant T, Eisele T, et al. Linking household and facility data for better coverage measures in reproductive, maternal, newborn, and child health care: systematic review. Journal of global health. 2016;6(2):020501. Epub 2016/09/09. pmid:27606060.
- 12. Kanyangarara M, Chou VB, Creanga AA, Walker N. Linking household and health facility surveys to assess obstetric service availability, readiness and coverage: evidence from 17 low- and middle-income countries. Journal of global health. 2018;8(1):010603. Epub 2018/06/05. pmid:29862026.
- 13. Munos MK, Maiga A, Do M, Sika GL, Carter ED, Mosso R, et al. Linking household survey and health facility data for effective coverage measures: a comparison of ecological and individual linking methods using the Multiple Indicator Cluster Survey in Côte d’Ivoire. Journal of global health. 2018;8(2):020803. Epub 2018/11/10. pmid:30410743.
- 14. Willey B, Waiswa P, Kajjo D, Munos M, Akuze J, Allen E, et al. Linking data sources for measurement of effective coverage in maternal and newborn health: what do we learn from individual- vs ecological-linking methods? Journal of global health. 2018;8(1):010601. Epub 2018/03/03. pmid:29497508.
- 15. Exley J, Gupta PA, Schellenberg J, Strong K, Requejo J, Moller AB, et al. A rapid systematic review and evidence synthesis of effective coverage measures and cascades for childbirth, newborn and child health in low- and middle-income countries. Journal of global health. 2021;12. Epub 15 January 2022.
- 16. Leslie HH, Doubova SV, Pérez-Cuevas R. Assessing health system performance: effective coverage at the Mexican Institute of Social Security. Health policy and planning. 2019;34(Supplement_2):ii67–ii76. Epub 2019/11/15. pmid:31723962.
- 17.
Gombe State Government [Internet]. History of Gombe State, Nigeria. [cited 9 Sept 2021]. Available from: http://gombestate.gov.ng/history-2/.
- 18.
National Bureau of Statistics (NBS) and United Nations Children’s Fund (UNICEF). Multiple Indicator Cluster Survey 2016–17, Survey Findings Report. Abuja, Nigeria: National Bureau of Statistics and United Nations Children’s Fund. 2017.
- 19.
Izugbara CO, Wekesah FM, Adedini SA. Maternal Health in Nigeria. A Situation Update. Nairobi, Kenya: African Population and Health Research Centre, 2016.
- 20. Bhattacharya AA, Umar N, Audu A, Felix H, Allen E, Schellenberg JRM, et al. Quality of routine facility data for monitoring priority maternal and newborn indicators in DHIS2: A case study from Gombe State, Nigeria. PloS one. 2019;14(1):e0211265. Epub 2019/01/27. pmid:30682130.
- 21.
IDEAS team. Informed Decisions for Actions in Maternal and Newborn Health 2010–17 Report: What works, why and how in maternal and newborn health [Internet]. IDEAS, London School of Hygiene & Tropical Medicine: 2017 [cited 9 Sept 2021]. Available from: https://ideas.lshtm.ac.uk/wp-content/uploads/2017/09/LSHTM_IDEAS_PhaseIReport_Web-reduced.pdf.
- 22. Makowiecka K, Marchant T, Betemariam W, Chaturvedi A, Jana L, Liman A, et al. Characterising innovations in maternal and newborn health based on a common theory of change: lessons from developing and applying a characterisation framework in Nigeria, Ethiopia and India. BMJ Glob Health. 2019;4(4):e001405. Epub 2019/08/14. pmid:31406587.
- 23.
Makowiecka K. The Pathway to Improved Maternal and Newborn Health Outcomes. Use of data for maternal and newborn health in Gombe State, Nigeria [Internet]. IDEAS, London School of Hygiene & Tropical Medicine: 2016 [cited 9 Sept 2021]. Available from: https://ideas.lshtm.ac.uk/wp-content/uploads/2017/08/Makowiecka_IDEAS_Pathway_Improved_Maternal_Newborn_Health_Gombe_Nigeria_2016.pdf.
- 24. Willey B, Umar N, Beaumont E, Allen E, Anyanti J, Bello AB, et al. Improving maternal and newborn health services in Northeast Nigeria through a government-led partnership of stakeholders: a quasi-experimental study. BMJ Open. 2022;12(2):e048877. pmid:35105566
- 25. Bhattacharya AA, Allen E, Umar N, Audu A, Felix H, Schellenberg J, et al. Improving the quality of routine maternal and newborn data captured in primary health facilities in Gombe State, Northeastern Nigeria: a before-and-after study. BMJ Open. 2020;10(12):e038174. pmid:33268402
- 26. Joseph NT, Piwoz E, Lee D, Malata A, Leslie HH. Examining coverage, content, and impact of maternal nutrition interventions: the case for quality-adjusted coverage measurement. Journal of global health. 2020;10(1):010501. Epub 2020/02/23. pmid:32082545.
- 27. Kemp CG, Sorensen R, Puttkammer N, Grand’Pierre R, Honoré JG, Lipira L, et al. Health facility readiness and facility-based birth in Haiti: a maximum likelihood approach to linking household and facility data. Journal of global health reports. 2018;2:e2018023. Epub 2018/01/01. pmid:31406933.
- 28. Nguhiu PK, Barasa EW, Chuma J. Determining the effective coverage of maternal and child health services in Kenya, using demographic and health survey data sets: tracking progress towards universal health coverage. Tropical medicine & international health: TM & IH. 2017;22(4):442–53. Epub 2017/01/18. pmid:28094465.
- 29. Nguyen PH, Khương LQ, Pramanik P, Billah SM, Menon P, Piwoz E, et al. Effective coverage of nutrition interventions across the continuum of care in Bangladesh: insights from nationwide cross-sectional household and health facility surveys. BMJ Open. 2021;11(1):e040109. Epub 2021/01/22. pmid:33472778.
- 30. Sharma J, Leslie HH, Kundu F, Kruk ME. Poor Quality for Poor Women? Inequities in the Quality of Antenatal and Delivery Care in Kenya. PloS one. 2017;12(1):e0171236. Epub 2017/02/01. pmid:28141840.
- 31. Wang W, Mallick L, Allen C, Pullum T. Effective coverage of facility delivery in Bangladesh, Haiti, Malawi, Nepal, Senegal, and Tanzania. PloS one. 2019;14(6):e0217853. Epub 2019/06/12. pmid:31185020.
- 32.
National Population Commission—NPC, ICF. Nigeria Demographic and Health Survey 2018—Final Report. Abuja, Nigeria: NPC and ICF, 2019.
- 33.
Marchant T. Change in maternal and newborn health care. Interactions between families and frontline workers—their frequency, quality and equity—and coverage of interventions of mothers and newborns. Report from Gombe State, Nigeria, 2012–2015 [Internet]. IDEAS, London School of Hygiene & Tropical Medicine: 2016 [cited 9 Sept 2021]. Available from: https://ideas.lshtm.ac.uk/wp-content/uploads/2017/08/Marchant_IDEAS_Gombe_State_Follow-upSurvey_2016.pdf.
- 34. Bhattacharya AA, Allen E, Umar N, Usman AU, Felix H, Audu A, et al. Monitoring childbirth care in primary health facilities: a validity study in Gombe State, northeastern Nigeria. Journal of global health. 2019;9(2):020411. Epub 2019/07/31. pmid:31360449.
- 35. Exley J, Hanson C, Umar N, Willey B, Shuaibu A, Marchant T. Provision of essential evidence-based interventions during facility-based childbirth: cross-sectional observations of births in northeast Nigeria. BMJ Open. 2020;10(10):e037625. Epub 2020/10/26. pmid:33099494.
- 36.
USAID & MCHIP [Internet]. Washington; Maternal and Child Health Integrated Program. Maternal and Newborn Quality of Care Surveys. [cited 14 Oct 2021]. Available from: https://www.mchip.net/qocsurveys/.
- 37.
DHIS2 [Internet]. University of Oslo; HISP Centre. About DHIS2 [cited11 Oct 2021]. Available from: https://dhis2.org/about/.
- 38.
WHO. Standards for improving quality of maternal and newborn care in health facilities. World Health Organization: Geneva. 2016.
- 39.
World Health Organization. WHO recommendations: intrapartum care for a positive childbirth experience. Geneva: World Health Organization, 2018.
- 40.
World Health Organization. Consultation on improving measurement of the quality of maternal, newborn and child care in health facilities. Geneva: World Health Organization, 2013.
- 41.
World Health Organization, United Nations Population Fund, UNICEF. Pregnancy, childbirth, postpartum and newborn care. A guide for essential practice (3rd edition). Geneva: World Health Organization, 2015.
- 42. Carter ED, Ndhlovu M, Eisele TP, Nkhama E, Katz J, Munos M. Evaluation of methods for linking household and health care provider data to estimate effective coverage of management of child illness: results of a pilot study in Southern Province, Zambia. Journal of global health. 2018;8(1):010607. Epub 2018/07/10. pmid:29983929.
- 43. Sauer SM, Pullum T, Wang W, Mallick L, Leslie HH. Variance estimation for effective coverage measures: A simulation study. Journal of global health. 2020;10(1):010506. Epub 2020/04/08. pmid:32257160.
- 44. Baker U, Peterson S, Marchant T, Mbaruku G, Temu S, Manzi F, et al. Identifying implementation bottlenecks for maternal and newborn health interventions in rural districts of the United Republic of Tanzania. Bulletin of the World Health Organization. 2015;93(6):380–9. Epub 2015/08/05. pmid:26240459.
- 45. Blanc AK, Warren C, McCarthy KJ, Kimani J, Ndwiga C, RamaRao S. Assessing the validity of indicators of the quality of maternal and newborn health care in Kenya. Journal of global health. 2016;6(1):010405. Epub 2016/05/28. pmid:27231541.
- 46. McCarthy KJ, Blanc AK, Warren CE, Kimani J, Mdawida B, Ndwidga C. Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya. Journal of global health. 2016;6(2):020502. Epub 2016/09/09. pmid:27606061.
- 47. Stanton CK, Rawlins B, Drake M, Dos Anjos M, Cantor D, Chongo L, et al. Measuring coverage in MNCH: testing the validity of women’s self-report of key maternal and newborn health interventions during the peripartum period in Mozambique. PloS one. 2013;8(5):e60694. Epub 2013/05/15. pmid:23667427.
- 48.
The Demographic and Health Surveys Program [Internet]. Rockville; USAID. The DHS Program: Country List. [cited 11 Oct 2021]. Available from: https://www.dhsprogram.com/Countries/Country-List.cfm.
- 49.
UNICEF [Internet]. About MICS. [cited 14 Oct 2021]. Available from: https://mics.unicef.org/about.
- 50. AbouZahr C, Boerma T. Health information systems: the foundations of public health. Bulletin of the World Health Organization. 2005;83(8):578–83. Epub 2005/09/27. pmid:16184276.
- 51.
United Nations Statistics Division [Internet]. New York: United Nations. Demographic and Social Statistics: Civil Registration and Vital Statistics. [cited 14 Oct 2021]. Available from: https://unstats.un.org/unsd/demographic-social/crvs/.
- 52. Yokobori Y, Obara H, Sugiura Y, Kitamura T. Gaps in the civil registration and vital statistics systems of low- and middle-income countries and the health sector’s role in improving the situation. Glob Health Med. 2021;3(4):243–5. pmid:34532606.
- 53. Sheffel A, Karp C, Creanga AA. Use of Service Provision Assessments and Service Availability and Readiness Assessments for monitoring quality of maternal and newborn health services in low-income and middle-income countries. BMJ Glob Health. 2018;3(6):e001011. Epub 2018/12/18. pmid:30555726.
- 54. Marchant T, Bryce J, Victora C, Moran AC, Claeson M, Requejo J, et al. Improved measurement for mothers, newborns and children in the era of the Sustainable Development Goals. Journal of global health. 2016;6(1):010506. Epub 2016/07/16. pmid:27418960.
- 55. Moller A-B, Newby H, Hanson C, Morgan A, El Arifeen S, Chou D, et al. Measures matter: A scoping review of maternal and newborn indicators. PloS one. 2018;13(10):e0204763. pmid:30300361
- 56. Moxon SG, Ruysen H, Kerber KJ, Amouzou A, Fournier S, Grove J, et al. Count every newborn; a measurement improvement roadmap for coverage data. BMC Pregnancy Childbirth. 2015;15 Suppl 2:S8. Epub 2015/09/24. pmid:26391444.