Figures
Abstract
Background
The persistence of preventable maternal and newborn deaths highlights the importance of quality of care as an essential element in coverage interventions. Moving beyond the conventional measurement of crude coverage, we estimated effective coverage of facility delivery by adjusting for facility preparedness to provide delivery services in Bangladesh, Haiti, Malawi, Nepal, Senegal, and Tanzania.
Methods
The study uses data from Demographic and Health Surveys (DHS) and Service Provision Assessments (SPA) in Bangladesh (2014 DHS and 2014 SPA), Haiti (2012 DHS and 2013 SPA), Malawi (2015–16 DHS and 2013–14 SPA), Nepal (2016 DHS and 2015 SPA), Senegal (2016 DHS and 2015 SPA), and Tanzania (2015–16 DHS and 2014–15 SPA). We defined effective coverage as the mathematical product of crude coverage and quality of care. The coverage of facility delivery was measured with DHS data and quality of care was measured with facility data from SPA. We estimated effective coverage at both the regional and the national level and accounted for type of facility where delivery care was sought.
Findings
The findings from the six countries indicate the effective coverage ranges from 24% in Haiti to 66% in Malawi, representing substantial reductions (20% to 39%) from crude coverage rates. Although Malawi has achieved almost universal coverage of facility delivery (93%), effective coverage was only 66%.vSuch gaps between the crude coverage and the effective coverage suggest that women delivered in health facility but did not necessarily receive an adequate quality of care. In all countries except Malawi, effective coverage differed substantially among the country’s regions of the country, primarily due to regional variability in coverage.
Citation: Wang W, Mallick L, Allen C, Pullum T (2019) Effective coverage of facility delivery in Bangladesh, Haiti, Malawi, Nepal, Senegal, and Tanzania. PLoS ONE 14(6): e0217853. https://doi.org/10.1371/journal.pone.0217853
Editor: Mahfuzar Rahman, BRAC, BANGLADESH
Received: January 24, 2019; Accepted: May 19, 2019; Published: June 11, 2019
Copyright: © 2019 Wang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This study was carried out with support provided by the United States Agency for International Development (USAID) through The DHS Program (#AID-OAA-C-13-00095). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Despite global increases in coverage of facility delivery, the reduction in maternal and neonatal deaths remains limited.[1] Crude coverage describes the use of care services, but does not provide information about the quality of care received. Examining the quality of maternal and newborn healthcare services centers upon the idea that skilled care provided at delivery, supported by well-equipped facilities, is critical for identifying and addressing complications in time for women and newborns to receive treatment and to save lives.[2] Moving beyond the conventional measurement of crude coverage, effective coverage combines both use and quality into one measurement, which can be understood as the fraction of the maximum health gain actually delivered through the health system to the population in need.[3, 4]
The concept of effective coverage first appeared several decades ago. The Tanahashi framework illustrated effective coverage as the final stage of service provision after availability of health services, physical accessibility to services, acceptability by those in need, and actual use of the service.[5] Shengelia et al. proposed a framework for effective coverage that integrates need, use, and quality [4]. Research on effective coverage has resumed recently but remained limited.[6] The few studies of effective coverage of maternal and child health services produce striking reductions of crude coverage. In Ghana, linking facility data to population data by districts, two-thirds of all births occurred in a health facility, but only one in every four births occurred in a high-quality facility.[7] Similarly, in Tanzania, using a high quality standard that facilities have 90% of required items, the estimate of effective coverage reduced crude coverage from 80% to zero.[8] In a study of 17 countries, using a stringent quality measurement cut-off of 20 or more out of 23 essential items, median coverage of facility delivery fell from 42% to 28%.[9]
When estimating effective coverage, measuring the quality of care can be challenging.[10] Of concern for quality of delivery care, there is no single set of standard measures used to assess quality.[1, 7, 11–13] Donabedian defined quality by components of structure, process, and outcome [14], which describe the health facility setting, care delivered to the client, and the client outcome. Many studies of quality of care in facility delivery focus on structural inputs.[7, 8, 13, 15, 16] Assessments of care practices provided has been limited,[11] and such observations are time-consuming, prone to measurement error, and subject to their own quality limitations, particularly in resource-constrained settings.[11, 17] Thus, service readiness assessments such as the World Health Organization (WHO) Service Availability and Readiness Assessment (SARA),[18] and The Demographic and Health Survey Program’s Service Provision Assessment (SPA), have been used as substitutes. These tools provide an overview of facility structural capacity to provide services but do not routinely include observation of actual service delivery.
The primary objective of this study is to estimate the effective coverage of obstetric and newborn care with a refined approach. This method takes into account different types of facilities where women delivered their births. We also estimated the uncertainty of the effective coverage estimates, which has not been commonly done in previous research on effective coverage. In measuring quality of care, we use a wide range of input-based quality of care indicators to provide a comprehensive assessment of the readiness of facilities to deliver obstetric and newborn care in these We link data from nationally representative household surveys -Demographic and Health Surveys (DHS)- with data from surveys of health facilities–SPA surveys in six countries. These countries were selected primarily because of the availability of closely timed DHS survey and SPA that can be linked. All six countries have high maternal and newborn mortality,[19, 20] which makes this analysis particularly relevant for these countries.
Data and methods
Data
This analysis is based on data from DHS and SPA surveys in six countries: Bangladesh, Haiti, Malawi, Nepal, Senegal, and Tanzania. All countries had recent DHS and SPA surveys completed within two years of each other. Both DHS and SPA surveys are primarily funded by the United States Agency for International Development and carried out by an in-country implementing agency (usually the country’s ministry of health or statistics office) with technical assistance from The DHS Program.
The DHS surveys are population-based household surveys that provides representative data on health indicators at national and regional levels. All women age 15–49 in selected households with a birth in the five years before the survey are interviewed about delivery care, including place of delivery for all live births during this period. This study focuses on delivery care received for live births in just the two years preceding the survey, to better synchronize the timing of the DHS and SPA data.
The SPA is a health facility-based survey designed to provide information on the availability and quality of preventive and curative health services. In each country except Haiti and Malawi, where the SPA was a facility census, a sample of formal health facilities was selected to represent the country and the administrative regions, by type of facility and by managing authority. This study focuses on facilities that provide delivery services, using data from the facility inventory and provider interviews. Table 1 provides the number of births and health facilities included in the analysis.
Statistical analysis
Effective coverage is calculated among individuals in need of care as the mathematical product of the use of the service and the quality of care provided.[4, 21] We first calculate the two components—coverage of facility delivery and the quality of facility delivery services.
Coverage of facility delivery.
We estimated the coverage of facility delivery based on DHS data as the percentage of births in the two years preceding the survey that were delivered in a health facility. We disaggregated the coverage by type of facility where the delivery occurred, because women may seek delivery care in a range of facilities with varied preparedness. For each of the six countries, facility types were harmonized between the DHS and SPA. S1 Tables provides a summary of the harmonized classifications for each country.
Facility readiness to provide delivery care.
This study focused on the structural aspect of quality of care, which refers to the physical attributes of a health facility including infrastructure, equipment, supplies, commodities, and the availability of trained personnel; in other words, service or facility readiness. We measured facility readiness with a composite score computed with a set of readiness indicators of obstetric and newborn care. Indicator selection was guided by three references: the World Health Organization (WHO) SARA Manual,[18] the indicators suggested by the Newborn Indicator Technical Working Group,[22] and a comprehensive systematic review by Gabrysch et al.[15] S1 Tables provides definitions of these indicators.
We calculated the composite readiness score using an equal-weight approach. This has proved to be the preferable method to create a composite measurement compared with other weighting schemes.[23, 24]Equal weight was given to six domains of readiness and to all indicators within the same domain; the sum of all domains was standardized to have a maximum of 100. Since non-CEmOC facilities are not expected to provide C-sections and safe blood transfusion, these two indicators were included in the calculation of readiness scores only for CEmOC facilities. Given this standardization, a facility’s score is interpreted as the percentage of the highest possible readiness that the facility could have.
Estimating effective coverage.
Effective coverage was estimated at both the regional and the national level, accounting for types of facilities where delivery care was sought.[25] The national estimates are improved by taking regional variations into account because regions differ in the use of each type of facility and in readiness among facilities in the same category. In most countries, the regions are administrative regions or provinces for which both DHS data and SPA data are representative. In Tanzania, regions were further grouped into nine geographic zones to allow for a large sample size in each zone, therefore reduced sampling errors.
At the regional level, the effective coverage is the summation of effective coverage of each type of facility that is constructed as the product of the coverage and readiness estimates: where ECr represents effective coverage in region r,
Crj is the proportion of births delivered in facility type j in region r,
and
Qrj is the average readiness score of facility type j in region r.
We accounted for the DHS sampling weight when estimating facility delivery coverage and the SPA sampling weight when calculating readiness scores. The calculated readiness score for a specific facility category is an average score of all facilities in the same category.
The national effective coverage is the summation of regional effective coverage weighted by the proportion of births in each region:
Where ECT represents the national level effective coverage and wr represents the proportion of births in region r.
The uncertainty of the estimates of effective coverage was assessed with an approximation procedure referred to as the “delta” method.[26] A detailed description of variance estimation of effective coverage is provided in S1 File.
Results
Analyzing the distribution of facilities by type, we found that government health facilities are the major providers of delivery care in all six countries (Fig A in S1 Figs). About 80% or more of facilities offering delivery care in Bangladesh, Tanzania, Nepal, and Senegal are government health facilities. Private facilities, especially private not-for-profit facilities, represent a larger share in Haiti and Malawi than in other countries. Most of the countries rely on lower-level facilities such as health posts or sub-health posts and dispensaries for delivery care. Government hospitals have a small share ranging from 1% in Senegal to 11% in Haiti.
We examined the availability of tracer items that are important for providing delivery care in each country at the regional level (only for non-CEmOC facilities) and at the national level (Tables C-H in S1 Tables). We found that facilities, especially non-CEmOC facilities, often lack equipment, medicines, supplies, or trained personnel needed to provide high quality of care. In all countries except Malawi, less than a third of non-CEmOC facilities had a 24/7 skilled birth attendant. Many non-CEmOC facilities lacked a functional emergency transportation system, available in only 30% of facilities in Bangladesh and Haiti Equipment such as a manual vacuum extractor, vacuum aspirator kit, were seldom observed, with either supply available in less than 10% of facilities in Tanzania, less than 20% in Haiti or Nepal, and less than 30% in Bangladesh,. In Bangladesh, availability of medicines and commodities ranged from 17% for hydrocortisone to 32% with an injectable uterotonic, and 33% with IV solution with an infusion set. Among non-CEmOC facilities, the regions often had similar items available at their facilities. While health facilities performed well in providing immediate newborn care services, provision of basic emergency obstetric care and newborn resuscitation was limited, a finding that was consistent across regions.
As expected, the availability of items was higher among CEmOC facilities.In all the countries, for both CEmOC and non-CEmOC facilities, the domain with the most limited availability was guidelines, training, and supervision. Less than one third of CEmOC facilities had a provider trained in CEmOC in 4 countries- Nepal (11%), Senegal (12%), Bangladesh (29%), and Tanzania (31%).
Readiness scores were calculated by facility type and region. We present the results with the corresponding coverage of facility delivery to facilitate the comparisons between readiness and use (Figs B-Min S1 Figs). In all countries, hospitals, whether private or public, were typically the type of facility most ready to provide delivery care, whereas lower-level facilities were much less prepared. For example, in Bangladesh, public hospitals had the highest readiness score, with 77% of the maximum capacity to provide delivery care services, but public union facilities had a readiness score of only 37%. Despite the poor readiness of these lower-level facilities, many were reported by women as one of the major sources of delivery care. In fact, in several countries the type of facility least ready to provide delivery care was the most commonly reported place of delivery. In Nepal, for example, despite having the lowest readiness score, government health posts were widely used in Provinces 6 and 7. In Tanzania, government dispensaries had the lowest readiness score but were commonly reported as a source for delivery care., the facility type with the lowest readiness score. A similar pattern was found in Senegal: the most commonly used type of facility, the government health post, had low service readiness scores compared with government hospitals and health centers.
Fig 1 depicts the countries’ national coverage of facility delivery against their facilities’ readiness score, as well as the range among their regions. For each country, the horizontal whisker indicates the range of the readiness score among the country’s regions, and the vertical whisker represents the range of the facility delivery coverage among the regions. The longer the whisker, the greater the variability among the regions. In four countries—Malawi, Senegal, Tanzania, and Nepal—national averages of coverage and readiness fell in quadrant I, indicating that both the national coverage and the readiness score were higher than 50%. Malawi had the highest coverage of facility delivery and the greatest readiness. Bangladesh had the lowest coverage and readiness, both lower than 50%. Haiti is in quadrant IV, with a readiness score above 50% but coverage below 50%. All countries demonstrated a larger regional variability in coverage than in readiness except for Malawi, where the regions had similar levels of coverage and readiness. Senegal had the greatest range of crude coverage of both facility delivery and facility readiness by region. Fig N in S1 Figs presents regional levels of readiness against coverage for each country.
Taking into account the readiness of facilities to provide the service, we describe the effective coverage at the national and regional level in Figs 2–7 and Table 2. Malawi had the highest effective coverage, at 66%, 27 percentage points lower than its crude coverage. The effective coverage was 66% in each region. Senegal was the only other country with a national effective coverage above 50%, but with considerable variations among regions, from 30% in the East to 64% in Dakar. The level of effective coverage appeared lowest in the East (30%) and North (38%) compared with other regions. Across countries, the lowest effective coverage estimate was found in Haiti, at 24%, with effective coverage below 25% in most regions. Effective coverage was also low in Bangladesh, at 27%. Khulna had much higher effective coverage (41%) compared with all other divisions, while Sylhet had the lowest (16%); this score was significantly lower than in all other divisions except Barisal.
While over half of births in Nepal were delivered in a health facility, the country’s effective coverage was 42%. Provinces 3, 4, and 7 had higher effective coverage than other provinces, about 50%; Provinces 6 and 2 had the lowest effective coverage, at 27% and 34% respectively. Nationally, effective coverage in Tanzania was 44%, which was substantially lower than the crude facility delivery coverage of 65%. There was a large variation in effective coverage by zones. The effective coverage in Southern Highlands (68%) was twice the level of the effective coverage in the Lake zone (32%).
Discussion and conclusions
After taking into account facilities’ preparedness to provide delivery care services, the effective coverage in all countries studied is much lower than the crude coverage. The reduction ranges from 20% in Nepal to 39% in Haiti. Even though Malawi has almost universal facility delivery, the effective coverage is only 66%. Our results indicate that women who delivered in a health facility did not necessarily receive the quality of care needed to avoid preventable maternal and newborn mortality.[27] Taken along with findings from studies in other health areas and settings, [8, 28, 29] these highlight the need for improving quality of care to achieve the health-related Sustainable Development Goals.
A variety of facility types reported providing delivery care services, from lower-level, peripheral facilities to high-level facilities such as hospitals. Despite the poor readiness of the lower-level facilities, women often reported these facilities as the major sources of delivery care, as evidenced in Tanzania and Senegal. In Senegal, the most commonly used type of facility, the government health post, had low service readiness scores compared with government hospitals and health centers. Similarly in Tanzania, delivery care was commonly sought in public dispensaries, the facility type with the lowest readiness score. This was also identified by a study in a rural region of Tanzania, which found that while over 80% of women delivered in a health facility, few delivered at a facility that offered high-quality routine or emergency obstetric care.7. While lower-level facilities in the six countries were not equipped with all of the tracer items examined, many lacked essential supplies or equipment. A majority of non-CEmOC facilities lacked an emergency transportation system, which is critical for these facilities to be able to transfer medical emergencies or complications that they are not able to treat themselves. Even among high-level facilities, facilities are often poorly equipped. Staff training is important to ensure that health providers are technically competent, but in-service trainings are universally inadequate, indicating a need for more investment in human resources.[30, 31]
Haiti and Bangladesh have the lowest effective coverage among the six countries, resulting from both limited use of health facilities for delivery and poor readiness among the facilities. The destruction of health facilities in the 2010 earthquake, the mountainous terrain, and lack of high quality facilities in rural areas may inhibit equitable access to quality delivery services in Haiti.[32–34] Physical proximity to a health facility as well as quality of care provided at health facilities both play important roles in the use of services in Haiti.[35, 36] Similarly, in Bangladesh, among the many factors that could hinder women from using a health facility for delivery, the poor quality of services undoubtedly contributes to the low rate of use.[37] The poor quality of care in health facilities is believed to contribute to the stall of maternal mortality decline, despite an increase in facility delivery coverage.[38] Although private facilities generally provide better quality of care, they are usually less financially and geographically accessible than public facilities.[39, 40]
Senegal, Nepal, and Tanzania present intermediate levels of effective coverage, but demonstrate large regional variations, particularly in the coverage of facility delivery. In Senegal, for example, Dakar and Thiès, the two regions with the highest effective coverage, more than 90% of births were delivered in a health facility, while the East region had less than 50% facility delivery and suffered from the lowest effective coverage. In Nepal, the province with the highest percentages of facility deliveries had almost double the level of effective coverage compared with the province with the lowest percentages of facility deliveries. The finding that many women still delivery at home highlights the importance of continued efforts to improve the coverage of facility delivery in countries or regions where home delivery is still common. Malawi possesses the highest national crude delivery coverage and effective coverage. The high facility delivery coverage is due in part to a ban on informal birth attendants enacted in 2007—a policy aimed at transitioning births to the formal sector.[41] Additionally, adoption of the Newborn Action Plan prioritized quality of care during labor and delivery.[42]
This study is subject to several limitations. First, the effective coverage estimate is the facility delivery coverage adjusted for structural inputs. We did not assess process attributes, or providers’ adherence to acceptable standards of care. Facility readiness may not be indicative of provider performance. In fact, the association between structure and process was found to be weak.[43] Our results might overestimate effective coverage in the absence of data on the process of service delivery.
A scoring approach in measuring quality of care as used in this study is necessary to provide a comprehensive picture of a facility’s preparedness to provide delivery services and provide effective coverage estimates at the population level. That is, effective coverage aims to capture the expected level of coverage of services provided in a service delivery environment with optimal readiness. The readiness score itself cannot identify specific deficits. Facilities with a similar score could possess quite different specific tracer items. Effective coverage must be interpreted with pragmatism, and the tracer items used to compute the measure should always be referenced.
This study focused on estimating the effective coverage of facility delivery. It is important to note that some women who did not deliver in health facilities might still receive an adequate basic care from other sources such as trained traditional health attendant or community health workers. In fact, a randomized controlled trial in Pakistan showed that trained traditional birth attendants contributed to 30% reduction in perinatal mortality.[44] These non-institutional resources of care should be included when assessing the effective coverage of overall delivery care.[6]
Taking into account both crude coverage and quality of care, effective coverage is a useful tool for monitoring a country’s progress toward achieving universal coverage of health care with sufficient quality. We found that adjusting for facility readiness substantially reduces crude coverage of facility delivery. Such consistent findings in in all six countries reinforce the importance of prioritizing quality of obstetric and newborn care to achieve further reduction of maternal and neonatal mortality. Health care can only achieve its full potential when it offers sufficient quality. Meanwhile, continued efforts are needed to increase the use of facility delivery services in areas where coverage remains low.
Supporting information
S1 File. Description of variance estimation of effective coverage.
https://doi.org/10.1371/journal.pone.0217853.s003
(PDF)
References
- 1. Marchant T, Bryce J, Victora C, Moran AC, Claeson M, Requejo J, et al. Improved measurement for mothers, newborns and children in the era of the Sustainable Development Goals. J Glob Health. 2016;6(1):010506. pmid:27418960; PubMed Central PMCID: PMCPMC4938381.
- 2. Tura G, Fantahun M, Worku A. The effect of health facility delivery on neonatal mortality: systematic review and meta-analysis. BMC pregnancy and childbirth. 2013;13(1):18.
- 3. Ng M, Fullman N, Dieleman JL, Flaxman AD, Murray CJ, Lim SS. Effective coverage: a metric for monitoring Universal Health Coverage. PLoS Med. 2014;11(9):e1001730. pmid:25243780; PubMed Central PMCID: PMCPMC4171091.
- 4. Shengelia B, Tandon A, Adams OB, Murray CJ. Access, utilization, quality, and effective coverage: an integrated conceptual framework and measurement strategy. Social science & medicine (1982). 2005;61(1):97–109. Epub 2005/04/26. pmid:15847965.
- 5. Tanahashi T. Health service coverage and its evaluation. Bulletin of the World Health Organization. 1978;56(2):295–303. Epub 1978/01/01. pmid:96953; PubMed Central PMCID: PMCPmc2395571.
- 6. Jannati A, Sadeghi V, Imani A, Saadati M. Effective coverage as a new approach to health system performance assessment: a scoping review. BMC health services research. 2018;18(1):886. Epub 2018/11/25. pmid:30470214; PubMed Central PMCID: PMCPmc6251131.
- 7. Nesbitt RC, Lohela TJ, Manu A, Vesel L, Okyere E, Edmond K, et al. Quality along the continuum: a health facility assessment of intrapartum and postnatal care in Ghana. PLoS One. 2013;8(11):e81089. pmid:24312265; PubMed Central PMCID: PMCPMC3842335.
- 8. Larson E, Vail D, Mbaruku GM, Mbatia R, Kruk ME. Beyond utilization: measuring effective coverage of obstetric care along the quality cascade. Int J Qual Health Care. 2017;29(1):104–10. pmid:27920246; PubMed Central PMCID: PMCPMC5890864.
- 9. Kanyangarara M, Chou VB, Creanga AA, Walker N. Linking household and health facility surveys to assess obstetric service availability, readiness and coverage: evidence from 17 low- and middle-income countries. J Glob Health. 2018;8(1):010603. pmid:29862026; PubMed Central PMCID: PMCPMC5963736 www.icmje.org/coi_disclosure.pdf (available upon request from the corresponding author), and declare no competing interests.
- 10. Nguhiu PK, Barasa EW, Chuma J. Determining the effective coverage of maternal and child health services in Kenya, using demographic and health survey data sets: tracking progress towards universal health coverage. Tropical Medicine & International Health. 2017;22(4):442–53.
- 11. Tripathi V, Stanton C, Strobino D, Bartlett L. Development and validation of an index to measure the quality of facility-based labor and delivery care processes in sub-Saharan Africa. PLoS One. 2015;10(6):e0129491. pmid:26107655
- 12. Van den Broek N, Graham W. Quality of care for maternal and newborn health: the neglected agenda. BJOG: An International Journal of Obstetrics & Gynaecology. 2009;116(s1):18–21.
- 13. Willey B, Waiswa P, Kajjo D, Munos M, Akuze J, Allen E, et al. Linking data sources for measurement of effective coverage in maternal and newborn health: what do we learn from individual- vs ecological-linking methods? J Glob Health. 2018;8(1):010601. pmid:29497508; PubMed Central PMCID: PMCPMC5823029 form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author). Drs. Marchant and Munos report grants from the Bill & Melinda Gates Foundation, and Dr Akuze reports grants from Makerere University School of Public Health during the conduct of the study. All other authors declare no conflict of interest.
- 14. Donabedian A. The quality of care. How can it be assessed? Jama. 1988;260(12):1743–8. Epub 1988/09/23. pmid:3045356.
- 15. Gabrysch S, Civitelli G, Edmond KM, Mathai M, Ali M, Bhutta ZA, et al. New Signal Functions to Measure the Ability of Health Facilities to Provide Routine and Emergency Newborn Care. PLoS Med. 2012;9(11):e1001340. pmid:23152724
- 16.
Winter R, Yourkavitch J, Mallick L, Wang W. Levels and trends in newborn care service availability and readiness in Bangladesh, Haiti, Malawi, Senegal, and Tanzania. Rockville, Maryland, USA: ICF International, 2016.
- 17. Lain SJ, Hadfield RM, Raynes-Greenow CH, Ford JB, Mealing NM, Algert CS, et al. Quality of data in perinatal population health databases: a systematic review. Med Care. 2012;50(4):e7–20. pmid:21617569.
- 18.
WHO. Service Availability and Readiness Assessment (SARA): An annual monitoring system for service delivery Reference Manual. Geneva, Switzerland: WHO; 2015.
- 19.
WHO, UNICEF, UNFPA, World Bank Group, The United Nations Population Division. Trends in maternal mortality: 1990 to 2015. Geneva: World Health Organization: 2015.
- 20.
UNICEF, WHO, World Bank Group, United Nations. ‘Levels & Trends in Child Mortality: Report 2017. New York: UNICEF, 2017.
- 21. Colston J. the use of effective coverage in the evaluation of maternal and child health programs: a technical note for the IDB's social protection and health division. Inter-American Development Bank, 2011.
- 22.
Save the Children Federation I. Newborn indicators 2017 [May 1, 2016]. Available from: http://www.healthynewbornnetwork.org/numbers/newborn-indicators/.
- 23.
Mallick L, Wang W, Temsah G. A comparison of summary measures of quality of service and quality of care for family planning in Haiti, Malawi, and Tanzania. Rockville, Maryland, USA: ICF, 2017.
- 24. Shwartz M, Restuccia JD, Rosen AK. Composite Measures of Health Care Provider Performance: A Description of Approaches. The Milbank quarterly. 2015;93(4):788–825. Epub 2015/12/03. pmid:26626986; PubMed Central PMCID: PMCPmc4678940.
- 25. Munos M, Maiga A, Do M, GL.; S, Carter E, R.; M, et al. Linking household survey and health facility data for effective coverage measures: a comparison of ecological and individual linking methods using the Multiple Indicator Cluster Survey in Côte d’Ivoire Journal of Global Health. 2018;8(2). pmid:30410743
- 26.
Hogg RV, Craig AT. Introduction to mathematical statistics. 2nd ed. Macmillan, New York1965.
- 27. Bhutta ZA, Das JK, Bahl R, Lawn JE, Salam RA, Paul VK, et al. Can available interventions end preventable deaths in mothers, newborn babies, and stillbirths, and at what cost? Lancet (London, England). 2014;384(9940):347–70. Epub 2014/05/24. pmid:24853604.
- 28. Koulidiati JL, Nesbitt RC, Ouedraogo N, Hien H, Robyn PJ, Compaore P, et al. Measuring effective coverage of curative child health services in rural Burkina Faso: a cross-sectional study. BMJ open. 2018;8(5):e020423. Epub 2018/06/03. pmid:29858415; PubMed Central PMCID: PMCPmc5988102.
- 29. Leslie HH, Ndiaye Y, Kruk ME. Effective coverage of primary care services in eight high-mortality countries. BMJ Global Health. 2017;2(3):e000424. pmid:29632704
- 30. Lanata CF. Human resources in developing countries. Lancet (London, England). 2007;369(9569):1238–9. Epub 2007/04/17. pmid:17434382.
- 31. Manzi F, Schellenberg JA, Hutton G, Wyss K, Mbuya C, Shirima K, et al. Human resources for health care delivery in Tanzania: a multifaceted problem. Human resources for health. 2012;10:3. Epub 2012/02/24. pmid:22357353; PubMed Central PMCID: PMCPmc3311084.
- 32. Alexandre PK, Saint-Jean G, Crandall L, Fevrin E. Prenatal care utilization in rural areas and urban areas of Haiti. Revista panamericana de salud publica = Pan American journal of public health. 2005;18(2):84–92. Epub 2005/09/15. pmid:16156958.
- 33. Behrman JA, Weitzman A. Effects of the 2010 Haiti Earthquake on Women's Reproductive Health. Studies in family planning. 2016;47(1):3–17. Epub 2016/03/31. pmid:27027990.
- 34. Gage AD, Leslie HH, Bitton A, Jerome JG, Thermidor R, Joseph JP, et al. Assessing the quality of primary care in Haiti. Bulletin of the World Health Organization. 2017;95(3):182–90. Epub 2017/03/03. pmid:28250531; PubMed Central PMCID: PMCPmc5328114.
- 35. Gage AJ, Guirlène Calixte M. Effects of the physical accessibility of maternal health services on their use in rural Haiti. Population studies. 2006;60(3):271–88. pmid:17060054
- 36. Wang W, Winner M, Burgert-Brucker CR. Limited Service Availability, Readiness, and Use of Facility-Based Delivery Care in Haiti: A Study Linking Health Facility Data and Population Data. Global Health: Science and Practice. 2017;5(2):244–60.
- 37. Karim RM, Abdullah MS, Rahman AM, Alam AM. Identifying influence of perceived quality and satisfaction on the utilization status of the community clinic services; Bangladesh context. Bangladesh Medical Research Council bulletin. 2015;41(1):1–12. Epub 2016/04/20. pmid:27089628.
- 38.
National Institute of Population Research and Training (NIPORT), International Centre for Diarrhoeal Disease Research Bangladesh (icddrb), MEASURE Evaluation. Bangladesh Maternal Mortality and Health Care Survey 2016: Preliminary Report. Dhaka, Bangladesh, and Chapel Hill, NC, USA: NIPORT, icddr,b, and MEASURE Evaluation., 2017.
- 39. Siddiqui N, Khandaker SA. Comparison of services of public, private and foreign hospitals from the perspective of Bangladeshi patients. Journal of health, population, and nutrition. 2007;25(2):221–30. Epub 2007/11/08. pmid:17985824; PubMed Central PMCID: PMCPmc2754001.
- 40. Sikder SS, Labrique AB, Ali H, Hanif AA, Klemm RD, Mehra S, et al. Availability of emergency obstetric care (EmOC) among public and private health facilities in rural northwest Bangladesh. BMC public health. 2015;15:36. Epub 2015/02/01. pmid:25637319; PubMed Central PMCID: PMCPmc4316389.
- 41. Godlonton S, Okeke EN. Does a ban on informal health providers save lives? Evidence from Malawi. Journal of development economics. 2016;118:112–32. Epub 2015/12/19. pmid:26681821; PubMed Central PMCID: PMCPmc4677333.
- 42.
The Ministry of Health of Malawi. Every Newborn Action Plan: An Action Plan to End Preventable Neonatal Deaths in Malawi. Malawi: The Ministry of Health of Malawi 2015.
- 43. Leslie HH, Sun Z, Kruk ME. Association between infrastructure and observed quality of care in 4 healthcare services: A cross-sectional study of 4,300 facilities in 8 countries. PLoS Med. 2017;14(12):e1002464. Epub 2017/12/13. pmid:29232377; PubMed Central PMCID: PMCPmc5726617.
- 44. Jokhio AH, Winter HR, Cheng KK. An intervention involving traditional birth attendants and perinatal and maternal mortality in Pakistan. The New England journal of medicine. 2005;352(20):2091–9. Epub 2005/05/20. pmid:15901862.