Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Community surveillance and response to maternal and child deaths in low- and middle-income countries: A scoping review

  • Tariro J. Basera ,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    baseratj@gmail.com

    Affiliation School of Public Health, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa

  • Kathrin Schmitz,

    Roles Conceptualization, Validation, Writing – review & editing

    Affiliation mothers2mothers, Cape Town, South Africa

  • Jessica Price,

    Roles Validation, Writing – review & editing

    Affiliation MRC-Wits Rural Public Health and Health Transitions Research Unit (Agincourt), School of Public Health, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa

  • Merlin Willcox,

    Roles Methodology, Validation, Writing – review & editing

    Affiliation School of Primary Care, Population Sciences and Medical Education, University of Southampton, Southampton, United Kingdom

  • Edna N. Bosire,

    Roles Validation, Writing – review & editing

    Affiliation South African Medical Research Council Developmental Pathways for Health Research Unit (DPHRU), School of Clinical Medicine, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa

  • Ademola Ajuwon,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Health Promotion and Education, Faculty of Public Health, University of Ibadan, Ibadan, Nigeria

  • Marjorie Mbule,

    Roles Conceptualization, Writing – review & editing

    Affiliation mothers2mothers, Cape Town, South Africa

  • Agnes Ronan,

    Roles Conceptualization, Writing – review & editing

    Affiliation mothers2mothers, Cape Town, South Africa

  • Fiona Burtt,

    Roles Conceptualization, Validation, Writing – review & editing

    Affiliation mothers2mothers, Cape Town, South Africa

  • Esca Scheepers,

    Roles Conceptualization, Validation, Writing – review & editing

    Affiliation mothers2mothers, Cape Town, South Africa

  • Jude Igumbor

    Roles Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliation School of Public Health, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa

Abstract

Background

Civil registration and vital statistics (CRVS) systems do not produce comprehensive data on maternal and child deaths in most low- and middle-income countries (LMICs), with most births and deaths which occur outside the formal health system going unreported. Community-based death reporting, investigation and review processes are being used in these settings to augment official registration of maternal and child deaths and to identify death-specific factors and associated barriers to maternal and childcare. This study aims to review how community-based maternal and child death reporting, investigation and review processes are carried out in LMICs.

Methods

We conducted a scoping review of the literature published in English from January 2013 to November 2020, searching PubMed, EMBASE, PsycINFO, Joanna Briggs, The Cochrane Library, EBM reviews, Scopus, and Web of Science databases. We used descriptive analysis to outline the scope, design, and distribution of literature included in the study and to present the content extracted from each article. The scoping review is reported following the PRISMA reporting guideline for systematic reviews.

Results

Of 3162 screened articles, 43 articles that described community-based maternal and child death review processes across ten countries in Africa and Asia were included. A variety of approaches were used to report and investigate deaths in the community, including identification of deaths by community health workers (CHWs) and other community informants, reproductive age mortality surveys, verbal autopsy, and social autopsy. Community notification of deaths by CHWs complements registration of maternal and child deaths missed by routinely collected sources of information, including the CRVS systems which mostly capture deaths occurring in health facilities. However, the accuracy and completeness of data reported by CHWs are sub-optimal.

Conclusions

Community-based death reporting complements formal registration of maternal and child deaths in LMICs. While research shows that community-based maternal and child death reporting was feasible, the accuracy and completeness of data reported by CHWs are sub-optimal but amenable to targeted support and supervision. Studies to further improve the process of engaging communities in the review, as well as collection and investigation of deaths in LMICs, could empower communities to respond more effectively and have a greater impact on reducing maternal and child mortality.

Introduction

Despite efforts to improve healthcare delivery, maternal and child mortality remain high in many low- and middle-income countries (LMICs). Approximately 830 women die each day globally during or following pregnancy and childbirth, with over 90% of these deaths occurring in LMICs [1]. Sub-Saharan Africa and the South Asian regions account for 66% and 33% of total global maternal deaths, respectively [2]. Similarly, under-5 mortality remains highest in sub-Saharan Africa, which accounts for half of all child deaths globally, and central and southern Asia, where 30.4% of all under-5 deaths occur [3]. In 2017, an estimated 5.5 million children under five years old died, of whom 2.5 million died in the first month of life [4].

High maternal and child mortality are attributed partly to poor quality of maternal and newborn care resulting from many factors, including delays in seeking and receiving care, delays in referrals for treatment, stock-outs of essential commodities, poor monitoring during labour, inadequate skills for providing emergency obstetric and neonatal care and managing other co-infections, lack of medical supplies including blood, widespread understaffing, and home birth [5, 6].

The implementation of interventions to reduce maternal and child mortality requires an adequate understanding of the causes of deaths and barriers to healthcare for mothers and children [7]. Creation of functional CRVS systems and quality data collected at the community level are critical to achieving this goal [8]. In LMICs, the ability to identify barriers and develop strategies to overcome them is often constrained by the lack of good quality data on maternal and child deaths from routinely collected sources of information [9]. For example, much of the available data for tracking births and deaths in LMICs is mainly from health facilities (hospitals) [10, 11]. All births and deaths should be registered through national CRVS systems in LMICs; however, this is difficult to achieve in LMIC settings because a significant number of births and deaths occur outside formal health systems [12, 13]. In 29 sub-Saharan African countries, for example, 77.7% of births occurred outside health facilities [14], while approximately 50% of under-five deaths occurred at home [15]. A comprehensive tracking system for maternal and child healthcare would integrate both facility- and community-based sources of data to inform interventions aimed at reducing maternal and child mortality in LMICs.

Community-based data sources include household surveys, verbal autopsies, social autopsies and demographic surveillance systems aimed at identifying maternal and child deaths [10, 1618]. A verbal autopsy (VA) involves a structured interview with the caregiver of the deceased, which aims to establish the probable biological cause of death [8]. The WHO has produced standardised VA questionnaires which elicit information on symptoms experienced during the final illness, the deceased’s medical history and, where relevant, details related to any pregnancies, antenatal care, labour and delivery [19]. According to Kalter and colleagues [20], a social autopsy (SA) refers to “an interview aimed at identifying social, behavioural, and health system contributors to death both within health facilities, and at different stages of the patient pathway.” Community-based death surveillance and response (CDSR) is a process of active case-finding that starts with notification of a maternal or child death by field-level health workers or community informants, investigation of the causes of deaths, relaying of this information to a focal person at the district-level health facility, and involving community members in review and response to prevent similar deaths in the future [7]. Community-based data collection methods have the potential to augment and improve overall data on maternal and child deaths in LMICs.

VAs and SAs have been used widely across LMICs [21]. However, less is known about how these data collection tools feed into implementation of responses to maternal and child deaths in LMICs and how they can be used to help decision-makers identify modifiable factors that contribute to deaths and the development of local interventions to reduce mortality. To inform the improvement of maternal and child death surveillance and response, therefore, this paper provides findings of a scoping review on community-based surveillance and response to maternal and child deaths in LMICs.

Study purpose

The scoping review aimed to explore the concept and current practice of community-based maternal and child death surveillance and response in LMICs. The key objectives were:

  1. To describe the methodology for CDSR of maternal and child deaths and investigation of causes of death by community health workers in LMICs.
  2. To determine the outcomes of CDSR processes for maternal and child deaths in LMICs.

Methods

A scoping review was conducted using Arksey and O’Malley’s framework [22], and the findings are presented using a narrative synthesis.

Criteria for inclusion

Studies were included if they reported on the investigation of maternal deaths and/or deaths of children under five years (including neonatal deaths) in LMICs. Studies had to include maternal and/or child deaths in the community alone or together with deaths in health facilities. Studies on facility-based deaths alone were excluded as they did not capture deaths in the community. Studies did not have to include a component of community-based review or response to the deaths. We included both qualitative and quantitative studies published in the English language from January 2013 to November 2020.

Search strategy

Our search strategy was designed to concentrate on deaths identified through CHWs or similar lay health worker cadres, following which verbal autopsy and social autopsy (VASA) were conducted to investigate the biological causes of, and avoidable factors contributing to, maternal and child deaths. We searched eight databases, including PubMed, EMBASE, PsycINFO, Joanna Briggs, The Cochrane Library, EBM reviews, Scopus, and Web of Science for articles published between January 2013 and November 2020, using Mesh Headings and free-text keywords that applied to community-based maternal and child death reviews. The timeframe was limited to literature published between January 2013 and November 2020 to gain information on current practice following the 2011 comprehensive review on social autopsy for maternal and child deaths by Kalter and colleagues [20]. We used the following key search terms combined using the Boolean operators ‘AND” and “OR”: “verbal autopsy”, “social autopsy”, “death review”, “post mortem interview”, “death surveillance and response”, “MPDSR”, “MDSR”, “confidential enquiry”, “death reporting”, “death registration”, “death investigation”, “death ascertainment”, “maternal deaths”, “under-five mortality”, “infant deaths”, “neonatal deaths”, “perinatal deaths”, “lay health worker”, “community health worker”, “community informant”, “community-based” (S1 Table). References from included articles were hand-searched for additional studies.

Data extraction and analysis

Following our search, all identified articles were collated and uploaded into EndNote and exported to Covidence software for screening, where duplicates were removed. Two reviewers independently evaluated the title and abstract of each article for assessment against the inclusion criteria. To determine texts included in the review, we conducted duplicate full-text screening. Any disagreements between the reviewers were resolved through discussions among the review team.

A standardised data evaluation tool from the Joanna Briggs Institute (JBI) Reviewers’ Manual was used to extract and synthesise data [23]. The data obtained included the following: Details of the processes and procedures of reporting, investigation and review of maternal and child deaths; measures to improve validity and data quality; the role of community health worker cadres/community informants in the death surveillance and response process; profile of respondents/participants; results or outcomes of the CDSR, including the number of maternal and child deaths notified and causes of death identified; barriers and facilitators to a successful CDSR; and perceptions and experiences of people involved in the process (S2 Table).

We used narrative synthesis to describe the scope, design, and distribution of literature included in the review and to present the contents extracted from each article [22]. The scoping review is reported following the PRISMA reporting guideline for systematic reviews [24].

Results

The initial search strategy identified 3162 articles. Following exclusion of all duplicates, we screened 3012 titles and abstracts and eliminated 2531 because they fell outside the scope of interest of the study. We reviewed the full text of the remaining 481 articles, of which 43 were included in this review. The Prisma flow chart in Fig 1 illustrates the selection process and number of articles included or excluded at each stage of the selection process.

thumbnail
Fig 1. PRISMA flow diagram of literature search strategy.

https://doi.org/10.1371/journal.pone.0248143.g001

Descriptive information for included studies

Of the 43 selected articles, 23 reported on the deaths of children under five years, 13 reported on maternal deaths, and seven covered both maternal and child deaths. Most studies (n = 28, 65.1%) were from sub-Saharan Africa, with Malawi having the highest number (Malawi n = 5). Fifteen articles (34.9%) were from Asian countries; the majority from India (n = 7) (Table 1).

thumbnail
Table 1. Summary of characteristics and methods used to identify deaths, and the number of deaths identified.

https://doi.org/10.1371/journal.pone.0248143.t001

Thirty-five studies were prospective enquiries while four were retrospective in design and the other four were cross-sectional studies. The recall period was up to eight weeks in seven studies, two years in four studies, while one study retrospectively investigated deaths in five years. The recall period was not reported in eleven studies (S2 Table).

Mechanisms for identifying and reporting maternal and child deaths in the community

Identifying maternal and child deaths.

Community-based informants. Although different terminologies were used to describe community health workers, they performed similar roles in tracking and collecting information on vital events, including maternal and child deaths, by visiting homes or other community settings. Volunteers also identified maternal and child deaths from civil society organisations and non-governmental organisations (e.g. White Ribbon Alliance working in Orissa State, India [25], religious leaders [26], traditional healers, burial records, village registers and police stations [27, 28], and village headmen [2931].

Reproductive Age Mortality Study (RAMOS). In three studies, maternal deaths were identified using RAMOS, which triangulates data from multiple records of maternal deaths. Sources include vital registration, patient records, interviews with family members, coroner’s office, the police, and traditional birth attendants [27, 28]. Once all maternal deaths are identified, a VA was undertaken for all deaths to ascertain the cause(s) of each death. One study in Ghana showed that community informants administered the shorter version of the RAMOS questionnaire, with four ‘yes’ or ‘no’ questions to identify a maternal death among women of reproductive age. Community health nurses and midwives then conducted VAs at households in which an affirmative answer had been given to at least one of the four questions [32].

As illustrated in Table 1, CHWs demonstrated capacity to identify maternal and child deaths, particularly those missed by health facility-based surveillance systems because they did not occur at facilities.

Accuracy and completeness of CHW reporting of maternal and child deaths.

Accuracy and completeness of CHW reporting systems are a crucial component of CDSR systems. Only four studies reported on this issue, from Malawi [33], Ethiopia [34], Sierra Leone [35], and Mali [36]. In Mali, for example, the under-five mortality rate calculated from CHW data was not different from the rate estimated using household surveys, with a difference of one death per 1000 live births [36]. However, CHW still missed some vital events. For example, in Malawi, compared to data obtained from a retrospective pregnancy history, Health Surveillance Agents (government employed CHWs) missed 33% of births and deaths [33]. Also, 90.5% of under-five deaths were reported by the Health Surveillance Agents in phase one of the Real-Time Monitoring of Under-Five Mortality project (January 2010 to August 2012), but this dropped to 87% in the second phase (October 2011 to February 2012) [33]. Reasons for decline in death reporting included turnover of CHWs, a decrease in the level of supervision at the district level, and delays in the transfer of data forms between CHWs, their supervisors and the district manager [34]. In Sierra Leone, the register for child deaths was incomplete because only about 40% of CHWs submitted a monthly report of under-five deaths between 2014 and 2017 [35].

Quality assurance methods.

Different quality assurance methods to enhance the validity of reporting of community-based maternal and child deaths were applied. Families were revisited in case of any inconsistencies to clarify inaccuracy or incompleteness of data in Bangladesh [37] and the MPDSR Quality Improvement committee checked 10% of the case studies to ensure quality and consistency of the VA data [38]. In Mali and Uganda, a random sample of VAs was re-investigated to cross-check with other sources of information to ensure the accuracy of the information supplied by community informants and fieldworkers [39]. Childcount+ platform, a mHealth application with built-in reminders, was used to collect data and monitor the performance and amount of work done by CHWs in Senegal [40]. In Pakistan and Senegal refresher training was provided for community informants [9, 40]. In Malawi, each CHW was assigned a supervisor who monitored the accuracy and completeness of the village registers completed by CHWs. The supervisor made a correction where necessary, provided immediate feedback to the CHWs, and conducted on-the-spot retraining for CHW [34]. In South Africa, completion of post-interview reflections by CHWs and conducting debriefing sessions were integrated into the CLMDR as quality assurance tools for monitoring, evaluating and responding to field experiences [41].

Methods for investigating causes and modifiable factors that contributed to maternal and child deaths.

The primary method of investigating biological causes of death is VA, while SA is used to investigate circumstances of death including care-seeking pathways. Table 1 illustrates the instruments used to conduct a verbal autopsy and social autopsy (VASA). Six of the studies did not specify the source of tools used for conducting VASA. Of the remaining studies, the majority (eleven) of the investigators adopted the WHO tools for VA and SA. Other less frequently used tools are INDEPTH Network’s VASA tool [6, 42], the QUARITE Trial tool [39], the Millennium Village Project (MVP) standardised tool [40], the Ballabgarb tool [42] and the Population Health Metrics Research Consortium shortened questionnaire [35]. There is generally a lack of coherence in the domains, length and type of questions in the different VASA instruments used in the reviewed studies.

Verbal autopsy. VA was used to obtain information about the cause of death by interviewing the deceased’s family, including the husband, mother, sister, mother-in-law, sister-in-law, or a traditional birth attendant who had provided care to the deceased [21, 43]. One study did not mention the respondents in VA interviews [44].

VA interviews were conducted within 14 to 30 days of the death in prospective enquiries, giving the family adequate time to grieve [42, 45, 46]. The recall period was longer in retrospective studies–ranging from three weeks in Rwanda [47] and two years in Pakistan [26] to five years in Ghana [32]. A recall of up to one year does not seem to affect the validity of the findings. A study conducted in India and Philippines reported that the probability of a correct diagnosis in VAs collected 3–11 months after death would, on average, be 95.9% of that in VAs collected within three months of death [48]. In another study, the probability of VAs to assign a cause of death decreased by 0.55% per month in the period after death [49].

There was variation in the type of personnel who conducted VAs in the studies where this information was provided. CHWs administered VAs in three studies, in Pakistan, Malawi and Uganda [9, 31, 50], with varying levels of education. In Pakistan, the CHWs who conducted the VAs were educated to at least college level [9], while the CHWs who administered VAs in Uganda had at least one year of secondary education [50]. The level of education of the Health Surveillance Assistants in Malawi was not specified [31].

The methods for determining the cause of death varied among the studies. Some used “physician review”, whereby physicians, obstetrician-gynaecologists, paediatricians and midwives independently assessed data from the interviews to assign a single cause of death based on the International Classification of Diseases [6, 9, 27, 28, 37]. Other studies used a computerised algorithm (InterVA-M software) to determine the most likely medical cause of death [25, 26, 35, 40, 45, 47, 50, 51], or analysis of data by researchers [42, 52].

Social autopsy. SA was conducted in ten studies. In India [40], Senegal [39], Uganda and Mali [39], Mozambique [51] Rwanda [45] and South Africa [41], the SA was administered together with a VA. When frontline government health workers in Bangladesh receive notification about the death of a mother or newborn, they conduct a SA and a community death review [7, 16, 53].

Methods for review and response to deaths.

Community death review meetings and confidential enquiries which include the participation of lay health workers, some community members and community leaders, are used to discuss remedial actions or strategies to prevent future deaths in the community and facilities [7, 31].

Community death review meeting. Community death review meetings were reported in five studies (Table 2). The community meeting involved asking for the potential cause(s) of death and avoidable factors, as well as to propose actions to prevent future deaths in Malawi [31], Sierra Leone [54], Mali and Uganda [39], Senegal [40] and Bangladesh [7]. In Sierra Leone, local community leaders, CHW supervisors and health centre staff were actors in community health data reviews [35, 54]. In Bangladesh, community death review meetings have on average 40–50 members, including health workers, community informants, and community members [18]. In Malawi, the public meeting was attended by representatives from the district hospital and health centre [31]. The CHWs presented a summary of the case of maternal death with the family’s consent. The community made recommendations and agreed on community factors that contributed to maternal mortality. In turn, the health workers reported proposed strategies to prevent future deaths, and community members questioned them about whether their action points from previous meetings had been completed [31]. In general, the review process was highly acceptable to the community, with communities taking ownership of the capturing of deaths and the response to address avoidable factors of maternal and child deaths. Feedback was reported to the community to enhance their involvement and increase accountability of healthcare workers to the community they serve [16, 31].

thumbnail
Table 2. Summary of studies where a community death review was conducted.

https://doi.org/10.1371/journal.pone.0248143.t002

Facility death review. Case reports compiled following VASA interviews were discussed by a maternal and child mortality review committee in five studies [16, 31, 39, 44, 55]. There was variation in the composition of maternal or child death review committees; some consisted only of health professionals, mostly local doctors, a paediatrician, a gynaecologist, a midwife or nurse, and a pharmacist [31, 32] others included lay health workers or community informants and fieldworkers [31, 39]. After discussing the details of each case, the committee identified avoidable factors, learning needs and proposed actions and resolutions to prevent future deaths. In three studies, the committee reported back to the community its recommendations on measures to prevent future deaths [16, 31, 54].

Actionable community responses.

Positive outcomes were noted in the five studies that included actionable community responses in Sierra Leone [54], Malawi [31], Mali and Uganda [39], and Bangladesh [16, 55], highlighting dissemination of recommendations to health workers and communities following case review (Table 2).

Involvement of multiple stakeholders including policymakers led to some positive outcomes such as improved availability of data necessary to make programmatic decisions [25, 56], implementation of actionable interventions, enactment of local policies, management and supervision of health facilities and CHW [31, 35, 57, 58]. Participation of local government leaders in social autopsy sessions developed a sense of ownership and commitment to take responsibility for their respective communities [55]. For example, the appointment of district-level MDR leads in Mchinji district, Malawi, improved actionable response of maternal deaths reviews, as 67% of response recommendations were taken up in 2014 compared to 26% in 2013 [58]. One year after the implementation of CDSR in Ethiopia, maternal deaths became the 21st mandatory reportable condition [57].

In Burkina Faso, the Ministry of Health has used data from CDSR to address stockouts of essential commodities for facilities, conducted in-service training for obstetric and newborn care in facilities with high maternal and child mortality rates, and provided surgical equipment to facilities in need [59]. The leadership of Kibaale district in Uganda allocated resources to construct a bridge that helped connect several communities with high mortality rates to the main road and increased access to emergency obstetric care [60]. CDSR in Bangladesh resulted in the implementation of actions following recommendations of the maternal death surveillance and response committee, such as the upgrading of the community clinic to a ten-bed hospital [55].

Death review meetings were shown to be a potentially powerful intervention to enable staff to learn from their shortcomings and to institute significant changes to procedures within their institution [7, 31]. For example, following a review of the death of a woman with eclampsia in Ethiopia, the MDSR committee recommended more rapid consultation with senior staff and purchased a generator and a biochemistry machine. When a similar case presented, all resuscitative measures were conducted with senior attendance by an Emergency Surgical Officer and Gynaecologist [61]. Some of the actions taken following death review meetings to improve staff capacity include implementation of quality improvement efforts, including provision of surgical packs, equipment and drugs; rotation, training and supervision of the surgical team and ensuring availability of transfusion blood from donors for obstetric emergency care [40]. In Uganda, health workers were transferred to under-served areas, and a mobile telephone network was created to fast-track contact with the on-call consultant and paediatrician by nurses and interns [39].

Community members recognised participatory review meetings as a tool to promote preventive messages and a strong basis for collective action to reduce maternal and child mortality, including increased capacity of the community to implement their own action plans and not repeat the same errors that previously resulted in a death [16, 54, 55]. Community participants reported improved trust in the health system in Malawi [31], and the importance of antenatal care (ANC), postnatal care and receiving care at the health facility [53, 55]. In Mali, to avert delays associated with lack of money to access care, some communities established savings groups to provide loans for emergency healthcare, based on community resolutions from participatory death reviews [39].

Pregnant women in Kashipur, Bangladesh, reported that ANC became readily available in the village following the deployment of skilled birth attendants in the community [55]. For example, a 19-year-old woman from Dhormogar village, Bangladesh, committed to delivering her first child by a skilled birth attendant after attending a social autopsy meeting [62]. The CDSR enabled the reduction in annual numbers of maternal deaths from 305 to 163 and neonatal deaths from 3361 to 1670 deaths in 2011 and 2015, respectively, in Bangladesh [63]. In Uganda, after one year of implementation, the Saving Mothers Giving Life initiative, which involved community surveillance and response to maternal deaths, was associated with a 30% reduction in maternal mortality in four districts, from 452 to 316 deaths per 100 000 live births [60].

Discussion

This scoping review demonstrates that community-based death reporting processes contribute significantly to the identification of maternal and child deaths in settings where CRVS data are not available or incomplete. Our findings show that community-based death reporting processes can be used to supplement maternal and child mortality data in CRVS through integration into the national health management information system, as is already done in India, Pakistan and Bangladesh, contributing to the sustainability and increased capacity of the CRVS systems [7, 44, 56].

Community-based informants (mostly CHWs) were used to identify maternal and child deaths. VA and SA processes were then used to determine the causes and avoidable factors of mortality [31, 50, 56]. Another death identification and reporting method is RAMOS; however, the extent to which this method is practised across LMICs is limited. Utilising CHWs for death identification aligns with the recommended strategy of task shifting in most LMICs.

We found that VA was the most used process for investigating the probable cause of death. The use of VA was previously restricted primarily to research contexts in most African countries, with only a few countries incorporating this method into conventional CRVS systems [43, 50, 64]. Where VA interviews are conducted, they are usually performed by trained health professionals, with only three studies stating the use of CHWs to perform this function. Studies that focused on community death reviews in Malawi, Bangladesh and Uganda trained CHWs to conduct VA interviews and showed that CHWs with at least one year of secondary education can perform VA successfully using simplified questionnaires [31, 50]. Where CHWs did not conduct VA interviews, they reported deaths or validated maternal deaths using RAMOS, following which VA was performed by a trained health professional.

Our findings also showed that VA interviews with the deceased’s next of kin or caregiver can be used to identify the cause of death where no medical cause/s of death would have been assigned. Different tools were used in various settings, but the WHO’s VA tool was most widely used, as it incorporates essential variables and integrates the indicators required for automated diagnostic algorithms [65]. Although such standardisation allows for easy comparison with other standardised methods, (for example, hospital records), having a standardised tool may not capture nuances peculiar to local settings [66]. We suggest that under certain conditions, it may be of value to adapt tools used for VASA to fit the local context.

A common feature in retrospective studies was the long duration of conducting VASA, raising concerns about the accuracy of reports [6, 26, 32]. The WHO recommends that findings from VA methodologies with recalls of more than one year should be interpreted with caution [67, 68]. However, there is no evidence in the current study that studies with a more extended recall period had problems with attributing the cause of death. A study conducted in Bangladesh did not find any evidence that undetermined cause of death was more common for enquiries with a three-year recall period [68]. A study investigating 10882 deaths with complete VAs from the Agincourt Health and Demographic Surveillance System in South Africa showed that a recall period of up to one year did not reduce the reliability of the data or the cause-of-death patterns derived [69]. Some of the strategies recommended for overcoming recall bias include flexibility of interview time and spending enough time with respondents [35, 43, 48].

This review found variation in protocols used to assign causes of maternal and child deaths across studies. Generally, the underlying cause of death was determined by trained physicians with concordance between the reviewers. We also found that community informants were not involved in ascertaining causes of death; a finding supported by Engmann et al. [70] which showed that, despite receiving similar training as physicians, non-physicians were perceived to be unreliable, and thus could not be relied on to determine the underlying cause of perinatal death using VA. Some of our reviewed studies used InterVA, a computer-based algorithm, to establish probable cause of death. InterVA is good at determining disease burdens at a population level when compared to physician review. However, it is much less reliable at determining the specific cause of death of a given individual when compared to physician review [71]. Other computerised algorithms such as Tariff, Simplified Symptom Pattern and Random Forest, were reported to have high accuracy at an individual level compared to physician-certified VA and InterVA in all age groups [49, 71]. However, further research is required to establish the generalisability of Random Forest, Tariff and Simplified Symptom Pattern algorithms in community settings and their compatibility with the WHO VA questionnaire.

Our review shows that CHWs/community informants reported maternal and child deaths to the health facility or district level, and relevant programme staff, on paper, phone call or electronically, depending on the context. Even though necessary quality assurance measures were introduced in CDR processes, there were significant challenges that undermine data quality. This finding compares with the results of a survey in Pakistan which assessed the accuracy of monthly reports submitted by community-based lay health workers and found that only 47.5% of the reports were classified as accurate, while 35% of the reports misreported data and over-reported deaths which did not happen in the catchment area [72]. Earlier studies from Malawi [73] and Ethiopia [74] reported that most of the data collected at the community level and reported to the health facility were incomplete due to management issues, lack of infrastructure, and health policy and politics [75]. The accuracy and completeness of village registers completed by village headmen in Malawi were influenced by insufficient supervision, a high degree of illiteracy of village headmen and non-integration of health facility and village-related data [29]. Use of poor-quality data results in inaccurate information about health systems gaps, which leads to poor management and performance of health programmes [76]. Accurate and complete mortality and health service delivery data reported by CHWs in Mali were attributed to active supervision and incentives (US$30 per month) [36], and by conducting post-interview reflections and debriefings in South Africa [41]. Considering the utility of this data for health planning at district, provincial and national levels, there is a need for adequate supervision, regular auditing and the development of a quality assurance system to improve data quality that will enhance validity and accuracy of community-based maternal and child mortality data. Improving the quality of care of maternal and child health requires the contributions of many actors [31, 54], including the community, civil society organisations, government, and the donor community, with the participation of various stakeholders in community death review meetings [16, 31].

The studies show that CHWs who collected information on deaths played a limited role in discussions on actionable community responses. Community informants ought to be recognised as important collaborators, facilitating the flow of information, as well as agents of engagement between the community, the death review system, health facilities and policymakers. Leadership and commitment from relevant government departments (as shown by the Ethiopian model) formalised and enhanced the collection of reliable and representative cause of death statistics through community-based death review processes [57].

More needs to be done concerning integrating CDSR into national programmes before the full benefit of the community death review process can be obtained in most LMICs. In Sierra Leone, for example, under the government’s National CHW Policy 2016–2020, CHWs have a role in reviewing community health-level data, but mechanisms for this process are yet to be determined [54]. Successful implementation of a CDSR system requires a national-level policy to notify all maternal and child deaths, and a policy to review maternal and child deaths, both in the community and at the facility. There is a need for adequate training and supervision of community informants to enhance the quality of data they report. Also, health workers involved in the reviews should be trained, especially on the action and response cycle, to ensure measures are implemented based on the evidence of the challenges and barriers identified in the CSDR. Further research is required to determine how many deaths need to be investigated and reviewed to maximise impact but minimise the cost of the CSDR system.

Conclusion

Community-based maternal and child death reporting processes improve the identification of maternal and child deaths in LMICs and subsequent investigation of causes of death and contributing factors. Lay or community health workers are tasked with the identification of deaths, but also conducted VASA in some contexts. With relevant quality assurance measures, it is feasible to fill the gap for accurate statistics on maternal and child mortality and its causes. The measures could include supervision and training of community health workers, use of information technology processes, infrastructure to ensure data accuracy and continuous data, community-based maternal and child death reporting and investigation. Further research is required to develop optimal methods for community death surveillance and review, which maximise impact while minimising cost. Reviewing deaths at community meetings and confidential enquiries can increase understanding of the causes and avoidable factors of maternal and child mortality, and prompt positive action at the local community and health facility to reduce mortality.

Supporting information

S1 Checklist. PRISMA flow diagram of literature search strategy.

https://doi.org/10.1371/journal.pone.0248143.s001

(DOC)

S2 Table. Summary of studies included in the review.

https://doi.org/10.1371/journal.pone.0248143.s003

(PDF)

Acknowledgments

TJB would like to thank all the authors for their invaluable guidance and advice on conducting scoping reviews and m2m for technical collaboration in writing the paper.

References

  1. 1. World Health Organization. Maternal mortality ratio. 2018. Available at http://www.who.int/healthinfo/statistics/indmaternalmortality/en/
  2. 2. World Health Organization. Maternal mortality: Key facts. 2018. Available at https://www.who.int/news-room/fact-sheets/detail/maternal-mortality
  3. 3. World Health Organization. Under-five mortality in 2018. Available at https://www.who.int/gho/child_health/mortality/mortality_under_five_text/en/
  4. 4. UNICEF 2018. Levels and Trends in Child Mortality: Report 2018. Available at https://childmortality.org/wp-content/uploads/2018/12/UN-IGME-Child-Mortality-Report-2018.pdf
  5. 5. Hulton L, Matthews Z, Martin‐Hilber A, Adanu R, Ferla C, Getachew A, et al. Using evidence to drive action: A “revolution in accountability” to implement quality care for better maternal and newborn health in Africa. International journal of gynaecology & obstetrics. 2014 Oct 1;127(1):96–101. pmid:25087502
  6. 6. Bogale TN, Worku AG, Bikis GA, Kebede ZT. Why gone too soon? Examining social determinants of neonatal deaths in northwest Ethiopia using the three-delay model approach. BMC paediatrics. 2017 Dec;17(1):216. pmid:29282018
  7. 7. Biswas A, Halim MA, Dalal K, Rahman F. Exploration of social factors associated with maternal deaths due to haemorrhage and convulsions: Analysis of 28 social autopsies in rural Bangladesh. BMC health services research. 2016a Dec;16(1):659.
  8. 8. D’Ambruoso L, Kahn K, Wagner RG, Twine R, Spies B, Van Der Merwe M, et al. Moving from medical to health systems classifications of deaths: extending verbal autopsy to collect information on the circumstances of mortality. Global health research and policy. 2016 Dec;1(1):2.
  9. 9. Soofi SB, Ariff S, Khan U, Turab A, Khan GN, Habib A, et al. Diagnostic accuracy of WHO verbal autopsy tool for ascertaining causes of neonatal deaths in the urban setting of Pakistan: a hospital-based prospective study. BMC paediatrics. 2015 Dec;15(1):144. pmid:26438252
  10. 10. Moodley J, Fawcus S, Pattinson R. Improvements in maternal mortality in South Africa. South African Medical Journal. 2018;108(3):4–8.
  11. 11. Kendall T, Danel I, Cooper D, Dilmitis S, Kaida A, Kourtis AP, et al. Eliminating preventable HIV-related maternal mortality in sub-Saharan Africa: what do we need to know? Journal of acquired immune deficiency syndromes. 2014;67(4): S250–8. pmid:25436825
  12. 12. Makinga PN, Moodley J, Titus MJ. The profile of maternal deaths in a district hospital: a five-year review of maternal deaths from 2006–2010. South African Family Practice. 2012;54(6):518–24.
  13. 13. Udjo EO, Lalthapersad-Pillay P. Estimating maternal mortality and causes in South Africa: National and provincial levels. Midwifery. 2014;30(5):512–8. pmid:23810471
  14. 14. Doctor HV, Nkhana-Salimu S, Abdulsalam-Anibilowo M. Health facility delivery in sub-Saharan Africa: successes, challenges, and implications for the 2030 development agenda. BMC public health. 2018 Dec;18(1):765. pmid:29921275
  15. 15. Price J, Lee J, Willcox M, Harnden A. Place of death, care-seeking and care pathway progression in the final illnesses of children under five years of age in sub-Saharan Africa-a systematic review. Journal of Global Health. 2019 Jul 22.
  16. 16. Biswas A, Ferdoush J, Abdullah AS, Halim A. Social autopsy for maternal and perinatal deaths in Bangladesh: a tool for community dialogue and decision making. Public health reviews. 2018 Dec;39(1):16.
  17. 17. Fottrell E, Byass P. Verbal Autopsy: Methods in Transition. Epidemiologic Reviews. 2010;32(1):38–55. pmid:20203105
  18. 18. Hanson C. Documentation for Data on Maternal Mortality-Historical information compiled for 14 countries (up to 200 years). Gapminder Documentation. 2010;10.
  19. 19. Nichols EK, Byass P, Chandramohan D, Clark SJ, Flaxman AD, Jakob R, et al. The WHO 2016 verbal autopsy instrument: An international standard suitable for automated analysis by InterVA, InSilicoVA, and Tariff 2.0. PLoS medicine. 2018 Jan 10;15(1): e1002486. pmid:29320495
  20. 20. Kalter HD, Salgado R, Babille M, Koffi AK, Black RE. Social autopsy for maternal and child deaths: a comprehensive literature review to examine the concept and the development of the method. Population health metrics. 2011 Dec;9(1):45. pmid:21819605
  21. 21. Nichols EK, Ragunanthan NW, Ragunanthan B, Gebrehiwet H, Kamara K. A systematic review of vital events tracking by community health agents. Global health action. 2019 Jan 1;12(1):1597452. pmid:31179875
  22. 22. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. International journal of social research methodology. 2005 Feb 1;8(1):19–32.
  23. 23. Munn Z, Tufanaru C, Aromataris E. JBI’s systematic reviews: data extraction and synthesis. AJN The American Journal of Nursing. 2014 Jul 1;114(7):49–54. pmid:25742352
  24. 24. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine. 2009 Aug 18;151(4):264–9. pmid:19622511
  25. 25. Dikid T, Gupta M, Kaur M, Goel S, Aggarwal AK, Caravotta J. Maternal and perinatal death inquiry and response project implementation review in India. The Journal of Obstetrics and Gynecology of India. 2013 Apr 1;63(2):101–7. pmid:24431614
  26. 26. Mir AM, Shaikh MS, Qomariyah SN, Rashida G, Khan M, Masood I. Using community informants to estimate maternal mortality in a rural district in Pakistan: a feasibility study. Journal of pregnancy. 2015;2015.
  27. 27. Mgawadere F, Unkels R, Adegoke A, van den Broek N. Measuring maternal mortality using a reproductive age mortality study (RAMOS). BMC pregnancy and childbirth. 2016 Dec;16(1):291. pmid:27687243
  28. 28. Mgawadere F, Unkels R, Kazembe A, van den Broek N. Factors associated with maternal mortality in Malawi: application of the three delays model. BMC pregnancy and childbirth. 2017 Dec;17(1):219. pmid:28697794
  29. 29. Singogo E, Kanike E, van Lettow M, Cataldo F, Zachariah R, Bissell K, et al. Village registers for vital registration in rural Malawi. Tropical medicine & international health. 2013 Aug;18(8):1021–4. pmid:23718633
  30. 30. Gadabu OJ, Manjomo RC, Mwakilama SG, Douglas GP, Harries AD, Moyo C, et al. An electronic register for vital registration in a rural village with no electricity in Malawi. Public health action. 2014 Sep 21;4(3):145–9. pmid:26400800
  31. 31. Bayley O, Chapota H, Kainja E, Phiri T, Gondwe C, King C, et al. Community-linked maternal death review (CLMDR) to measure and prevent maternal mortality: a pilot study in rural Malawi. BMJ Open. 2015;5(4): e007753. pmid:25897028
  32. 32. Adomako J, Asare GQ, Ofosu A, Iott BE, Anthony T, Momoh AS, et al. Community-based surveillance of maternal deaths in rural Ghana. Bulletin of the World Health Organization. 2016 Feb 1;94(2):86. pmid:26908958
  33. 33. Joos O, Amouzou A, Silva R, Banda B, Park L, Bryce J, et al. Strengthening community-based vital events reporting for real-time monitoring of under-five mortality: lessons learned from the Balaka and Salima Districts in Malawi. PLoS One. 2016 Jan 11;11(1): e0138406. pmid:26752726
  34. 34. Amouzou A, Banda B, Kachaka W, Joos O, Kanyuka M, Hill K, et al. Monitoring child mortality through community health worker reporting of births and deaths in Malawi: validation against a household mortality survey. PLoS One. 2014 Feb 18;9(2): e88939. pmid:24558453
  35. 35. Hutain J, Perry HB, Koffi AK, Christensen M, O’Connor EC, Jabbi SM, et al. Engaging communities in collecting and using results from verbal autopsies for child deaths: an example from urban slums in Freetown, Sierra Leone. Journal of global health. 2019 Jun;9(1). pmid:30842882
  36. 36. Munos MK, Koffi AK, Sangho H, Traoré MG, Diakité M, Silva R, et al. Strengthening community networks for vital event reporting: community-based reporting of vital events in rural Mali. PLoS One. 2015 Nov 25;10(11): e0132164. pmid:26605540
  37. 37. Halim A, Utz B, Biswas A, Rahman F, Van Den Broek N. Cause of and contributing factors to maternal deaths; a cross‐sectional study using verbal autopsy in four districts in Bangladesh. BJOG: An International Journal of Obstetrics & Gynaecology. 2014 Sep; 121:86–94.
  38. 38. Biswas A, Halim A, Rahman F, Doraiswamy S. Factors Associated with Maternal Deaths in a Hard-To-Reach Marginalized Rural Community of Bangladesh: A Cross-Sectional Study. International Journal of Environmental Research and Public Health. 2020 Jan;17(4):1184.
  39. 39. Willcox ML, Kumbakumba E, Diallo D, Mubangizi V, Kirabira P, Nakaggwa F, et al. Circumstances of child deaths in Mali and Uganda: a community-based confidential enquiry. The Lancet Global Health. 2018 Jun 30;6(6): e691–702. pmid:29773123
  40. 40. Moshabela M, Sene M, Nanne I, Tankoano Y, Schaefer J, Niang O, et al. Early detection of maternal deaths in Senegal through household-based death notification integrating verbal and social autopsy: a community-level case study. BMC health services research. 2015 Dec;15(1):16. pmid:25609079
  41. 41. Igumbor J, Adetokunboh O, Muller J, Bosire EN, Ajuwon A, Phetlhu R, et al. Engaging community health workers in maternal and infant death identification in Khayelitsha, South Africa: a pilot study. BMC Pregnancy Childbirth. 2020 Nov 26;20(1):736. pmid:33243207
  42. 42. Rai SK, Kant S, Srivastava R, Gupta P, Misra P, Pandav CS, et al. Causes of and contributors to infant mortality in a rural community of North India: evidence from verbal and social autopsy. BMJ open. 2017 Aug 1;7(8):e012856. pmid:28801384
  43. 43. Gouda HN, Flaxman AD, Brolan CE, Joshi R, Riley ID, AbouZahr C, et al. New challenges for verbal autopsy: Considering the ethical and social implications of verbal autopsy methods in routine health information systems. Social Science & Medicine. 2017 Jul 1; 184:65–74. pmid:28501755
  44. 44. Singh S, Murthy GV, Thippaiah A, Upadhyaya S, Krishna M, Shukla R, et al. Community based maternal death review: lessons learned from ten districts in Andhra Pradesh, India. Maternal and child health journal. 2015 Jul 1;19(7):1447–54. pmid:25636651
  45. 45. Roder-DeWan S, Gupta N, Kagabo DM, Habumugisha L, Nahimana E, Mugeni C, et al. Four delays of child mortality in Rwanda: a mixed-methods analysis of verbal social autopsies. BMJ Open. 2019 May 1;9(5):e027435. pmid:31133592
  46. 46. Kakoty SD, Ahmed M, Kalita D. Causes of neonatal death and associated health-seeking behaviour in Barpeta district, Assam, India: a community-based study. International Journal Of Community Medicine And Public Health. 2016 Dec 22;3(11):3102–5.
  47. 47. Gupta N, Hirschhorn LR, Rwabukwisi FC, Drobac P, Sayinzoga F, Mugeni C, et al. Causes of death and predictors of childhood mortality in Rwanda: a matched case-control study using verbal social autopsy. BMC public health. 2018 Dec;18(1):1378. pmid:30558586
  48. 48. Serina P, Riley I, Hernandez B, Flaxman AD, Praveen D, Tallo V, et al. What is the optimal recall period for verbal autopsies? Validation study based on repeat interviews in three populations. Population health metrics. 2016 Dec;14(1):40. pmid:27833459
  49. 49. Murray CJ, Lozano R, Flaxman AD, Serina P, Phillips D, Stewart A, et al. Using verbal autopsy to measure causes of death: the comparative performance of existing methods. BMC medicine. 2014 Dec;12(1):5 pmid:24405531
  50. 50. Nabukalu D, Ntaro M, Seviiri M, Reyes R, Wiens M, Sundararajan R, et al. Community health workers trained to conduct verbal autopsies provide better mortality measures than existing surveillance: Results from a cross-sectional study in rural western Uganda. PloS one. 2019 Feb 13;14(2): e0211482. pmid:30759139
  51. 51. Källander K, Counihan H, Cerveau T, Mbofana F. Barriers on the pathway to survival for children dying from treatable illnesses in Inhambane province, Mozambique. Journal of global health. 2019 Jun;9(1). pmid:31275569
  52. 52. Zaba B, Calvert C, Marston M, Isingo R, Nakiyingi-Miiro J, Lutalo T, et al. Effect of HIV infection on pregnancy-related mortality in sub-Saharan Africa: secondary analyses of pooled community-based data from the network for Analysing Longitudinal Population-based HIV/AIDS data on Africa (ALPHA). The Lancet. 2013 May 18;381(9879):1763–71.
  53. 53. Biswas A, Rahman F, Eriksson C, Halim A, Dalal K. Social Autopsy of maternal, neonatal deaths and stillbirths in rural Bangladesh: a qualitative exploration of its effect and community acceptance. BMJ Open. 2016b Aug 1;6(8): e010490.
  54. 54. O’Connor EC, Hutain J, Christensen M, Kamara MS, Conteh A, Sarriot E, et al. Piloting a participatory, community-based health information system for strengthening community-based health services: findings of a cluster-randomised controlled trial in the slums of Freetown, Sierra Leone. Journal of global health. 2019 Jun;9(1).
  55. 55. Biswas A, Rahman F, Eriksson C, Dalal K. Maternal and neonatal death review (MNDR): A useful approach in identifying appropriate and effective maternal and neonatal health initiative in Bangladesh. Health. 2014; 6:1669–79.
  56. 56. Negandhi PH, Neogi SB, Chopra S, Phogat A, Sahota R, Gupta R, et al. Improving reporting of infant deaths, maternal deaths and stillbirths in Haryana, India. Bulletin of the World Health Organization. 2016 May 1;94(5):370. pmid:27147767
  57. 57. Abebe B, Busza J, Hadush A, Usmael A, Zeleke AB, Sita S, et al. ‘We identify, discuss, act and promise to prevent similar deaths’: a qualitative study of Ethiopia’s Maternal Death Surveillance and Response system. BMJ Global health. 2017 Mar 1;2(2):e000199. pmid:28589016
  58. 58. Konopka S, Levine R. Eliminating maternal deaths in Malawi: Integration of MDSR into existing surveillance system. 2015. Available at https://www.who.int/maternal_child_adolescent/epidemiology/maternal-death-surveillance/case-studies/malawi/en/
  59. 59. Gilmartin C, Levine R. Eliminating maternal deaths in Burkina Faso: Integration of MDSR into the existing surveillance system. 2015. Available at https://www.who.int/maternal_child_adolescent/epidemiology/maternal-death-surveillance/case-studies/burkina-faso/en/
  60. 60. Serbanescu F, Binzen S, Morof D, Kaharuza F. Saving Mothers, Giving Life initiative: lessons learned from a maternal death surveillance and response system in Uganda. 2019. Available at https://www.who.int/maternal_child_adolescent/epidemiology/maternal-death-surveillance/case-studies/uganda/en/
  61. 61. Evidence for Action. Maternal death as a public health emergency: Integrating MDSR into existing surveillance in Ethiopia. 2015. Available at https://www.who.int/maternal_child_adolescent/epidemiology/maternal-death-surveillance/case-studies/ethiopia/en/
  62. 62. Biswas A. Social autopsy as an intervention tool in the community to prevent maternal and neonatal deaths: experiences from Bangladesh Social autopsy. MDSR Action Network. 2016c:6–8. Available at http://mdsr-action.net/case-studies/social-autopsy-as-an-intervention-tool-in-the-community-to-prevent-maternal-and-neonatal-deaths-experiences-from-bangladesh/
  63. 63. Mahmud R. Social autopsy triggers community response for averting maternal and neonatal death in Bangladesh. World Health Organisation. 2016:1–5. Available at https://www.who.int/maternal_child_adolescent/epidemiology/maternal-death-surveillance/case-studies/social-autopsy-bangladesh/en/
  64. 64. Prata N, Gerdts C, Gessessew A. An innovative approach to measuring maternal mortality at the community level in low-resource settings using mid-level providers: a feasibility study in Tigray, Ethiopia. Reproductive health matters. 2012 Jan 1;20(39):196–204. pmid:22789098
  65. 65. Siddiqui MB, Ng CW, Low WY. Methodologies of verbal autopsy and social autopsy tools adopted by VASA studies in exploring under-five mortality determinants. International Journal of Endorsing Health Science Research. 2018 May; 6(3):43–55.
  66. 66. Sankoh O, Byass P. Time for civil registration with verbal autopsy. The Lancet Global Health. 2014 Dec 1;2(12): e693–4. pmid:25433624
  67. 67. World Health Organization. Verbal autopsy standards: The 2012 WHO verbal autopsy instrument. Geneva: World Health Organization; 2012. Available at https://www.who.int/healthinfo/statistics/WHO_VA_2012_RC1_Instrument.pdf?ua=1
  68. 68. Curtis SL, Mswia RG, Weaver EH. Measuring maternal mortality: Three case studies using verbal autopsy with different platforms. PloS one. 2015 Aug 21;10(8): e0135062. pmid:26295160
  69. 69. Hussain-Alkhateeb L, Petzold M, Collinson M, Tollman S, Kahn K, Byass P. Effects of recall time on cause-of-death findings using verbal autopsy: empirical evidence from rural South Africa. Emerging themes in epidemiology. 2016 Dec;13(1):10. pmid:27777600
  70. 70. Engmann C, Ditekemena J, Jehan I, Garces A, Phiri M, Thorsten V, et al. Classifying perinatal mortality using verbal autopsy: is there a role for nonphysicians? Population health metrics. 2011 Dec;9(1):42.
  71. 71. Leitao J, Desai N, Aleksandrowicz L, Byass P, Miasnikof P, Tollman S, et al. Comparison of the physician-certified verbal autopsy with a computer-coded verbal autopsy for cause of death assignment in hospitalised patients in low-and middle-income countries: a systematic review. BMC medicine. 2014 Dec;12(1):22.
  72. 72. Mahmood S, Ayub M. Accuracy of primary health care statistics reported by community-based lady health workers in district Lahore. JPMA. The Journal of the Pakistan Medical Association. 2010 Aug 1;60(8):649. pmid:20726196
  73. 73. Kanjo C. Pragmatism or policy: Implications on health information systems success. The Electronic Journal of Information Systems in Developing Countries. 2011 Aug;48(1):1–20.
  74. 74. Damtew ZA, Kaasbøll J. Target setting procedures for immunisation services in Ethiopia: Discrepancies between plans and reality. Journal of Health Management. 2011 Mar;13(1):39–58.
  75. 75. Ngoma C, Igira F. Contradictions in collecting and recording maternal health data at the community level: A case study from two districts in Tanzania. Journal of Health Informatics in Developing Countries. 2012 Nov 21;6(2).
  76. 76. Mitsunaga T, Hedt-Gauthier BL, Ngizwenayo E, Farmer DB, Gaju E, Drobac P, et al. Data for program management: an accuracy assessment of data collected in household registers by community health workers in Southern Kayonza, Rwanda. Journal of community health. 2015 Aug 1;40(4):625–32. pmid:25502593
  77. 77. Shikha B, Harsh S, Narayan G. Infant deaths’ audit: Contextual factors contributing to Infant deaths in tribal district-Valsad, Gujarat (India). Journal of Research in Medical and Dental Science. 2015 Jul 1;3(3):171.
  78. 78. Naik SS, Mohakud NK, Mishra A, Das M. Quality assessment of maternal death review: A pilot study in 10 high priority districts of Odisha State, India. Indian Journal of Community Medicine. 2020 Apr 1;45(2):184. pmid:32905101
  79. 79. Keenan JD, Arzika AM, Maliki R, Adamou SE, Ibrahim F, Kiemago M, et al. Cause-specific mortality of children younger than 5 years in communities receiving biannual mass azithromycin treatment in Niger: verbal autopsy results from a cluster-randomised controlled trial. The Lancet Global Health. 2020 Feb 1;8(2):e288–95. pmid:31981558