Figures
Abstract
Background
An estimated 32 million women and girls of reproductive age living in emergency situations, all of whom require sexual and reproductive health (SRH) information and services. This systematic review assessed the effect of SRH interventions, including the Minimum Initial Service Package (MISP) on a range of health outcomes from the onset of emergencies.
Methods and findings
We searched EMBASE, Global Health, MEDLINE and PsychINFO databases from January 1, 1980 to April 10, 2017. This review was registered with the PROSPERO database with identifier number CRD42017082102. We found 29 studies meet the inclusion criteria. We found high quality evidence to support the effectiveness of specific SRH interventions, such as home visits and peer-led educational and counselling, training of lower-level health care providers, community health workers (CHWs) to promote SRH services, a three-tiered network of health workers providing reproductive and maternal health services, integration of HIV and SRH services, and men’s discussion groups for reducing intimate partner violence. We found moderate quality evidence to support transport-based referral systems, community-based SRH education, CHW delivery of injectable contraceptives, wider literacy programmes, and birth preparedness interventions. No studies reported interventions related to fistulae, and only one study focused on abortion services.
Conclusions
Despite increased attention to SRH in humanitarian crises, the sector has made little progress in advancing the evidence base for the effectiveness of SRH interventions, including the MISP, in crisis settings. A greater quantity and quality of more timely research is needed to ascertain the effectiveness of delivering SRH interventions in a variety of humanitarian crises.
Citation: Singh NS, Smith J, Aryasinghe S, Khosla R, Say L, Blanchet K (2018) Evaluating the effectiveness of sexual and reproductive health services during humanitarian crises: A systematic review. PLoS ONE 13(7): e0199300. https://doi.org/10.1371/journal.pone.0199300
Editor: Ines Keygnaert, Ghent University, BELGIUM
Received: January 3, 2018; Accepted: June 5, 2018; Published: July 6, 2018
Copyright: © 2018 Singh et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are available in Table 2 included within the paper. Additionally, all included papers in the systematic review are available on the websites of the journals in which they were published.
Funding: This work was funded with support from the Department of Reproductive Health & Research, World Health Organization (to Karl Blanchet). The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The World Health Organisation defines health emergencies as sudden-onset events from naturally occurring or man-made hazards, or gradually deteriorating situations through which the risk to public health steadily increases over time.[1] It is estimated that 1 billion, or about 14% of the world’s population, live in areas affected by conflict.[2] According to the United Nations High Commissioner for Refugees, the number of forcibly displaced people has nearly doubled in the past two decades (from 33.9 million in 1997 to 65.6 million in 2016), with numbers remaining at a record high.[3] Given the changing nature of conflict and protracted crises, the average time spent in displacement has now reached 20 years.[3] The United Nations Population Fund estimates that of the more than 100 million people in need of humanitarian assistance in 2015, 32 million were women and girls aged 15–49 years.[4]
Women and girls are disproportionately affected in both sudden and protracted emergencies,[5] and face multiple sexual and reproductive health (SRH) challenges in conflict and post-conflict settings.[6] Inadequate or interrupted access to SRH services can also increase the number of people affected, generating a high risk of: mortality or morbidity due to pregnancy-related causes; unintended or unwanted pregnancies due to lack of information or access to contraceptive services; complications related to unsafe abortions; sexual and gender-based violence (SGBV); and an increased incidence of sexually transmitted infections (STIs), including HIV.[7, 8] These challenges limit women’s empowerment and their participation in the recovery process, resulting in violations of their human rights, and a reduction in the resources available to alleviate suffering and to be directed towards the process of recovery. Furthermore, there is an economic case for investing in SRH services in humanitarian crises settings, which face financial and other constraints, as it is estimated that for each additional $1 US dollar spent on contraceptive services above the current level of funding in crisis settings, the cost of maternal and newborn health-related care would be reduced by $2.22.[4]
Over the past two decades, there has been increased attention to SRH in populations in humanitarian settings. In 1994, the importance of refugees’ rights to SRH were articulated and globally agreed in Chapter X of the proceedings of the International Conference on Population and Development in Cairo.[9] In 1995, the growing awareness of, and commitment to, addressing emergency SRH needs culminated in the formation of the Inter-Agency Working Group (IAWG) on Reproductive Health in Crises, tasked with promoting access to quality SRH care among women and other vulnerable populations impacted by humanitarian crises.[10] In 1999, the IAWG developed a field manual to provide guidance to field staff on reproductive health interventions in emergencies, and included a chapter on the Minimum Initial Service Package (MISP), to be implemented within 48 hours of the onset of every humanitarian crisis. The MISP aims to facilitate the coordination of SRH services, prevent and manage the consequences of sexual violence, reduce HIV transmission, minimise maternal and neonatal morbidity and mortality, and plan for comprehensive SRH services in the post-crisis phase.
Despite increasing attention to SRH in humanitarian settings, recent evaluations of the MISP have been mixed.[11, 12] A systematic review in 2015 [13] found no peer-reviewed papers that evaluated MISP implementation comprehensively since the first global evaluation in 2004, which identified a low awareness among health actors, and no systematic implementation of the MISP.[14] The literature is even sparser for studies assessing the effectiveness of SRH interventions including the MISP in humanitarian crises.[13, 15, 16] The only systematic review conducted to date to assess the effectiveness of SRH interventions in humanitarian settings reported a low quantity and quality of evidence, but notably did not comprehensively search for studies focusing on abortion, or aim to disaggregate data by vulnerable sub-populations, e.g. adolescents.[15]
To build upon progress made and to address evidence gaps, we aimed to consolidate the existing evidence base for the effectiveness of SRH interventions including the MISP from the onset of emergencies by conducting a broader systematic review. Our systematic review aimed to assess the effect of SRH interventions including the MISP and its components reported in the peer-reviewed literature between 1980 and 2017 on a range of health outcomes from the onset of emergencies. As part of this objective, we also aimed to assess issues related to targeting of SRH interventions including the MISP, e.g. whether they are delivered to vulnerable populations such as those with disabilities, sex workers, adolescent girls, and lesbian, gay, transsexual, queer and intersex (LGBTQI) populations.
Methods
This systematic literature review adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (S1 Appendix).[17] The review was registered with the PROSPERO database with identifier number CRD42017082102. The inclusion and exclusion criteria are detailed in Table 1.
Search strategy and selection criteria
Search terms for SRH were based on the definition of SRH from the International Conference on Population and Development in 1994 [9] and from the World Health Organisation’s SRH strategies and guidance in 2010 [18] and 2017 [19]. SRH refers to a state of physical, emotional, mental and social well-being in relation to sexuality and reproductive health; it is not merely the absence of disease, dysfunction or infirmity. [4, 18] International guidelines on SRH in conflict-affected settings include activities related to family planning, abortion, HIV/AIDS and STIs including PMTCT, maternal and newborn health, and SGBV.[20]
We defined a humanitarian crisis as a serious disruption of the functioning of a community or a society causing widespread human, material, economic or environmental losses that exceed the ability of the affected community or society to cope using its own resources, necessitating a request to the national or international level for external assistance. The crisis situation may either be man-made (e.g. armed conflict) or a natural phenomenon (e.g. drought). Only studies from low-income or middle-income countries were included in this study, as the majority of humanitarian crises occur in these countries, and the resources and strategies available to address them are very different in high-income countries.
A detailed protocol with specific search terms are provided in S2 Appendix, and were generated by the authors and then supplemented by searching for other search strategies used in previous systematic reviews on similar topics.[21, 22] We also consulted a trained information science and Cochrane review specialist at the London School of Hygiene and Tropical Medicine to review our literature searching syntax and strategy.
We included studies from peer-reviewed journals across the following four databases: EMBASE, Global Health, MEDLINE and PsychINFO. We complemented searches by screening the reference lists of papers for potentially relevant studies, as well as reference lists of relevant systematic reviews. We also consulted experts on SRH service delivery and research to identify additional research not identified during our systematic search (see Acknowledgments section for list of experts). Selection criteria for literature are detailed in Table 1.
Data analysis
We downloaded all returned citations from the searched databases into an Endnote library and applied a standard data-screening process (Fig 1). We based the primary and secondary outcomes of interest for inclusion from the IAWG field manual,14 as it is an established and widely used manual for SRH in crisis-affected settings, and was selected based on discussion with the SRH expert committee. Inclusion and exclusion criteria applied during screening are outlined in Table 1. Data from the final selected studies were then extracted into a Microsoft Excel database, with data extraction fields including study author and year, setting, crisis type, crisis stage, study design and methods, research setting, health outcomes and intervention descriptions. First round data screening and extraction were independently conducted by NSS, JS and SA. Second round detailed data extraction was conducted independently and in duplicate by NSS and JS.
We used a narrative synthesis approach due to the heterogeneity of study outcomes, interventions and methods. Findings were synthesised by main SRH outcomes including those included in an earlier systematic review by Warren et al. on SRH interventions in humanitarian settings [15] i.e. family planning; abortion; prevention, treatment, and care for STIs including HIV/AIDS; maternal, newborn and child health, including obstetric care; SGBV; and studies with cross-cutting SRH themes. These themes were developed iteratively after thematic analysis of the studies’ stated aims and primary reported health outcome of interest.
The quality of reporting in the included studies were assessed using the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) and Consolidated Standards of Reporting Trials (CONSORT) checklists,[23, 24] which are commonly used for reporting the quality of observational studies and randomised controlled trials. Both checklists include measures regarding the reporting of participant selection, sample sizes, variables, data sources, bias, descriptive and outcome data, interpretation, and generalisability, among others. In order to further explore the quality of reporting, we awarded papers one point for reporting each of the items on the relevant checklist. When totalled, these points formed the numerator of a proportional score, with the denominator the total number of possible relevant checklist items which varied slightly by study type, i.e. 22 total points for the STROBE checklist, and 25 total points for the CONSORT checklist. NSS, JS and SA conducted quality assessment, who each independently evaluated the quality of all included studies and discussed each discrepancy until consensus was reached. For this systematic review, the study team determined a priori that papers with a score of <33% were considered low reporting quality, moderate quality if 34–66%, and high quality if >67%. These quality thresholds have been used in a previous systematic review on SRH in humanitarian crises settings.[22]
Results
A total of 14,510 citations were returned from peer-reviewed databases, with one additional study provided by expert recommendation (Fig 1). Following full screening, the review of reference lists, and a review of two existing systematic reviews on similar topics, [13, 15] a total of 29 studies met the inclusion criteria (Table 2).
Of the 29 included studies, 23 (79.3%) were published during the last decade between January 2007 and March 2017. In relation to the geographical distribution of the studies, 17 studies (58.6%) were conducted in Africa, a further nine studies (31.0%) in Asia, one study was conducted in Haiti (3.4%) while the remaining two studies (6.9%) both comprised sites in multiple countries. In relation to the typology of humanitarian crisis, 24 studies (82.8%) were conducted in areas affected by armed conflict, and the two multi-site studies (6.9%) were conducted in areas affected by both armed conflict and natural disasters. The remaining three studies (10.3%) were conducted in areas affected by a natural disaster: the first study focused on the 2005 earthquake in northern Pakistan; the second study focused on the 2013 Typhoon Haiyan in the Philippines; and the third study was conducted in the aftermath of the 2010 earthquake in Haiti.
Of the included studies, over a third (34.5%, n = 10) examined the effectiveness of interventions relating to pregnancy and maternal and newborn health (MNH). Six studies (20.7%) assessed family planning interventions, while a further five studies (17.2%) assessed interventions addressing either HIV or STIs. Three studies (10.3%) examined interventions related to SGBV, while only one study (3.4%) focused on the prevention of mother-to-child transmission of HIV (PMTCT). The remaining four studies (13.8%) assessed a number of cross-cutting SRH domains, of which three studies (10.3%) focused on both family planning and MNH interventions, and one study (3.4%) addressed family planning and abortion care. Notably, no studies addressed interventions aimed at responding to, or the prevention of, vaginal injuries and fistulae.
Study quality
All 29 studies were assessed for quality of reporting using the STROBE checklist. The majority of the observational studies (72.4%, n = 21) were found to be of high quality,[25–44] and the remaining eight studies (27.6%) were of moderate quality.[45–51]
There were common areas in which the included studies in this review provided low quality reporting. All moderate quality quantitative studies stated changes in health outcomes, but statistical associations between the intervention and the outcome were inconsistently reported, i.e. most studies did not report differences between SRH interventions and outcomes. Second, it was also not clear whether relevant confounders and biases were considered during the design of the study and analysis of the data.
Family planning
We identified six studies related to family planning. Along with other SRH outcomes, all six studies assessed contraceptive use in their respective contexts. One paper assessed a refugee-led reproductive health group operating across 48 Guinean refugee camps that recruited refugee nurses and midwives to local health facilities, trained lay women to provide health education and contraception, and to facilitate referrals. Individuals who reported the reproductive health group facilitators as their primary source of information were more likely to be current users of contraception (aOR = 1.3, 95% CI 0.7, 4.2, non-significant).[25] A home-based counselling and awareness programme for internally displaced women in Sudan led to an increase in the use of modern family planning methods (aOR 2.8, 95% CI 2.0, 4.1).[27] A programme of mobile outreach and public health strengthening in Uganda led to an increase in the number of women who reported ever using a family planning method (aOR 2.23, 95% CI 1.7, 2.92, P<0.001), and a reduction in the unmet need for family planning from 52.1% to 35.7% (aOR 0.47, 95% CI 0.37, 0.6, P<0.001).[26] A study in Pakistan providing subsidised healthcare to refugees reported use of contraceptives in the subsidised group (54%) was more than double the use reported in the non-subsidised group (25%), (P<0.001), and reported that the non-subsidised group was more likely to use the oral contraceptive pill (40.7%), whereas the subsidised group was more likely to have tubal ligation (36.7%) (p<0.001).[52] A multi-country study involving sites in Chad, the Democratic Republic of the Congo, Djibouti, Mali, and Pakistan assessed the impact of a CARE programme that included staff training, supervision in health facilities, the supply of contraceptives, community mobilisation, and awareness raising. An absolute number of 52,616 new users of modern methods of contraception were reported, of which an average of 61% of users across all sites opted for long-acting reversible contraception.[46] A study in rural Afghanistan assessed the impact of health education and the delivery of injectable contraceptives by community health workers. Over an eight-month period between 2005 and 2006, contraceptive use increased by 24–27% across three sites.[45]
Pregnancy & maternal and newborn health
We included ten studies reporting on pregnancy or maternal and newborn health-related outcomes. A cross-sectional study amongst internally-displaced women in Darfur, Sudan assessed the impact of a maternal health education programme delivered in the form of home visits. Receiving maternal health education at home was associated with a 43% reduction in the odds of giving birth at home as compared to in a healthcare facility (aOR 0.57, 95% CI: 0.35, 0.93).[34] Another study amongst internally-displaced women in Darfur found that following the implementation of an interpersonal and mass education campaign, women were more likely to deliver at a healthcare facility (OR 5.4, 95% CI: 4.0, 7.4, P<0.001).[35] Two studies assessed the effect of referral systems on access to hospital-based care. Following the implementation of an ambulance-based referral system and improved hospital telecommunications in Yirol, South Sudan, the authors reported that 99.1% of the estimated number of women with absolute obstetric indications were treated at the hospital.[51] A second study examined the impact of a hospital-based vehicle, motorbikes at satellite primary healthcare centres, along with community education activities and facility improvements, on service utilisation and case fatality rates in Bo, Sierra Leone during the period 1992–1993. Service utilisation more than doubled in the period following initiation of the transport system. The case fatality rate declined from 20% to 10% in the post-intervention period. However, there was no significant difference in outcomes between those who were referred using a hospital vehicle and those who used other means to reach the hospital.[48]
In the Philippines, following Typhoon Haiyan, training of trainers and quality assurance workshops were held, with subsequent improvements in 24-hour access to skilled birth attendants from 84% to 96% at three months (p<0.05).[36] An evaluation of a programme in West Darfur, Sudan implemented by Medair, including primary healthcare service provision, health promotion activities, and the training of midwives, reported an increase in skilled birth attendance from 35.7% to 52.7% (p = 0.025).[37] The implementation of a community-based safe motherhood programme in Kabul Province, Afghanistan, delivered by a cadre of newly trained community midwives, reported an increase in the proportion of women receiving antenatal care from 37.3% in 2004 to 91.2% in 2006 (p<0.01), and an increase in the proportion of women delivering at a healthcare facility from 31.3% to 55.2% (p<0.01).[33]
An evaluation of an International Rescue Committee (IRC) programme, which aimed to reduce maternal mortality among Afghan refugees in Pakistan by establishing emergency obstetric care centres, training community members on safe motherhood, and linking primary care with pregnancy-related education, reported a reduction in the maternal mortality ratio from 291 to 102 per 100000 live births between the first and fifth years of the programme. A reduction in the neonatal mortality rate from 25 to 20.7 per 1000 live births was also reported during the same period, while the proportion of births registered in an emergency obstetric care facility increased from 4.8% in 1996 to 67.2% in 2007.[49] A study conducted by Save the Children evaluated a birth preparedness package programme implemented in eastern Nepal between 2003 and 2004. The programme involved an educational component delivered by community healthcare workers, and preparation in advance of delivery to optimise maternal and newborn health outcomes. Along with improvements in essential newborn practices, the proportion of women reporting one or more antenatal care visit increased from 60% to 84% (p<0.001), and use of postnatal care within six weeks of delivery increased from 45% to 72% (p<0.001). Changes in the use of a skilled birth attendant were not statistically significant.[32]
Another study conducted in the Maela refugee camp on the Thai-Myanmar border assessed the effect of a special care baby unit on neonatal and cause-specific mortality rates. Between 2008 and 2011, the neonatal mortality rate declined from 21.8 to 10.7 deaths per 1000 live births (p = 0.03), while cause-specific mortality also fell in relation to the four main causes of neonatal death: prematurity, early onset neonatal sepsis, congenital abnormalities, and jaundice.[50]
HIV and STIs
A study conducted by Médecins Sans Frontières (MSF) in the conflict-affected region of Bukavu, eastern Democratic Republic of the Congo, reported a median weight gain of 2.5kg and a CD4 gain of 163 cells/ml at 6-months for patients initiated on generic, fixed dose anti-retroviral treatment.[47] A second study on 24 MSF programmes in 12 countries reported a median 12-month survival of 0.89 (95% CI: 0.88, 0.91) and a median 6-month CD4 gain of 129 cells/mm3 following the integration of HIV care and treatment programmes with other medical activities.[30]
A third non-randomised cohort study amongst internally displaced women in Haiti reported an increase in condom use (AOR 4.05, 95% CI: 1.86, 8.83, p<0.001) following implementation of a peer health worker-led intervention involving a video-based session on HIV and STIs, followed by a six-week psycho-educational programme.[31] A pre-post study of an HIV/AIDS and STI prevention project, including outreach and education activities, in Sierra Leone identified an increase from 38% condom use at last sexual encounter to 68% amongst commercial sex workers, and from 39% to 68% amongst those who identified as members of the military forces.[28] Following the roll-out of HIV prevention education activities in an urban setting in Sierra Leone amongst adolescents aged 15 to 24 years, contraceptive use increased from 16% to 46% amongst female adolescents, and from 16% to 37% amongst male adolescents (p < .01) [29].
PMTCT
One study examined the effectiveness of a comprehensive PMTCT programme in conflict-affected northern Uganda. Over the course of a ten-year period, the proportion of HIV-positive women delivering in a health facility increased from 56% to 81% (p = 0.033).[44]
Sexual and gender-based violence
Three studies, all of which were randomised controlled trials, reported SGBV outcomes. A trial in the Ivory Coast compared the impact of participation in a gender dialogue group and an economic empowerment programme, versus participation only in the economic empowerment programme. Women participating in both the gender dialogue group and the economic empowerment programme were less likely to report economic abuse (OR 0.39, 95% CI 0.25, 0.6, p<0.0001), and were less likely to be accepting of the justification given for violent acts (β = -0.97, 95% CI -1.67, -0.28, p = 0.006).[38] A second randomised-controlled trial conducted in the Ivory Coast examined the effect of a sixteen-week intimate partner violence prevention programme. Men who received the intervention reported a decreased intention to use physical intimate partner violence (aRR 0.83, 95% CI 0.66, 1.06). Men in the intervention arm reported a greater ability to control their hostility and manage conflict (aRR 1.3, 95% CI 1.06, 1.58). A non-statistically significant difference was identified in reported levels of physical and/or sexual intimate partner violence (aRR 0.52, 95% CI 0.18, 1.51).[39]
A third randomised controlled trial conducted in the Democratic Republic of the Congo compared the impact of either cognitive processing therapy (comprising one individual session and 11 group sessions), or individual support for female survivors of sexual violence with high levels of post-traumatic stress and combined depression and anxiety symptoms. Both the individual support and group therapy arms reported a statistically significant improvement in all checklist scores (HSCL-25 score, PSTD checklist, and the functional-impairment score) at the end of the intervention, which was sustained at six months post-intervention (p<0.001).[40]
Interventions targeting outcomes across multiple SRH domains
Four studies reported on outcomes that spanned both family planning and pregnancy and maternal and neonatal health outcomes. A three-tiered community-based intervention in Myanmar employed traditional birth attendants to provide antenatal services and assist with deliveries, while health workers provided antenatal care and family planning supplies, and maternal health workers oversaw the aforementioned activities and attended both normal and complicated deliveries. Use of a modern method of contraception increased from 23.9% to 45.0% (prevalence rate ratio (PRR) 1.88, 95% CI 1.63, 2.17). Unmet family planning needs dropped from 61.7% to 40.5% (PRR 0.65, 95% CI 0.60, 0.72), while birth attendance by someone trained in emergency obstetric care increased from 5.1% to 48.7% (PRR 9.55, 95% CI 7.21, 12.64).[42] A cross-sectional study reviewed the possible impact of a reproductive health literacy programme amongst refugee women in Guinea. Half of the survey respondents (50%) reported current use of modern contraceptives, while 24% reported using a condom the last time they had sex, of which both findings were interpreted by study authors as an increase since implementation of the reproductive health literacy programme. The study found that 92% of women who reported becoming pregnant since the implementation of the reproductive health literacy programme reported attending at least three antenatal visits.[41]
In another study evaluating the effectiveness of an emergency obstetric care (EmOC) intervention, a trained physician was posted to a district general hospital in Makeni, Sierra Leone. Additional training was conducted, an unused operating theatre was operationalised, and a generator and blood bank were installed. The proportion of women accessing the hospital increased from 31 in 1990 to 98 in 1995, with a reduction in the case fatality rate from 32% to 5%. Notably, 444 induced abortion-related procedures were performed, compared with only 22 in 1990.[53]
Following the 2005 earthquake in Pakistan, a four-year project was initiated by USAID with the aim of improving the management capacity of district health authorities, improving access to primary healthcare services, increasing community participation in service management, and improving household-level knowledge and health-seeking behaviour. The study found non-statistically significant increases in the use of modern contraceptives (18% to 22%), at least one antenatal care visit (70.3% to 73.6%), and presence of a skilled birth attendant (36% to 38%). The study also found a statistically significant increase from 25% to 33.3% (p<0.01) in women receiving postnatal care.[43]
Discussion
This review identified 29 studies assessing the effectiveness of SRH interventions in humanitarian crises published between 1980 and 2017. We found high quality evidence for specific interventions appearing to have improved SRH outcomes, including home visits and peer-led educational and counselling, training of lower-level health care providers, the use of CHWs to promote SRH services, a three-tiered network of health workers providing SRH services, the integration of HIV and SRH services, and men’s discussion groups to address intimate partner violence. We found moderate quality evidence to support transport-based referral systems, community-based SRH education, CHW delivery of injectable contraceptives, wider literacy programmes, and birth preparedness interventions. We identified no studies focusing on adolescents, LGBTQ populations or people with disabilities. Additionally, no studies measured the effectiveness of interventions addressing the comprehensive clinical management of rape, or the response to, or prevention of, vaginal injuries and fistulae.
The quality of studies included in the review was variable. Three quarter of the studies (72.4%, n = 21) used either experimental designs, i.e. randomised controlled trials, or quasi-experimental study designs, which provided some statistical measure of difference between intervention and outcome. However, where appropriate, there was often insufficient adjustment for potential confounders Evidence of attribution was particularly weak, with the vast majority of studies using cross-sectional and pre-post study designs with no control.
Although the majority of studies (72.4%, n = 21) were graded as high quality, the application of the STROBE checklist revealed a number of commonly recurring methodological weaknesses. Blinding was rarely used, including in the randomised controlled trials, which risks reporting bias of health outcomes. There was a lack of controlled studies, limited appreciation of clear exposures and confounders, absence of reporting on sampling methods, and an inadequate handling of bias. However, it is recognised that for a number of SRH interventions and in certain humanitarian contexts, blinding or use of control groups is not possible or appropriate. There was also limited use of stratification, for example by gender or age, and so potentially differing health outcomes in more vulnerable groups is missing.
We recognise that there are many logistical and ethical challenges related to SRH research in humanitarian crises. However, the more developed evidence base for other health outcomes in similar crises settings, e.g. mental health and communicable diseases,[16] signals that conducting more rigorous research in humanitarian contexts is possible. Given the lack of longitudinal data or studies with an adequate control comparison group, innovative ways of collecting data, e.g. using information and communication technologies (ICT) widely used by many conflict-affected populations such as WhatsApp, should be tested. These data collection methods may prove beneficial for researchers, healthcare providers, and organisations seeking to collect health outcome data at the individual-level, and from populations on the move who have traditionally been challenging to follow up. There is also a need for innovation in establishing stronger referral and follow-up systems in crisis settings to ensure health outcomes used to assess effectiveness are as close to its true effectiveness as possible. Researchers should also consider use of alternative study designs where standard RCTs are not operationally or ethically possible. Adjusted approaches such as stepped wedge trial designs could be used more widely in order to establish a counterfactual through the use of a control group, while remaining operationally and ethically acceptable. Additionally, no studies reported measuring outcomes beyond the study period, signalling the need to have data on longer-term effects of SRH interventions on target populations affected by humanitarian crises. Despite a well-established SRH evidence base in stable settings, further robust research is needed to determine effective and cost-effective interventions to improve SRH outcomes in populations in crisis settings.
This systematic review had a number of limitations. Caution must be exercised in generalising our study’s findings, as the specific contexts, and enabling and restrictive factors to intervention delivery and effectiveness, varied widely between studies. Although we based search terms and developed inclusion criteria to best address our research aim, our search may have missed identifying additional papers from relevant SRH domains. We also did not conduct a search for grey literature. Our strict study design criteria also excluded qualitative studies, which form a key component of the literature in this field. However, we only included quantitative studies demonstrating quantitative change over time with the aim of extracting a certain type of evidence to inform our findings on the effectiveness of SRH interventions in crisis settings. Additionally, only papers written in English and French were included. We applied a narrative synthesis approach to the findings, as we were unable to conduct a meta-analysis due to the heterogeneous nature of intervention types, indicators and methods used in the included studies. We used the STROBE checklist to assess the quality of reporting in studies, but a more specialised quality assessment tool such as the Newcastle Ottawa Scale or Cochrane Collaboration's tool for assessing risk of bias would have provided a more robust review of quality.[54]
This systematic review found high quality evidence to support improved SRH outcomes through home visits and peer-led educational and counselling, training of lower-level health care providers, CHWs to promote SRH services, a three-tiered network of health workers providing SRH services, the integration of HIV and SRH services, and men’s discussion groups for the reduction of intimate partner violence. However, the types of study design including many studies with no control group, the limited use of statistical data, and the variable quality of studies, signal that caution must be exercised in the interpretation of these results. There is a need for a higher quantity and quality of more timely research on the effectiveness of SRH interventions in humanitarian crises, in particular focusing on outcomes amongst adolescents, and studies that focus on safe abortion care, post-abortion care, vaginal injury and fistulae, the prevention of SGBV, and the comprehensive clinical management of rape.
Acknowledgments
We thank Maria Rodriguez, Loulou Kobeissi, Adam Poulter, Robyn Drysdale, Rajrattan Rokhande and Sara Nam for reviewing the study protocol. The authors alone are responsible for the views expressed in this manuscript and they do not represent the views, decisions or policies of the institutions with which they are affiliated.
References
- 1.
World Health Organization. Emergency Response Framework 2014 [5 December 2017]. Available from: http://apps.who.int/iris/bitstream/10665/89529/1/9789241504973_eng.pdf?ua=1.
- 2.
State of world population New York: United Nations Population Fund; 2015 [14 November]. Available from: http://www.unfpa.org/sites/default/files/sowp/downloads/State_of_World_Population_2015_EN.pdf.
- 3. Singh NS, Huicho L, Afnan-Holmes H, John T, Moran AC, Colbourn T, et al. Countdown to 2015 country case studies: systematic tools to address the "black box" of health systems and policy assessment. BMC Public Health. 2016;16 Suppl 2:790. pmid:27634035; PubMed Central PMCID: PMCPMC5025822.
- 4.
Adding It Up: The Costs and Benefits of Investing in Sexual and Reproductive Health: Guttmacher Institute; 2017 [14 November]. Available from: https://www.guttmacher.org/fact-sheet/adding-it-up-contraception-mnh-2017.
- 5. Peterson K. From the field: gender issues in disaster response and recovery. Nat Hazards Obs. 1997;21:3–4.
- 6.
United Nations. Report of the Secretary-General on women and peace and security New York: United Nations; 2014 [21 November 2018]. Available from: http://www.un.org/ga/search/view_doc.asp?symbol=S/2014/693.
- 7. Glasier A, Gulmezoglu AM, Schmid GP, Moreno CG, Van Look PF. Sexual and reproductive health: a matter of life and death. Lancet. 2006;368(9547):1595–607. pmid:17084760.
- 8. Austin J, Guy S, Lee-Jones L, McGinn T, Schlecht J. Reproductive health: a right for refugees and internally displaced persons. Reprod Health Matters. 2008;16(31):10–21. pmid:18513603.
- 9.
Report of the International Conference on Population and Development. International Conference on Population and Development; New York: United Nations 1994.
- 10. Schreck L. Turning point: A special report on the refugee reproductive health field. International Family Planning Perspectives. 2000;26(4):162–6.
- 11. Casey SE, Chynoweth SK, Cornier N, Gallagher MC, Wheeler EE. Progress and gaps in reproductive health services in three humanitarian settings: mixed-methods case studies. (Special Issue: Taking stock of reproductive health in humanitarian settings: 2012–2014 Inter-agency Working Group on Reproductive Health in Crises' global review.). Conflict and Health. 2015;9(Suppl. 1). pmid:20153139018.
- 12. Onyango MA, Hixson BL, McNally S. Minimum Initial Service Package (MISP) for reproductive health during emergencies: time for a new paradigm? Global Public Health. 2013;8(3):342–56. https://dx.doi.org/10.1080/17441692.2013.765024. pmid:23394618.
- 13. Casey SE. Evaluations of reproductive health programs in humanitarian settings: a systematic review. Confl Health. 2015;9(1):S1. pmid:25685183; PubMed Central PMCID: PMCPMC4328944.
- 14.
United Nations High Commissioner for Refugees. Reproductive Health Services for Refugees and Internally Displaced Persons: Report of an Inter-agency Global Evaluation. 2004.
- 15. Warren E, Post N, Hossain M, Blanchet K, Roberts B. Systematic review of the evidence on the effectiveness of sexual and reproductive health interventions in humanitarian crises. BMJ Open. 2015;5(12). https://doi.org/10.1136/bmjopen-2015-008226. pmid:20163058134.
- 16. Blanchet K, Ramesh A, Frison S, Warren E, Hossain M, Smith J, et al. Evidence on public health interventions in humanitarian crises. Lancet. 2017;390(10109):2287–96. pmid:28602563.
- 17. Moher D, Liberati A, Tetzlaff J, Altman D. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS medicine. 2009;6 (7).
- 18.
World Health O. Measuring sexual health: Conceptual and practical considerations and related indicators. 2010.
- 19.
World Health O. Sexual health and its linkages to reproductive health: an operational approach. Sexual health and its linkages to reproductive health: an operational approach2017.
- 20. Lisam S. Minimum initial service package (MISP) for sexual and reproductive health in disasters. Journal of Evidence-Based Medicine. 2014;7(4):245–8. https://doi.org/10.1111/jebm.12130. pmid:25586453.
- 21. Nyamtema AS, Urassa DP, van Roosmalen J. Maternal health interventions in resource limited countries: a systematic review of packages, impacts and factors for change. BMC pregnancy and childbirth. 2011;11:30. pmid:21496315; PubMed Central PMCID: PMCPMC3090370.
- 22. Warren E, Post N, Hossain M, Blanchet K, Roberts B. Systematic review of the evidence on the effectiveness of sexual and reproductive health interventions in humanitarian crises. BMJ Open. 2015;5(12):e008226. pmid:26685020; PubMed Central PMCID: PMCPMC4691726.
- 23. Knottnerus A, Tugwell P. STROBE—a checklist to Strengthen the Reporting of Observational Studies in Epidemiology. J Clin Epidemiol. 2008;61(4):323. pmid:18313555
- 24. Altman DG. Better reporting of randomised controlled trials: the CONSORT statement. BMJ. 1996;313(7057):570–1. pmid:8806240; PubMed Central PMCID: PMCPMC2352018.
- 25. Howard N, Kollie S, Souare Y, von Roenne A, Blankhart D, Newey C, et al. Reproductive health services for refugees by refugees in Guinea I: family planning. Confl Health. 2008;2:12. pmid:18925936; PubMed Central PMCID: PMCPMC2579911.
- 26. Casey SE, McNab SE, Tanton C, Odong J, Testa AC, Lee-Jones L. Availability of long-acting and permanent family-planning methods leads to increase in use in conflict-affected northern Uganda: Evidence from cross-sectional baseline and endline cluster surveys. [References]. Global Public Health: An International Journal for Research, Policy and Practice. 2013;8(3):284–97. https://doi.org/10.1080/17441692.2012.758302.
- 27. Adam IF. Evidence from cluster surveys on the association between home-based counseling and use of family planning in conflict-affected Darfur. International Journal of Gynecology & Obstetrics. 2016;133(2):221–5. https://doi.org/10.1016/j.ijgo.2015.09.023. pmid:20163170757.
- 28. Larsen MM, Sartie MT, Musa T, Casey SE, Tommy J, Saldinger M. Changes in HIV/AIDS/STI knowledge, attitudes and practices among commercial sex workers and military forces in Port Loko, Sierra Leone. Disasters. 2004;28(3):239–54. https://doi.org/10.1111/j.0361-3666.2004.00256.x. pmid:15344939.
- 29. Casey SE, Larsen MM, McGinn T, Sartie M, Dauda M, Lahai P. Changes in HIV/AIDS/STI knowledge, attitudes, and behaviours among the youth in Port Loko, Sierra Leone. Global public health. 2006;1(3):249–63. https://doi.org/10.1080/17441690600668106. pmid:19153910.
- 30. O'Brien DP, Venis S, Greig J, Shanks L, Ellman T, Sabapathy K, et al. Provision of antiretroviral treatment in conflict settings: the experience of Médecins Sans Frontières. Conflict and health. 2010;4(1):12.
- 31. Logie CH, Daniel C, Newman PA, Weaver J, Loutfy MR. A psycho-educational HIV/STI prevention intervention for internally displaced women in Leogane, Haiti: results from a non-randomized cohort pilot study. PloS one. 2014;9(2). https://doi.org/10.1371/journal.pone.0089836. pmid:20143167940.
- 32. McPherson RA, Neena K, Moore JM, Meena S. Are birth-preparedness programmes effective? Results from a field trial in Siraha District, Nepal. (Special issue: Reproductive and newborn health.). Journal of Health, Population and Nutrition. 2006;24(4):479–88. pmid:20073128578.
- 33. Hadi A, Rahman T, Khuram D, Ahmed J, Alam A. Raising institutional delivery in war-torn communities: experience of BRAC in Afghanistan. Asia Pacific Family Medicine. 2007;6(1). pmid:20083048481.
- 34. Adam IF. The influence of maternal health education on the place of delivery in conflict settings of Darfur, Sudan. Conflict and Health. 2015;9(31). pmid:20153383159.
- 35. Adam IF, Nakamura K, Kizuki M, Al Rifai R, Vanching U. Relationship between implementing interpersonal communication and mass education campaigns in emergency settings and use of reproductive healthcare services: Evidence from Darfur, Sudan. BMJ Open. 2015;5 (9) (no pagination)(e008285). https://doi.org/10.1136/bmjopen-2015-008285. pmid:606980475.
- 36. Castillo MS, Corsino MA, Calibo AP, Zeck W, Capili DS, Andrade LC, et al. Turning disaster into an opportunity for quality improvement in essential intrapartum and newborn care services in the philippines: Pre- to posttraining assessments. BioMed Research International. 2016;2016 (no pagination)(6264249). https://doi.org/10.1155/2016/6264249. pmid:610982395.
- 37. Pham K, Sharpe EC, Weiss WM, Vu A. The use of a lot quality assurance sampling methodology to assess and manage primary health interventions in conflict-affected West Darfur, Sudan. Popul Health Metr. 2016;14:34. pmid:27757070; PubMed Central PMCID: PMCPMC5053218.
- 38. Gupta J, Falb KL, Lehmann H, Kpebo D, Xuan Z, Hossain M, et al. Gender norms and economic empowerment intervention to reduce intimate partner violence against women in rural Côte d’Ivoire: a randomized controlled pilot study. BMC International Health and Human Rights. 2013;13(1):46. pmid:24176132
- 39. Hossain M, Zimmerman C, Kiss L, Abramsky T, Kone D, Bakayoko-Topolska M, et al. Working with men to prevent intimate partner violence in a conflict-affected setting: a pilot cluster randomized controlled trial in rural Cote d'Ivoire. BMC Public Health. 2014;14(339). pmid:20143155256.
- 40. Bass JK, Annan J, McIvor Murray S, Kaysen D, Griffiths S, Cetinoglu T, et al. Controlled trial of psychotherapy for Congolese survivors of sexual violence. N Engl J Med. 2013;368(23):2182–91. pmid:23738545.
- 41. McGinn T, Allen K. Improving refugees' reproductive health through literacy in Guinea. Global public health. 2006;1(3):229–48. https://doi.org/10.1080/17441690600680002. pmid:19153909.
- 42. Mullany LC, Lee TJ, Lin Y, Lee CI, Teela KC, Paw P, et al. Impact of community-based maternal health workers on coverage of essential maternal health interventions among internally displaced communities in eastern Burma: the MOM Project. PLoS medicine. 2010;7(8). https://doi.org/10.1371/journal.pmed.1000317. pmid:20103293846.
- 43. Zaman RU, Tehzeeb Z, Rashid N, Allen S, Iftikhar C, Shafique A, et al. Evaluating primary healthcare service revitalization interventions though a knowledge, practice and coverage survey in earthquake-affected areas in Pakistan. Journal of Public Health and Epidemiology. 2013;5(5):228–36. pmid:20133204423.
- 44. Bannink-Mbazzi F, Lowicki-Zucca M, Ojom L, Kabasomi SV, Esiru G, Homsy J. High PMTCT program uptake and coverage of mothers, their partners, and babies in northern Uganda: achievements and lessons learned over 10 years of implementation (2002–2011). Journal of acquired immune deficiency syndromes. 2013;62(5):e138–45. pmid:23274930.
- 45. Huber D, Saeedi N, Samadi AK. Achieving success with family planning in rural Afghanistan. Bull World Health Organ. 2010;88(3):227–31. pmid:20428392; PubMed Central PMCID: PMCPMC2828781.
- 46. Curry DW, Rattan J, Huang SY, Noznesky E. Delivering high-quality family planning services in crisis-affected settings II: Results. Global Health: Science and Practice. 2015;3(1):25–33. https://doi.org/10.9745/GHSP-D-14-00112. pmid:20153251987.
- 47. Culbert H, Tu D, O'Brien DP, Ellman T, Mills C, Ford N, et al. HIV treatment in a conflict setting: outcomes and experiences from Bukavu, Democratic Republic of the Congo. PLoS Medicine / Public Library of Science. 2007;4(5):e129. https://dx.doi.org/10.1371/journal.pmed.0040129. pmid:17535100.
- 48. Samai O, Sengeh P. Facilitating emergency obstetric care through transportation and communication, Bo, Sierra Leone. The Bo PMM Team. International Journal of Gynaecology & Obstetrics. 1997;59 Suppl 2:S157–64. pmid:9389627.
- 49. Purdin S, Khan T, Saucier R. Reducing maternal mortality among Afghan refugees in Pakistan. International Journal of Gynecology and Obstetrics. 2009;105(1):82–5. https://doi.org/10.1016/j.ijgo.2008.12.021. pmid:19232603.
- 50. Turner C, Carrara V, Naw Aye Mya Thein N, Aw Chit Mo Mo W, Turner P, Bancone G, et al. Neonatal intensive care in a Karen Refugee camp: a 4 year descriptive study. PloS one. 2013;8(8). https://doi.org/10.1371/journal.pone.0072721. pmid:20133358211.
- 51. Groppi L, Somigliana E, Pisani V, Ika M, Mabor JL, Akec HN. A hospital-centered approach to improve emergency obstetric care in South Sudan. Int J Gynaecol Obstet. 2015;128. pmid:25270823
- 52. Raheel H, Karim MS, Saleem S, Bharwani S. Knowledge, Attitudes and Practices of Contraception among Afghan Refugee Women in Pakistan: A Cross-Sectional Study. PloS one. 2012;7 (11) (no pagination)(e48760). https://doi.org/10.1371/journal.pone.0048760. pmid:365979076.
- 53. Leigh B, Kandeh HB, Kanu MS, Kuteh M, Palmer IS, Daoh KS, et al. Improving emergency obstetric care at a district hospital, Makeni, Sierra Leone. The Freetown/Makeni PMM Team. International Journal of Gynaecology & Obstetrics. 1997;59 Suppl 2:S55–65. pmid:9389614.
- 54. da Costa BR, Cevallos M, Altman DG, Rutjes AW, Egger M. Uses and misuses of the STROBE statement: bibliographic study. BMJ Open. 2011;1(1):e000048. pmid:22021739; PubMed Central PMCID: PMCPMC3191404.