Skip to main content
Advertisement
  • Loading metrics

Evaluation of conditional cash transfers and mHealth audio messaging in reduction of risk factors for childhood malnutrition in internally displaced persons camps in Somalia: A 2 × 2 factorial cluster-randomised controlled trial

Abstract

Background

Cash transfer programmes are increasingly used in humanitarian contexts to help address people’s needs across multiple sectors. However, their impact on the key objectives of reducing malnutrition and excess mortality remains unclear. mHealth interventions show great promise in many areas of public health, but evidence for their impact on reducing the risk factors for malnutrition is uncertain. We therefore implemented a trial to determine the impacts of 2 interventions in a protracted humanitarian context, a cash transfer conditionality and mHealth audio messages.

Methods and findings

A 2 × 2 factorial cluster-randomised trial was implemented in camps for internally displaced people (IDP) near Mogadishu, Somalia, starting in January 2019. The main study outcomes were assessed at midline and endline and included coverage of measles vaccination and the pentavalent immunisation series, timely vaccination, caregiver’s health knowledge, and child diet diversity. Twenty-three clusters (camps) were randomised to receive or not receive conditional cash transfers (CCTs) and an mHealth intervention, and 1,430 households were followed up over 9 months. All camps received cash transfers made at emergency humanitarian level (US$70/household/month) for 3 months followed by a further 6 months at a safety net level (US$35). To be eligible to receive cash, households in camps receiving CCT were required to take their children <5 years age to attend a single health screening at a local clinic and were issued with a home-based child health record card. Participants in camps receiving the mHealth intervention were asked (but not required) to listen to a series of audio messages about health and nutrition that were broadcast to their mobile phone twice a week for 9 months. Participants and investigators were not blinded. Adherence to both interventions was monitored monthly and found to be high (>85%). We conducted intention-to-treat analysis.

During the humanitarian intervention phase, the CCT improved coverage of measles vaccination (MCV1) from 39.2% to 77.5% (aOR 11.7, 95% CI [5.2, 26.1]; p < 0.001) and completion of the pentavalent series from 44.2% to 77.5% (aOR 8.9, 95% CI [2.6, 29.8]; p = < 0.001). By the end of the safety net phase, coverage remained elevated from baseline at 82.2% and 86.8%, respectively (aOR 28.2, 95% CI [13.9, 57.0]; p < 0.001 and aOR 33.8, 95% CI [11.0, 103.4]; p < 0.001). However, adherence to timely vaccination did not improve. There was no change in the incidence of mortality, acute malnutrition, diarrhoea, or measles infection over the 9 months of follow-up.

Although there was no evidence that mHealth increased Mother’s knowledge score (aOR 1.32, 95% CI [0.25, 7.11]; p = 0.746) household dietary diversity increased from a mean of 7.0 to 9.4 (aOR 3.75, 95% CI [2.04, 6.88]; p < 0.001). However, this was not reflected by a significant increase in child diet diversity score, which changed from 3.19 to 3.63 (aOR 2.1, 95% CI [1.0, 4.6]; p = 0.05). The intervention did not improve measles vaccination, pentavalent series completion, or timely vaccination, and there was no change in the incidence of acute malnutrition, diarrhoea, measles infection, exclusive breastfeeding, or child mortality. No significant interactions between the interventions were found. Study limitations included the limited time available to develop and test the mHealth audio messages and the necessity to conduct multiple statistical tests due to the complexity of the study design.

Conclusions

A carefully designed conditionality can help achieve important public health benefits in humanitarian cash transfer programmes by substantially increasing the uptake of child vaccination services and, potentially, other life-saving interventions. While mHealth audio messages increased household diet diversity, they failed to achieve any reductions in child morbidity, malnutrition, or mortality.

Trial registration

ISRCTN ISRCTN24757827. Registered November 5, 2018.

Author summary

Why was this study done?

  • The use of cash transfers in humanitarian emergencies is commonplace, but there is limited information on how they impact child mortality or acute malnutrition.
  • Conditional cash transfers are not frequently used in humanitarian programming, despite their ability to promote healthy behaviours.
  • mHealth, or mobile health, is a term used for the practice of medicine and public health supported by mobile devices. The use of complementary interventions, such as mHealth behaviour change communication, may help to increase the impact of cash transfers on health and nutrition outcomes.

What did the researchers do and find?

  • During 2019, we conducted a 9-month, cluster-randomised controlled trial, in camps for displaced people near to Mogadishu in Somalia.
  • Using a 2 × 2 factorial design, we studied the use of a cash conditionality and mHealth audio messages to improve health-seeking behaviour and reduce risk factors for malnutrition.
  • The conditionality involved a one time point health screening, and 2 audio messages were broadcast to participant’s phones, each week for 8 months.
  • Cash conditionality significantly improved the coverage of measles and pentavalent vaccination, although timely vaccination for all antigens did not improve.
  • The mHealth intervention did not improve any of the primary trial outcomes, although it was associated with a higher household diet diversity.

What do these findings mean?

  • mHealth audio messages were well accepted, and further work to refine and iteratively test them may be useful.
  • A carefully designed, simple, cash conditionality can substantially improve coverage of key public health interventions and help reduce the risk factors for malnutrition and excess mortality in a humanitarian context.
  • Further work to scale up and test cash conditionality in different contexts is warranted.

Introduction

In low- and middle-income countries, acute malnutrition affects 45 million children aged <5 years [1]. This is a serious global health concern as acute malnutrition is a leading cause of death in children, accounting for 11.5% of total deaths, and contributes significantly to the overall disease burden [2]. Populations affected by natural disasters or conflicts often suffer from a greater prevalence of acute malnutrition, and infectious disease is one of its immediate causes [3]. Each year immunization averts an estimated 2.5 million deaths among children under 5 years old and a much larger number of infections, and this also contributes to controlling malnutrition. However, weak health systems are a major constraint on the effectiveness of immunization programmes, and these challenges may be exacerbated in fragile states and humanitarian contexts [4,5].

Cash-based interventions (CBIs) are increasingly used as a humanitarian response to emergencies and have gained greater acceptance compared with in-kind interventions [6]. Among the reasons behind this greater acceptance is the perception that CBI increases beneficiary agency, as they can often decide how to use the cash for their specific needs of goods or services; it is a cost-effective intervention, has positive impacts on local economies, and improves beneficiary satisfaction. However, CBIs do not appear to consistently reduce the risk of malnutrition in children, and there is no evidence on its ability to reduce excess mortality [610]. Even in nonhumanitarian contexts debate continues on the relative merits of conditional and unconditional transfers on child health and nutrition and how that may play out in different contexts [11,12].

The prevalence of acute child malnutrition in Somalia is among the highest in the world as a result of the political instability and conflict afflicting the country since 1991, together with recurrent natural disasters such as droughts [3,13,14]. Because of this protracted state of conflict, regional agriculture and trade is disrupted, which exacerbates food insecurity by increasing food prices, especially in urban areas [9]. Conflict also causes forced displacement and reduces humanitarian access, hinders the provision of health services, and increases the risk of mortality. In 2017 to 2018, acute malnutrition affected 1.2 million children in Somalia, of which over 230,000 were severely malnourished [15]. Internally displaced people (IDP) are the population group most affected by acute malnutrition and disease outbreaks, as they often live in peri-urban camps that lack adequate access to essential services. Studies have also indicated that low knowledge of health and nutrition issues may contribute to the risk of malnutrition [16].

CBIs were first implemented at scale in Somalia in 2011 to respond to the famine crisis and were seen as an essential strategy for providing food assistance, given the existence of functioning markets and the limited humanitarian access to southern Somalia [17]. Recently, as part of the Research on Food Assistance for Nutritional Impact (REFANI) consortium, Concern Worldwide and University College London (UCL) tested if an emergency multipurpose cash transfer, implemented over a 5-month period, would reduce acute malnutrition risk in children aged <5 years living in IDP camps in the Afgooye Corridor, Mogadishu [18]. The CBI in the REFANI-S study failed to reduce the incidence of acute malnutrition despite significantly improving food security, measured at the household and individual level [7]. This finding suggested the need for modification of the CBI by adding elements such as behaviour change communications (BCCs), which have been shown to reduce acute malnutrition risk in some contexts [19].

mHealth, or mobile health, is a term used for the practice of medicine and public health supported by mobile devices. The Cash for Improved Nutrition in Somalia (CINS) study aimed to assess whether modifying a CBI, by adding a one-time conditionality of health screening children at the local health clinic, or a mHealth BCC intervention delivered through mobile phones, could reduce the risk factors for acute malnutrition in children, aged 0 to 59 months, living in IDP camps. We tested 2 hypotheses. Firstly, that the conditional cash intervention would improve vaccination coverage, and secondly, that the mHealth intervention would increase mother/caregiver’s health and nutrition knowledge, and improve caring behaviours, as indicated by improved vaccination coverage and a greater child diet diversity score (IDDS).

Methods

Ethical approvals and trial registration

The Ministry of Health & Human Services of the Federal Republic of Somalia (reference: MOH&HS/DGO/0993/Jun/2018) and the Research Ethics Committee of UCL (project ID: 4684/001) granted ethical approval. The study was registered on November 5, 2018, with ISRCTN (ISRCTN24757827). This study is reported as per the Consolidated Standards of Reporting Trials (CONSORT) guideline (S1 CONSORT Checklist). A consort checklist for this paper is included in the Supporting information (S1 CONSORT Checklist).

Setting

The trial took place in the Afgooye Corridor, in peri-urban Mogadishu, Somalia. The Afgooye Corridor hosts the largest IDP camps in Mogadishu, the cumulative result of multiple protracted crises in the country over the years. The IDP camps are spontaneous and privately run settlements, often managed by informal settlement managers. The camps are often overcrowded, lack basic sanitation and health services, and residents face recurrent evictions. The IDP living in these camps subsist mostly on humanitarian assistance from relief agencies and from casual labour when available.

Interventions

All study participants were enrolled in a cash transfer programme and received the same level of transfers. We tested 2 separate interventions that were delivered as part of this cash transfer programme: (1) a cash transfer conditionality, where household registration for the cash transfer programme, was conditional on a one-time health screening of their children aged 0 to 59 months; and (2) an mHealth BCC intervention, where we transmitted prerecorded audio messages to the mobile phones of people registered for the cash transfer programme.

Cash transfer programme

The cash transfer programme consisted of 3 monthly electronic transfers of US$70.00 (henceforth humanitarian cash transfer), followed by 6 monthly electronic transfers of US$35.00 (henceforth safety net cash transfer). The humanitarian cash was aligned to the recommended transfer value from the Somali Cash Working Group, which reflected 80% of the multipurpose (i.e., full) minimum expenditure basket (MEB) for the given location. The safety net cash transfer value followed standard practice of the implementing agency at the time of intervention design, i.e., half the full humanitarian value. Whereas the higher value was distributed at times of peak hunger, the safety net value was lower so as to reach as many households in need as possible while supporting household income, promote positive coping strategies, and reduce risk of dependence.

Upon registration, a household female representative received a mobile phone SIM card with a unique number, which was recorded and through which they received the cash transfer via a mobile money transfer made by the telecommunications company we contracted (Hormuud Telecom Somalia). The cash transfer programme targeted women as the household cash recipient on the assumption that their spending was more likely to benefit their children. Cash transfers were made on March 24, April 27, June 3, July 4, July 27, August 25, September 29, October 27, and December 8, 2019.

Cash transfer conditionality

The conditionality intervention, henceforth the conditional cash transfer (CCT) intervention, was a one-time requirement for all children aged 0 to 59 months to attend the local clinic at the beginning of the study, where health staff screened their health and issued them with a CINS health record card. The child was offered any necessary vaccinations, but agreement to receive vaccination was not necessary to meet the conditionality. Children born after registration for the cash transfer had taken place were not required to attend.

Households in the CCT intervention arm were actively encouraged to meet the conditionality, which all did. If households had failed to meet the conditionality, they would have been denied registration for the cash transfer programme. During registration for the cash transfer programme, we verified whether households in the CCT arm met the conditionality by asking the mothers/caregiver to show the child CINS health card. Additional checks of the child’s CINS health card were carried out monthly by study staff and community health workers (CHWs) to encourage any newly arrived children, in the households of the CCT arm, to be health screened and receive their CINS health card. The health record card was designed for the study based on recommendations from the World Health Organisation (WHO), the existing MoH Child Health booklet, and experience in Malawi, where passport-sized, home-based health record cards had been developed [21]. The card was designed to be able to fit in a pocket and had a water-resistant cover. It received some limited pretesting with volunteer Concern staff before being printed in Mogadishu. Study health record cards were only issued to children living in the CCT intervention arm camps.

All households in the CCT and unconditional cash transfer (UCT) arms had similar access to the local health clinic. In addition, CHWs visited all households in all the study arms each month to review the vaccination status of their children, aged 0 to 59 months, and to remind their caregivers of any due child vaccinations.

mHealth behaviour change communication

The mHealth intervention consisted of a series of 30 pairs of health-promoting audio messages. Each pair of messages comprised a 2-minute long drama and a 1-minute long reenforcing message that were transmitted on separate days, usually on Friday for the drama and Sunday for the reenforcement, to the recipient’s mobile phone. The message series comprised 5 seasons, each of 6 pairs of messages and transmission of the whole series took place over 8 months (May to December 2019). The drama component was a serialised fictional story, following a family similar to those in the study camps. The content of the message series covered 6 topics: (1) vaccination; (2) water, sanitation, and hygiene (WASH); (3) infant and young child feeding (IYCF) practices; (4) identifying signs of serious illness and seeking care; (5) recognition, treatment, and prevention of acute malnutrition; and (6) maximizing health and nutrition for all household members. We identified these 6 topics as important barriers to optimal health and nutrition during the implementation of the REFANI-S study. [7] We designed the message content based on information gathered during a formative human-centred design workshop held in Mogadishu with Concern staff, CHWs, and mothers and fathers from the IDP community. The design process was also informed by the theoretical behaviour change approach used in a previous mHealth project in Bangladesh [22]. We developed the messages in collaboration with 2 Somali companies that specialised in interactive voice response (IVR) technology (Shaqodoon Organisation, Hargeisa, Somaliland) and creative message development (Media INK, Mogadishu, Somalia). Messages were recorded in Mahrati and Maay, the 2 Somali languages widely spoken in the IDP camps, and recipients received broadcasts in their preferred language.

Trial design and participants

We implemented a 2 × 2 factorial cluster-randomised controlled trial, where IDP camps were the units of randomisation. We surveyed 23 clusters between January 17 and February 12, 2019. We used 3 criteria to select these clusters: first, the clusters should not be receiving any cash assistance from another organisation; second, the clusters needed to be located between 0.3 and 1 km straight-line distance from the Concern Worldwide–operated health centre, where we planned to undertake the health screening of children; and third, clusters needed to be of comparable size. There were no exclusion criteria for individuals participating in the study except that the household was required to have a child aged 0 to 59 months.

Informed verbal consent was obtained from camp leaders in all IDP camps before starting data collection. In addition, following a detailed explanation of the study objectives and data collection process, informed verbal and written consent was obtained from caregivers at the household. Study participants were informed about their right to withdraw from the study and that participation or withdrawal from the study would not affect their entitlement to humanitarian assistance. Confidentiality and data security of the respondents was ensured by the use of password-protected encrypted devices and the removal of any information from datasets that could be used to identify respondents or their location.

We planned to include 20 clusters in the study with an average of 65 children, aged 0 to 59 months, per cluster. However, the surveyed clusters had fewer children than expected (average 54.3 children, range: 11 to 102), so we included all 23 surveyed clusters in the study, and we used the Round 1 (R1) data that we collected as our baseline. We then randomly allocated half the 23 clusters to the CCT intervention resulting in 12 clusters assigned to this intervention and 11 to the control (see Fig 1). The allocation was done by first listing the clusters in order of size (number of households) and then randomly assigning the CCT intervention or control to alternate members of the list, using a random number, generated using the Excel RANDBETWEEN() function, to determine the allocation for the first cluster. The process was then repeated in an identical way to randomly allocate the mHealth intervention, separately, to the CCT control and intervention groups. The randomisation of interventions was performed in London by the study PI. As with most interventions of this nature, participants could not be “blinded” to allocation status. Within each cluster, all households with children aged <5 years (n = 774) were eligible to be included in the study, together with all the children aged <5 years and their mothers/caregivers that were members of these households.

thumbnail
Fig 1. Study flow chart for households.

CCT, conditional cash transfer; HH, household; R, data collection round; UCT, unconditional cash transfer.

https://doi.org/10.1371/journal.pmed.1004180.g001

Following the baseline survey and cluster randomisation, the cash distribution and mHealth interventions started. We then implemented 8 additional rounds of data collection from the study households, beginning on April 29, 2019 (see Fig 1). The “midline” data collection took place at R3 in June (3 months after the start of the intervention), and the “endline” took place at R9 in December (9 months after the start of the intervention). In all 9 rounds of data collection, the sample of households and mothers/caregivers remained the same (a closed household cohort). However, we included in the study all the children aged <5 years that joined the household after baseline.

We collected information at the household and individual level, i.e., mother/caregiver and child (see S1 Table). We gathered data from household heads and mothers/primary carers regarding household demographics, food security, expenditure, morbidity, WASH, breastfeeding practices, mother/caregiver’s knowledge on health, and nutrition and vaccination programme coverage. We also collected mid-upper arm circumference (MUAC) measurements and assessed bipedal pitting oedema (henceforth oedema). We identified children as acutely malnourished if they presented with a MUAC <12.5 cm and/or oedema and referred them to the health centre for treatment. We identified all children <5 years old who died between R1 and R9 data collections and arranged a verbal autopsy (VA) interview with their mothers/caregivers.

Field procedures and data handling

Data were collected by the research field teams using a structured questionnaire, translated into Somali, on mobile Android devices running Open Data Kit (ODK). Data collection at baseline (month 0), midline (after 3 months of intervention), and endline (after 9 months of intervention) was conducted by study enumerators, who were hired specifically for the data collection exercises. Data were collected at the monthly time points in between 0, 3, and 9 months by CHWs. Prior to starting data collection, we implemented 1-week training sessions for enumerators and supervisors at R1, R3, and R9 data collection rounds. During these training sessions, we piloted and revised questionnaires. The R1, R2, and R3 data collection was undertaken by 10 teams. Each team had an enumerator and 2 CHWs. The rest of data collection rounds were conducted by 10 teams of CHWs, with each team having 2 members. Teams in all rounds were supervised by 4 nutrition supervisors, under the overall supervision of a field study coordinator. During each round of data collection, if we could not reach a household after repeated attempts or any of its members were absent, we enquired about the reasons for this absence from family or neighbours.

Household demographics

To understand household composition, we collected data on the numbers of members and their ages. We then estimated total, child, and aged dependency ratios as the ratio between the number of members aged <15 years or aged ≥65 years, members aged <15 years, and members aged ≥65 years, each divided by the number of members aged 15 to 64 years, respectively. Additionally, we obtained information on the sex of the head of household, and whether they lived in a monogamous or polygamous arrangement.

Water, sanitation, and hygiene

Using a questionnaire and through observation, we obtained data on whether households had access to piped water, whether they pay for this access, and the time that it took them to collect water. We also obtained data on household access to handwashing facilities, soap availability, and the type of toilet. We classified households as engaging in open defecation if their members reported to relieve themselves in open fields or if their household showed no evidence, reported or observed, of having access to latrines.

Food security

We used household and child dietary diversity score (DDS) and the reduced coping strategies index (rCSI) to assess food security. We applied a 24-hour food recall to a checklist of 12 food groups for estimating the household DDS, as recommended by the Food and Agriculture Organisation of the United Nations [23]. The household DDS food groups were as follows: (1) cereals; (2) white tubers and roots; (3) vegetables; (4) fruits; (5) meat; (6) eggs; (7) fish and seafood; (8) pulses, nuts, and seeds; (9) dairy products; (10) oils and fats; (11) sweets; and (12) spices, condiments, and beverages. The household DDS has a range of 0 to 12. Similarly, we applied a 24-hour food recall to a checklist of 7 food groups to estimate child DDS, as recommended by WHO [24]. The child DDS food groups were as follows: (1) grains, roots and tubers; (2) legumes and nuts; (3) dairy products; (4) flesh foods; (5) eggs; (6) vitamin A-rich fruits and vegetables; and (7) other fruits and vegetables. The child DDS has a range of 0 to 7. The rCSI is a simple tool applied in different contexts that assesses the frequency, in days within a 7-day period, and the severity of 5 coping strategies commonly used by households, when they cannot access enough food [25]. The 5 coping strategies are consuming less preferred foods, borrowing food, reducing meals, reducing portion sizes, and restricting adult’s food consumption to preserve children’s food consumption. As per recommendations, we weighted and summed the frequency responses to these strategies to create an index where higher scores indicate greater food insecurity. The rCSI range is 0 to 56. Rations of prepared food were distributed in this setting, so we asked how many days, within a 7-day period, the household relied on these wet rations. We asked how many meals were consumed in the household in the past 24-hour period.

Household expenditure

We collected 30-day and 4-month household expenditure from a list of 10 food groups and 27 nonfood items. We then standardised all expenditure figures to a 30-day period and added them to calculate household total, food, and nonfood expenditure.

Mother/caregiver characteristics and knowledge on health and nutrition

We asked mothers/caregivers their age in completed years, if they could read or not, if they had engaged in paid labour in the past year, and if they slept under a mosquito net in the past night. We assessed knowledge on health and nutrition topics using a list of 20 questions/statements covering 5 topics, for which respondents needed to answer yes or no to indicate whether they agreed with the statement (see S4 Table). Knowledge on health topics and nutrition was defined as the number of correctly answered questions.

Vaccination coverage

We collected data on vaccination coverage, based on the Somalia Expanded Programme on Immunisation (EPI) schedule (see S2 Table), by checking the child’s health card at baseline, midline, and endline, or by mothers/caregivers recall if no health card was available or there was no entry for a particular antigen [26]. Bacillus Calmette–Guérin (BCG) vaccination status was assessed by the presence of a scar. Adverse events were not specifically recorded for trial purposes as there was no plausible reason to suspect that an increase in these would be associated with the intervention. During the trial, there was no indication of an increase in adverse vaccination events from routine health facility reports.

Child age and anthropometry

We ascertained the children’s month and year of birth using a calendar of local events. We then randomly selected a day of the month to generate the date of birth. We estimated age in months as the difference between the day of data collection and the date of birth divided by 30.4.

We measured MUAC on the left arm to 1 mm precision using a standard MUAC insertion tape. We measured children’s MUAC in duplicate and entered both measures into the ODK questionnaire, which we designed to automatically estimate difference between these measurements and their mean. If the estimated difference was greater than 5 mm, we obtained a third measurement and estimated the mean using the pair of values with the lowest difference. We recorded presence of bilateral pitting oedema if an imprint remained in both feet after pressing them with the thumbs for 3 seconds. We defined acute malnutrition as the presence of a MUAC <12.5 cm and/or bilateral pitting oedema.

Exclusive breastfeeding

We assessed exclusive breastfeeding in children aged <6 months using the WHO tool for IYCF practices [24] at R1, R3, and R9 visits. The WHO tool collects a 24-hour breastfeeding recall, as described by the child’s mother/caregiver, and information of liquids and food intake. We defined exclusive breastfeeding as reporting consumption of breastmilk in the past 24 hour while reporting no consumption of any other food or liquid.

Child morbidity

We asked mother/caregivers whether the child had been unwell in the last 4 weeks or since the last round of data collection. We defined all-cause morbidity in children as having been reported unwell. Starting at the second round of data collection for children identified as having been unwell, we asked whether was due to diarrhoea or measles. We defined diarrhoea if the mother/caregiver reported the child had 3 or more loose or watery stools per day, and measles if the child had fever and maculopapular rash, with cough or coryza or conjunctivitis.

Child mortality and verbal autopsy

For all the children, <5 years old, that died in the period between R1 and R9, we arranged for VA interviews, by trained staff, with their mothers or caregivers that reported having been with them in the period preceding death. VA interviews are designed to collect cause-of-death information—signs and symptoms—from deaths that occurred outside of health facilities and where death certification is weak or absent [27]. We adapted and shortened the 2016 WHO VA tool by removing nonrelevant questions, correcting skip patterns, and simplifying language to facilitate use by interviewers with no medical training. We calculated the probability of different causes of death using InterVA-5 software, which uses Bayesian reasoning to calculate the probability of cause of death categories based on the reported presence of signs, symptoms, and the circumstances of death [20]. For each death, InterVA-5 software reports the probability of up to 3 of the most likely causes. If the sum of these probabilities was less than 100, we allocated the remnant to an “indeterminate” category. We created a category called “lost to follow-up,” defined as the sum of the deaths lost to follow-up with VA interviews, each given a value of 100. We compiled and added all reported likelihoods for these causes of death to estimate the population level burden and estimated the population cause-specific mortality fractions (CSMFs) by dividing the population-level burden by the total number of deaths.

Outcomes

The primary outcomes of the trial were assessed at the midline and endline time points. For the CCT intervention, these were measles vaccination coverage, defined as the proportion of children aged 9 to 59 months who had received MCV1, and “EPI vaccination coverage,” defined as the proportion of children aged <60 months who had received all their vaccinations according to the EPI schedule and their age (see Table 3). For the mHealth intervention, 2 additional primary outcomes were assessed: mother/caregiver’s knowledge of health and nutrition topics, defined as the mean number of correctly answered knowledge’s questions (see S1 Table), and dietary diversity of children aged 6 to 23 months, defined as the mean child DDS.

Following trial registration with ISRCTN, the name of the “EPI vaccination coverage” outcome was changed to “Timely Vaccination” to align better with terminology used in the literature, and “Pentavalent series completion,” defined as the proportion of children aged 12 to 23 months that had received all 3 does of Pentavalent vaccine, was added as an additional indicator of vaccination coverage.

The secondary outcomes of the trial were as follows: acute malnutrition incidence, assessed as a single failure; mortality incidence; all-cause morbidity incidence, assessed as a single failure; exclusive breastfeeding in children, defined as the proportion of exclusively breastfed children aged <6 months; and the CSMF obtained from VA interviews. Other outcomes of the trial included the following: all-cause morbidity, assessed as multiple failure; diarrhoea incidence, assessed as a single and multiple failure; measles incidence, assessed as a single failure; total, food, and nonfood household expenditure; and the food security indicators household diet diversity (HDDS) and the rCSI.

Sample size

We estimated the sample size to observe differences in measles vaccination coverage and child DDS using the user-written clustersampsi function in Stata (StataCorp. 2015. Release 14. College Station, TX: StataCorp LP) [28]. As this function is designed for use with large numbers of clusters and because we did not include the Holm–Bonferroni adjustment for multiplicity, the calculated power was overestimated. We hypothesised that a greater measles vaccination coverage would be the results of the CCT intervention and that a greater child DDS would be the behavioural result of the mHealth intervention. Based on prior data [7], we expected a baseline measles vaccination coverage of around 64%. With 10 clusters per arm, with an average population of 65 children (aged <5 years) per cluster, and allowing for an alpha risk of 0.05 and an ICC of 0.06, we calculated we would have 80% power to detect a minimum increase of 18 percentage points in measles vaccination coverage. This minimum detectable difference laid below our hypothesised effect size of 20 percentage points. In addition, based on prior data [7], we expected a baseline child DDS of 3 with a standard deviation of 2. With 10 clusters per arm with an average population of 65 children (aged <5 years) per cluster, and allowing for an alpha risk of 0.05 and an ICC of 0.01, we calculated we would have 80% power to detect a minimum increase of 0.42 in child DDS.

Data analysis

We undertook data analysis using Stata v17. Prevalence estimates at baseline were computed accounting for the trial cluster design using the Stata complex survey svy commands and differences in means and proportions were tested for using the lincom command. For variables collected at R1, R3, and R9 (baseline, midline, and endline), we assessed impact using mixed effects, multilevel, regression models: linear, logistic, or ordered logistic, depending on whether the outcome variables were continuous, categorical, or ordinal, respectively. Models included cluster and household variables as random-effects and dummy variables denoting the time point (baseline, midline, or endline) and intervention (CCT and mHealth) as fixed-effects in the model. All models included baseline data to account for any observed differences at baseline and were adjusted for age and sex. We conducted an available case analysis using mixed models, and the analysis is valid under the missing-at-random assumption. We used robust variance for calculation of standard errors. We tested for interactions between the 2 interventions and found no evidence of a significant effect for any outcome. We therefore report only the main effects in the results and provide a table of effects for the combined interventions in the annex. The absolute difference in risk for the vaccination coverage outcomes were calculated as the difference in regression adjusted contrasts, using the margins post-estimation command. The absolute difference in child diet diversity and maternal/caregiver knowledge scores was calculated using mixed effects linear regression. To provide a description of how the interventions effected the vaccination for each antigen, we also calculated the arithmetic difference-in-difference (DiD), by subtracting the baseline prevalence from the midline and endline values, and then subtracting the control prevalence from the intervention prevalence at each time point.

For assessing the impact on incidence, we estimated hazard ratios using Cox proportional hazards models, adjusting for child’s age and sex as covariates in the models, and using svy to calculate cluster-robust standard errors. For comparing probable causes of death, we used chi-squared tests, after we stratified the CSMF by arm. All analysis of intervention effects is “intention to treat,” meaning we compare clusters as randomised irrespective of whether participants received the intended intervention. P values were adjusted for multiple comparisons using the Holm–Bonferroni step-down procedure [29], but all confidence intervals are calculated at the 95% level. The adjustments were made based on all 72 tests that were conducted to test the impacts of the 2 interventions on the primary and secondary outcomes.

Results

Participants flow

Figs 1 and 2 show the household and children flow for the 9 rounds of data collection. All households that were invited to participate enrolled in the study and all households receiving the CCT intervention met the conditionality and subsequently received the cash transfer. Overall, there was good household follow-up. Seven hundred and one households (90.6%) had data collected in all 9 rounds, and 745 households (96.3%) had data collected in at least 7 rounds. For children, a sample of 1,244 children were included in the study at baseline, and 225 children entered the study afterwards (57, 49, 23, 19, 14, 14, 17, and 32 for rounds 2, 3, 4, 5, 6, 7, 8, and 9, respectively). Between January 17 and December 26, we collected 11,545 observations.

thumbnail
Fig 2. Study flowchart for children.

CCT, conditional cash transfer; UCT, unconditional cash transfer.

https://doi.org/10.1371/journal.pmed.1004180.g002

Unfortunately, a total of 27 children died during that period, 17 boys and 10 girls (63% and 37%, respectively). The large proportion of these deaths (18 deaths, 66.7%) were reported in R2 and R3, which coincides with the Gu season (April to June) of long rains and flash floods in Somalia. The number of deaths in the CCT and control arms were comparable (14 and 13 deaths, respectively), but fewer deaths occurred in the mHealth arm than in the control arm (8 and 19 deaths, respectively).

Baseline characteristics

Tables 1 and 2 shows baseline characteristics of households, mothers/caregivers, and children. Most households reported being female headed and 15% were in a polygamous arrangement. The average household size was 5.1 members of which 1.6, 1.6, and 1.87 members were aged <5 years, 5 to 14 years, and 15 to 64 years, respectively. Households with elderly members, aged 65 and above, were less common with 1 elderly person for every 15 households. All households reported access to piped water, but a third paid for this access. A very small proportion of households reported access to handwashing facilities, while we observed soap ownership in only a third. Open defecation was rare as most households reported access to pit latrines. To collect water, households spent a mean of 43 minutes each day. On average, households reported consumption of 1.9 meals per day and receipt of wet food rations from a humanitarian organisation in 3 out of the past 7 days. Households reported, on average, a high dietary diversity with a consumption of about 7 out of 12 food groups in the past 24 hours. Households reported an average household expenditure of US$86.7 (95% CI [73.3; 100.0]) in the last 30 days, and food as their greatest expenditure category.

thumbnail
Table 1. Baseline characteristics of participant households randomised to receive the cash conditionality (CCT) or mHealth interventions.

https://doi.org/10.1371/journal.pmed.1004180.t001

thumbnail
Table 2. Baseline characteristics of study participants randomised to receive the cash conditionality (CCT) or mHealth interventions1.

https://doi.org/10.1371/journal.pmed.1004180.t002

The mothers/caregivers from the sample of 774 households had an average age of 30 years (95% CI [29.5; 31.9]), 81% to 91% reported not been able to read, two-thirds reported to have done paid labour in the past year, and a quarter reported sleeping under a mosquito net the night before.

Children were on average 27 months old, and there was a 1.0:1.1 girl:boy sex ratio. One in 4 children were reported to sleep under a mosquito net the previous evening, and two-thirds were reported to have been ill in the previous 4-week period. Acute malnutrition affected 7.63% (95% CI [5.87, 9.85]) of the sample, 0.63% (95% CI [0.33, 1.21]) presented oedema, and they had a mean MUAC of 14.2 cm (95% CI [14.1, 14.4]). Measles vaccination was low at 42.4% (95% CI [38.0, 46.9]), and only 20.8% (95% CI [16.1, 26.4]) had received all vaccinations according to the age schedule. On average, children consumed food from 2.85 food groups (95% CI [2.64, 3.06]), and those aged 6 to 23 months consumed food from 3.05 food groups (95% CI [2.79, 3.31]).

Intervention exposure

All households in the study were registered to benefit from cash transfers and received their cash transfers in a timely manner. Table 3 shows that the participant’s exposure to the CCT and mHealth interventions was high throughout the study. We detected minor leakage of the intervention between the study arms, with 6% of households in the control arm reporting having heard a mHealth audio message between baseline and round 2. However, this reported leakage fell markedly in subsequent data collection rounds.

thumbnail
Table 3. Participants reported exposure to interventions.

https://doi.org/10.1371/journal.pmed.1004180.t003

Primary outcomes

Table 4 show the impact on the 5 primary outcomes of the study: measles vaccination, pentavalent series completion, timely EPI vaccination, maternal/caregiver knowledge, and child dietary diversity. The CCT intervention significantly improved measles vaccination coverage from 39.2% to 77.5% and Pentavalent series completion from 44.2% to 77.5%. This improvement was observed at midline and had increased further by endline. Comparing prevalence changes between the study arms using a DiD approach, we found an increase in crude measles coverage of 39.1% (95% CI [24.5, 53.8]) by endline (see S5 Table). S6 Table shows the crude vaccination coverage for all antigens in children aged 0 to 59 months at baseline, midline, and endline for the CCT and control arms. At endline, compared with the control group, the group receiving the CCT intervention showed significantly greater coverage in all vaccinations, except oral polio vaccine 0 (OPV 0) and BCG. However, we found that CCT did not improve timely EPI vaccination coverage.

There was no evidence that the mHealth intervention improved mother’s knowledge, any of the vaccination outcomes, or child diet diversity (see Table 4 for hypothesis testing and S7 Table for DiD prevalence values).

thumbnail
Table 4. Effect of the cash transfer conditionality (CCT) and mHealth interventions on primary outcomes.

https://doi.org/10.1371/journal.pmed.1004180.t004

Secondary outcomes and other outcomes

Table 5 shows the interventions association with household expenditure, food security, and exclusive breastfeeding. The CCT intervention did not affect household food and nonfood expenditure. The CCT intervention appeared to increase household dietary diversity at endline, but this did not remain significant following the Holm–Bonferroni correction. The CCT intervention was not associated with household reliance on coping strategies.

thumbnail
Table 5. Intervention effects on household expenditure, food security, and exclusive breastfeeding.

https://doi.org/10.1371/journal.pmed.1004180.t005

The mHealth intervention was not associated with household expenditure but significantly increased household DDS by endline from a mean of 7.0 to 9.5. There was no effect on household coping strategies or exclusive breastfeeding in children aged <6 months.

Table 6 presents the survival analysis for mortality, morbidity, and acute malnutrition. The CCT intervention reduced the risk of measles infection, consistent with the increase in vaccination coverage described above. However, these effects were no longer significant after the Holm–Bonferroni correction. The CCT intervention did not affect the risk of all-cause morbidity or the risk of diarrhoea, when assessed as either a single failure or multiple failures, and had no impact on the risk of dying.

thumbnail
Table 6. Intervention effects on the risk of mortality and morbidity.

https://doi.org/10.1371/journal.pmed.1004180.t006

The mHealth intervention did not affect the risks of acute malnutrition, measles, all-cause morbidity, and diarrhoea, but there was a suggestion that it may have reduced the risk of death. There were a total of 27 deaths recorded in study children with 8 occurring in the mHealth intervention arm and 19 in the control, with an overall death rate of 0.2 deaths/100 child-months. However, after the Holm–Bonferroni correction was applied, this difference was not significant. Out of the 27 recorded deaths, we gathered VA data from 24 children (15 male and 9 female), an overall follow-up of 88.9%. The mothers/caregivers of the remaining 3 children could not be traced. The 3 leading probable causes of death were diarrhoeal diseases, measles, and severe malnutrition, accounting for 55% of the total CSMF. Causes of death are ranked in S3 Table. We stratified the CSMF by sex and interventions, but due to the small number of deaths that occurred in the study, we did not test for differences between groups.

Discussion

This study was among the first trials in Africa to demonstrate a beneficial impact of a CCT intervention on child immunisation. Introduction of a single time point conditionality and provision of an enhanced home-based health record card had a highly significant positive impact on vaccination with improvements in both measles (MCV1) vaccination coverage and pentavalent series completion. The mHealth intervention was associated with an increase in household diet diversity, despite no evidence that knowledge had improved. To the best of our knowledge, this is the first study to demonstrate that mHealth interventions may improve household diet diversity when combined with a multipurpose UCT programme. However, no change in child diet diversity or any other primary outcome was observed, and there was no improvement in exclusive breastfeeding.

The strong impact of cash transfer conditionality on uptake of vaccination services is consistent with other studies that have provided evidence that conditional transfers can enhance the use of health services and improve health outcomes [8,12]. However, our findings contrast with a recent review of CCT in Africa, which showed no impact on immunisation coverage [30]. Evidence on the impact of home-based health records on vaccination is very limited and inconclusive, although their use is recommended by WHO, especially in remote and hard-to-reach populations [21]. The design of this study did not permit us to determine the relative contribution of record cards and conditionality to the intervention effect.

The selection and calculation of vaccination indictors for use in different studies is somewhat variable [31]. Here, we chose to use “measles vaccination coverage” in children above 9 months due to the importance of measles infections for child mortality in this and other emergency and displacement contexts, its use as an indicator of programme adequacy by the Sphere Project, and the finding from a previous trial in the same area that coverage was low [7,32,33]. We also used “Pentavalent series completion” to indicate the overall functioning of routine EPI vaccination and allow comparison with the global DTP3 coverage indicator used by WHO and the DPT series completion used as a Sphere indicator [32,34]. Lastly, we measured “Timely vaccination” to provide information of the ability of the EPI system to provide age-appropriate vaccination.

Timely vaccination (also referred to as on-time vaccination or its reverse, delayed vaccination) is important to assess as delayed vaccination may lead to an increase in mortality and it increases the fraction of a population that requires vaccination in order to eliminate a disease [35,36]. When measured in other contexts, the proportion of children receiving timely vaccination has also often been low [37,38]. Analysis by antigen and child age revealed that administration of OPV0 and BCG were low in the CCT intervention group, and this accounted for the lack of improvement in the Timely Vaccination indicator despite the large improvements in age-appropriate coverage of other antigens. A lack of improvement in OPV0 coverage has also been reported in a CCT trial in Nigeria [39]. OPV0 was likely to be missed out as infants were frequently offered BCG, OPV1, and Pentavalent 1 on their first to a health facility, rather than BCG and OPV0. This suggests that further work on staff training and support is required, as well as a review of the immunization schedule and community awareness and acceptability.

Achieving full vaccination is challenging in this context for a range of reasons, including weak health infrastructure, financial and human resource constraints, insecurity, a highly mobile population, as well as knowledge of and attitudes towards vaccination among caretakers. Evidence-based approaches to identify and remove barriers to vaccination are recommended as part of the Immunization 2030 global strategy [40]. Since the end of this study, the Government of Somalia has updated its EPI policy, which continues to prioritise routine immunisation for children under 1 year while also promoting vaccination for other eligible groups, including children 12 to 24 months who were previously unvaccinated. We observed no impact on child morbidity during the follow-up period of the study, which is in line with a recent review that showed no consistent effect of CCT on child health outcomes in Africa [30]. However, the beneficial impacts of enhanced immunisation would be likely to manifest over the longer term and be of particular benefit during the periodic outbreaks of measles and other diseases that have afflicted this population [33].

mHealth interventions have been demonstrated to have potential to improve multiple health indicators in low-income countries [41]. We examined a range of outcomes here but achieved mixed results. Knowledge score did not improve, although in both control and intervention arms, it increased by 2.5 points between baseline and midline, suggesting a possible learning effect induced by the asking of the questions at baseline. No increase was seen between midline and endline. Little evidence exists on the effectiveness of audio message approaches, as used in this study. Evidence on the impact of mHealth on diet diversity in other contexts is sparse, although some alternative approaches have been shown to increase vegetable consumption [42]. Given the mixed results reported here, further work to refine and test the use of mHealth audio messages in this and similar contexts is warranted with further exploration of the links between knowledge and practice.

The partnership between an NGO that had been operational in the area for many years and an academic institution with a strong track record in research in fragile contexts provided the necessary expertise to conduct this trial in challenging circumstances. Regular visits by the researchers to the field sites and the strong working relationships between the academic study coordinator and the NGO field coordinator were essential to the robust running of the trial. Periodic, monthly follow-up visits allowed close monitoring of participants with regular data collection and for the calculation of incidence as well as prevalence indicators.

Use of both health record cards and caregiver recall to determine child vaccination status allowed for measurements to be made in the whole population sample. Only a small proportion possessed record cards at baseline, so if we had relied on card records only, it is likely to have resulted in selection of a biased sample. However, as record cards were issued as part of the CCT intervention, there was an unavoidable difference between the CCT and control arms in how vaccination data were collected after the baseline. It is therefore possible that the greater use of record cards in the CCT arm may have resulted in improved reporting of vaccinations and a resulting measurements bias. However, a recent study has demonstrated that while results from studies are inconsistent, parental recall compared to record-based data in East Africa may be reliable [43]. In addition, the large increases in vaccination coverage observed in the CCT arm between midline and endline (when record cards were used at both time points) argue that the observed intervention effect was not due to improved reporting during data collection.

Working with national companies experienced in production and broadcasting of mHealth messages helped to ensure the quality of the productions and allowed for messages to be recorded in both of the commonly used local languages. The process of mHealth message design was originally conceived as involving successive iterative cycles of design and message testing. Due to limitations in the available time, the intended testing process had to be curtailed, and, while messages were reviewed by the local study team, it was not possible to pretest all messages with participant volunteers before broadcast. Additionally, the BCC approach was ambitious, aiming to address multiple behaviours simultaneously, instead of focusing on few simple messages at a time. However, engagement with the mHealth messages remained high throughout the study, suggesting the general desirability of the messages among participants.

The use of a 2 × 2 factorial design allowed the testing of 2 important interventions and was therefore cost-efficient. However, the study design also required a large number of comparisons and significance tests. The use of Holm–Bonferroni correction is recommended in situations where a large number of tests are required, and we adopted it for the analysis of this trial to reduce the risk of type 1 errors [29].

Our data show that including a simple, one time point conditionality in a humanitarian cash transfer programme can increase the uptake of proven life-saving interventions, such as child vaccination. Further work to understand the contribution of home-based health record cards and how CHW interacted with them would be useful and contribute to optimising their design. Use of mHealth messages may be useful for increasing expenditure on food and diet diversity during cash transfer programmes. However, in this context, they failed to achieve any direct health benefits, despite achieving high engagement. Future studies should include iterative message design and intensive pretesting of content and format with participant volunteers. This would help to maximise the chances of utilising this potentially desirable modality to achieve health and nutrition impacts in this complex context.

Supporting information

S1 CONSORT Checklist. CONSORT 2010 checklist of information study checklist prepared using CONSORT guidelines.

https://doi.org/10.1371/journal.pmed.1004180.s001

(DOC)

S1 Table. Data collected during each of the 9 rounds (R1-R9).

https://doi.org/10.1371/journal.pmed.1004180.s002

(DOCX)

S2 Table. Expanded programme of immunisation schedule in Somalia.

https://doi.org/10.1371/journal.pmed.1004180.s003

(DOCX)

S3 Table. Cause-specific mortality fraction within each trial arm ranked by proportional contribution.

https://doi.org/10.1371/journal.pmed.1004180.s004

(DOCX)

S4 Table. List of 20 statements used to assess mother/caregiver knowledge.

https://doi.org/10.1371/journal.pmed.1004180.s005

(DOCX)

S5 Table. Unadjusted primary outcome indicators at baseline, midline, and endline in the conditional cash transfer vs control comparison.

https://doi.org/10.1371/journal.pmed.1004180.s006

(DOCX)

S6 Table. Crude vaccination coverage of children aged 0–59 months at baseline, midline, and endline in the conditional cash transfer vs control comparison.

https://doi.org/10.1371/journal.pmed.1004180.s007

(DOCX)

S7 Table. Unadjusted primary outcome indicators at baseline, midline, and endline in the mHealth vs control comparison.

https://doi.org/10.1371/journal.pmed.1004180.s008

(DOCX)

S8 Table. Combined effects of the conditional cash transfer (CCT) and mHealth interventions on primary outcomes.

https://doi.org/10.1371/journal.pmed.1004180.s009

(DOCX)

Acknowledgments

We gratefully acknowledge the cooperation of the study participants and the work of all members of the field data collection teams.

References

  1. 1. UNICEF, WHO, World Bank. Levels and Trends in Child Malnutrition, UNICEF / WHO / World Bank Group Joint Child Malnutrition Estimates. 2021.
  2. 2. Black RE, Victora CG, Walker SP, Bhutta ZA, Christian P, de Onis M, et al. Maternal and Child Nutrition 1—Maternal and child undernutrition and overweight in low-income and middle-income countries. Lancet. 2013;382(9890):427–451. pmid:23746772
  3. 3. Kinyoki DK, Berkley JA, Moloney GM, Kandala NB, Noor AM. Predictors of the risk of malnutrition among children under the age of 5 years in Somalia. Public Health Nutr. 2015;18(17):3125–33. Epub 2015/06/20. pmid:26091444; PubMed Central PMCID: PMC4697134.
  4. 4. Seal A, Checchi F, Balfour N, Nur A-RH, Jelle M. A weak health response is increasing the risk of excess mortality as food crisis worsens in Somalia. Confl Health. 2017;11(1):12. Epub 03/07/2017. WOS:000406117200001. pmid:28680460
  5. 5. WHO. State of the world’s vaccines and immunization. World Health Organization, UNICEF, World Bank; 2009.
  6. 6. Doocy S, Tappis H. Cash-based approaches in humanitarian emergencies: A systematic review. London; 2016 April.
  7. 7. Grijalva-Eternod CS, Jelle M, Haghparast-Bidgoli H, Colbourn T, Golden K, King S, et al. A cash-based intervention and the risk of acute malnutrition in children aged 6–59 months living in internally displaced persons camps in Mogadishu, Somalia: A non-randomised cluster trial. PLoS Med. 2018;15(10):e1002684. Epub 29/10/2018. pmid:30372440; PubMed Central PMCID: PMC6205571.
  8. 8. Lagarde M, Haines A, Palmer N. The impact of conditional cash transfers on health outcomes and use of health services in low and middle income countries. Cochrane Database Syst Rev. 2009;(4):55. Epub 2009/10/13. WOS:000270687000060; PubMed Central PMCID: PMC7177213. pmid:19821444
  9. 9. Pega F, Liu SY, Walter S, Lhachimi SK. Unconditional cash transfers for assistance in humanitarian disasters: effect on use of health services and health outcomes in low- and middle-income countries. Cochrane Database Syst Rev. 2015;9:84. WOS:000366059800064 pmid:26360970
  10. 10. Soofi SB, Ariff S, Khan GN, Habib A, Kureishy S, Ihtesham Y, et al. Effectiveness of unconditional cash transfers combined with lipid-based nutrient supplement and/or behavior change communication to prevent stunting among children in Pakistan: a cluster randomized controlled trial. Am J Clin Nutr. 2021. pmid:34612491
  11. 11. Siddiqi A, Rajaram A, Miller SP. Do cash transfer programmes yield better health in the first year of life? A systematic review linking low-income/middle-income and high-income contexts. Arch Dis Child. 2018;103(10):920–6. Epub 2018/05/01. pmid:29705725.
  12. 12. Sun S, Huang J, Hudson DL, Sherraden M. Cash Transfers and Health. Annu Rev Public Health. 2021;42:363–80. Epub 2021/01/05. pmid:33395543.
  13. 13. Seal A, Bailey R. Famine in Somalia and the Failure of Data-Driven Humanitarianism2013. Available from: http://blogs.plos.org/speakingofmedicine/2013/04/04/famine-in-somalia-and-the-failure-of-data-driven-humanitarianism/.
  14. 14. Seal A, Hailey P, Bailey R, Maxwell D, Majid N. Famine, conflict, and political indifference. BMJ. 2017;357. Epub 10/05/2017. WOS:000401169600003. pmid:28490428
  15. 15. OCHA. Humanitarian Needs Overview: Somalia, 2017. 2018.
  16. 16. Kalid M, Osman F, Sulaiman M, Dykes F, Erlandsson K. Infant and young child nutritional status and their caregivers’ feeding knowledge and hygiene practices in internally displaced person camps, Somalia. BMC Nutrition. 2019;5(1):59. pmid:32153972
  17. 17. Hedlund K, Majid N, Maxwell D, Nicholson N. Final Evaluation of the Unconditional Cash and Voucher Response to the 2011–12 Crisis in Southern and Central Somalia. Humanitarian Outcomes. 2012. Available from: https://www.calpnetwork.org/publication/final-evaluation-of-the-unconditional-cash-and-voucher-response-to-the-2011-12-crisis-in-southern-and-central-somalia/
  18. 18. Jelle M, Grijalva-Eternod CS, Haghparast-Bidgoli H, King S, Cox CL, Skordis-Worrall J, et al. The REFANI-S study protocol: a non-randomised cluster controlled trial to assess the role of an unconditional cash transfer, a non-food item kit, and free piped water in reducing the risk of acute malnutrition among children aged 6–59 months living in camps for internally displaced persons in the Afgooye corridor, Somalia. BMC Public Health. 2017;17(1):632. Epub 06/07/2017. WOS:000405872500004. pmid:28683834
  19. 19. Roy SK, Fuchs GJ, Mahmud Z, Ara G, Islam S, Shafique S, et al. Intensive nutrition education with or without supplementary feeding improves the nutritional status of moderately-malnourished children in Bangladesh. J Health PopulNutr. 2005;23(4):320–330. pmid:16599102
  20. 20. Byass P, Hussain-Alkhateeb L, D’Ambruoso L, Clark S, Davies J, Fottrell E, et al. An integrated approach to processing WHO-2016 verbal autopsy data: the InterVA-5 model. BMC Med. 2019;17(1):102. Epub 2019/05/31. pmid:31146736; PubMed Central PMCID: PMC6543589.
  21. 21. WHO recommendations on home-based records for maternal, newborn and child health. Geneva: World Health Organisation; 2018.
  22. 22. Jennings HM, Morrison J, Akter K, Kuddus A, Ahmed N, Kumer Shaha S, et al. Developing a theory-driven contextually relevant mHealth intervention. Glob Health Action. 2019;12(1):1550736–. pmid:31154988.
  23. 23. Kennedy G, Berardo A, Papavero C, Horjus P, Ballard T, Dop M, et al. Proxy measures of household food consumption for food security assessment and surveillance: comparison of the household dietary diversity and food consumption scores. Public Health Nutr. 2010;13(12):2010–2018. WOS:000284709000010 pmid:20602864
  24. 24. WHO. Indicators for assessing infant and young child feeding practices part 2. World Health Organisation; 2010.
  25. 25. Maxwell D, Caldwell R. The Coping Strategies Index: A Tool for Rapid Measurement of Household Food Security and the Impact of Food Aid Programs in Humanitarian Emergencies. USAID/CARE/WFP/Tufts University/TANGO; 2008.
  26. 26. National Immunization Policy, Somalia. Mogadishu: Federal Government of Somalia; 2014.
  27. 27. D’Ambruoso L, Boerma T, Byass P, Fottrell E, Herbst K, Källander K, et al. The case for verbal autopsy in health systems strengthening. Lancet Glob Health. 2017;5(1):e20–e21. pmid:27866775
  28. 28. Hemming K, Marsh J. A menu-driven facility for sample-size calculations in cluster randomized controlled trials. Stata J. 2013;13(1):114–135.
  29. 29. Holm S. A Simple Sequentially Rejective Multiple Test Procedure. Scand J Stat. 1979;6(2):65–70.
  30. 30. Onwuchekwa C, Verdonck K, Marchal B. Systematic Review on the Impact of Conditional Cash Transfers on Child Health Service Utilisation and Child Health in Sub-Saharan Africa. Front Public Health. 2021;9:643621. Epub 2021/08/03. pmid:34336755; PubMed Central PMCID: PMC8316722.
  31. 31. MacDonald SE, Russell ML, Liu XC, Simmonds KA, Lorenzetti DL, Sharpe H, et al. Are we speaking the same language? an argument for the consistent use of terminology and definitions for childhood vaccination indicators. Hum Vaccin Immunother. 2019;15(3):740–7. Epub 2018/11/21. pmid:30457475; PubMed Central PMCID: PMC6605715.
  32. 32. Sphere Handbook: Humanitarian Charter and Minimum Standards in Disaster Response: Sphere Project; 2018 [cited 2018 18 July 2019]. Available from: http://www.sphereproject.org/handbook/.
  33. 33. Seal AJ, Jelle M, Grijalva-Eternod CS, Mohamed H, Ali R, Fottrell E. Use of verbal autopsy for establishing causes of child mortality in camps for internally displaced people in Mogadishu, Somalia: a population-based, prospective, cohort study. Lancet Glob Health. 2021;9(9):e1286–e95. Epub 2021/08/21. pmid:34416214.
  34. 34. WHO Strategic Advisory Group. 2018 Assessment Report of the Global Vaccine Action Plan Strategic Advisory Group Of Experts On Immunization. Geneva: World Health Organisation; 2018. Available from: https://apps.who.int/iris/handle/10665/276967
  35. 35. Clark A, Sanderson C. Timing of children’s vaccinations in 45 low-income and middle-income countries: an analysis of survey data. Lancet. 2009;373(9674):1543–9. pmid:19303633
  36. 36. Akmatov MK, Kretzschmar M, Krämer A, Mikolajczyk RT. Timeliness of vaccination and its effects on fraction of vaccinated population. Vaccine. 2008;26(31):3805–11. pmid:18565626
  37. 37. Suárez-Castaneda E, Pezzoli L, Elas M, Baltrons R, Crespin-Elías EO, Pleitez OAR, et al. Routine childhood vaccination programme coverage, El Salvador, 2011—In search of timeliness. Vaccine. 2014;32(4):437–44. pmid:24315884
  38. 38. Qazi U, Malik S, Raza UA, Saad M, Zeeshan MF, Anwar S. Compliance to timely vaccination in an Expanded Program on Immunization center of Pakistan. Vaccine. 2019;37(32):4618–22. pmid:29395529
  39. 39. Okoli U, Morris L, Oshin A, Pate MA, Aigbe C, Muhammad A. Conditional cash transfer schemes in Nigeria: potential gains for maternal and child health service uptake in a national pilot programme. BMC Pregnancy Childbirth. 2014;14:408. Epub 2014/12/17. pmid:25495258; PubMed Central PMCID: PMC4273319.
  40. 40. IA2030. Immunisation Agenda 2030. IA2030, 2020.
  41. 41. Hall CS, Fottrell E, Wilkinson S, Byass P. Assessing the impact of mHealth interventions in low- and middle-income countries—what has been shown to work? Glob Health Action. 2014;7:25606. Epub 2014/11/02. pmid:25361730; PubMed Central PMCID: PMC4216389.
  42. 42. Bhurosy T, Middlestadt SE, Lin HC, Thiagarajah K, Fly AD. A Randomized mHealth Trial to Promote Vegetable Intake Through Counting and Goal Setting. J Nutr Educ Behav. 2020;52(12):1111–9. Epub 2020/10/11. pmid:33036918.
  43. 43. Binyaruka P, Borghi J. Validity of parental recalls to estimate vaccination coverage: evidence from Tanzania. BMC Health Serv Res. 2018;18(1):440. Epub 2018/06/14. pmid:29895298; PubMed Central PMCID: PMC5998457.