Skip to main content
Advertisement
  • Loading metrics

Universal versus conditional day 3 follow-up for children with non-severe unclassified fever at the community level in the Democratic Republic of the Congo: A cluster-randomized, community-based non-inferiority trial

  • Luke C. Mullany ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Software, Supervision, Writing – original draft, Writing – review & editing

    lcm@jhu.edu

    Affiliation Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Elburg W. van Boetzelaer,

    Roles Data curation, Investigation, Methodology, Supervision, Writing – review & editing

    Affiliation International Rescue Committee, Kalemie, Democratic Republic of the Congo

  • Julie R. Gutman,

    Roles Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Malaria Branch, Division of Parasitic Diseases and Malaria, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Laura C. Steinhardt,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliation Malaria Branch, Division of Parasitic Diseases and Malaria, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Pascal Ngoy,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation International Rescue Committee, Kalemie, Democratic Republic of the Congo

  • Yolanda Barbera Lainez,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliation International Rescue Committee, New York, New York, United States of America

  • Alison Wittcoff,

    Roles Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliation International Rescue Committee, Kalemie, Democratic Republic of the Congo

  • Steven A. Harvey,

    Roles Conceptualization, Funding acquisition, Methodology, Writing – review & editing

    Affiliation Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Lara S. Ho

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation International Rescue Committee, New York, New York, United States of America

Abstract

Background

The World Health Organization’s integrated community case management (iCCM) guidelines recommend that all children presenting with uncomplicated fever and no danger signs return for follow-up on day 3 following the initial consultation on day 1. Such fevers often resolve rapidly, however, and previous studies suggest that expectant home care for uncomplicated fever can be safely recommended. We aimed to determine if a conditional follow-up visit was non-inferior to a universal follow-up visit for these children.

Methods and findings

We conducted a cluster-randomized, community-based non-inferiority trial among children 2–59 months old presenting to community health workers (CHWs) with non-severe unclassified fever in Tanganyika Province, Democratic Republic of the Congo. Clusters (n = 28) of CHWs were randomized to advise caregivers to either (1) return for a follow-up visit on day 3 following the initial consultation on day 1, regardless of illness resolution (as per current WHO guidelines; universal follow-up group) or (2) return for a follow-up visit on day 3 only if illness continued (conditional follow-up group). Children in both arms were assessed again at day 8, and classified as a clinical failure if fever (caregiver-reported), malaria, diarrhea, pneumonia, or decline of health status (development of danger signs, hospitalization, or death) was noted (failure definition 1). Alternative failure definitions were examined, whereby caregiver-reported fever was first restricted to caregiver-reported fever of at least 3 days (failure definition 2) and then replaced with fever measured via axillary temperature (failure definition 3). Study participants, providers, and investigators were not masked. Among 4,434 enrolled children, 4,141 (93.4%) met the per-protocol definition of receipt of the arm-specific advice from the CHW and a timely day 8 assessment (universal follow-up group: 2,210; conditional follow-up group: 1,931). Failure was similar (difference: –0.7%) in the conditional follow-up group (n = 188, 9.7%) compared to the universal follow-up group (n = 230, 10.4%); however, the upper bound of a 1-sided 95% confidence interval around this difference (−∞, 5.1%) exceeded the prespecified non-inferiority margin of 4.0% (non-inferiority p = 0.089). When caregiver-reported fever was restricted to fevers lasting ≥3 days, failure in the conditional follow-up group (n = 159, 8.2%) was similar to that in the universal follow-up group (n = 200, 9.1%) (difference: −0.8%; 95% CI: −∞, 4.1%; p = 0.053). If caregiver-reported fever was replaced by axillary temperature measurement in the definition of failure, failure in the conditional follow-up group (n = 113, 5.9%) was non-inferior to that in the universal follow-up group (n = 160, 7.2%) (difference: −1.4%; 95% CI: −∞, 2.5%; p = 0.012). In post hoc analysis, when the definition of failure was limited to malaria, diarrhea, pneumonia, development of danger signs, hospitalization, or death, failure in the conditional follow-up group (n = 108, 5.6%) was similar to that in the universal follow-up group (n = 147, 6.7%), and within the non-inferiority margin (95% CI: −∞, 2.9%; p = 0.017). Limitations include initial underestimation of the proportion of clinical failures as well as substantial variance in cluster-specific failure rates, reducing the precision of our estimates. In addition, heightened security concerns slowed recruitment in the final months of the study.

Conclusions

We found that advising caregivers to return only if children worsened or remained ill on day 3 resulted in similar rates of caregiver-reported fever and other clinical outcomes on day 8, compared to advising all caregivers to return on day 3. Policy-makers could consider revising guidelines for management of uncomplicated fever within the iCCM framework.

Trial registration

ClinicalTrials.gov NCT02595827

Author summary

Why was this study done?

  • Many children in low-resource settings presenting with febrile illness to community health workers have no danger signs and are not diagnosed with malaria, pneumonia, or diarrhea, and as a result, are sent home, and caregivers are advised to return on day 3 (after the initial consultation on day 1).
  • As many such non-severe unclassified febrile illnesses self-resolve, the advice given to caretakers could be simplified to return only if the illness continues or worsens.
  • Updating the guidelines requires evidence that simplified guidelines would not compromise the health status of these children.

What did the researchers do and find?

  • We conducted a cluster-randomized, community-based non-inferiority trial in the Democratic Republic of Congo, where children with non-severe unclassified febrile illness received either the current universal return advice or the simplified advice to return conditionally on illness continuation or progression.
  • We found evidence that the simplified advice did not result in any increased clinical failure of these children in the first week or first month after first presenting to community health workers.

What do these findings mean?

  • Our findings indicate that the health status of children presenting to community health workers with non-severe unclassified fever is unlikely to be compromised if caregivers are advised to return only if the illness continues or worsens.
  • An update to the global guidelines for integrated community case management could be considered, as simplified advice regarding return visits may reduce unnecessary follow-up visits, saving resources for families and health workers.

Introduction

Continued progress in reducing deaths in children under 5 years old in the context of weak health systems depends partially on the extent to which community health workers (CHWs) can rapidly identify and manage sick children in outpatient settings within their community [13]. The World Health Organization (WHO) provides guidelines for CHW cadres in low-resource settings to care for sick children aged 2–59 months through implementation of integrated community case management (iCCM) of common childhood illnesses [4,5], an extension of the integrated management of childhood illness (IMCI) approach to the community level. These guidelines prescribe that CHWs assess children through a combination of caregiver-directed questions and examination. For children with malaria, pneumonia, or diarrhea, CHWs provide direct treatment; for children with danger signs (such as inability to drink or breastfeed, vomiting everything, convulsions, or lethargy/loss of consciousness), CHWs refer immediately to a health center. Caregivers of children who present with fever but are neither diagnosed with malaria, pneumonia, or diarrhea nor have danger signs (non-severe unclassified fever) are advised to return with the child for reassessment on day 3 [4,5].

With recent progress in reducing overall childhood mortality and combating malaria burden, and increased availability of new childhood vaccines for pneumonia, strategies for management of febrile children are being reevaluated [6]. This is particularly true for uncomplicated febrile illnesses, which commonly resolve rapidly without any need for treatment, and are thought to largely be attributable to viruses [710]. Among 1,000 children presenting with fever at rural and urban outpatient clinics in Tanzania, viral infections dominated (71%), and fevers were nearly universally self-limiting [11]. Evidence of the safety of withholding treatment for malaria rapid diagnostic test (mRDT)–negative febrile children has been demonstrated in a number of studies [1,12,13]. For example, among nearly 1,000 mRDT-negative febrile children in Tanzania randomly assigned to receive or not receive anti-malarials, investigators found only 3 cases of bacteremia, and no serious adverse events or deaths, among untreated children [12]. In Zambia, when mRDT-negative febrile children were provided only an antipyretic, only 8.2% had continuing fever or were reported by their caregiver to be unwell at a follow-up visit 5–7 days later [13].

For febrile children who have no obvious or classified cause of fever and no danger signs on day 1, the current practice recommending universal follow-up on day 3 even in the absence of continued fever or other signs may be unwarranted, potentially adding substantially to CHW and caregiver time and resource costs. The time and effort to undertake unnecessary visits not only increase the work burden on CHWs, who are usually volunteers, but also represent important opportunity costs to caregivers, whose time might otherwise be utilized for important income-generating activities. To ease this burden, a change to iCCM guidelines could be implemented whereby CHWs advise caregivers to return with the child only if signs persist or worsen. Such an update to global iCCM guidelines, however, requires evidence that expectant home-based management does not compromise the health status of these children. We therefore implemented a cluster-randomized, community-based trial to examine the non-inferiority of advising caregivers to return with mRDT-negative febrile children without danger signs only in cases where the illness progresses or signs do not resolve, compared with universal follow-up (independent of sign resolution).

Methods

Study area

We conducted this study in the sparsely populated, southeastern Tanganyika Province of the Democratic Republic of the Congo (DRC), where malaria is endemic [14] and the frequency of formal care-seeking within public sector facilities is low [15]. The International Rescue Committee, in joint collaboration with the Ministry of Public Health, has been implementing the Rapid Access Expansion Program (RAcE) (funded by Global Affairs Canada, administered by WHO) to train and deploy CHWs to deliver iCCM in 11 health zones in Tanganyika Province. CHWs in this setting are not paid a salary, but receive a bicycle from the iCCM program to assist with travel to and from their linked health center. Services provided by CHWs are free of charge to community members. Two RaCE-participating health zones (Kalemie and Nyemba, total CHW catchment area population ~168,000) were selected as the geographic area for our study (Fig 1).

thumbnail
Fig 1. Map of study area.

Intervention, conditional follow-up; control, universal follow-up.

https://doi.org/10.1371/journal.pmed.1002552.g001

Study design and aims

Further details of our cluster-randomized non-inferiority trial have been published elsewhere [16]. Briefly, each of the 28 health areas (14 in each zone) consisted of a health center and a team of 1 to 18 associated CHWs: literate, locally resident volunteers who received 5 days of training on the iCCM algorithm and other core competencies (e.g., communication and recording) as per DRC Ministry of Public Health guidelines. We aimed to determine if the risk of clinical deterioration (“failure”) among children aged 2–59 months presenting to these CHWs with non-severe unclassified fever was similar between (1) those advised to follow up with the CHW on day 3 regardless of the child’s condition (universal follow-up) and (2) those advised to follow-up on day 3 only if illness did not resolve (conditional follow-up). Failure was assessed on day 8, and was defined as the child having caregiver-reported fever, 1 of the 3 CHW-treatable illnesses (i.e., malaria, diarrhea, or pneumonia), a referable danger sign, hospitalization, or death. We hypothesized that 5% of children would meet this definition under current guidelines (universal follow-up) and that the true rate of failure among children receiving the updated follow-up advice (conditional follow-up) would be 6%. Our a priori–defined non-inferiority margin for the conditional follow-up approach was 4 percentage points; specifically, conditional follow-up would be considered non-inferior if the upper bound of a 1-sided 95% confidence interval around the absolute difference in outcome rate (conditional follow-up minus universal follow-up) did not exceed 4%.

Randomization

We used restricted randomization balanced on zone and health area estimates of (1) population size, (2) prior 6-month likelihood of mRDT-negative febrile children (number of children mRDT negative/under-5 population), and (3) geographic distance from CHW to zonal health center to allocate the 28 health areas (and all the CHWs and the children they enrolled within these areas) to either universal or conditional follow-up advice (also see sample size section below) [16].

Eligibility and intervention

During the enrollment period for this study, any febrile child with neither danger signs nor a CHW-treatable illness (malaria, pneumonia, or diarrhea) was eligible; at initial presentation (day 1) all caregivers were advised to seek follow-up care with the CHW if signs worsened. The CHW then provided the cluster-specific advice about when to return for a follow-up visit. Specifically, CHWs in the universal follow-up group advised all caregivers to come back with the child on day 3, while those in the conditional follow-up group advised a return visit on day 3 only if signs remained the same or worsened.

Consent, enrollment, and data collection

CHWs verbally requested permission to subsequently (i.e., on day 8) visit the child and caregiver at home, at which point they would explain the study and obtain consent to participate; for those agreeing to this initial recruitment, the CHW notified his/her health area data collector of the eligible child. On the scheduled day 8 visit, the CHW and data collector jointly visited the home, obtained oral informed consent, enrolled the child, and conducted a standard assessment to record outcome and covariate data. The data collector recorded axillary temperature, respiratory rate, and mid-upper arm circumference (MUAC), then the CHW assessed the child using the standard iCCM algorithm. At this visit, any child with reported fever, or who was treated by the CHW for malaria, diarrhea, or pneumonia, or who had a referable danger sign was visited again 2 weeks (and, if necessary, again 4 weeks) later; procedures on repeat visits were identical to those on day 8. Final vital status (alive/died) of all enrolled children was recorded on day 31, regardless of the number of follow-up visits conducted. An additional structured questionnaire was administered (typically on day 8) to elicit information on household demographic and socioeconomic variables, and care-seeking before and after the initial visit to the CHW. All data were collected on paper forms, and identified with a unique 6-digit code, allowing linkage of data for each individual child while maintaining anonymity of child and caregiver identity.

Quality control

CHWs were fully trained on study procedures, including eligibility determination and delivery of the cluster-appropriate follow-up advice. Each week, supervising data collectors checked the iCCM registers maintained by CHWs to ensure that all eligible children were identified; these measures were supplemented by periodic spot checks of registers by senior field research staff, who also conducted periodic direct observation of data collector field work. Paper forms were checked for accuracy and completeness by a data officer, then entered twice into a secure online database (REDCap) [17] using customized data entry screens with built-in validation checks. Additional details have been previously published [16].

Sample size

We estimated that the true cluster-specific failure rates would vary between 1.5% and 8.5%, implying a coefficient of variation of approximately 0.35. Based on programmatic data from January to June 2015, we anticipated that of approximately 493 mRDT-negative fever cases per month across the 28 clusters, 70% would be eligible (i.e., after excluding children with danger signs or treatable conditions), leading to an annualized average cluster size of 148 eligible children, of which 90%, or 133, would be enrolled. We estimated that 12 health areas per group would be required to detect non-inferiority (i.e., 1-sided 5% significance) with 80% power [18,19], but elected to include all 28 available health areas (14 per group), thus increasing our a priori–estimated power to 86.8%. Soon after initiating enrollment, our estimate of total per cluster yield was revised to 152 (further increasing our estimated power), and leading to a final anticipated enrollment of 4,270, or 2,135 children per group.

Analysis

We first assessed randomization balance by comparing the distribution of child, maternal, household, socioeconomic, and CHW characteristics between the two groups, and noted any that appeared unbalanced. We next examined the proportion of children in each group whose caregivers reported receiving follow-up advice congruent with the allocation of their corresponding CHW, and the proportion of day 8 follow-up visits (i.e., outcome assessments) that occurred within ±24 hours of the scheduled date (i.e., between day 7 and 9, inclusive). The subset of children meeting both these criteria defined the group for conducting per-protocol analysis, which was our primary analytic approach, given the non-inferiority design. The primary outcome, failure at day 8, was defined as at least 1 of the following: (1) caregiver reports that the child currently has fever, (2) CHW classification of diarrhea, pneumonia, or malaria, (3) presence of a danger sign, (4) hospitalization, or (5) death. We estimated the difference in the proportion meeting this definition across the study arms (conditional minus universal) along with a 1-sided 95% confidence interval using a binomial regression model with an identity link function, and conducted robust standard error estimation to account for the clustered design.

To increase the specificity of our outcomes, we additionally examined 3 alternate definitions of failure, whereby the first component (caregiver report of fever) in the above composite definition was modified. The progressively specific modifications were as follows: definition 2 required that caregiver-reported fever had been present for ≥3 days, definition 3 used measured axillary temperature ≥ 38.0°C in place of the caregivers’ report (objective clinical failure), and definition 4 eliminated fever from the composite definition of failure. These 3 additional definitions were constructed and analyzed in a manner identical to the first definition. Among all 4 definitions, the first 3 were prespecified analyses. During a post-study analytic workshop in conjunction with discussions with the data and safety monitoring board, the fourth definition (requiring that at least 1 of death, hospitalization, referral for danger signs, or a CHW-treated illness was present) was added, in an effort to further increase specificity given the higher than expected rates of caregiver-reported fever. The estimation of the difference in failure rate between the 2 groups was repeated for each definition, adjusting for (i.e., including as fixed effects) variables appearing imbalanced. An intent-to-treat analysis, whereby the above-mentioned per-protocol requirements were removed, was also conducted. Finally, given the relatively small number of clusters, we also conducted a cluster-level analysis of the primary outcome definitions, using a t test to estimate the difference in the mean cluster-level proportions.

Secondary outcome analysis was descriptive; we describe the clinical presentation at enrollment, care-seeking patterns before and after enrollment, and longer-term outcomes 2 and 4 weeks later (at day 15 and day 29) of children that were classified as “failed” at day 8. All analyses were conducted using R (https://cran.r-project.org/) and Stata 14.2 (StataCorp, College Station, TX).

Ethical approval

The study protocol was approved by the Johns Hopkins Bloomberg School of Public Health’s Institutional Review Board (No. 6608), and the Ethical Committee of the Ministry of Public Health in Kinshasa, DRC (No. 001/CNES/CNES/SR/03/2015). US Centers for Disease Control and Prevention investigators participated under a non-engaged determination from their agency’s Office for Human Research Protections.

Results

Participation

Between October 12, 2015, and November 28, 2016, 233 CHWs working in Kalemie and Nyemba health zones identified 4,702 eligible children. For approximately 1.3% (n = 60) of these children, their caregivers declined to provide preliminary permission; for the remaining 4,642 eligible children, 14 of their caregivers refused to participate in the day 8 follow-up, and 170 (3.7%) were lost to follow-up between initial identification as eligible and the follow-up visit, while the caregivers for the remaining 4,458 children were met and provided consent. Refusal and loss to follow-up rates did not differ between the groups. After consent and upon extraction of information recorded by the CHW at enrollment, 17 children were excluded (13 and 4 in the universal and conditional follow-up groups, respectively) because they were found to meet the age-specific criteria for pneumonia and thus should not have been eligible. In the universal and conditional follow-up arms, respectively, there were 2,366 (mean age 2.1 years) and 2,068 (mean age 2.0 years) children who were assessed at the day 8 visit and provided information on final outcome (Fig 2).

Randomization balance

The groups were largely balanced on a range of child, maternal, household, and CHW characteristics (Table 1). Maternal literacy was slightly higher in the conditional follow-up group, while the distribution of self-reported religious affiliation, source of household water, and availability of electricity differed only slightly between the groups. CHWs to whom children initially presented were similar across groups in terms of marital and educational status and time since receiving CHW training, but a greater proportion presented to female CHWs in the conditional than in the universal follow-up group (28.3% versus 15.0%). There were no substantive differences between the groups in the clinical and care-seeking descriptors of children at enrollment (Table 2).

thumbnail
Table 1. Distribution of child, maternal, household, and CHW characteristics between universal and conditional follow-up groups.

https://doi.org/10.1371/journal.pmed.1002552.t001

thumbnail
Table 2. Clinical and care-seeking descriptors of enrolled children at initial presentation to CHW.

https://doi.org/10.1371/journal.pmed.1002552.t002

In both groups, approximately three-quarters of caregivers indicated that the fever had been present for 2 days or fewer. Caregivers were slightly more likely to report cough along with the presenting fever in the conditional follow-up group (314/2,064; 15.2%) compared with the universal follow-up group (256/2,363; 10.8%). Care-seeking prior to contacting the CHW was rare in both groups, with 4.7% (111/2,362) and 2.1% (43/2,065) reporting seeking some care (predominately from non-qualified providers including family members, neighbors, or traditional healers) prior to initial presentation to the CHW in the universal and conditional follow-up groups, respectively.

Advice given and return visits

More than 98% of caregivers reported that the CHW gave them follow-up advice that was congruent with the allocation of the cluster: in the universal follow-up group, 2,352 of 2,366 caregivers (99.4%) reported that the CHW indicated they should return on day 3, while in the conditional follow-up group, 2,044 of 2,068 (98.8%) reported being instructed to return on day 3 if the child’s illness had not resolved (Table 3).

thumbnail
Table 3. Advice given by CHWs, return visits made, and reasons for returning to the CHWs.

https://doi.org/10.1371/journal.pmed.1002552.t003

As a result, the overall rate of return to the CHW between enrollment and day 8 was substantially higher in the universal follow-up group (1,861/2,366, 78.7%) than the conditional follow-up group (187/2,068, 9.0%). In the conditional follow-up group, of the 187 caregivers who returned with their child, 41 reported returning because the CHW directed them to return (21.9% of all returnees, but only 2.0% of the group overall). Caregivers’ reports of return visits to the CHW matched very closely with the CHWs’ own records; sensitivity and specificity of the caregiver’s report compared to gold standard CHW records were 95.7% and 98.2%, respectively. Less than 3% of caregivers reported that their child received any anti-malarials, antibiotics, or medications for diarrhea during the period following the initial visit to the CHW, and there were no differences between the groups.

Primary outcome analysis

Among all enrolled children, 93.4% (4,141/4,434) met the per-protocol management definition and were included in the primary outcome analysis. Among those not meeting this definition (n = 293), this was because the day 8 visit occurred late (i.e., >9 days, n = 237, 80.9%) or early (i.e., <6 days, n = 21, 7.2%), or caregivers reported receiving advice incongruent with the allocation (n = 29, 9.9%). Among the 4,141 included children, the overall rate of failure using the primary outcome definition was 10.1%; cluster-specific rates varied substantially across the 28 clusters (mean = 11.6%, SD: 8.2), resulting in a coefficient of variation of 0.71. The total number (and proportion) of children meeting the primary outcome definitions was similar regardless of the advice provided (Table 4).

thumbnail
Table 4. Proportion of children meeting the failure definitions and individual components of the failure definitions at day 8 visit (per-protocol analysis).

https://doi.org/10.1371/journal.pmed.1002552.t004

For our first definition (primary), the rate of failure in the conditional follow-up group (9.74%, 188/1,931) was 0.67% lower than in the universal follow-up group (10.41%, 230/2,210), but the upper bound of the 1-sided 95% confidence interval was 5.1%, slightly above our non-inferiority margin (p = 0.089). Failure rates were similar between the 2 groups for all alternative definitions. When caregiver-reported fever was restricted to fevers lasting ≥3 days, the upper bound of the 1-sided 95% confidence interval (4.1%) exceeded the non-inferiority margin; when utilizing axillary temperature to classify fever, the upper bound was 2.2%. When clinical failure was defined in terms of the health outcomes death, hospitalization, referral for danger signs, or a CHW-classified and -treated condition (malaria, pneumonia, or diarrhea), the absolute failure proportions were 5.59% and 6.65% in the conditional and universal follow-up groups, respectively (absolute difference: −1.06%; 95% CI: −∞, 2.85%; p = 0.017).

The likelihood of individual components of the failure definition was likewise similar in both groups (Table 4). Overall, caregivers reported the child had fever at the time of follow-up in 200 (9.1%) and 151 (7.8%) cases in the universal and conditional follow-up groups, respectively. The overall proportion of children with fever reduced to about 5.1% overall considering only children whose caregiver-reported fever had been continuing for ≥3 days, and reduced further to 1.3% when fever was defined as axillary temperature ≥ 38.0°C (measured by the data collectors). In all, 105 (4.8%) and 78 (4.0%) children in the universal and conditional follow-up groups, respectively, were classified with malaria; other findings were rarely seen. There were 20 hospitalizations (9 and 11 in the universal and conditional follow-up groups, respectively) and 4 deaths (2 and 2, respectively) within 8 days.

Estimates of the absolute difference in failure rates between the groups, and the corresponding upper bounds of 1-sided 95% confidence intervals, did not change in any substantive way when conducting an intent-to-treat analysis (S1 Table). Similar results were obtained when adjusting for unbalanced variables or estimating outcomes using a cluster-level analysis (S2 Table).

Follow-up through 2 and 4 weeks

Of the 418 children who met the primary definition of failure at the day 8 visit, 385 (92.1%) had a follow-up visit at 2 weeks (day 15). Of these, 13.8% met the same definition of failure at day 15 (30/217) in the universal follow-up group, compared with 10.7% (18/168) in the conditional follow-up group. Among these 48 failures at 2 weeks (day 15), 45 visits were completed at 4 weeks, with 2 of 28 (7.1%) in the universal follow-up group and 1 of 17 (5.9%) in the conditional follow-up group meeting the failure definition. When considering all children in the per-protocol analysis over the entire follow-up period (including day 8, 2 weeks, 4 weeks, and day 31 [for vital status] follow-up), there were 151/2,210 (6.83%) and 111/1,931 (5.75%) instances of the most specific components of failure (death, hospitalization, referral for danger signs, or classification with malaria, pneumonia, or diarrhea) in the universal and conditional follow-up groups, respectively (absolute difference: −1.13%; 95% CI: −∞, 2.89%; p = 0.018).

Discussion

In these rural communities of southeastern DRC, caregivers depend heavily on government-supported CHWs to respond to childhood illnesses, most commonly febrile illnesses. Caregivers and CHWs alike are best served if frameworks such as iCCM containing guidelines for fever management are based on the best available evidence, and promote efficiency in use of scarce resources, including CHW and caregiver time. In this study, we found that advising caregivers of children under 5 years old presenting with uncomplicated fever to return on day 3 only if signs continued or worsened resulted in similar rates of clinical failure in the week after presentation when compared with current guidance of universal follow-up visits on day 3. Compared to caregiver-reported fever, the statistical strength of the evidence for non-inferiority was greater for measured fever, danger signs requiring referral, or other clinical outcomes (CHW-treatable diagnoses, hospitalization, or death). We also observed consistency of parameter estimates (i.e., little difference in failure rates) across all definitions, when considering individual components of the clinical failure definitions, and when taking an intent-to-treat versus per-protocol analytic approach. This study was planned in conjunction with a similar sister study in Southern Nations, Nationalities, and Peoples’ Region, Ethiopia (ClinicalTrials.gov identifier NCT02926625), where the prevalence of malaria is much lower. The results were similar, with an absolute difference of –3.81% (95% CI: −∞, 0.65%) between the conditional and universal follow-up groups for the primary outcome [20], indicating that the conditional approach was minimally inferior or non-inferior to universal follow-up across at least 2 different settings of malaria epidemiology and health systems.

Approximately 90% of illnesses resolved within a week, in line with findings from some other studies of mRDT-negative fevers where artemisinin-based combination therapies were withheld [1,13], though this proportion is lower than the 98%–99% resolution of other reports [3,21]. In our study, on day 8, 8.5% of caregivers overall reported that the child had fever; however, only 5.1% reported fever that had been present for at least 3 days, suggesting that some of those with fever on day 8 might have had a new illness unrelated to the initial presentation. More than half (52.1%) of all failures and almost three-quarters (71.6%) of objective clinical failures were due to malaria, a slightly higher rate than in other studies [1,21], likely reflecting higher levels of transmission at this site.

In some communities, even when current guidelines are followed and CHWs advise universal follow-up on day 3, the actual return visit rate may be substantially lower than 100%. Prior to conducting the trial, we posited that adherence to the universal follow-up advice might be poor. The return visit rate for children in this group, however, approached 80%, but this is not necessarily generalizable to other settings. In our setting, some CHWs in the universal follow-up group reported actively seeking out children for their follow-up visit; further investigation would be needed to understand what the return rate would be in settings where CHWs did not actively follow up children on day 3. The rate of return does not, however, directly affect the interpretation of the original question, which is focused on the actions/guidance of the CHW and does not depend on the response of the caregivers. This can be understood by considering the extreme case: if all caregivers returned only if the child continued to be sick, regardless of universal or conditional follow-up advice, then the natural conclusion would be that the advice given is irrelevant (i.e., equivalent) relative to health status at day 8.

Along these lines, CHWs in some countries typically refer febrile children with a negative mRDT to health facilities. However, caregivers in many cases do not complete the referral [22], perhaps perceiving their child’s illness to be insufficiently serious to comply; this might undermine CHW referral advice when truly warranted (e.g., children with danger signs) [23]. Simplifying guidelines about CHW advice about management of non-malarial febrile illness could reduce confusion and increase compliance with CHW referral advice for severe cases. Additionally, reducing unnecessary follow-up visits and referrals may save resources, both for families and for CHWs and facility health workers. We note that this conclusion applies only to the subset of febrile children presenting to CHWs who are not treated or referred for danger signs; when this subset is a very small proportion of those visiting CHWs, the savings in terms of time and resources would be less.

There were a number of limitations to this study. We underestimated the overall rate of clinical failure when including caregiver’s report of fever in the definition; at the design stage we anticipated that approximately 5% of children would be classified as failures at the day 8 follow-up, yet the actual rate was closer to double this. As a result, the non-inferiority margin, which was set a priori at 4%, ultimately represented a smaller relative increase in failure than we originally considered as representing non-inferiority. This issue may have arisen in part from the nature of the primary outcome definition; it is possible that caregivers may have overreported fever at 8 days if they perceived a greater likelihood of receipt of medicine, advice, or other material assistance if fever was reported in the presence of the data collector. In general, for all iterations of the clinical failure definition, the substantial variance in cluster-specific rates reduced the precision of our estimates around the difference in rates. Despite this decrease in power, only for the definitions that included caregiver-reported fever did this result in the upper bound of the confidence interval exceeding the non-inferiority margin. Finally, this region of DRC remains continuously affected by ongoing security concerns due to low-level conflict between multiple armed groups. While we were largely successful in conducting the study throughout the planned data collection period, slowly increasing levels of tensions in some areas led to restricted movement for caregivers, CHWs, and data collectors, leading to slightly lower recruitment rates as the study progressed.

Conclusion

A driving concern underlying the choice between universal and conditional follow-up recommendations for children with uncomplicated fever is that under the less intense conditional follow-up approach, a greater proportion of children might suffer clinical outcomes. In the current study, we found largely similar likelihoods of clinical failure regardless of the approach used for follow-up advice, using a series of increasingly restrictive definitions. Specifically, when clinical failure comprised objective outcomes (hospitalization or death) and CHW-observed measures of clinical deterioration (i.e., progression to malaria, pneumonia, or diarrhea, or referable danger signs), our data, in conjunction with the data from Ethiopia, provide evidence that conditional follow-up is non-inferior to universal follow-up. iCCM guidelines could be updated to allow either approach to management of uncomplicated fever, so that decision-making for policy-makers can be responsive to context-specific considerations while still adhering to global recommendations.

Supporting information

S1 Table. Proportion of children meeting failure definitions and individual definition components at day 8 visit (intent-to-treat analysis).

https://doi.org/10.1371/journal.pmed.1002552.s002

(DOCX)

S2 Table. Comparison of unadjusted, adjusted, and cluster-level analysis for failure definitions.

https://doi.org/10.1371/journal.pmed.1002552.s003

(DOCX)

Acknowledgments

This study was made possible by the support of the American people through the United States Agency for International Development (USAID). The findings of this study are the sole responsibility of the authors and do not necessarily reflect the views of USAID, the US Centers for Disease Control and Prevention, or the United States government. We would like to acknowledge Larry Barat and Meera Venkatesan for providing valuable input into the design and conceptualisation of this study.

References

  1. 1. Mubi M, Janson A, Warsame M, Martensson A, Kallander K, Petzold MG, et al. Malaria rapid testing by community health workers is effective and safe for targeting malaria treatment: randomized cross-over trial in Tanzania. PLoS ONE. 2011;6:e19753. pmid:21750697
  2. 2. Yeboah-Antwi K, Pilingana P, Macleod WB, Semrau K, Siazeele K. Community case management of fever due to malaria and pneumonia in children under five in Zambia: a cluster randomized control trial. PLoS Med. 2010;7:e1000340. pmid:20877714
  3. 3. Mukanga D, Tiono AB, Anyorigiya T, Källander K, Konate AT, Oduro AR. Integrated community case management of fever in children under five using rapid diagnostic tests and respiratory rate counting: a multi-country cluster randomized trial. Am J Trop Med Hyg. 2012;87(5):21–9.
  4. 4. World Health Organization. Caring for the sick child in the community: participant’s manual. Geneva: World Health Organization; 2011 [cited 2018 Jan 30]. Available from: http://apps.who.int/iris/bitstream/10665/44398/1/9789241548045_Manual_eng.pdf.
  5. 5. World Health Organization. Caring for the sick child in the community: chart booklet. Geneva: World Health Organization; 2011 [cited 2018 Jan 30]. Available from: http://apps.who.int/iris/bitstream/10665/44398/4/9789241548045_Chart_Booklet_eng.pdf.
  6. 6. Herlihy JM, D’Acremont V, Hay Burgess DC, Hamer DH. Diagnosis and treatment of the febrile child. In: Black RE, Laxminarayan R, Temmerman M, Walker N, editors. Reproductive, maternal, newborn, and child health. Disease control priorities, 3rd edition, volume 2. Washington (DC): World Bank; 2016.
  7. 7. Elfving K, Shakely D, Andersson M, Baltzell K, Ali AS, Bachelard M, et al. Acute uncomplicated febrile illness in children aged 2–59 months in Zanzibar—aetiologies, antibiotic treatment and outcome. PLoS ONE. 2016;11(1):e0146054. pmid:26821179
  8. 8. Crump JA, Morrissey AB, Nicholson WL, Massung RF, Stoddard RA, Galloway RL, et al. Etiology of severe non-malaria febrile illness in Northern Tanzania: a prospective cohort study. PLoS Negl Trop Dis. 2013;7:e2324. pmid:23875053
  9. 9. Hertz JT, Munishi OM, Sharp JP, Reddy EA, Crump JA. Comparing actual and perceived causes of fever among community members in a low malaria transmission setting in northern Tanzania. Trop Med Int Health. 2013;18(11):1406–15. pmid:24103083
  10. 10. World Health Organization. WHO informal consultation on fever management in peripheral health care settings: a global review of evidence and practice. Geneva: World Health Organization; 2013.
  11. 11. D’Acremont V, Kilowoko M, Kyungu E, Philipina S, Sangu W, Kahama-Maro J, et al. Beyond malaria—causes of fever in outpatient Tanzanian children. N Engl J Med. 2014;370:809–17. pmid:24571753
  12. 12. McMorrow M, Ahmed S, Lyaruu P, Maganga M, Lyimo T, Abdulla SM, et al. Randomized, controlled trial of treatment of febrile children with a negative malaria rapid diagnostic test with artemether-lumefantrine vs. no antimalarial in Bagamoyo District, Tanzania. Am J Trop Med Hyg. 2012;87(5S1):252–3.
  13. 13. Hamer DH, Brooks ET, Semrau K, Pilingana P, MacLeod WB, Siazeele K, et al. Quality and safety of integrated community case management of malaria using rapid diagnostic tests and pneumonia by community health workers. Pathog Glob Health. 2012;106:32–9. pmid:22595272
  14. 14. Ministère du Plan et Suivi de la Mise en œuvre de la Révolution de la Modernité, Ministère de la Santé Publique, Measure DHS. République Démocratique du Congo Enquête Démographique et de Santé 2013–2014. Rockville (MD): ICF International; 2014.
  15. 15. National Institute of Statistics, United Nations Children’s Fund. Multiple Indicator Cluster Survey—Democratic Republic of Congo (MICS-DRC 2010). Final report. New York: United Nations Children’s Fund; 2011.
  16. 16. van Boetzelaer , Ho LS, Gutman JR, Steinhardt LC, Wittcoff A, Barbera Y, et al. Universal versus conditional three-day follow up visit for children with uncomplicated fever at the community level: design of a cluster-randomized, community-based, non-inferiority trial in Tanganyika, Democratic Republic of Congo. BMC Pediatr. 2017;17(1):36. pmid:28122542
  17. 17. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. pmid:18929686
  18. 18. Blackwelder WC. “Proving the null hypothesis” in clinical trials. Control Clin Trials. 1982;3(4):345–53. pmid:7160191
  19. 19. Hayes RJ, Moulton LH. Cluster randomized trials. Boca Raton: Chapman & Hall; 2009.
  20. 20. Källander K, Alfvén T, Funk T, Abebe A, Hailemariam A, Getachew D, et al. Universal versus conditional day 3 follow-up for children with non-severe unclassified fever at the community level in Ethiopia: a cluster-randomised non-inferiority trial. PLoS Med. 2018;15(4):e1002553.
  21. 21. d’Acremont V, Malila A, Swai N, Tillya R, Kahama-Maro J, Lengeler C, et al. Withholding antimalarials in febrile children who have a negative result for a rapid diagnostic test. Clin Infect Dis. 2010;51:506–11. pmid:20642354
  22. 22. Nanyonjo A, Bagorogoza B, Kasteng F, Ayebale G, Makumbi F, Tomson G, et al. Estimating the cost of referral and willingness to pay for referral to higher-level health facilities: a case series study from an integrated community case management programme in Uganda. BMC Health Serv Res. 2015;15:347. pmid:26315661
  23. 23. Ruizendaal E, Dierickx S, Peeters Grietens K, Schallig HD, Pagnoni F, Mens PF. Success or failure of critical steps in community case management of malaria with rapid diagnostic tests: a systematic review. Malar J. 2014;13:229. pmid:24924295