Figures
Abstract
Introduction
Sepsis is dysregulated systemic inflammatory response which can lead to tissue damage, organ failure, and death. With an estimated 30 million cases per year, it is a global public health concern. Severe infections leading to sepsis account for more than half of all under five deaths and around one quarter of all neonatal deaths annually. Most of these deaths occur in low and middle income countries and could be averted by rapid assessment and appropriate treatment. Evidence suggests that service provision and quality of care pertaining to sepsis management in resource poor settings can be improved significantly with minimum resource allocation and investments. Cognizant of the stark realities, a project titled ‘Interrupting Pathways to Sepsis Initiative’ (IPSI) introduced a package of interventions for improving quality of care pertaining to sepsis management at 2 sub-district level public hospitals in rural Bangladesh. We present here the quality improvement process and achievements regarding some fundamental steps of sepsis management which include rapid identification and admission, followed by assessment for hypoxemia, hypoglycaemia and hypothermia, immediate resuscitation when required and early administration of parenteral broad spectrum antibiotics.
Materials and Method
Key components of the intervention package include identification of structural and functional gaps through a baseline environmental scan, capacity development on protocolized management through training and supportive supervision by onsite ‘Program Coaches’, facilitating triage and rapid transfer of patients through ‘Welcoming Persons’ and enabling rapid treatment through ‘Task Shifting’ from on-call physicians to on-duty paramedics in the emergency department and on-call physicians to on-duty nurses in the inpatient department.
Results
From August, 2013 to March, 2015, 1,262 under-5 children were identified as syndromic sepsis in the emergency departments; of which 82% were admitted. More neonates (30%) were referred to higher level facilities than post-neonates (6%) (p<0.05). Immediately after admission, around 99% were assessed for hypoxemia, hypoglycaemia and hypothermia. Around 21% were hypoxemic (neonate-37%, post-neonate-18%, p<0.05), among which 94% received immediate oxygenation. Vascular access was established in 78% cases and 85% received recommended broad spectrum antibiotics parenterally within 1 hour of admission. There was significant improvement in the rate of establishing vascular access and choice of recommended first line parenteral antibiotic over time. After arrival in the emergency department, the median time taken for identification of syndromic sepsis and completion of admission procedure was 6 minutes. The median time taken for completion of assessment for complications was 15 minutes and administration of first dose of broad spectrum antibiotics was 35 minutes. There were only 3 inpatient deaths during the reporting period.
Citation: Rahman AE, Iqbal A, Hoque DME, Moinuddin M, Zaman SB, Rahman QS-u, et al. (2017) Managing Neonatal and Early Childhood Syndromic Sepsis in Sub-District Hospitals in Resource Poor Settings: Improvement in Quality of Care through Introduction of a Package of Interventions in Rural Bangladesh. PLoS ONE 12(1): e0170267. https://doi.org/10.1371/journal.pone.0170267
Editor: Umberto Simeoni, Centre Hospitalier Universitaire Vaudois, FRANCE
Received: September 18, 2016; Accepted: December 30, 2016; Published: January 23, 2017
Copyright: © 2017 Rahman et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data are available at Figshare. (DOI: https://figshare.com/s/e3d417c4683beef8ee7c).
Funding: This study was a component of the project titled "Interrupting Pathways to Maternal, Newborn and Early Childhood Sepsis Initiative" (IPSI) (project number S065353001) that was funded by Global Affairs Canada Trade and Developments MUSKOKA Initiative on Maternal, Newborn and Child Health (MNCH), received by Dr. Charles Larson, url http://www.international.gc.ca/. The funders had no role in study design, data collection, analysis and writing the manuscript.
Competing interests: No competing interests to declare.
Introduction
Sepsis is defined as a dysregulated systemic inflammatory response due to a suspected or proven infection which can lead to tissue damage, organ failure, and death [1, 2]. It is the final common pathway to death due to pneumonia, diarrhoeal disease, malaria, bacterial septicemia, dengue and severe nosocomial infections among others [3]. With an estimated 30 million cases per year, it is a global public health concern [4, 5]. Severe infections leading to sepsis accounts for more than half of all under five deaths and around one quarter of all neonatal deaths annually [6–8]. The proportionate contribution of sepsis and other severe infections among neonatal deaths is greater than preterm birth (15%) and intra-partum related complications (11%) [6]. However, until recently, sepsis remained as a neglected issue in the global agenda. As a consequence, the rate of reduction of sepsis specific mortality between 1990 and 2010 has been much slower (4%) than that of preterm birth (29%) and intra-partum related complications (20%) [9]. Out of the total global research spending on newborn health, less than 15% is spent on prevention and treatment of severe infections and sepsis [10].
Early childhood sepsis, particularly neonatal sepsis, is among the most critical concerns for low and middle income countries. In 2012, an estimated 6.1 million neonates suffered from syndromic sepsis in South Asia and Sub Saharan Africa [11]. A significant proportion of these cases did not survive as the case fatality rate is very high with significant variation between countries and regions (8%-80%) [12, 13]. Similarly in Bangladesh, a developing country in South Asia, sepsis and other severe infections account for 39% of all under five deaths and 37% of all neonatal deaths [14].
Sepsis should be recognized early and treated aggressively in hospital settings as appropriate case management can prevent 84% of deaths due to sepsis [15, 16]. In adults, each hour of delay in administration of appropriate antimicrobial agents in severe sepsis decreases survival rate by 7.6% [17]. While similar data in children are lacking, quality improvement endeavours which include early administration broad spectrum antibiotics and supportive care through a resuscitation bundle have resulted in dramatic improvements in resource rich environments [18–21]. However, sepsis still remains as one of the major killers in South-East Asia and other resource poor settings due to inadequate capacity for implementing guidelines that are crafted for resource rich environments [22]. As a result, sub-optimal care is the norm in many healthcare facilities [23, 24]. This finding has led to a call for implementation science in care delivery to help the poorest who suffer from sepsis [24].
Like many other developing countries, service provison, capacity and quality of care in public facilities of Bangladesh are sub-optimal. A recent study conducted in 18 public facilities in Bangladesh reported that triage in the emergency departments was inadequate, infection prevention practice was poor, use of supplemental oxygen was inappropriate and administration of parenteral antibiotics for syndromic sepsis was infrequent [25]. Other studies have also reported the gaps in public facilities in terms of skilled health workforce, supply of essential drugs, equipment and logistics [26–28].
Evidence suggests that the service provision and quality of care pertaining to sepsis management in resource poor settings can be improved significantly with minimum resource allocation and investments [29–33]. Cognizant of the stark realities in Bangladesh, the International Centre for Diarrheal Diseases Research, Bangladesh (icddr,b) and the University of British Columbia in collaboration with the Ministry of Health and Family Welfare (MOHFW) of Government of Bangladesh implemented a project titled ‘Interrupting Pathways to Sepsis Initiative’ (IPSI) in rural Bangladesh between 2012 and 2015. This was a quality improvement initiative which introduced a package of interventions including a resuscitation bundle for sepsis management at select public hospitals. The objective of this paper is to describe the quality improvement process and its key outcomes.
Materials and Methods
Study Site and Setting
The IPSI project was implemented in 2 sub-districts of Tangail district; which is located around 120 km North West to Dhaka city, the capital of Bangladesh. The sub-districts (locally known as upazila) are Gopalpur and Bhuapur which have a total population of around 500,000. The average population density is 1432 per square km in Gopalpur and 882 per square km in Bhuapur [34]. The literacy rate is around 41% and agriculture is the main source of income. Each upazila is served by a first level referral hospital which is locally known as the Upazila Health Complex (UHC) or sub-district hospital. A sub-district hospital has around 50 inpatient beds with outdoor and emergency services.
Study Design
We conducted a baseline environmental scan and based on the findings, we developed a simple standard operating practice for managing syndromic sepsis. Following that, we implemented a package of interventions in the demonstration hospitals, and documented the process of implementation and its outcomes between August 2013 and March 2015.
- 1. Baseline environmental scan: The baseline hospital environmental scan was undertaken to assess the structural and functional gaps pertaining to sepsis management in the demonstration hospitals. At first, we conducted a health facility survey in each hospital with trained physicians using a modified version of the WHO Health Facility Assessment Tool. Gaps related to infrastructure, availability of human resource, laboratory tests, equipment, drug and supply, knowledge and skill of health care providers, documentation and reporting system, and service utilization in outpatient, emergency and inpatient departments were explored and documented. Then, we employed a rapid hospital ethnography for five days in each facility by a team of trained physicians (#2) and an anthropologist. Gaps related to existing patient flow system, triage, admission procedure, transfer of patient to the inpatient department, initiation of treatment in the inpatient department, confidence of the health care providers, and monitoring and supervision mechanism were explored.
The following gaps were identified specific to management of syndromic sepsis:- Infrastructure: There were no dedicated beds or areas for pediatric patients suffering from infectious diseases. Hand washing facility was inadequate and ventilation system was poor.
- Knowledge, skills and practice of health care providers: There was inadequate knowledge regarding syndromic sepsis and its management options. Standard Operating Procedure (SoP) and job aids to manage syndromic sepsis were absent. There were also improper infection prevention and sanitation practices.
- Confidence of the health care providers: Doctors and nurses were not confident in managing neonates and young infants. As a result, nearly all children presenting with signs of severe infections were referred to higher level facilities. Regarding neonates, nearly all of them were referred to higher level facilities from the emergency department irrespective of their presenting complaints.
- Equipment, drugs and logistics: None of the hospitals had pulse oximeter or glucometer. The hospitals reported frequent stock outs of essential drugs (parenteral antibiotics, intravenous fluid) and supplies (infusion sets, oxygen, soaps).
- Documentation and record keeping: Documentation and record keeping system in both the hospitals were poor as there was no checklist or clinical service register. Information regarding personal details, clinical status and treatment details were inadequately documented in individual patient record forms in the inpatient department.
- Patient flow system and delays:
- There was no functioning triage in the emergency department. During busy hours, even the critically ill children had to wait in queue for long durations.
- There was delay in assessment and taking decisions regarding admission. During office hours (8 am to 2 pm), the emergency departments were serviced by a physician and a paramedic. However, after office hour, the physician used to stay on-call and the emergency department was primarily managed by a paramedic. Upon arrival of a sick children, the on-duty paramedic used to call the on-call physician after primary assessment. Then the on-call physician used to come to the emergency department, re-assess the child and take decision regarding admission.
- There was delay in transferring the patient after admission, as there was no assistance in navigating the patient from the emergency to the inpatient department.
- There was delay in initiating treatment in the inpatient department. The inpatient department was primarily managed by an on-duty nurse and an on-call physician. Upon arrival of a sick child after admission, the on-duty nurse used to call the on-call physician. The on-call physician used to come, assess and give order to the on-duty nurse to commence treatment. Moreover, there was no official mechanism to inform the inpatient from the emergency department regarding an admission.
- Supervision mechanism: There was no systematic mechanism for monitoring and supervision of clinical and administrative staff.
- 2. Developing a customized action plan for Quality Improvement: A workshop (one day) was organized in each hospital to share key findings from the baseline environmental scan. Facility managers and concerned clinical service providers (doctors, nurses and paramedics) attended the workshop and developed a customized action plan to address specific structural and functional gaps. Key recommendations to improve quality of care pertaining to management of syndromic sepsis included developing a simplified Standard Operating Procedure (SoP), education and skill enhancement of clinical service providers, developing job aids, introduction of patient record form and checklists, correction of the patient flow system, task shifting to minimize delays, introducing a supportive supervision mechanism, minor structural renovation, ensuring supply of essential equipment, drugs and logistics.
- 3. Developing a simplified SoP and an Implementation Package for management of syndromic sepsis: A simplified SoP was developed based on the Survival Sepsis Campaign guidelines [35], the Bangladesh adapted version of WHO pocket Book for Hospital Care of Children [36] and the Bangladesh National Neonatal Health Strategy and Guidelines of Bangladesh [37]. Senior pediatricians and public health specialists of Bangladesh were consulted to finalize the SoP. The SoP recommended four key steps for effective management of syndromic sepsis (Fig 1).
Step 1- Triage, Identification and Rapid Admission: Sick children will be prioritized in the emergency department followed by identification of syndromic sepsis through clinical assessment and immediate admission for proper treatment. Neonatal (0–28 days) syndromic sepsis was defined as the presence of any of the following sign/ symptoms—hypothermia, hyperthermia, altered mental status, convulsion, respiratory distress, umbilical infection and not feeding properly. Early childhood (29 days to 59 months) syndromic sepsis was defined as the presence of any of the following sign/ symptoms—hypothermia, altered mental status, convulsion, respiratory distress and not feeding properly.
Step 2- Fast Assessment: After ‘Triage, Identification and Rapid Admission’; airway, breathing and circulation of the sick child will be assessed and corrective measures should be initiated if necessary. In addition, pulse, blood pressure, temperature, O2 saturation, random blood sugar and weight will be measured immediately after admission.
Step 3- Initial Management and Immediate Resuscitation: After ‘Fast Assessment’; vascular assess should be established as early as possible. Concurrently, corrective measures will be taken immediately for hypoxemia, hypothermia, hyperthermia and hypoglycemia.
Step 4- Parenteral administration of Broad Spectrum Antibiotics: After ‘Initial Management and Immediate Resuscitation’; broad spectrum antibiotics must be administered parenterally immediately. Parenteral Ampicillin (50 mg/kg body weight; 8 hourly) and Gentamicin (5mg/kg body weight for neonates and 7.5 mg/kg body weight for post neonates, once daily) combination will be the first line antibiotics and parenteral Ceftriaxone will be the second line antibiotics. In case of proven sepsis, the broad spectrum antibiotics will be continued for 7–10 days. In case of early discharge due to request from the care takers, oral antibiotics can be recommended after 48 hours of admission (if there is no other complication).
- 4. Education and skill enhancement of clinical service providers: A concise training package was developed based on the SoP. Doctors, nurses and paramedics directly involved with pediatric clinical services in the demonstration hospitals received one-day training on this package. Regular refreshers trainings were organized (quarterly in year one and six monthly in year two) to reinforce education and promote knowledge retention.
- 5. Flow charts to assist management: A clinical algorithm flow chart was prepared based on the SoP. These charts were placed in prominent positions in the emergency and inpatient departments to serve as quick references for clinicians. Some additional visual reminders related to infection prevention practice, hand washing and waste management were also developed and displayed in prominent positions.
- 6. Correction of patient flow system: The patient flow system was streamlined to address the delays in triage, assessment, admission and initiation of treatment. Two specific measures were taken for this purpose.
- ‘Welcome Persons’: A lay person known as the ‘Welcome Person’ was positioned 24/7 in the emergency department to facilitate the patient flow system. The ‘Welcome Person’ was responsible for greeting all children after arriving in the hospital and directly take them to the clinical service provider at the emergency department for clinical assessment. After ‘Tirage, Identification and Admission’, the ‘Welcome Person’ used to navigate the syndromic sepsis cases to the inpatient department and call in the on-duty nurse for conducting ‘Fast Assessment’.
- Task shifting: Selective task shifting was done to address delays related to admission in the emergency department and initiation treatment in the inpatient department. Task shifting in the emergency department ensured that the on-duty paramedic was allowed to clinically assess children, identify syndromic sepsis and admit them immediately by taking consent from the on-call physician over telephone. Similarly, task shifting in the inpatient department allowed the on-duty nurses to conduct ‘Fast Assessment’, ‘Initial Management and Immediate Resuscitation’ and ‘Parenteral administration of Broad Spectrum Antibiotics’ immediately with assent from the on-call physician.
- 7. Introduction of checklists and patient record forms: A ‘Syndromic Sepsis Case Finding Checklist’ was introduced in the emergency department. The checklist was filled by the on-duty paramedic for all children presenting in the emergency department. ‘Syndromic Sepsis Fast Assessment Checklist’, ‘Initial Management Checklist’, ‘Case Recording Form’, and ‘Management Outcome Tool’ were introduced in the inpatient department. These tools and checklists were maintained for all children admitted in the inpatient department with syndromic sepsis. These checklists were followed and filled by the on-duty nurse in the inpatient department.
- 8. Minor structural renovations: In the emergency department a hand washing facility with liquid soap dispenser was installed and minor repairs were made to improve infection control measures. In the inpatient department, a separate pediatric area to segregate children with suspected infections was created. The ventilation system was improved and hand washing facilities were established. Infection control measures also included basic medical waste management training which was provided to all concerned health care providers. Basic steps included- waste minimization, segregation, proper handling and disposal of waste.
- 9. Equipment and supply chain management: Glucometers and pulse oximeters were provided to each hospital. Intravenous fluids, injectable antibiotics (Ampicillin, Gentamicin and Ceftriaxone), infusion sets and syringes were supplied to prevent stock-outs. The hospital managers and supply chain personnel were advised on how to maintain an updated inventory of essential medications and fluids.
- 10. Supportive supervision and Program Coach: To ensure comprehensive implementation of the intervention package, central and onsite supportive supervision were introduced. Central supervision was done by key personnel from the Directorate General of Health Services through periodic field visits. Each of the demonstration hospitals was served by a physician employed by the project as a ‘Program Coach’. The ‘Program Coach’ provided on site supportive supervision during office hours and remained on-call after office hours to provide technical support to the clinical staff. The ‘Program Coach’ used to review the checklists and patient record forms, identify potential gaps regarding delays and adherence to SoP, and provide feedback to the concerned clinical staff and hospital managers to overcome those gaps.
Data Collection & Extraction
Data was extracted from the ‘Case Identification Checklist’, ‘Fast Assessment Checklist’, ‘Initial Management Checklist’, ‘Case Recording Form’ and ‘Management Outcome Tool’ by project staff who were not involved with implementation. After taking necessary preparation, the simplified SoP was officially launched in the demonstration hospital on 22 August, 2013. We are presenting the information from the launching till 31 March, 2015.
Ethics Statement
This was a quality improvement initiative which adopted national and international guidelines for managing syndromic sepsis. The service was delivered through government system as a routine service. Necessary approval was obtained from the Directorate General of Health Services of Ministry of Health and Family Welfare before commencing the quality improvement process in demonstration hospitals. In addition, we also obtained approval from the Institutional Review Board of icddr,b which consists of two independent committees; i.e Research Review Committee and Ethics Review Committee (protocol number PR 12076). We only extracted data from routine registers and hospital patient record forms with necessary de-identification. We did not interact with patients for collecting additional data for the study. Hence, the Institutional Review Board of icddr,b and the Directorate General of Health Services exempted us from obtaining consents from individual patients.
Data Analysis
Data was entered and stored in Microsoft SQL server and STATA version 13 special edition (College Station, Texas, USA) was used to analyze data. We used descriptive statistics to present the quality of care related to key steps of managing syndromic sepsis as per the SoP. Hypoxemia was defined as having pulse O2 saturation below 92%. Hypothermia was defined as having axillary temperature below 96°F and hypoglycemia as serum blood sugar level below 2.5 mmol/L. Each indicator was stratified by: age (0–28 days as neonates and 29 days-59 months as post neonates) and sex (male and female), hospital (Gopalpur and Bhuapur), time of admission (8.31 am-2 pm as office hours and 2.01 pm-8.30 am as after office hours) and day of arrival (Saturday-Thursday as weekdays and Friday as weekends). For categorical variables, we estimated proportions and for continuous variables, we estimated means and standard deviations. The point estimates were reported with 95% CI. Inferential statistics were used to assess the difference in proportions or means between categories of stratifying variables.
Time gaps between emergency arrival and completion of key steps related to managing syndromic sepsis were assessed. We used median with the inter-quartile range to present the time gaps as distributions of the data was skewed (checked using Kernel density estimation). The Mann-Whitney U test was employed for the equality of median for continuous variables. All the statistical tests were carried out at 5% level of significance with two sided alternatives.
Results
Between August 2013 and March 2015, a total of 1262 children (648 in Bhaupur and 614 in Gopalpur) were identified as syndromic sepsis in the emergency departments. Among the neonates identified as syndromic sepsis (n = 208), the most common sign/symptom was respiratory distress (72%) followed by feeding problem (43%), altered mental status (28%), hypothermia (11%), umbilical infection (9%), hyperthermia (8%) and convulsions (6%). Similarly, among the post neonates, the most common sign/symptom was respiratory distress (76%), followed by convulsions (23.6%), feeding problem (17%), altered mental status (13.6%) and hypothermia (3%).
Of the 1,262 children identified as syndromic sepsis, 82% were admitted, 10% were referred to the higher level district hospital from the emergency department and 8% refused admission. The rate of referral was much higher among neonates than post neonates (30% vs 6%; p<0.05). The rate of referral among neonates did not vary significantly during the implementation period. Among the neonates who were referred (N = 62), the main presenting sign/symptoms were convulsion (67%), altered mental status (53%) and not feeding properly (38%). Among the post neonates who were referred (N = 62), the chief presenting complaints were hypothermia (26%) and altered mental status (23%). Regarding those who refused admission, umbilical infection (33%) was the predominant sign among neonates and hypothermia (23%) among post neonates. The rate of referral was higher among females (13%) than males (6%) (p<0.05). No significant difference was noted in rate of referral by hospital, time of arrival and day of arrival.
Table 1 summarizes quality of care related to ‘Fast Assessment’ of syndromic sepsis cases. Almost all the neonates and post neonates had their blood oxygen saturation level, blood glucose level, pulse rate, temperature and weight measured immediately after admission in the inpatient department. There was no significant variation among the stratifying variables. However, only one third had their blood pressure measured with significant variation between age (neonate 3% and post neonate 38%; p<0.005), hospitals (Bhuapur 8% vs Gopalpur 62%; p<0.005) and time of arrival (office hours 29% vs after office hours 38%; p<0.05).
Table 2 presents the key findings regarding ‘Initial management and Immediate Resuscitation’ of syndromic sepsis patients in the inpatient department. One fifth of the syndromic sepsis cases had hypoxemia during admission. More neonates (37%) were hypoxemic than post neonates (18%) (p<0.005). Females were more likely to have hypoxemia (26%) than males (18%) (p<0.005). Almost all (94%) of the hypoxemic children received supplemental oxygen immediately without significant variation among different strata. Very few had hypoglycemia (0.3%) or hypothermia (0.5%) during admission. Vascular access was established in 79% of the admitted cases (Fig 2) with significant improvement between the first quarter (55%) and the last quarter (97%) (p<0.5).
Around 85% of the syndromic sepsis cases received the first dose of recommended antibiotics parenterally (Ampicillin + Gentamicin in combination or Ceftriaxone) within one hour of admission (Fig 2). Approximately 90% received the first dose of recommended antibiotics in the first three hours after admission. More neonates (76%) received the recommended antibiotics than post neonates (62%) within one hour of admission; (p<0.05).
Fig 2 demonstrates the quarterly trend in administration of the first dose of recommended antibiotics parenterally within one hour of admission. There was significant improvement in choice of the first line recommended antibiotics i.e Ampicillin and Gentamicin in combination (from 49% to 75%; (p<0.005) during the implementation period. Similarly, choice of the second line recommended antibiotic i.e Cenftriaxone decreased from 61% to 5%, (p<0.005) between the first quarter and the last quarter.
Table 3 demonstrates the time gap between arriving in the emergency department and conducting key steps related to management of syndromic sepsis. The median time taken to complete the assessment and identify sysdromic sepsis in the emergency department was 6 minutes with an inter quartile range of 5–15 minutes, i.e assessment and identification was completed within 5 minutes for 25% of the patients and within 15 minutes for 75% of the patients. Similarly, the median time taken complete the ‘Fast Assessment’ was completed 15 minutes (inter quartile range 6–20 minutes). ‘Initial Management and Immediate Resuscitation’ was completed with a median value to 35 minutes (inter quartile range 25–45 minutes). Similarly, the median value between arriving in the emergency department and receiving the first dose of parenteral antibiotics was 35 minutes (inter quartile range 25–45 minutes). All of these four steps of managing syndromic sepsis was faster in Bhuapur than Gopalpur (p<0.05). However, completion of ‘Initial Management and Immediate Resuscitation’ and ‘Parenteral administration of first dose of antibiotics’ were significantly slower among neonates than post neonates (median 40 minute vs 35 minutes for both steps, p<0.05).
Fig 3 shows the quarterly trend in hospital outcomes of patients admitted with syndromic sepsis. In the first quarter of implementation (August-December 2013), 35% patients were discharged with medical advice. The condition improved significantly in the last quarter (January-March 2015) as more than 85% were discharged with medical advice. Around 20% patients admitted with syndromic sepsis were referred to a higher level facility in the first quarter, which decreased to less than 5% in the last quarter. There were only three inpatient deaths among all children admitted with syndromic sepsis. The average duration of hospital stay was 2.2 days with a median value of 2 days (inter quartile range 1–3 days). In the first quarter, 47% patient with syndromic sepsis stayed in the facility for more than 48 hours as opposed to 80% in the last quarter. The percentage of children leaving the facility in less than 24 hours decreased from 29% to 4% between the first and the last quarter.
Discussion
This quality improvement project was implemented because of inadequate service readiness and poor care delivery for managing neonatal and early childhood syndromic sepsis in the demonstration hospitals. The full intervention package was designed based on local contexts and resources, and in such a manner that after a sick child arrives in the emergency department, the hospital and healthcare providers were prepared to rapidly identify and manage syndromic sepsis as per the SoP. Service availability and quality of care pertaining to management of syndromic sepsis in the demonstration hospitals were improved and sustained over the implementation period. The two participating sub-district hospitals were representative of similar facilities in resource constrained settings.
In addition to the traditional approach of quality improvement through training alone, we tested innovative approaches which may have played decisive role in addressing the existing gaps and changed practices within a short period. This began with the use of a ‘Baseline Environmental Scan’ to assess the needs and prioritize interventions addressing specific gaps. The action plan for improving service availability and quality of care was primarily designed and implemented by the hospital managers and concerned clinical staff. As a general principle, the project played a supporting role in the quality improvement process, which played a cardinal role in developing ownership regarding the overall implementation package. The novel approach of introducing a ‘Welcome Person’, as well as ‘Task Shifting’ contributed to reducing the documented delays in triage, assessment and treatment, including high adherence to the SoP. Onsite supportive supervision by the ‘Program Coach’ and organizing onsite regular refreshers trainings also have led to improved clinical practices and sustaining the improved quality of care.
Early and appropriate care seeking is one of the most important aspects for interrupting the pathways to deaths due to syndromic sepsis. Neonates and young infants are innately vulnerable to severe infection leading to sepsis. Angus et al. (2001) reported that incidence of sepsis among infants (<1 year of age) is almost 9–10 times higher than older children (1–4 years and 5–14 years) [38]. On an average, the emergency department of each hospital was visited by only 6 neonates with syndromic sepsis monthly. Considering a catchment population of around 250,000 for each of the demonstration hospitals and innate vulnerability of neonates, the number seems to be very low. The most likely explanation could be-lack of education of parents regarding danger signs leading to inappropriate care seeking practices as seen in rural settings of low income countries [39–43]. In some parts of rural Bangladesh, the traditional practice is to confine movement of mothers and newborns outside home during the early neonatal period [44]. This may delay the care seeking practice until the neonate becomes severely ill, an assertion which is supported by the findings of our study where a greater proportion of neonates presented with syndromic sepsis had severe symptoms like hypoxemia and hypothermia.
The first step of managing syndromic sepsis was to ensure ‘Triage, Identification and Rapid Admission’ of children with syndromic sepsis. The baseline environmental scan revealed that the emergency departments of the demonstration facilities did not have a functioning triage or a structured system to assess and identify syndromic sepsis. Almost all the newborns and young infants were referred to higher level facilities irrespective of their presenting complaints as the clinical service providers felt less confident in treating neonates through inpatient services. In support to this explanation, a recent survey conducted in 12 first level public facilities of Bangladesh also reported that the proportional contribution of neonates among all inpatient admissions is less than 1% [25]. Given that neonates are infection prone [38], this `ure affirms the reluctance towards admitting neonates at first level hospitals. We were reasonably successful with our approach as around four fifths of the children identified as syndromic sepsis were admitted in the inpatient department. Among the neonates, around 30% were referred out after introducing the quality improvement initiatives. Although the rate of referral among neonates was still on the higher side, it was a significant improvement from the previous practice where almost all newborns were referred out from the emergency department. This also implies that with introduction of triage and systematic assessment in the emergency department supported by onsite supervision by ‘Program Coaches’, the clinical service providers became more confident in treating neonates through inpatient services. Though we have tried to further reduce the rate of referral among neonates through training and supportive supervision, the rates did not vary significantly over the implementation period. We do not have conclusive information regarding the appropriateness of these referral, but the relative higher rate among neonates can be explained by their innate vulnerability and lack of readiness of the first level facilities to manage newborns with major complications. The need for further research to explore contributing factors and potential solutions to this problem is emphasized through this finding.
The next steps in managing syndromic sepsis are to ensure ‘Fast assessment’ followed by ‘Initial Management and Immediate Resuscitation’ in the inpatient department. With some pitfalls, most of the children with syndromic sepsis were assessed quickly and the resuscitation bundle was initiated immediately. These changes further support the findings and recommendation from other studies which have reported the improvement in quality of care through capacity development and with minimum investments in resource poor setting [29–33]. Apart from the sepsis education through refreshers trainings and supportive supervision by onsite ‘Program Coaches’, ‘Task Shifting’ to nurses have contributed significantly in changing the existing practice, adhering to the guidelines and sustaining high standard of care. Other studies have also reported that nurses have less turnover rate than doctors, demonstrate higher motivation and possess better retention of skills [45]. Although almost all of the admitted children with hypoxemia received immediate oxygenation through traditional practice, the high rate of hypoxemia (21%) signifies the importance of introducing bubble CPAP, BiPAP in similar settings [46–48].
Early administration of broad spectrum antibiotic parenterally is one of the most important steps in management of syndromic sepsis. The Surviving Sepsis Campaign Guideline recommends administering the first dose of antibiotic within one hour of admission [35]. Approximately 85% of the children with syndromic sepsis received the first dose of recommended antibiotic parenterally within one hour of arrival. Around three quarters of them received the first dose within 45 minutes of arrival; an achievement that has eluded practitioners even in resource rich areas. Several factors including facilitation of triage through the ‘Welcome Persons’ and ‘Task Shifting’ in the emergency department, introduction of protocolized management, ‘Task Shifting’ in the inpatient department and on site supportive supervision by ‘Program Coaches’ may have been influential in reducing possible delays in administering key steps of sepsis management. The novel approach of introducing a ‘Welcome Person’ to navigate patients to appropriate service delivery points, facilitate the patient transfer process from the emergency to the inpatient department, and maintaining liaison with clinical service providers may have played the most catalytic role in this regard. The attribution and effectiveness of the ‘Welcome Person’ in improving quality of care and reducing delays need further assessment and understanding.
The National Neonatal Health Strategy and Guidelines of Bangladesh (2009) and the Bangladesh adapted version of WHO Pocket Book for Hospital Care of Children recommend using the combination of Ampicillin and Gentamicin as the first line antibiotics for managing syndromic sepsis [36, 37]. The combination is chosen over the Ceftriaxone as it is safer, cheaper and has high synergistic bactericidal effect [46, 49]. The choice for first line antibiotic shifted from Ceftriaxone to the combination of Ampicillin and Gentamicin in both facilities over the project implementation period. We believe this change in practice was the result of continuous supportive supervision and repeated feedback loop by onsite ‘Program Coaches’. Considering the higher cost, side effects and possible resistance to Ceftriaxone, the shift in choice and practice has larger policy implication [46].
Duration of hospital stay is one of the main concerns for effective management of syndromic sepsis. Although, there was some improvement over time, the average duration of hospital stay was still around only 3 days in the last quarter. Cultural barriers and financial constraints due to high out of pocket expenditure and opportunity cost during hospital stay could explain the behavior [50, 51]. The ‘Program Coaches’ encouraged the clinical service providers to counsel the parents to stay for longer duration and complete the treatment. The focus was to ensure at least 48 hours of hospital stay as the recent WHO recommendation suggests that 2 days of parenteral antibiotic followed by 5–7 days of oral antibiotic is safe and effective [52–54]. With the change in approach and counselling of parents by clinical service providers, there was significant improvement in more than 48 hours of hospital stay over time. Acknowledging the challenge of ensuring 7–10 days of hospital stay in resource poor settings like Bangladesh, focusing on the first 48 hours can be an important program learning for other projects in similar settings.
Though the project has demonstrated reasonable accomplishment related to implementation of most of the key components of sepsis management, the rate of establishing vascular access did not reach a high standard. This is similar to other study findings as a meta-analysis of 128 literature published between 1975 and 2011, reported that first attempt to establish an intravenous channel fails in 12–26% of adults and 24–54% of children [55]. Factors associated with this failed attempts could be the characteristics of patients (age, weight, skin color, etc.), insertion site, catheter caliber and operator's expertise, etc. [55, 56]. After a few failed attempt the procedure becomes increasingly difficult as the child becomes more anxious and fearsome which in turn raises the sympathetic activity causing vasoconstriction. Furthermore the inability to establish an intravenous channel also creates a negative impact on the nursing staff which may have decreased their self-confidence and therefore intended efficiency [57]. This signifies the importance of introducing additional aid (eg. ACCU vein) in establishing intravenous channel and intraosseous channels can be tested as they have shown encouraging results in other settings [57, 58]. There was a difference between the hospitals in measurement of BP as only 8% of the admitted cases in Bhuapur had their BP measured in contrast to 62% in Gopalpur. On the other hand, the level of use of recommended antibiotic was higher in Bhuapur than Gopalpur. We do not regard low levels of BP measurement as a major oversight in care because in children BP measurements are difficult and also hypotension is a late sign in children and is rarely used to diagnose shock even in resource rich settings. However, the contrasting performance of the two demonstration hospitals regarding some indicators underpins an important program learning. Consistent with our study findings, other initiatives have also acknowledged that even with the same level of inputs, uptake and sustainability of a generic set of interventions can be different in different context [59, 60]. This signifies the importance of developing context specific action plan for implementing a generic guideline or intervention package.
The quality improvement initiatives were undertaken in only two demonstration sites and the findings presented in this paper may lack external validity to be generalizable nationally and regionally. However, the inadequate service readiness and poor quality of care that were existent in the demonstration hospitals before introducing the intervention package are mostly generalizable to other public hospitals in resource constrained settings. Therefore, the findings from this paper present important program learnings to be tried and tested in similar settings. One of the other limitations of this initiative is the inability to attribute different components of the intervention package to different achievements. We can only infer that the interventions have worked as a package but cannot report the attributable fraction of an individual innovation and initiative. The prime objective was to improve the quality of care in the shortest possible time. The intervention package was updated and upgraded throughout the implementation period through the ‘Pan-Do-Study-Act’ cycle [61]. Therefore, the package may have been ‘over-dosed’ rather than ‘under-dosed’. Though we do not have extensive data regarding costing, the package focused on addressing gaps related to service readiness and capacity of health workforce with minimum external inputs. Regarding service readiness, the package focused on ensuring supply of equipment, drugs and logistics essential for managing syndromic sepsis. All of them are already included in the essential list of equipment, drug and logistics for first level facilities as recommended in the National Neonatal Health Strategy and Guidelines of Bangladesh (2009) (37). Government of Bangladesh has already established a Quality Improvement Secretariat under the Ministry of Health with specific focus on maternal and newborn health. The secretariat can replicate the role of ‘Program Coaches’ to provide supportive supervision and necessary oversight to improve quality of care. Regarding streamlining the patient flow and reducing delays, we believe that the maximum return was achieved from the welcome person which is a low cost intervention. The welcome person can also take the responsibility of navigating all maternal and newborn cases in a hospital to reduce possible delays and improve quality of care. Considering the minimum investment that is required to address the structural and functional gaps and national priority to improve quality of care, we strongly believe that the package has great potential to sustain at scale. However, further refinement can be considered to make the intervention package less resource intensive and more cost effective before potential scale up. Another important aspect of this quality improvement initiative is its potential to reduce the burden of inappropriate referral to higher level facilities which can further reduce the cost on health systems. The other limitation related to inference of these findings is the absence of specific estimates from baseline or from a comparison hospital. Since this was a quality improvement initiate, the major focus was on improving the processes over time and achieve standard quality of care benchmarks. Most of these practices and services were not available in the demonstration hospitals, and hence specific estimates for comparison were not available. However, the ‘Baseline Environmental Scan’ documented the poor preparedness and inappropriate sepsis management practices in the demonstration hospitals. The visible improvement in quality of care can therefore be linked to the intervention package introduced by this project. The other limitation is the effect of possible reporting bias as the on-duty paramedics and nurses were responsible for documenting the steps of managing syndromic sepsis through the checklists and patient record forms. However, the effect may have been minimized due the continuous presence of ‘Welcome Persons’ and supportive supervision by on-site ‘Program Coaches’. The Hawthorne effect [62, 63] could have been another limitation of our study but it is very unlikely that this effect would persist with almost two years of implementation.
Conclusion and Recommendation
With minor limitations, quality of care pertaining to sepsis management can be improved with a well-designed, need based and context specific intervention package even for the most resource limiting environment. Successful testing of some novel approaches such as facilitation support for patient navigation (Welcome Person) and onsite supportive supervision (Program Coach) to maintain PDCA (Plan→ Do→ Check→Act) cycle are important program learnings.
Acknowledgments
We would like to specially thank the contribution of managers, clinical service providers of the demonstration hospitals for their kind support and cooperation in developing the customized action plan for the quality improvement and implementation process. We also would like to acknowledge the contribution of national and district level health managers for their continuing support in monitoring and supervision. Clinical experts who have provided their technical inputs in adopting and adapting the national guidelines also deserve special acknowledgments. At last and most importantly, we are grateful to the patients and their caretakers who received care from the demonstration hospitals during the implementation period.
Author Contributions
- Conceptualization: AER AI CL SEA NK DMEH.
- Formal analysis: AER AI QSR MM CL SEA NK DMEH.
- Funding acquisition: CL SEA NK.
- Investigation: AER AI SZ TB AIC RH CL SEA NK DMEH.
- Methodology: AER AI CL SEA NK DMEH.
- Project administration: AER AI SEA DMEH NK CL SZ TB AIC RH.
- Resources: AER AI CL SEA NK DMEH SZ TB AIC RH.
- Software: QSR MM.
- Supervision: CL NK SEA DMEH.
- Visualization: AER AI MM.
- Writing – original draft: AER AI NK CL SEA DMEH SZ.
- Writing – review & editing: AER AI NK CL SEA DMEH SZ TB AIC RH.
References
- 1. Angus DC, Van der Poll T. Severe sepsis and septic shock. New England Journal of Medicine. 2013;369(9):840–51. pmid:23984731
- 2. Goldstein B, Giroir B, Randolph A. International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatric critical care medicine. 2005;6(1):2–8. pmid:15636651
- 3. Kissoon N, Uyeki TM. Sepsis and the global burden of disease in children. JAMA pediatrics. 2016;170(2):107–8. pmid:26661465
- 4. Fleischmann C, Scherag A, Adhikari N, Hartog C, Tsaganos T, Schlattmann P, et al. Global burden of sepsis: a systematic review. Critical Care. 2015;19(1):1.
- 5. Fleischmann C, Scherag A, Adhikari NK, Hartog CS, Tsaganos T, Schlattmann P, et al. Assessment of global incidence and mortality of hospital-treated sepsis. Current estimates and limitations. American journal of respiratory and critical care medicine. 2016;193(3):259–72. pmid:26414292
- 6. Liu L, Oza S, Hogan D, Perin J, Rudan I, Lawn JE, et al. Global, regional, and national causes of child mortality in 2000–13, with projections to inform post-2015 priorities: an updated systematic analysis. The Lancet. 2015;385(9966):430–40.
- 7. Oza S, Lawn JE, Hogan DR, Mathers C, Cousens SN. Neonatal cause-of-death estimates for the early and late neonatal periods for 194 countries: 2000–2013. Bulletin of the World Health Organization. 2015;93(1):19–28. pmid:25558104
- 8. Kissoon N, Carapetis J. Pediatric sepsis in the developing world. Journal of Infection. 2015;71:S21–S6. pmid:25917800
- 9. Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. The Lancet. 2013;380(9859):2095–128.
- 10. Bhutta ZA, Darmstadt GL. A role for science investments in advancing newborn health. Science translational medicine. 2014;6(253):253cm8–cm8. pmid:25210057
- 11. Seale AC, Blencowe H, Manu AA, Nair H, Bahl R, Qazi SA, et al. Estimates of possible severe bacterial infection in neonates in sub-Saharan Africa, south Asia, and Latin America for 2012: a systematic review and meta-analysis. The Lancet infectious diseases. 2014;14(8):731–41. pmid:24974250
- 12. Thaver D, Zaidi AK. Burden of neonatal infections in developing countries: a review of evidence from community-based studies. The Pediatric infectious disease journal. 2009;28(1):S3–S9.
- 13. Kissoon N, Carcillo JA, Espinosa V, Argent A, Devictor D, Madden M, et al. World federation of pediatric intensive care and critical care societies: global sepsis initiative. Pediatric Critical Care Medicine. 2011;12(5):494–503. pmid:21897156
- 14.
National Institute of Population Research and Training (NIPORT). Bangladesh Demographic and Health Survey 2011. Dhaka, Bangladesh: 2013.
- 15. Darmstadt GL, Ahmed ANU, Saha SK, Chowdhury MA, Alam MA, Khatun M, et al. Infection control practices reduce nosocomial infections and mortality in preterm infants in Bangladesh. Journal of Perinatology. 2005;25(5):331–5. pmid:15716984
- 16. Edmond K, Zaidi A. New approaches to preventing, diagnosing, and treating neonatal sepsis. PLoS Med. 2010;7(3):e1000213. pmid:20231868
- 17. Kumar A, Roberts D, Wood KE, Light B, Parrillo JE, Sharma S, et al. Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Critical care medicine. 2006;34(6):1589–96. pmid:16625125
- 18. Cruz AT, Perry AM, Williams EA, Graf JM, Wuestner ER, Patel B. Implementation of goal-directed therapy for children with suspected sepsis in the emergency department. Pediatrics. 2011;127(3):e758–e66. pmid:21339277
- 19. Paul R, Melendez E, Stack A, Capraro A, Monuteaux M, Neuman MI. Improving adherence to PALS septic shock guidelines. Pediatrics. 2014;133(5):e1358–e66. pmid:24709937
- 20. Paul R, Neuman MI, Monuteaux MC, Melendez E. Adherence to PALS sepsis guidelines and hospital length of stay. Pediatrics. 2012;130(2):e273–e80. pmid:22753559
- 21. Larsen GY, Mecham N, Greenberg R. An emergency department septic shock protocol and care guideline for children initiated at triage. Pediatrics. 2011:peds. 2010–3513.
- 22. Kissoon N. Sepsis guidelines: Suggestions to improve adherence. Journal of Infection. 2015;71:S36–S41. pmid:25917797
- 23. Qazi SA, Stoll BJ. Neonatal sepsis: a major global public health challenge. The Pediatric infectious disease journal. 2009;28(1):S1.
- 24. Riviello ED, Sugira V, Twagirumugabe T. Sepsis research and the poorest of the poor. The Lancet Infectious Diseases. 2015;15(5):501–3. pmid:25932573
- 25. Hoque DM, Rahman M, Billah SM, Savic M, Karim AR, Chowdhury EK, et al. An assessment of the quality of care for children in eighteen randomly selected district and sub-district hospitals in Bangladesh. BMC pediatrics. 2012;12(1):1.
- 26. Arifeen S, Bryce J, Gouws E, Baqui A, Black R, Hoque D, et al. Quality of care for under-fives in first-level health facilities in one district of Bangladesh. Bulletin of the World Health Organization. 2005;83(4):260–7. pmid:15868016
- 27. Anwar I, Kalim N, Koblinsky M. Quality of obstetric care in public-sector facilities and constraints to implementing emergency obstetric care services: evidence from high-and low-performing districts of Bangladesh. Journal of health, population, and nutrition. 2009;27(2):139. pmid:19489412
- 28. Chowdhury S, Hossain SA, Halim A. Assessment of quality of care in maternal and newborn health services available in public health care facilities in Bangladesh. Bangladesh Medical Research Council Bulletin. 2009;35(2):53–6. pmid:20120780
- 29.
(WHO) WHO. Management of the child with a serious infection or severe malnutrition: guidelines for care at the first-referral level in developing countries: World Health Organization; 2000.
- 30. Bhutta ZA, Zaidi AKM, Thaver D, Humayun Q, Ali S, Darmstadt GL. Management of newborn infections in primary care settings: a review of the evidence and implications for policy? The Pediatric infectious disease journal. 2009;28(1):S22.
- 31. Darmstadt GL, Batra M, Zaidi AKM. Parenteral antibiotics for the treatment of serious neonatal bacterial infections in developing country settings. The Pediatric infectious disease journal. 2009;28(1):S37.
- 32. Darmstadt GL, Batra M, Zaidi AKM. Oral antibiotics in the management of serious neonatal bacterial infections in developing country communities. The Pediatric infectious disease journal. 2009;28(1):S31.
- 33. Wook LJ. Global health improvement and WHO: shaping the future. The Lancet. 2003;362(9401):2083–8.
- 34.
Bangladesh Bureau of Statistics. 2011 [cited 2016 5th September]. Available from: http://www.bbs.gov.bd/.
- 35. Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock, 2012. Intensive care medicine. 2013;39(2):165–228. pmid:23361625
- 36.
World Health Organization. Pocket book of hospital care for children: guidelines for the management of common illnesses with limited resources. Geneva, Switzerland.: 2011.
- 37.
Ministry of Health & Family Welfare of Government of Bangladesh. National Neonatal Health Strategy and Guidelines for Bangladesh. 2009.
- 38. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Critical Care Medicine-Baltimore-. 2001;29(7):1303–10.
- 39. Sandberg J, Pettersson KO, Asp G, Kabakyenga J, Agardh A. Inadequate knowledge of neonatal danger signs among recently delivered women in southwestern rural Uganda: a community survey. PLoS One. 2014;9(5):e97253. pmid:24824364
- 40. Geldsetzer P, Williams TC, Kirolos A, Mitchell S, Ratcliffe LA, Kohli-Lynch MK, et al. The recognition of and care seeking behaviour for childhood illness in developing countries: a systematic review. PloS one. 2014;9(4):e93427. pmid:24718483
- 41. Syed U, Khadka N, Khan A, Wall S. Care-seeking practices in South Asia: using formative research to design program interventions to save newborn lives. Journal of Perinatology. 2008;28:S9–S13.
- 42. Ahmed S, Sobhan F, Islam A. Neonatal Morbidity and Care‐seeking Behaviour in Rural Bangladesh. Journal of Tropical Pediatrics. 2001;47(2):98–105. pmid:11336143
- 43. Darmstadt GL, Syed U, Patel Z, Kabir N. Review of domiciliary newborn-care practices in Bangladesh. Journal of Health, Population and Nutrition. 2006:380–93.
- 44. Winch PJ, Alam MA, Akther A, Afroz D, Ali NA, Ellis AA, et al. Local understandings of vulnerability and protection during the neonatal period in Sylhet District, Bangladesh: a qualitative study. The Lancet. 2005;366(9484):478–85.
- 45. Koyamaibole L, Kado J, Qovu JD, Colquhoun S, Duke T. An evaluation of bubble-CPAP in a neonatal unit in a developing country: effective respiratory support that can be applied by nurses. Journal of tropical pediatrics. 2006;52(4):249–53. pmid:16326752
- 46. Darmstadt GL, Batra M, Zaidi AK. Parenteral antibiotics for the treatment of serious neonatal bacterial infections in developing country settings. The Pediatric infectious disease journal. 2009;28(1):S37–S42.
- 47. Chisti MJ, Salam MA, Smith JH, Ahmed T, Pietroni MA, Shahunja K, et al. Bubble continuous positive airway pressure for children with severe pneumonia and hypoxaemia in Bangladesh: an open, randomised controlled trial. The Lancet. 2015;386(9998):1057–65.
- 48. Martin S, Duke T, Davis P. Efficacy and safety of bubble CPAP in neonatal care in low and middle income countries: a systematic review. Archives of Disease in Childhood-Fetal and Neonatal Edition. 2014;99(6):F495–F504. pmid:25085942
- 49. Bhutta ZA, Zaidi AK, Thaver D, Humayun Q, Ali S, Darmstadt GL. Management of newborn infections in primary care settings: a review of the evidence and implications for policy? The Pediatric infectious disease journal. 2009;28(1):S22–S30.
- 50. Bhandari N, Bahl R, Bhatnagar V, Bhan M. Treating sick young infants in urban slum setting. The Lancet. 1996;347(9017):1774–5.
- 51. Baqui AH, El-Arifeen S, Darmstadt GL, Ahmed S, Williams EK, Seraji HR, et al. Effect of community-based newborn-care intervention package implemented through two service-delivery strategies in Sylhet district, Bangladesh: a cluster-randomised controlled trial. The Lancet. 2008;371(9628):1936–44.
- 52. Baqui AH, Saha SK, Ahmed ANU, Shahidullah M, Quasem I, Roth DE, et al. Safety and efficacy of alternative antibiotic regimens compared with 7 day injectable procaine benzylpenicillin and gentamicin for outpatient treatment of neonates and young infants with clinical signs of severe infection when referral is not possible: a randomised, open-label, equivalence trial. The Lancet Global health. 2015;3(5):e279–e87. pmid:25841891
- 53. Tshefu A, Lokangaka A, Ngaima S, Engmann C, Esamai F, Gisore P, et al. Simplified antibiotic regimens compared with injectable procaine benzylpenicillin plus gentamicin for treatment of neonates and young infants with clinical signs of possible serious bacterial infection when referral is not possible: a randomised, open-label, equivalence trial. The Lancet. 2015;385(9979):1767–76.
- 54.
World Health Organization. Guideline: managing possible serious bacterial infection in young infants when referral is not feasible. 2015.
- 55. Sabri A, Szalas J, Holmes KS, Labib L, Mussivand T. Failed attempts and improvement strategies in peripheral intravenous catheterization. Bio-medical materials and engineering. 2013;23(1–2):93–108. pmid:23442240
- 56. Witting MD. IV access difficulty: incidence and delays in an urban emergency department. The Journal of emergency medicine. 2012;42(4):483–7. pmid:22137793
- 57. Kuensting LL, DeBoer S, Holleran R, Shultz BL, Steinmann RA, Venella J. Difficult venous access in children: taking control. Journal of Emergency Nursing. 2009;35(5):419–24. pmid:19748021
- 58. Paxton J, Knuth T, Klausner H. 53: Humeral Head Intraosseus Insertion: The Preferred Emergency Venous Access. Annals of Emergency Medicine. 2008;52(4):S58.
- 59. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation science. 2009;4(1):1.
- 60. Victora CG, Schellenberg JA, Huicho L, Amaral J, El Arifeen S, Pariyo G, et al. Context matters: interpreting impact findings in child survival evaluations. Health policy and planning. 2005;20(suppl 1):i18–i31.
- 61. Taylor MJ, McNicholas C, Nicolay C, Darzi A, Bell D, Reed JE. Systematic review of the application of the plan–do–study–act method to improve quality in healthcare. BMJ quality & safety. 2014;23(4):290–8.
- 62. Parsons HM. What happened at Hawthorne? Science. 1974;183(4128):922–32. pmid:17756742
- 63. Wickström G, Bendix T. The" Hawthorne effect"—what did the original Hawthorne studies actually show? Scandinavian journal of work, environment & health. 2000:363–7.