Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Retrospective study on the usefulness of pulse oximetry for the identification of young children with severe illnesses and severe pneumonia in a rural outpatient clinic of Papua New Guinea

  • Julien Blanc ,

    Contributed equally to this work with: Julien Blanc, Nicolas Senn

    Roles Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    blanc.julien@hotmail.com

    Affiliation Department of Ambulatory Care and Community Medicine, University of Lausanne, Lausanne, Switzerland

  • Isabella Locatelli ,

    Roles Data curation, Formal analysis

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Ambulatory Care and Community Medicine, University of Lausanne, Lausanne, Switzerland

  • Patricia Rarau ,

    Roles Data curation, Validation

    ‡ These authors also contributed equally to this work.

    Affiliation Vector Borne Disease Unit, PNG Institute of Medical Research, Madang (MAD), Papua New Guinea

  • Ivo Mueller ,

    Roles Data curation, Validation

    ‡ These authors also contributed equally to this work.

    Affiliations Vector Borne Disease Unit, PNG Institute of Medical Research, Madang (MAD), Papua New Guinea, Population Health & Immunity Division, Walter & Eliza Hall Institute of Medical Research, Melbourne, Australia, Barcelona Institute of Global Health (ISGLOBAL), Barcelona, Spain, Malaria, Parasites & Hosts Unit, Institut Pasteur, Paris, France

  • Blaise Genton ,

    Roles Conceptualization, Data curation, Validation

    ‡ These authors also contributed equally to this work.

    Affiliations Department of Ambulatory Care and Community Medicine, University of Lausanne, Lausanne, Switzerland, Infectious Diseases Service, University Hospital, Lausanne, Switzerland, Swiss Tropical and Public Health Institute, University of Lausanne, Switzerland

  • Noémie Boillat-Blanco ,

    Roles Data curation, Validation

    ‡ These authors also contributed equally to this work.

    Affiliations Department of Ambulatory Care and Community Medicine, University of Lausanne, Lausanne, Switzerland, Infectious Diseases Service, University Hospital, Lausanne, Switzerland

  • Mario Gehri ,

    Roles Data curation, Validation

    ‡ These authors also contributed equally to this work.

    Affiliation Children’s Hospital, Lausanne, Switzerland

  • Nicolas Senn

    Contributed equally to this work with: Julien Blanc, Nicolas Senn

    Roles Conceptualization, Data curation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Department of Ambulatory Care and Community Medicine, University of Lausanne, Lausanne, Switzerland

Abstract

Objective

This secondary analysis of data of a randomized controlled trial (RCT) retrospectively investigated the performance of pulse oximetry in identifying children with severe illnesses, with and without respiratory signs/symptoms, in a cohort of children followed for morbid episodes in an intervention trial assessing the efficacy of Intermittent Preventive Treatment for malaria in infants (IPTi) in Papua New Guinea (PNG) from June 2006 to May 2010.

Setting

The IPTi study was conducted in a paediatric population visiting two health centres on the north coast of PNG in the Mugil area of the Sumkar District.

Participants

A total of 669 children visited the clinic and a total of 1921 illness episodes were recorded. Inclusion criteria were: age between 3 and 27 months, full clinical record (signs/symptoms) and pulse oximetry used systematically to assess sick children at all visits. Children were excluded if they visited the clinic in the previous 14 days.

Outcomes

The outcome measures were severe illness, severe pneumonia, pneumonia, defined by the Integrated Management of Childhood Illness (IMCI) definitions, and hospitalization.

Results

Out of 1921 illness episodes, 1663 fulfilled the inclusion criteria. A total of 139 severe illnesses were identified, of which 93 were severe pneumonia. The ROC curves of pulse oximetry (continuous variable) showed an AUC of 0.63, 0.68 and 0.65 for prediction of severe illness, severe pneumonia and hospitalization, respectively. Pulse oximetry allowed better discrimination between severe and non-severe illness, severe and non-severe pneumonia, admitted and non-admitted patients, in children ≤12-months of age relative to older patients. For the threshold of peripheral arterial oxygen saturation ≤ 94% measured by pulse oximetry (SpO2), unadjusted odds ratios for severe illness, severe pneumonia and hospitalization were 6.1 (95% Confidence Interval (CI) 3.9–9.8), 8.5 (4.9–14.6) and 5.9 (3.4–10.3), respectively.

Conclusion

Pulse oximetry was helpful in identifying children with severe illness in outpatient facilities in PNG. A SpO2 of 94% seems the most discriminative threshold. Considering its affordability and ease of use, pulse oximetry could be a valuable additional tool assisting the decision to admit for treatment.

Introduction

Pneumonia is the leading infectious cause of mortality in children under five years, responsible for 704 000 deaths in 2015 [1]. The majority of deaths due to pneumonia occur in developing countries as it is strongly related to socio-economic factors such as malnutrition, poverty or inadequate access to the health system [2].

Hypoxemia is one of the major complications of pneumonia, associated with severe pneumonia [3]. It is also strongly associated with mortality; children with hypoxemia were more than four times more likely to die in the next five days compared to children without hypoxemia in a Kenyan study [4].

In developed countries, hypoxemia is usually identified using pulse oximetry, whereas in resource-poor settings indirect clinical signs such as cyanosis, or others signs reflecting respiratory distress (high respiratory rate, lower chest wall indrawing, head nodding, nasal flaring, grunting, drowsiness, and/or inability to drink/breastfeed) are usually used. The latter signs are correlated with a higher risk of mortality than specifically with hypoxemia. Several studies evaluated the association between hypoxemia and signs and symptoms. These are recognized as useful to evaluate children presenting with Acute Respiratory Infections (ARIs) in settings without access to pulse oximetry, but most of the studies highlighted limited predictive values with high variability in clinical performance and inter-observer variability between studies [511]. In a Papua New Guinean prospective observational study, cyanosis was highly specific but poorly sensitive to identify children with hypoxemia, moreover it is a late sign and shows considerable inter-observer variability, failing to detect hypoxemia in 30–40% of the cases [12]. Finally, a meta-analysis by Zhang et al. (2011) concluded that signs with high sensitivity usually lack specificity and that neither single nor combined signs/symptoms have enough performance to reliably predict hypoxemia in children with ARIs [13].

Few studies have investigated the use of pulse oximetry to detect hypoxemic diseases in children in resource-poor countries. A Malawian study showed that implementation of routine pulse oximetry increases the referral of severely hypoxemic children with pneumonia and that following the WHO guidelines, care-givers are likely to under-refer children with severe hypoxemia [14]. Two studies showed that models combining pulse oximetry-derived information with clinical and paraclinical information predicted the need to hospitalized children consulting an emergency department and outpatient facility in Bangladesh [15,16]. A study conducted in Peru in the ‘90s in a large paediatric emergency department found that pulse oximetry could help in assessing severity of the disease and facilitated referral of patients requiring oxygen to the appropriate centers [17].

The present observational study investigated the performance of pulse oximetry to identify children with severe illnesses with- and without respiratory signs/symptoms among a cohort of children followed for morbid episodes in an intervention trial assessing the efficacy of Intermittent Preventive Treatment for malaria in infants (IPTi) in Papua New Guinea (PNG).

Methods

Study design

This is a secondary analysis of the randomized controlled trial (RCT) data from a cohort of children aged 3–27 months followed-up as part of a double-blinded RCT on the prevention of malaria (IPTi) [18].

Study sites

The IPTi trial was conducted on 1121 children aged 3–27 months from June 2006 to May 2010 (www.clinicalTrials.gov: NCT00285662) [18]. The study took place on the north coast of PNG in the Mugil area of the Sumkar District, Madang Province. It included 20 villages situated in an ~400-km2 coastal area 30–60 km north of Madang town. Two main health centers serve this region, Mugil and Alexishafen, complemented by several first-aid posts. The health centers provide basic in-patient care (including deliveries) and run a daily outpatient clinic for common acute medical problems. Nurses run the centers and patients (adults or children) need to be referred to Madang hospital to see a doctor (60 km away). First-aid posts are rudimentary and remote health facilities in presence of a nurse living in the community. Pulse oximetry was implemented and used systematically to assess sick children in the Mugil site from December 2007; therefore, only data collected after this date and from this site are used in the present study.

The study was carried out in accordance with Good Clinical Practice (ICH GCP E6) guidelines and externally monitored by two independent monitors and the Data Safety Monitoring Board. The study was approved by the PNG Medical Research Advisory Committee (MRAC number 05.20). The trial was registered on http://www.clinicaltrials.gov (number NCT00285662) and formed part of the IPTi Consortium (http://www.ipti-malaria.org) [18].

Study population

The study was conducted on a pediatric population (669 children aged 3 to 27 months) enrolled in the IPTi trial and visiting the study health facilities in Mugil for any health-related problem.

Morbidity surveillance

A passive case detection system was maintained at the study health-center clinic of Mugil to ensure continuous morbidity surveillance of study participants. Children visited the health center at routine vaccination time points (3, 6 and 9 months) and parents of participating children were asked to visit the clinic free-of-charge whenever their child was sick. They were seen by one of the study nurses, often accompanied by a health-center staff member. Community reporters were responsible for reporting any deaths that occurred. Additionally, when a child did not show up for a regular follow-up visit, study staff enquired to see what had happened to the child. Death rarely occurred in the health facilities. Finally, at the end of the study, a last check was performed to ensure that children were still living (part of the main study protocol). The passive surveillance records collected were used to perform the present analysis.

The IPTi study was explained in detail and an information brochure given to consenting parents. A child was enrolled after written consent from at least one parent.

Each illness episode was assessed using a standard case report form. Main symptoms and signs were systematically reported using tick-boxes. In December 2007, pulse oximetry (Nellcor Pulse OxyMax N-20PA) was introduced at the Mugil study clinic and used systematically to assess peripheral arterial oxygen saturation of sick children. The normal values of SpO2, according to the WHO definitions, are between 97 and 100%, with a lower limit of 94% at sea level [19]; in the present study the health clinic staff were recommended to consider admission or referral of study participants if their peripheral arterial oxygen saturation dropped below 94%; moreover WHO recommendations were followed to administer oxygen if the SpO2 was < 90% [20]. In cases of history of fever in the previous 48 hours, or an axillary temperature > 37.5°C, a rapid diagnostic test (RDT) for malaria (ICT ComboH, South Africa) was performed and haemoglobin (Hb) levels measured using a portable Hemocue 201 machine (Angelholm, Sweden). Malaria treatment was based on RDT results. All illnesses were treated according to the standard treatment guidelines of PNG, based on Integrated Management of Childhood Illness (IMCI), except for malaria where an ad hoc study procedure with artemether/lumefantrine was used. Children were also assessed for danger signs and symptoms and referred for admission when necessary.

A severe illness was defined as an illness episode with potential life-threatening features as detailed in Table 1. At least one danger sign was needed to classify an episode as severe disease. A child with severe illness may not be admitted for any of the following reasons: parental refusal, personal judgment of health staff, or misidentification of danger signs & symptoms.

Study staff

The clinical staff comprised 2 to 3 nurses and community health workers (CHW) specially trained for study procedures including completing case report forms and blood collection. Otherwise, care provided was very close to that usually performed in government health facilities, except there was no shortage of drugs or consumables.

Study procedure

A clinical case was included if it fulfilled the following inclusion criteria:

  1. Children aged between 3 and 27 months, enrolled in the IPTi study
  2. Full clinical records (signs and symptoms) were available
  3. Pulse oximetry was measured at time of visit

Children who visited the clinic in the prior 14 days were excluded from the study to avoid counting the same episode twice. Definitions of the measured outcomes are summarized in Table 1.

Statistical analysis

We calculated the performance (sensitivity, specificity, positive and negative predictive values), unadjusted odds ratio (OR) and likelihood ratio (LR) of pulse oximetry peripheral arterial oxygen saturation with thresholds between 90% and 99% to identify severe illnesses from all cases, severe pneumonia from all pneumonias and hospitalizations from all cases.

Receiver operating characteristic (ROC) curves were drawn and areas under the curve (AUC) calculated for all three outcomes, global and stratified by age (≤ 12 months vs. > 12 months). AUCs in the two age groups were compared using AUC standard errors given in [21]. Optimal cut-off to predict outcome was obtained combining results of odds ratios and Youden Indexes.

Results

Between December 2007 and May 2010, 669 children visited the clinic, 327 (49%) were females and a total of 1921 illness episodes were recorded. We retained 1663 illness episodes that occurred in 643 children (312 females) fulfilling inclusion criteria. Details of excluded subjects are shown in Figs 1 and 2 shows the illness classification tree.

thumbnail
Fig 1. Study flowchart.

Abbreviations: RR: Respiratory Rate, SpO2: peripheral arterial oxygen saturation measured with pulse oximetry, T°: Temperature.

https://doi.org/10.1371/journal.pone.0213937.g001

No deaths were recorded. The general description of the cohort is shown in Table 2.

The mean value of SpO2 was 96.9% (SD 3.7%) in episodes presenting ≥1 danger sign (n = 139) and 98.4% (SD: 2.2%) in those without danger sign (n = 1524) (p<0.001). It was 96.6% (SD: 3.9%) and 98.4% (SD 2.2%) in episodes presenting criteria of severe pneumonia (n = 93) and in those with non-severe pneumonia (n = 727), respectively (p<0.001). It was 96.0% (SD 4.0%) and 98.1% (SD 2%) in children hospitalized (n = 84) and those non-hospitalized (n = 1579) respectively (p<0.001).

Among 1663 illness episodes, 139 were classified as severe illness. Using SpO2 thresholds between 99% and 90%, sensitivity of pulse oximetry to predict severe illness among all illnesses ranged from 73 to 4%, specificity from 41 to 99%, positive predictive value (PPV) from 10 to 26% and negative predictive value (NPV) from 94 to 92%. The AUC for SpO2 to predict severe illness was 0.63 (Fig 3). When stratified by age, the AUC was higher for children ≤12-months compared to children >12-months (0.68 and 0.56, respectively; p = 0.02) (Fig 4).

thumbnail
Fig 3. ROC curves to predict: Severe diseases among all illness episodes, severe pneumonia among all pneumonias episodes and hospitalizations among all illness episodes.

https://doi.org/10.1371/journal.pone.0213937.g003

thumbnail
Fig 4. ROC curves stratified by age to predict: Severe diseases among all illness episodes, severe pneumonia among all pneumonias episodes and hospitalizations among all illness episodes.

https://doi.org/10.1371/journal.pone.0213937.g004

Among 820 pneumonia episodes, 93 episodes were classified as severe pneumonia. Using SpO2 thresholds between 99% and 90%, sensitivity of pulse oximetry to predict severe pneumonia among all pneumonia ranged from 81 to 5%, specificity from 34 to 98%, PPV from 14 to 46% and NPV from 93 to 89%. The AUC for SpO2 to predict severe pneumonia was 0.68 (Fig 3). When stratified by age, the AUC for children ≤12-months was 0.73 while it was 0.60 for children >12-months (p = 0.04) (Fig 4).

Among 1663 illness episodes, 84 episodes ended with hospitalization. For Using SpO2 thresholds between 99% and 90%, sensitivity of pulse oximetry in predicting hospitalizations among all illnesses ranged from 75 to 2%, specificity from 40 to 99%, PPV from 6 to 26% and NPV from 97 to 95%. The AUC for SpO2 to predict hospitalization was 0.65 (Fig 3). When stratified by age, the AUC was higher for children ≤12-months compared to children >12-months (0.70 and 0.56, respectively; p = 0.04) (Fig 4).

The ORs and Youden Indexes according to SpO2 threshold for prediction of the three outcomes (severe illness, severe pneumonia and hospitalization) are given in Fig 5.

thumbnail
Fig 5. ORs and Youden Indexes for different cut-offs of SpO2.

https://doi.org/10.1371/journal.pone.0213937.g005

Discussion

Only a few studies have explored the utility of pulse oximetry to identify severely ill children in a remote day-to-day pediatric outpatient clinic. It was found that a low SpO2 correlates with severity of illness, regardless of etiology. As expected, the association with severe illnesses was stronger when the SpO2 was lower and the association was also stronger if severe illnesses included respiratory symptoms. An AUC of 0.60 for severe pneumonia represents a fair performance although we expected better performance. It suggests that SpO2 values alone have only a limited discriminative power. As shown in other studies, a combination of clinical signs and pulse oximetry values could lead to better performance [15,16].

We observed better performance of pulse oximetry in younger children, independent of the outcome (AUC of 0.68 for severe illness among all illness episodes and 0.73 for severe pneumonia among all pneumonia). This observation is particularly interesting because identification of severe illness is more complicated in younger children and pulse oximetry could be therefore a valuable tool in this sub-group. Reasons for this are unclear, but it is possible that younger children have more immature lung function and thus even a mild disease might lead quickly to a decrease in SpO2.

Pulse oximetry showed high NPVs, constantly above 90% that are comparable or even better than those found in the meta-analysis of Zhang & al., suggesting that pulse oximetry can be a useful additional tool to reasonably exclude severe illnesses in children presenting at an outpatient clinic in a developing country, a lower prevalence setting compared to an emergency department.

WHO recommends oxygen administration to children with severe pneumonia if the SpO2 falls under 90% [20]. The British Thoracic Society guidelines for the management of community-acquired pneumonia (CAP) in children highlights that there is not a single validated severity score to guide the decision for hospitalization. In an emergency care-based study that evaluated which children were at risk of a severe infection using vital signs, a threshold of a SpO2 <94% was proposed. For unclear reasons a threshold for hospitalization of SpO2 < 92% was finally proposed [22]. A systematic review and meta-analysis that evaluated the association between hypoxemia and mortality in children with acute lower respiratory infection in mid- and low-income countries, showed that children with SpO2 values of less than 90% and 92% had an increased risk of mortality, but the OR between the two cut-offs showed no significant difference [23]. A recent systematic review proposes giving oxygen to all children presenting with WHO-defined emergency signs with a SpO2 < 95%, but the threshold should be weighted with the oxygen-availability supplies [24]. In the present study, it seems appropriate to consider referral for admission or further care if the SpO2 is ≤94% [25]. Fig 5 shows that a cut-off of SpO2 ≤ 94% seems the best compromise, with high OR and Youden Index that are only slightly smaller than their maximum values.

Implications for routine practice:

Often in ambulatory settings, the paramedical staff is the first health staff to encounter sick children with limited training in recognizing clinical signs of hypoxemia that makes it difficult to identify severe illnesses and severe acute respiratory infections. Thus, the introduction of a simple objective and reproducible measure of hypoxemia such as pulse oximetry would be welcome. The use of pulse oximetry is extremely easy and affordable making it the tool of choice for large screenings in relatively low-prevalence rural settings (in our study, less than 10% of illness could be considered clinically severe). Moreover, a better evaluation of the peripheral arterial oxygen saturation could lead to a more rational use of oxygen therapy.

In addition to evaluating the performance of pulse oximetry as a diagnostic tool, this study explored the feasibility of implementing it, which indicated that pulse oximetry can be confidently used in day-to-day practice by staff with limited clinical expertise. Its implementation in the frame of existing guidelines such as the IMCI, therefore seems feasible with the potential to improve substantially the management of severe pneumonia and more generally severe illnesses. As a recent systematic review highlights [26], more prospective studies are needed to assess how pulse oximetry could impact on illness outcome.

Conclusion

This study provided some evidence for the usefulness of measuring oxygen saturation by pulse oximetry in children in resource-poor outpatient clinics in improving the identification of children with severe pneumonia and more generally severe illnesses, especially in children under one year. A SpO2 of 94% appeared to be a reasonable threshold for considering further examination and observation. Furthermore, this study showed that it is feasible to implement such a device in the context of an outpatient clinic with limited resources. Due to its ease of use and affordability, policy makers should consider introducing it into the IMCI recommendations.

Supporting information

S1 Table. Danger signs among all illness episodes.

Se: sensitivity, Sp: specificity, PPV: positive predictive value, NPV: negative predictive value, LR +: positive likelihood ratio, LR-: negative likelihood ratio, OR: odd ratio.

https://doi.org/10.1371/journal.pone.0213937.s001

(TIF)

S2 Table. Severe pneumonia among all pneumonia episodes.

Se: sensitivity, Sp: specificity, PPV: positive predictive value, NPV: negative predictive value, LR +: positive likelihood ratio, LR-: negative likelihood ratio, OR: odd ratio.

https://doi.org/10.1371/journal.pone.0213937.s002

(TIF)

S3 Table. Hospitalization among all illness episodes.

Se: sensitivity, Sp: specificity, PPV: positive predictive value, NPV: negative predictive value, LR +: positive likelihood ratio, LR-: negative likelihood ratio, OR: odd ratio.

https://doi.org/10.1371/journal.pone.0213937.s003

(TIF)

Acknowledgments

We would like to thank all the study participants and their parents and the study health staff who performed the data collection.

References

  1. 1. Estimates of the global, regional, and national morbidity, mortality, and aetiologies of lower respiratory tract infections in 195 countries: a systematic analysis for the Global Burden of Disease Study 2015. Lancet Infect Dis. 2017;17: 1133–1161. pmid:28843578
  2. 2. WHO | Global action plan for prevention and control of pneumonia (GAPP). In: WHO [Internet]. [cited 9 Apr 2014]. Available: http://www.who.int/maternal_child_adolescent/documents/fch_cah_nch_09_04/en/
  3. 3. Subhi R, Adamson M, Campbell H, Weber M, Smith K, Duke T. The prevalence of hypoxaemia among ill children in developing countries: a systematic review. Lancet Infect Dis. 2009;9: 219–227. pmid:19324294
  4. 4. Onyango FE, Steinhoff MC, Wafula EM, Wariua S, Musia J, Kitonyi J. Hypoxaemia in young Kenyan children with acute lower respiratory infection. BMJ. 1993;306: 612–615. pmid:8369033
  5. 5. Wandeler G, Pauchard JY, Zangger E, Diawara H, Gehri M. Which clinical signs predict hypoxaemia in young Senegalese children with acute lower respiratory tract disease? Paediatr Int Child Health. 2015;35: 65–68. pmid:25547179
  6. 6. Rao YK, Midha T, Kumar P, Tripathi VN, Rai OP. Clinical predictors of hypoxemia in Indian children with acute respiratory tract infection presenting to pediatric emergency department. World J Pediatr WJP. 2012;8: 247–251. pmid:22886198
  7. 7. Usen S, Weber M, Mulholland K, Jaffar S, Oparaugo A, Omosigho C, et al. Clinical predictors of hypoxaemia in Gambian children with acute lower respiratory tract infection: prospective cohort study. BMJ. 1999;318: 86–91. pmid:9880280
  8. 8. Rambaud-Althaus C, Althaus F, Genton B, D’Acremont V. Clinical features for diagnosis of pneumonia in children younger than 5 years: a systematic review and meta-analysis. Lancet Infect Dis. 2015;15: 439–450. pmid:25769269
  9. 9. Duke T, Blaschke AJ, Sialis S, Bonkowsky JL. Hypoxaemia in acute respiratory and non-respiratory illnesses in neonates and children in a developing country. Arch Dis Child. 2002;86: 108–112. pmid:11827904
  10. 10. Ayieko P, English M. In children aged 2–59 months with pneumonia, which clinical signs best predict hypoxaemia? J Trop Pediatr. 2006;52: 307–310. pmid:16943216
  11. 11. Mwaniki MK, Nokes DJ, Ignas J, Munywoki P, Ngama M, Newton CR, et al. Emergency triage assessment for hypoxaemia in neonates and young children in a Kenyan hospital: an observational study. Bull World Health Organ. 2009;87: 263–270. pmid:19551234
  12. 12. Laman M, Ripa P, Vince J, Tefuarani N. Can clinical signs predict hypoxaemia in Papua New Guinean children with moderate and severe pneumonia? Ann Trop Paediatr. 2005;25: 23–27. pmid:15814045
  13. 13. Zhang L, Mendoza-Sassi R, Santos JCH, Lau J. Accuracy of symptoms and signs in predicting hypoxaemia among young children with acute respiratory infection: a meta-analysis [Review article]. Int J Tuberc Lung Dis. 2011;15: 317–325. pmid:21333097
  14. 14. McCollum ED, King C, Deula R, Zadutsa B, Mankhambo L, Nambiar B, et al. Pulse oximetry for children with pneumonia treated as outpatients in rural Malawi. Bull World Health Organ. 2016;94: 893–902. pmid:27994282
  15. 15. Raihana S, Dunsmuir D, Huda T, Zhou G, Rahman QS, Garde A, et al. Development and Internal Validation of a Predictive Model Including Pulse Oximetry for Hospitalization of Under-Five Children in Bangladesh. PLoS ONE. 2015;10. pmid:26580403
  16. 16. Garde A, Zhou G, Raihana S, Dunsmuir D, Karlen W, Dekhordi P, et al. Respiratory rate and pulse oximetry derived information as predictors of hospital admission in young children in Bangladesh: a prospective observational study. BMJ Open. 2016;6. pmid:27534987
  17. 17. Madico G, Gilman RH, Jabra A, Rojas L, Hernández H, Fukuda J, et al. The role of pulse oximetry. Its use as an indicator of severe respiratory disease in Peruvian children living at sea level. Respiratory Group in Peru. Arch Pediatr Adolesc Med. 1995;149: 1259–1263. pmid:7581759
  18. 18. Senn N, Rarau P, Stanisic DI, Robinson L, Barnadas C, Manong D, et al. Intermittent preventive treatment for malaria in Papua New Guinean infants exposed to Plasmodium falciparum and P. vivax: a randomized controlled trial. PLoS Med. 2012;9: e1001195. pmid:22479155
  19. 19. WHO | Oxygen therapy for children: a manual for health workers. In: WHO [Internet]. [cited 16 Sep 2018]. Available: http://www.who.int/maternal_child_adolescent/documents/child-oxygen-therapy/en/
  20. 20. Pocket Book of Hospital Care for Children: Guidelines for the Management of Common Childhood Illnesses [Internet]. 2nd ed. Geneva: World Health Organization; 2013. Available: http://www.ncbi.nlm.nih.gov/books/NBK154447/
  21. 21. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143: 29–36. pmid:7063747
  22. 22. Harris M, Clark J, Coote N, Fletcher P, Harnden A, McKean M, et al. British Thoracic Society guidelines for the management of community acquired pneumonia in children: update 2011. Thorax. 2011;66 Suppl 2: ii1–23. pmid:21903691
  23. 23. Lazzerini M, Sonego M, Pellegrin MC. Hypoxaemia as a Mortality Risk Factor in Acute Lower Respiratory Infections in Children in Low and Middle-Income Countries: Systematic Review and Meta-Analysis. PloS One. 2015;10: e0136166. pmid:26372640
  24. 24. Tosif S, Duke T. Evidence to Support Oxygen Guidelines for Children with Emergency Signs in Developing Countries: A Systematic Review and Physiological and Mechanistic Analysis. J Trop Pediatr. 2017;63: 402–413. pmid:28158795
  25. 25. Senn N, Rarau P, Salib M, Manong D, Siba P, Rogerson S, et al. Use of Antibiotics within the IMCI Guidelines in Outpatient Settings in Papua New Guinean Children: An Observational and Effectiveness Study. PLoS ONE. 2014;9. pmid:24626194
  26. 26. Enoch AJ, English M, Shepperd S. Does pulse oximeter use impact health outcomes? A systematic review. Arch Dis Child. 2016;101: 694–700. pmid:26699537