Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Diagnostic Value of Capillary Refill Time for Detecting Serious Illness in Children: A Systematic Review and Meta-Analysis

  • Susannah Fleming ,

    susannah.fleming@phc.ox.ac.uk

    Affiliation Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, United Kingdom

  • Peter Gill,

    Affiliation The Hospital for Sick Children, Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada

  • Caroline Jones,

    Affiliation Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, United Kingdom

  • James A. Taylor,

    Affiliation Child Health Institute, University of Washington, Seattle, Washington, United States of America

  • Ann Van den Bruel,

    Affiliation Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, United Kingdom

  • Carl Heneghan,

    Affiliation Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, United Kingdom

  • Nia Roberts,

    Affiliation Bodleian Health Care Libraries, University of Oxford, Oxford, Oxfordshire, United Kingdom

  • Matthew Thompson

    Affiliation Department of Family Medicine, University of Washington, Seattle, Washington, United States of America

The Diagnostic Value of Capillary Refill Time for Detecting Serious Illness in Children: A Systematic Review and Meta-Analysis

  • Susannah Fleming, 
  • Peter Gill, 
  • Caroline Jones, 
  • James A. Taylor, 
  • Ann Van den Bruel, 
  • Carl Heneghan, 
  • Nia Roberts, 
  • Matthew Thompson
PLOS
x

Abstract

Importance

Capillary refill time (CRT) is widely recommended as part of the routine assessment of unwell children.

Objective

To determine the diagnostic value of capillary refill time for a range of serious outcomes in children.

Methods

We searched Medline, Embase and CINAHL from inception to June 2014. We included studies that measured both capillary refill time and a relevant clinical outcome such as mortality, dehydration, meningitis, or other serious illnesses in children aged up to 18 years of age. We screened 1,265 references, of which 24 papers were included in this review. Where sufficient studies were available, we conducted meta-analysis and constructed hierarchical summary ROC curves.

Results

Meta-analysis on the relationship between capillary refill time and mortality resulted in sensitivity of 34.6% (95% CI 23.9 to 47.1%), specificity 92.3% (88.6 to 94.8%), positive likelihood ratio 4.49 (3.06 to 6.57), and negative likelihood ratio 0.71 (0.60 to 0.84). Studies of children attending Emergency Departments with vomiting and diarrhea showed that capillary refill time had specificity of 89 to 94% for identifying 5% dehydration, but sensitivity ranged from 0 to 94%. This level of heterogeneity precluded formal meta-analysis of this outcome. Meta-analysis was not possible for other outcomes due to insufficient data, but we found consistently high specificity for a range of outcomes including meningitis, sepsis, admission to hospital, hypoxia, severity of illness and dengue.

Conclusions

Our results show that capillary refill time is a specific sign, indicating that it can be used as a “red-flag”: children with prolonged capillary refill time have a four-fold risk of dying compared to children with normal capillary refill time. The low sensitivity means that a normal capillary refill time should not reassure clinicians.

Introduction

Identifying children who may have hemodynamic compromise or shock is a routine part of clinical assessment and a core component of Pediatric Advanced Life Support.[13] In most settings, this includes assessment of peripheral perfusion such as capillary refill time (CRT) as well as measurement of blood pressure to assess cardiovascular status. However, blood pressure is maintained in children in the early stages of shock to a greater extent than in adults, to the expense of reduced peripheral perfusion and raised heart rate, so may be a less valuable measure particularly in triage or other frontline healthcare settings.[4, 5]

In a recent systematic review of the validity and reliability of CRT,[6] we found that CRT is 2 seconds or less when measured on the finger in healthy children and older infants, but may extend to 4 seconds when measured on the chest or foot. In addition to the influence of the body site at which CRT is measured, changes in both ambient and skin temperature may have a significant effect on measured values. Current evidence also indicates that inter-observer reliability of CRT is highly variable, and may be related to the measurement method, with those made using stopwatches displaying lower inter-observer variability than simple counting.

Despite the evidence on variability in measurements and a lack of standardization, CRT is included as part of the routine or initial assessment of seriously ill or injured children in Pediatric Advanced Life Support and in a number of major international guidelines (Table 1).[13, 79] CRT is also frequently recommended in monitoring and guiding the treatment of children with severe sepsis or septic shock.[4, 5]

Prolonged CRT or decreased peripheral perfusion is cited as a red flag for serious illness in children.[1013] However, to our knowledge there has not been a comprehensive and systematic assessment of the diagnostic value of CRT across a range of serious conditions in children of all ages in all settings. This systematic review assesses the current evidence for the diagnostic and prognostic value of CRT for identifying children with serious illnesses such as dehydration and meningitis, and to predict adverse outcomes such as death.

Methods

A protocol was developed by the authors for this review. This has not been registered or published, but is provided as S1 Text.

Search strategies

A detailed search strategy was developed in collaboration with an information specialist (NR) to identify papers on the diagnostic accuracy of CRT in children (see S2 Text for details). The search strategy was applied to three bibliographic databases Medline (OvidSP) [1946-present], Embase (OvidSP) [1974-present] and CINAHL (OvidSP) [1980-present]. Additional papers were identified from the reference lists of relevant papers and consultation with experts. Search date was 9 June 2014. Searches were not restricted by language or country of origin.

Inclusion and exclusion criteria

We included papers which reported measurement of CRT by any method on a minimum of 20 subjects under the age of 18 years. We excluded papers that reported data only on subjects over the age of 18 years, or in which more than 50% of the children were neonates born prematurely (<35 weeks gestation). We also excluded studies in which more than 50% of subjects had significant pre-existing cardiorespiratory disease such as cardiac malformations. However, we included studies that reported these groups separately, allowing extraction of a group with at least 20 children who fulfilled the inclusion criteria.

Eligible studies measured and reported the relationship between CRT and a relevant clinical outcome, with no other restriction on study design or clinical setting. Acceptable outcomes included: mortality; final diagnosis of a specific serious illness (e.g. meningitis, dehydration, or pneumonia); admission to secondary care facilities; hypoxia; and measures of severity of illness or infection composed of groupings of other acceptable outcomes (e.g. where “severe illness” is defined by hypoxia or a specific list of final diagnoses). Studies performing multivariate analyses including CRT with other clinical and/or laboratory tests were not included in this review unless univariate results for CRT and a relevant outcome were also presented.

References were screened for inclusion by two reviewers using title and abstract, using full-text where necessary. Subsequently, four reviewers assessed selected studies for eligibility using the full text. Where necessary we attempted to contact authors for further information to clarify eligibility.

Quality criteria

Quality assessment criteria were developed based on the QUADAS-2 checklist.[14] The criteria (S1 Table) assessed patient selection, performance of the index test (CRT), performance of the comparator, and aspects of timing and flow.

Data extraction

Data from all included studies were extracted on a pre-specified form by one author and checked by a second author, with any disagreements resolved by consensus. We extracted data on patient characteristics and study design, country of origin, and method of measuring CRT. Measurements of CRT were considered to be prolonged based on the definitions used by the investigators for each included study. All relevant outcomes were identified and extracted. Where they were not reported, we calculated sensitivity, specificity, and likelihood ratios, including 95% confidence intervals, from the 2x2 tables. Where one or more cells of a 2x2 table was empty, we added 0.5 to each cell before calculating summary statistics.[15] Where insufficient data were reported to calculate outcome measures or reconstruct 2x2 tables, we contacted study authors to obtain further information. Study settings were categorized into high-income, upper-middle-income, lower-middle-income, and low-income countries based on their World Bank classification in July 2013.[16]

Analysis

Results are reported descriptively, identifying and explaining differences between studies and any resulting heterogeneity. When comparable outcomes were reported by at least four studies and no apparent clinical heterogeneity was present, meta-analysis was performed using the bivariate method.[17] Based on the parameters from this analysis, a hierarchical summary receiver operative characteristic (ROC) curve was constructed. When data on more than one cut-off was available, only one was included in the meta-analysis to avoid inclusion of data on the same patient twice. Where necessary, we included the data corresponding to the cut-off which was used most frequently in other studies within the meta-analysis, in an attempt to reduce overall heterogeneity. Statistical heterogeneity was inspected visually on the ROC plot by checking the distance of the individual studies from the hierarchical summary ROC curve. When statistical heterogeneity was present, no pooled results were reported.

Analyses were carried out using R (version 3.0.1, The R Foundation for Statistical Computing), with Stata (version 11.2, Statacorp) additionally used to generate hierarchical summary ROC curves.

Results

After removal of duplicates, we screened 1,265 references (Fig 1), and included 24 papers in this review, of which 13 reported studies carried out in high income countries, and 11 in low or middle income countries. Nine studies on 17,285 children assessed the relationship between CRT and mortality, and six studies on approximately 680 children assessed the relationship between CRT and dehydration, allowing meta-analyses on both outcomes. We also identified 11 papers on 41,287 children reporting other outcomes related to serious illness, including meningitis (four studies, n = 10,205), hospital admission (three studies, n = 17,742), sepsis (three studies, n = 19,923), dengue fever (two studies, n = 2,039), urinary tract infection (one study, n = 15,781), pneumonia (one study, n = 15,781), hypoxia (one study, n = 3,176), and combined measures of severity of illness (three studies, n = 8,555), with some studies reporting multiple outcomes. Full details of individual study characteristics are given in S2 Table.

The quality assessment of the included papers is summarized in Fig 2, with details in S3 Table. Although performance on most of the quality criteria was good, reporting of the method of measurement of CRT was generally poor, with 11 papers reporting neither the site nor the methods of time measurement, and a further six reporting only one of these (noted as unclear reporting). Blinding was also poorly reported, particularly for the clinical outcomes. In many cases, blinding of CRT measurement could only be established by timing, in that the measurement was made before determination of the clinical outcome. Few studies had contemporaneous measurement of CRT and clinical outcome, although it should be noted that this was impractical or impossible for some outcomes, such as final clinical diagnosis, or mortality. Missing data were generally not reported leading to uncertainty regarding the representativeness of the sample.

Predictive accuracy of CRT for mortality

We extracted 2x2 tables from seven of the studies on mortality, and data from the other two[18, 19] were obtained after communication with the authors (for details of extracted data, see S4 Table). The nine included studies provided data on 17,285 children, of whom 1,149 died. Eight of the studies were conducted in hospital settings in low or lower-middle income countries.

In all nine studies, CRT had high specificity for predicting overall mortality (range of 80–98%). All but two showed low sensitivity: one reporting moderate sensitivity was a very small study with wide confidence intervals,[20] and the second recruited children in a different setting (pre-hospital emergency transport in a high income country).[21] We used data from the nine studies to calculate a hierarchical summary ROC (HSROC) curve, shown in green in Fig 3. The summary point calculated by the meta-analysis (shown as a red box in Fig 3) has a sensitivity of 34 6% (95% CI 23 9–47 1%), specificity 92 3% (88 6–94 8%), positive likelihood ratio 4 49 (3 06–6 57), and negative likelihood ratio 0 71 (0 60–0 84) for prolonged CRT as a predictor of mortality. A bivariate random effects model was used to estimate a 95% prediction region for the curve, and a 95% confidence region for the summary point.

thumbnail
Fig 3. Hierarchical summary ROC curve showing diagnostic accuracy of CRT for predicting mortality.

https://doi.org/10.1371/journal.pone.0138155.g003

In the dumbbell plot in Fig 4, the pre-test probability (prevalence) is shown in blue for each study, with the post-test probability after finding prolonged CRT (positive test) in red, and the post-test probability after finding normal CRT (negative test) in green. It can be seen that prolonged CRT consistently increases the post-test probability, whereas normal CRT does not greatly reduce it.

thumbnail
Fig 4. Pre/post test probability plot of prolonged CRT for predicting mortality.

Markers show pre-test prevalence (blue), and post-test probabilities after positive (red) and negative (green) tests. Multiple results are shown for two studies: results are shown for two different cut-offs reported by Maitland et al,[22] and results from a subgroup analysis by Pamba and Maitland showing the performance for predicting death from different conditions[23].

https://doi.org/10.1371/journal.pone.0138155.g004

One large study[23] reported the mortality due to various causes with an abnormal CRT, as shown in the lower portion of the dumbbell plot in Fig 4. This indicates that CRT longer than 3 seconds is predictive of mortality from malaria (without severe anemia), malnutrition, meningitis, and sepsis, but not from acute respiratory infection or malarial anemia (Hb<50g/l).

Diagnostic accuracy of CRT for dehydration

Of the six papers reporting the diagnostic accuracy of CRT for dehydration, recruitment overlapped in two[24, 25] (we selected the one with the larger cohort, more clearly defined measurement method, and more data on the outcome of interest for analysis.[25]) The number of children in the five included studies is 499, of whom 147 had ≥5% dehydration (see S5 Table).

We were able to extract sufficient data to reconstruct 2x2 tables for the outcome of ≥ 5% dehydration from all five studies. One study investigated the relationship between CRT and dehydration in children with diabetic ketoacidosis.[26] However, given that dehydration as a result of diabetic ketoacidosis has a markedly different pathophysiology from other causes of dehydration (e.g. infectious gastroenteritis), we did not include this study in the meta-analysis but it is presented in the dumbbell plot. The three studies reporting data for children attending Emergency Departments with gastrointestinal symptoms[25, 27, 28] all showed high specificity (range 88–94%). A hierarchical summary ROC curve for this data is shown in S1 Fig. The dumbbell plot in Fig 5 shows that prolonged CRT markedly increases the probability of a child having ≥ 5% dehydration, except in the case of diabetic ketoacidosis, where the utility of CRT is greatly reduced. Positive likelihood ratios ranged from 1.3 to 16.9, with negative likelihood ratios ranging from 0.06 to 0.99 (S5 Table).

thumbnail
Fig 5. Pre/post test probability plot of prolonged CRT for predicting significant dehydration and severe illness.

https://doi.org/10.1371/journal.pone.0138155.g005

The high heterogeneity of the data, as evidenced by the large confidence and prediction regions and the large distance of the individual study results from the summary ROC curve, means that reporting of the position of the summary point is not statistically relevant.

Diagnostic accuracy of CRT for other serious illnesses

We identified 11 studies with data on the accuracy of CRT for eight other clinical outcomes: dengue, meningitis, admission, sepsis, urinary tract infection, pneumonia, hypoxia, and severity of illness. Leonard and Beattie[29] reported no significant association between CRT and meningococcal disease or other significant bacterial illness but did not provide specific data (and contact with the authors failed to yield additional data). Three further studies did not report 2x2 tables for any outcomes;[19, 30, 31] data were obtained after contact with two study authors,[19, 31] but attempts to obtain results from the third study[30] were unsuccessful, although odds ratios are reported for all outcomes. One study[32] was excluded from the pre/post test probability plot as the case-control design precluded calculation of true prevalence. The results obtained are summarized in S6 Table.

Prolonged CRT shows consistently high specificity for prediction of dengue, meningitis, admission, sepsis, hypoxia, and severity of illness. No sensitivity or specificity values could be calculated for the outcomes of urinary tract infection or pneumonia, but reported odds ratios of between 2 and 5 are similar to those for other outcomes. In two studies of dengue, prolonged CRT showed variable sensitivity, which is likely to be explained by the large differences in the sample size and study design. Prolonged CRT showed low sensitivity for meningitis in one study carried out in low and lower-middle income settings, but moderate sensitivity in two studies carried out in high income settings. The sensitivity of CRT was relatively low for prediction of admission, sepsis, hypoxia, and severity of illness.

The pre/post test probability plots (Fig 5) for the eight studies for which prevalence and likelihood ratios were available, show that in most cases, prolonged CRT considerably increases the probability of an adverse clinical outcome. However, this is not the case for the study of meningitis in low and lower-middle income countries, although it does appear to hold for studies of meningitis in high-income countries. Few studies show any noticeable reduction in the probability of an adverse outcome following a normal CRT result, even where prevalence is relatively high.

Discussion

Our results show that CRT is an important “red flag” vital sign for identifying children with serious illness: finding an abnormal CRT increases the likelihood of a serious outcome including death and dehydration, but a normal CRT does not make a serious outcome less likely. Therefore, a normal CRT should not be used to rule out serious illness in children.

Our review identified 24 studies on over 53,000 children across a variety of outcomes and settings including primary and secondary care, low- and high-income countries, and emergency services. A prolonged CRT consistently performed well as a red flag in all these different situations, but the most robust evidence is found in low or middle income settings. Considering it is a clinical feature that does not require sophisticated equipment and can be measured in children of all ages in all circumstances, the measurement of CRT should be part of the standard evaluation of all acutely ill children worldwide.

The most convincing data were found for predicting death, indicating that a child with a prolonged CRT has a 4-fold greater risk of dying compared to a child with normal CRT. This strongly reinforces the recommendations in the World Health Organization’s Integrated Management of Childhood Illness (IMCI) guidelines that an abnormal CRT indicates shock and should be managed accordingly, and suggests that measurement of CRT should become part of routine IMCI protocols.[3] However, all of these studies were carried out in high mortality settings (lower income countries or high acuity settings in high income countries), and are unlikely to be generalizable to settings with low mortality rates.

Although heterogeneity precluded drawing firm conclusions from meta-analysis, abnormal CRT was shown to markedly increase the post-test probability of significant dehydration, with the exception of children presenting with diabetic ketoacidosis. The majority of these studies were performed in high-income settings, and reaffirm the importance of routinely measuring CRT in children with suspected dehydration, a common reason why parents bring children to healthcare professionals.

CRT specificity may vary for certain diseases. For example, it was less useful for meningitis than for sepsis, dengue, hypoxia, or need for hospital admission for serious infection. This may be because of the rapid evolving illness in meningitis leaving a narrow window for delivering life-saving treatments, or due to the infrequent presence of shock in these situations, as reduced peripheral perfusion secondary to shock is likely to be a common cause of prolonged CRT. Prolonged CRT clearly has a diagnostic role in assessing children, but we found a somewhat lower positive likelihood ratio (4.5 for outcome of mortality) compared to other markers of serious illness in children in high income settings (such as tachypnea, body temperature ≥ 40°C, or meningeal irritation[12, 13]) where positive likelihood ratios typically range between 5 and 10. Although likelihood ratios of 5 are generally considered to only moderately change the probability of disease, this may be all that can be expected from a clinical feature.[33] Moreover, the inconsistent and non-standardized measurement of CRT in clinical practice may also reduce the potential utility of this vital sign.[34, 35]

To our knowledge, this is the first systematic review of the diagnostic accuracy of CRT in children worldwide. We used a comprehensive search strategy that identified all available studies. However, studies often evaluate CRT together with many other clinical features, and thus terms referring to CRT or peripheral perfusion may not have picked up all available studies. We therefore supplemented our literature searches by reference tracking and expert consultation. We were unable to assess our results for publication bias, as there were fewer than 10 studies for any given outcome.

We found substantial heterogeneity particularly between studies reporting CRT for predicting dehydration. The statistical heterogeneity cannot be fully explained by clinical factors alone, but may be partly due to differences in measurement technique, which were incompletely reported. Nevertheless, the results of the individual studies suggest that while CRT could be an important red flag for dehydration, more evidence from better specified and appropriately powered studies are needed to obtain a precise estimate of CRT’s diagnostic value.

Poor reporting was a significant issue across included studies. In particular, we found inconsistent or incomplete reporting on how CRT was measured. The results of our previous review indicate that measurement methods such as the choice of body site, pressing time or ambient temperature impact the test’s validity and reliability.[6] The paucity of reporting of these factors suggests that the estimates of diagnostic accuracy we report may be more conservative than if the studies had used more consistent and valid measurement methods. However, where reported, included studies used the finger as the measurement site, and use cut-offs of 2 or 3 seconds to define prolonged CRT. These are consistent with the findings of our previous review, which recommends that CRT should be measured on the finger, and found that normal CRT in healthy children at this site is 2 seconds or less. Standardization of CRT measurement is essential for future diagnostic accuracy studies.

There was also poor reporting of whether all included children received measurements of both CRT and the clinical outcome, which was typically due to retrospective or observational study designs, leading to missing data. This incomplete reporting introduces both risk of selection bias and may limit the representativeness of the findings as children who were particularly unwell may have been excluded in the studies. We were unable to assess the diagnostic value of CRT in detecting serious illness at different age groups, and the inclusion of wide age ranges in some studies may have obscured potential age-related differences. We also found very limited data from primary care settings where access to diagnostic investigations may be limited and clinical signs such as CRT play a vital role in clinical assessment.

For clinicians, our findings emphasize the diagnostic value of CRT; highlighting that CRT is generally highly specific, but has variable and often low sensitivity–hence better for ruling in than ruling out. Since CRT has limited reliability, repeating measurement is important before getting alarmed. Clinical guidelines need to emphasize their rationale for including CRT, including the method for measurement (making it clearer where and for how long to press, and use of a stopwatch, or equivalent, to measure), and the interpretation of CRT values (avoiding terms like prolonged or sluggish, and instead provide whole second cut off values).

A number of important issues remain unresolved. First, we found only one study in primary care, and no studies that looked at the outcomes of dehydration in this setting. Yet, the numbers presenting with acute gastroenteritis and dehydration in these settings worldwide are considerable. Second, using more consistent and standardized methods of measuring CRT to determine its clinical utility across a wide range of diseases could aid its interpretation and use. Third, studies are needed to determine the added diagnostic value of CRT or its independent diagnostic value over and above other vital signs and clinical features. Finally, there are opportunities to explore the use of new technologies to improve the measurement and detection of CRT, and determine whether they perform better when compared with heart rate or other non-invasive measures of cardiovascular status such as blood pressure.

Conclusions

A capillary refill time of 3 seconds or more is an important warning sign for serious illness and risk of death in children, and can easily be used in a wide range of settings and with only minimal training. Normal CRT in children does not make a serious outcome less likely, and should not be used to rule out serious illness. Standardization of CRT measurement would likely increase the diagnostic utility of this test.

Supporting Information

S1 Fig. Hierarchical summary ROC curve showing diagnostic accuracy of CRT for predicting significant dehydration.

https://doi.org/10.1371/journal.pone.0138155.s001

(PDF)

S1 Table. Quality assessment criteria.

https://doi.org/10.1371/journal.pone.0138155.s002

(PDF)

S2 Table. Characteristics of included studies.

https://doi.org/10.1371/journal.pone.0138155.s003

(PDF)

S3 Table. Quality assessment of included papers.

https://doi.org/10.1371/journal.pone.0138155.s004

(PDF)

S4 Table. Extracted data on diagnostic accuracy of CRT for predicting mortality in children.

https://doi.org/10.1371/journal.pone.0138155.s005

(PDF)

S5 Table. Extracted data on diagnostic accuracy of CRT for ≥5% dehydration.

https://doi.org/10.1371/journal.pone.0138155.s006

(PDF)

S6 Table. Diagnostic accuracy of CRT in predicting serious illness and admission to hospital.

https://doi.org/10.1371/journal.pone.0138155.s007

(PDF)

S1 Text. Systematic review protocol.

https://doi.org/10.1371/journal.pone.0138155.s008

(PDF)

S2 Text. Search strategy for diagnostic accuracy studies.

https://doi.org/10.1371/journal.pone.0138155.s009

(PDF)

S3 Text. Completed PRISMA checklist.

https://doi.org/10.1371/journal.pone.0138155.s010

(PDF)

Author Contributions

Conceived and designed the experiments: SF PG JAT AVdB MT NR. Performed the experiments: SF PG JAT AVdB MT. Analyzed the data: SF PG AVdB CJ. Wrote the paper: SF PG JAT AVdB MT NR CJ CH.

References

  1. 1. Mackway-Jones K, Advanced Life Support Group (Manchester England). Advanced paediatric life support: the practical approach. 4th ed. Malden, Mass.: Blackwell; 2005.
  2. 2. Ralston M, American Heart Association., American Academy of Pediatrics. PALS provider manual. Dallas, Tex.: American Heart Association; 2006. viii, 274 p. p.
  3. 3. World Health Organization. Department of Child and Adolescent Health and Development., UNICEF. Management of the child with a serious infection or severe malnutrition: guidelines for care at the first-referral level in developing countries. Geneva: Dept. of Child and Adolescent Health and Development UNICEF; 2000. xiii, 162 p. p.
  4. 4. Brierley J, Carcillo JA, Choong K, Cornell T, Decaen A, Deymann A, et al. Clinical practice parameters for hemodynamic support of pediatric and neonatal septic shock: 2007 update from the American College of Critical Care Medicine. Critical care medicine. 2009;37(2):666–88. Epub 2009/03/28. pmid:19325359.
  5. 5. Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock, 2012. Intens Care Med. 2013;39(2):165–228. pmid:ISI:000314765000001.
  6. 6. Fleming S, Gill P, Jones C, Taylor JA, Van den Bruel A, Heneghan C, et al. Validity and reliability of measurement of capillary refill time in children: a systematic review. Archives of disease in childhood. 2014. Epub 2014/09/28. pmid:25260515.
  7. 7. National Institute for Health and Care Excellence. Feverish illness in children—Assessment and initial management in children younger than 5 years. CG47. London: National Institute for Health and Care Excellence; 2007.
  8. 8. National Institute for Health and Care Excellence. Bacterial meningitis and meningococcal septicaemia. CG102. London: National Institute for Health and Care Excellence; 2010.
  9. 9. National Institute for Health and Care Excellence. Feverish illness in children. CG160. London: National Institute for Health and Care Excellence; 2013.
  10. 10. Colletti JE, Brown KM, Sharieff GQ, Barata IA, Ishimine P. The management of children with gastroenteritis and dehydration in the emergency department. The Journal of emergency medicine. 2010;38(5):686–98. Epub 2009/04/07. pmid:19345549.
  11. 11. Steiner MJ, DeWalt DA, Byerley JS. Is this child dehydrated? JAMA: the journal of the American Medical Association. 2004;291(22):2746–54. Epub 2004/06/10. pmid:15187057.
  12. 12. Thompson M, Van den Bruel A, Verbakel J, Lakhanpaul M, Haj-Hassan T, Stevens R, et al. Systematic review and validation of prediction rules for identifying children with serious infections in emergency departments and urgent-access primary care. Health Technology Assessment (Winchester, England). 2012;16(15):1–100. pmid:22452986.
  13. 13. Van den Bruel A, Haj-Hassan T, Thompson M, Buntinx F, Mant D. Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet. 2010;375(9717):834–45. Epub 2010/02/06. pmid:20132979.
  14. 14. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Annals of internal medicine. 2011;155(8):529–36. Epub 2011/10/19. pmid:22007046.
  15. 15. Agresti A. An introduction to categorical data analysis. 2nd ed. New Jersey: Wiley; 2007.
  16. 16. The World Bank. Data—Country Groups [cited 2013 12 July]. Available from: http://go.worldbank.org/47F97HK2P0.
  17. 17. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of clinical epidemiology. 2005;58(10):982–90. Epub 2005/09/20. pmid:16168343.
  18. 18. Mathur NB, Arora D. Role of TOPS (a simplified assessment of neonatal acute physiology) in predicting mortality in transported neonates. Acta Paediatrica. 2007;96(2):172–5. Epub 2007/04/13. pmid:17429899.
  19. 19. Weber MW, Carlin JB, Gatchalian S, Lehmann D, Muhe L, Mulholland EK. Predictors of neonatal sepsis in developing countries. The Pediatric infectious disease journal. 2003;22(8):711–7. Epub 2003/08/13. pmid:12913772.
  20. 20. Ahmed F, Mahmood C, Sharma J, Hoque S, Zaman R, Hasan M. Dengue and dengue haemorrhagic fever in children during the 2000 outbreak in Chittagong, Bangladesh. Dengue Bulletin. 2001;25(December):33–9.
  21. 21. Carcillo JA, Kuch BA, Han YY, Day S, Greenwald BM, McCloskey KA, et al. Mortality and functional morbidity after use of PALS/APLS by community physicians. Pediatrics. 2009;124(2):500–8. Epub 2009/08/05. pmid:19651576.
  22. 22. Maitland K, Berkley JA, Shebbe M, Peshu N, English M, Newton CR. Children with severe malnutrition: can those at highest risk of death be identified with the WHO protocol? PLoS medicine. 2006;3(12):e500. Epub 2006/12/30. pmid:17194194; PubMed Central PMCID: PMC1716191.
  23. 23. Pamba A, Maitland K. Capillary refill: prognostic value in Kenyan children. Archives of disease in childhood. 2004;89(10):950–5. Epub 2004/09/24. pmid:15383440; PubMed Central PMCID: PMC1719664.
  24. 24. Gorelick MH, Shaw KN, Murphy KO. Validity and reliability of clinical signs in the diagnosis of dehydration in children. Pediatrics. 1997;99(5):E6. Epub 1997/05/01. pmid:9113963.
  25. 25. Gorelick MH, Shaw KN, Murphy KO, Baker MD. Effect of fever on capillary refill time. Pediatric emergency care. 1997;13(5):305–7. Epub 1997/11/22. pmid:9368239.
  26. 26. Morrison G, Sottosanti M, Singh R, Sharma A, Fraser D, Alawi K, et al. Quantifying dehydration in children with diabetic ketoacidosis (DKA): Does it matter? Pediatric Critical Care Medicine. 2011;Conference: 6th World Congress on Pediatric Critical Care: One World Sharing Knowledge Sydney, NSW Australia. Conference Start: 20110313 Conference End: 20110317. Conference Publication:(var.pagings). 12 (3 SUPPL. 1):A122-A3. pmid:70418978.
  27. 27. Saavedra JM, Harris GD, Li S, Finberg L. Capillary refilling (skin turgor) in the assessment of dehydration. Am J Dis Child. 1991;145(3):296–8. Epub 1991/03/01. pmid:2003478.
  28. 28. Shavit I, Brant R, Nijssen-Jordan C, Galbraith R, Johnson DW. A novel imaging technique to measure capillary-refill time: improving diagnostic accuracy for dehydration in young children with gastroenteritis. Pediatrics. 2006;118(6):2402–8. Epub 2006/12/05. pmid:17142525.
  29. 29. Leonard PA, Beattie TF. Is measurement of capillary refill time useful as part of the initial assessment of children? European Journal of Emergency Medicine. 2004;11(3):158–63. pmid:15167177.
  30. 30. Craig JC, Williams GJ, Jones M, Codarini M, Macaskill P, Hayen A, et al. The accuracy of clinical symptoms and signs for the diagnosis of serious bacterial infection in young febrile children: prospective cohort study of 15 781 febrile illnesses. BMJ. 2010;340:c1594. Epub 2010/04/22. pmid:20406860; PubMed Central PMCID: PMC2857748.
  31. 31. Young Infants Clinical Signs Study G. Clinical signs that predict severe illness in children under age 2 months: a multicentre study. Lancet. 2008;371(9607):135–42. pmid:18191685.
  32. 32. Verbakel JY, MacFaul R, Aertgeerts B, Buntinx F, Thompson M. Sepsis and meningitis in hospitalized children: performance of clinical signs and their prediction rules in a case-control study. Pediatric emergency care. 2014;30(6):373–80. Epub 2014/05/23. pmid:24849278.
  33. 33. Jaeschke R, Guyatt GH, Sackett DL. Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA: the journal of the American Medical Association. 1994;271(9):703–7. Epub 1994/03/02. pmid:8309035.
  34. 34. Blacklock C, Haj-Hassan TA, Thompson MJ. When and how do GPs record vital signs in children with acute infections? A cross-sectional study. The British journal of general practice: the journal of the Royal College of General Practitioners. 2012;62(603):e679–86. Epub 2012/12/26. pmid:23265227; PubMed Central PMCID: PMC3459775.
  35. 35. Thompson M, Mayon-White R, Harnden A, Perera R, McLeod D, Mant D. Using vital signs to assess children with acute infections: a survey of current practice. The British journal of general practice: the journal of the Royal College of General Practitioners. 2008;58(549):236–41. Epub 2008/05/23. pmid:18494174; PubMed Central PMCID: PMC2277108.