Figures
Abstract
Background
Blood cultures are often recommended for the evaluation of community-acquired pneumonia (CAP). However, institutions vary in their use of blood cultures, and blood cultures have unclear utility in CAP management in hospitalized children.
Objective
To identify clinical factors associated with obtaining blood cultures in children hospitalized with CAP, and to estimate the association between blood culture obtainment and hospital length of stay (LOS).
Methods
We performed a multicenter retrospective cohort study of children admitted with a diagnosis of CAP to any of four pediatric hospitals in the United States from January 1, 2011-December 31, 2012. Demographics, medical history, diagnostic testing, and clinical outcomes were abstracted via manual chart review. Multivariable logistic regression evaluated patient and clinical factors for associations with obtaining blood cultures. Propensity score-matched Kaplan-Meier analysis compared patients with and without blood cultures for hospital LOS.
Results
Six hundred fourteen charts met inclusion criteria; 390 children had blood cultures obtained. Of children with blood cultures, six (1.5%) were positive for a pathogen and nine (2.3%) grew a contaminant. Factors associated with blood culture obtainment included presenting with symptoms of systemic inflammatory response syndrome (OR 1.78, 95% CI 1.10–2.89), receiving intravenous hydration (OR 3.94, 95% CI 3.22–4.83), receiving antibiotics before admission (OR 1.49, 95% CI 1.17–1.89), hospital admission from the ED (OR 1.65, 95% CI 1.05–2.60), and having health insurance (OR 0.42, 95% CI 0.30–0.60). In propensity score-matched analysis, patients with blood cultures had median 0.8 days longer LOS (2.0 vs 1.2 days, P < .0001) without increased odds of readmission (OR 0.94, 95% CI 0.45–1.97) or death (P = .25).
Citation: McCulloh RJ, Koster MP, Yin DE, Milner TL, Ralston SL, Hill VL, et al. (2015) Evaluating the Use of Blood Cultures in the Management of Children Hospitalized for Community-Acquired Pneumonia. PLoS ONE 10(2): e0117462. https://doi.org/10.1371/journal.pone.0117462
Academic Editor: Guy Brock, University of Louisville, UNITED STATES
Received: August 23, 2014; Accepted: December 23, 2014; Published: February 6, 2015
Copyright: © 2015 McCulloh et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: Ethical restrictions make data unsuitable for public deposition. Data requests may be sent to the corresponding author Russell J. McCulloh, MD, Children’s Mercy Hospital (rmcculloh@cmh.edu).
Funding: This work was supported by Rhode Island Foundation Clinical Research Grant: Sponsored by The Rhode Island Foundation (http://www.rifoundation.org/). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Pediatric community-acquired pneumonia (CAP) is a common reason for hospitalization, and CAP is associated with substantial healthcare resource use and costs to patients and families.[1] Previous studies have documented extensive variation in the management of CAP in the emergency department[2] and in the inpatient setting.[3] In 2011, national guidelines were developed as a means of optimizing healthcare resource use and clinical outcomes. These guidelines recommended specific measures to standardize the evaluation and treatment of CAP in children.[4] In particular, these guidelines recommend that “[b]lood cultures should be obtained in children requiring hospitalization for presumed bacterial CAP that is moderate to severe, particularly those with complicated pneumonia.” However, the authors noted that this strong recommendation was based on low-quality evidence, and criteria for obtaining blood cultures are often not followed.[5]
Previous studies have identified a low prevalence of bacteremia among children evaluated in the emergency department for CAP. A review of blood cultures obtained from children seen at 35 emergency departments found an overall prevalence of bacteremia of only 2.1% and a contamination prevalence of 1.0%.[6] Bacteremia prevalence is higher among children hospitalized for CAP, particularly if pneumonia is complicated by pleural effusion.[7] However, the overall prevalence of bacteremia in this population remains only 7%, with most cases among children undergoing pleural drainage or with other distal sites of infection (e.g., osteomyelitis).[7]
Given the national benchmark of blood culture contamination at 2–3%,[8–10] false-positive blood cultures pose a significant potential concern for pediatricians managing pediatric CAP in the inpatient setting. A previous study of the impact of contaminated blood cultures for hospitalized adults found that contaminated blood cultures resulted in an increased length of stay (LOS) of 4.5 days and significant increases in health care costs.[11] Thus, identifying the potential impact of obtaining blood cultures on the clinical course of children hospitalized for CAP is a critical need. The primary objectives of this study were (1) to identify factors associated with a medical provider’s decision to obtain blood cultures in children hospitalized with CAP and (2) to estimate the association of blood culture obtainment and hospital LOS. Secondary objectives were to assess any associations of obtaining blood cultures with other diagnostic evaluations, antibiotic prescription patterns, and clinical outcomes.
Methods
Data Source
We performed a retrospective cohort study of health care provider practices for pediatric CAP in four regionally distinct hospitals. This study was approved by the IRBs associated with each site, including the Committee for the Protection of Human Subjects (Children’s Hospital at Dartmouth, Lebanon, NH), the Lifespan Institutional Review Board (Hasbro Children’s Hospital, Providence, RI), the Research Subjects Review Board at Rochester Medical Center (Golisano Children’s Hospital at Rochester Medical Center, Rochester, NY), and the University of Texas Health Science Center Institutional Review Board (Children’s Hospital of San Antonio (San Antonio, TX). Written informed consent for obtainment of patient information was waived by all institutional IRBs under the condition that patient data would be de-identified. Data collected were de-identified/anonymized at each respective study site prior to aggregation and analysis. All data were extracted from existing medical records. Eligible participants included all otherwise healthy children aged 3 months to 18 years initially admitted to a general inpatient unit for CAP between January 1, 2011 and December 31, 2012, identified by admitting or discharge diagnosis of pneumonia by international classification of disease, ninth edition (ICD-9) codes 480–488.1. Exclusion criteria included direct admission to the PICU or the presence of ICD-9 codes indicating medical complexity, including chronic neuromuscular, cardiovascular, respiratory, renal, gastrointestinal, hematologic, immunologic, metabolic, congenital/genetic, or malignancy as defined elsewhere.[12] Patients initially admitted to an outside hospital or emergency department did not have available temporal data on blood culture obtainment, antimicrobial prescriptions, or total LOS. To avoid immortal-time bias,[13] these patients were also excluded from analysis.
Data Collected
Reviewers manually collected: (1) demographic data; (2) diagnostic evaluation data; (3) antimicrobials administered; (4) therapeutic interventions; and (5) clinical outcomes including LOS, intensive care unit transfer, readmission within 14 days of discharge, and death during hospitalization. Pneumococcal and Haemophilus influenzae type b (Hib) vaccination status was also assessed, based on documentation within available medical records. Patients were considered fully immunized for these pathogens when: (1) vaccine records were available for review and were up to date; (2) parents or the care team reported immunizations being up to date and immunization records were unavailable; or (3) documentation of incomplete immunization status was absent. Patients were determined to meet criteria for systemic inflammatory response syndrome (SIRS) based on review of vital signs in the emergency department and hospital admission using international consensus guidelines criteria.[14] LOS was calculated using admission and discharge dates and times. Blood culture results were determined false-positive if any of the following criteria were met: 1) growth of an organism considered to be unlikely a pathogen in otherwise healthy children, including Bacillus non-anthracis spp. and Corynebacterium spp.; 2) growth of a single isolate of a typically non-pathogenic organism in otherwise healthy children including coagulase-negative staphylococci; 3) growth of multiple bacterial isolates of common contaminant skin flora such as coagulase-negative staphylococci with different resistance patterns; or 4) growth of a likely contaminating organism in a single blood culture at >48 hours. Multiple positive cultures of apparently identical (i.e. same resistance pattern) coagulase-negative staphylococci were to be considered true positives.
Statistical Analysis
Univariable categorical analyses were performed using χ2 statistics or Fisher’s exact test, as appropriate. Continuous variables were analyzed using linear regression. The linearity of trends was assessed using cubic B-splines, and optimal coding of continuous variables were determined using Akaike information criterion and Bayesian information Criterion.
Models used subject-matter knowledge from published literature and a priori clinical assumptions, analyzed by directed acyclic graphs (DAG), to guide statistical modeling assumptions.[15,16] The DAG analysis served as the basis for constructing propensity scores. For the purposes of this study, “treated” patients were defined as those having blood cultures drawn; patients not undergoing blood cultures were “controls”. Controls were matched to treated in a 1:1 ratio using random sampling with replacement. To minimize bias, we restricted the caliper to 0.1 to ensure controls had similar probabilities of receiving treatment. We restricted the matched analyses to include only those patients with common support (positivity assumption)[17], which implies that the patient must have at least one control within their caliper to be included. Due to a larger sample of matched participants without blood cultures, controls were matched with replacement, resulting in a “pseudo-population” with oversampling of controls. The final sample of this pseudo-population control group was reweighted to restore the original control group sample size.
Potential predictors of blood culture obtainment were analyzed using multivariable logistic regression with generalized estimating equations, clustered by study site. Length of stay was compared using propensity score-matched Kaplan-Meier survival analysis. Patients were right-censored at death. As prolonged hospitalizations were less likely to be related to initial blood culture obtainment, we provided greater weight to earlier discharges by using the Peto-Peto-Prentice test statistic. This length of stay analysis was repeated after excluding patients with a pathogenic blood culture to estimate the hypothetical impact of eliminating all unnecessary (negative or contaminant) blood cultures. Secondary analyses assessed the relationship of obtaining blood cultures with other diagnostic evaluations, antimicrobial prescription practices, and clinical outcomes (intensive care unit [ICU] stay, hospital readmission, or death) using propensity score-matched logistic regression with generalized estimating equations, clustered by study site. If odds ratios were unable to be estimated due to rare events, we used propensity score-matched Fisher’s exact test. Statistical significance was defined as a two-sided P < .05. All analyses were performed using Stata SE, version 13.1 (STATACorp, College Station, TX), with the PSMATCH2 module used for propensity scoring.
Results
Eligibility and Baseline Factors
During the study period, a total number of 838 children met inclusion criteria. Of these patients, 75 were excluded for presence of a complex chronic condition, 148 were excluded for being admitted from a referring hospital or emergency department, and one patient was excluded for missing admission and discharge data, leaving a total of 614 patients who qualified for analysis. Patient demographics and baseline factors at admission are summarized in Table 1.
Three hundred ninety children had blood cultures obtained. Six (1.5%) children had blood cultures positive for a pathogen (5 patients with Streptococcus pneumoniae, 1 with non-typeable Haemophilus influenzae), and nine (2.3%) grew a contaminant (6 patients with coagulase-negative staphylococci, 1 patient with non-hemolytic streptococci, and 2 patients with Bacillus species, non-anthracis). Two patients with pneumococcal bacteremia were treated with narrow-spectrum antibiotics; the remainder of patients with bacteremia received broad-spectrum cephalosporin therapy at hospital admission and discharge. More than a third of patients received at least one dose of antibiotics either at an ambulatory clinic or in the ED prior to admission (39.6% with blood cultures, 34.8% without blood cultures). Children were generally identified as “up to date” for pneumococcal and Hib vaccination, and most children presented to the hospital with SIRS criteria. Clinical and patient factors included in the propensity score are listed in Table 2. No factor differed significantly between populations with and without blood cultures in propensity score-matched analysis (Table 1), suggesting that the matching procedure was successful.
Factors associated with blood culture obtainment
Table 2 describes the magnitude of association of selected criteria on the decision to obtain blood cultures. Factors associated with an increased odds ratio (OR) for blood culture obtainment included the presence of SIRS criteria at presentation (OR 1.78, 95% CI 1.10–2.89), receiving intravenous hydration (OR 3.94, 05% CI 3.22–4.83), receipt of antibiotics prior to admission (OR 1.49, 95% CI 1.17–1.89), and hospital admission from the ED (OR 1.65, 95% CI 1.05–2.60). Patients with insurance had fewer blood cultures drawn than patients with no health insurance (OR 0.42, 95% CI 0.30–0.60).
Management of patients hospitalized with CAP
Table 3 summarizes diagnostic and treatment practices used in children hospitalized with CAP based on whether blood cultures were obtained. In propensity score-matched analysis, children from whom blood cultures were obtained had a greater prevalence of chest tube placement (4.9% vs. 0.0%, P < .0001) and ancillary diagnostic testing. Although receipt of antibiotics was similar between study groups, third- and fourth-generation cephalosporin use was more prevalent among children undergoing blood cultures. Children not undergoing blood cultures more often received narrow-spectrum antibiotic therapy.
Clinical outcomes
Times to discharge of patients undergoing blood cultures and not undergoing blood cultures are compared in Fig. 1. These results represent a difference in median time to discharge of 0.8 days (2.0 vs 1.2 days, P < .0001). An additional analysis excluding positive blood cultures (n = 6) found similar results (data not shown). In propensity score-matched analysis, patients with blood cultures had marginally higher odds of ICU stay (OR 1.47, 95% CI 0.75–2.88), but no significant difference in odds of re-hospitalization (OR 0.94, 95% CI 0.45–1.97; Table 3). There was also no association between obtainment of blood cultures and prevalence of patient deaths in unmatched (P = .56) or matched analysis (P = .25; Table 3). No re-hospitalizations were due to bacteremia or sepsis.
Discussion
This multi-center, retrospective analysis of children hospitalized with CAP identified several factors associated with the decision to obtain blood cultures. We found that the presence of criteria consistent with SIRS, receipt of antibiotics prior to hospital admission, and receipt of intravenous hydration were all factors associated with an increased OR for blood culture obtainment. These findings are consistent with the IDSA recommendation for obtaining blood cultures in moderate to severe CAP, as they suggest illness which might be considered severe or unresponsive to outpatient therapy. Admission to the hospital from the ED was also associated with increased OR for blood culture obtainment, which is consistent with findings from previous studies of practice patterns for CAP management in the ED.[2,18] Having health insurance was associated with a lower OR for blood culture obtainment. Previous studies have described decreased resource use among children with public or no health insurance as compared to patients with private insurance.[19] These previous findings make the reduced OR we identified potentially somewhat surprising, as our cohort included a majority of children who had private insurance (60%).
Our study also quantified the potential magnitude of the effect that obtainment of blood cultures may have had on time to discharge for children hospitalized with CAP. We identified a median increase in time to discharge of 0.8 days for children undergoing blood cultures. We hypothesize that the median LOS of 2 days for patients undergoing blood cultures may reflect clinicians’ decision to await negative blood culture results at 48 hours. Our findings are consistent with recently-published studies in children hospitalized with CAP on the potential impact of blood culture testing on LOS.[20] Unlike the study published by Leyenaar, et al., our analyses were able to account for specific blood culture results, which included a contamination prevalence of 2.3% and detection of a pathogen in only 1.5%. These microbiological data allowed us to more precisely determine the potential benefit of a more targeted blood culture approach on LOS. Given the non-specific nature of the IDSA guidelines in regards to blood culture testing,[4] our results support more refined criteria for blood culture testing in children hospitalized for CAP.[21]
The decision to obtain blood cultures occurs concurrently with several other important decisions regarding the management of CAP. These decisions include use of other diagnostic testing modalities, choice and route of antimicrobial therapy, and even whether a patient should be hospitalized. Previous studies have found that blood culture obtainment has been associated with increased use of other ancillary testing and an increased risk of hospitalization.[2] The results of our study support these findings. In unmatched analysis, patients undergoing blood cultures had higher prevalence of nearly every diagnostic testing modality. One could argue that patients having blood cultures obtained are more ill at presentation, prompting health care providers to order blood cultures. However, after matching on propensity scores based on patient and clinical factors, the differences in ancillary testing persisted. ICU admission—a surrogate for illness severity that was intentionally excluded from our propensity score—was only marginally higher in children with blood cultures after propensity score matching, suggesting that illness severity was reasonably well-controlled in our analysis. Additionally, we found that blood culture obtainment directly correlated with use of third- and fourth-generation cephalosporins and inversely correlated with use of narrow-spectrum therapies. When taken together, these observations suggest that blood culture testing was more related to practice patterns than to clinical illness. Indeed, children with and without blood cultures had similar odds of death and readmission, suggesting that different practice patterns did not result in different patient outcomes. Thus, reducing unnecessary blood cultures may need to be part of a larger strategy to optimize overall diagnostic and antimicrobial use in pediatric CAP.[22,23]
Our study has limitations. First, the marginally higher frequency of ICU admissions in children with blood cultures in the matched analysis suggests that our propensity scores may not have fully captured patient severity of illness. In addition, we could not confirm the timing of blood culture obtainment in all cases, so we could not rule out some blood cultures being obtained for complications during hospitalization. Both these factors would bias the blood culture group towards longer lengths of stay. However, markers of disease severity and complications were only mildly higher in the blood culture group, e.g. 4% more ICU admissions and 5% more chest tube placements. Thus, the degree of bias from these sources is likely small. Moreover, our use of the Peto-Peto-Prentice test statistic to underweight late discharges limited the influence of prolonged lengths of stay. True prevalence of bacteremia may be inaccurate as not all patients were sampled and our analysis cannot account for false negative blood cultures due to antibiotic pre-treatment or limits of detection of bacteremia using current blood culture techniques. However, by repeating the Kaplan-Meier analysis excluding known bacteremia, we identified the maximum hypothetical benefit in LOS if bacteremia could be predicted with 100% accuracy. Our repeat analysis excluding pathogenic blood cultures matched controls with similar disease severity as the culture-negative patients, thereby decreasing risk of missed blood cultures. False negative blood cultures would by their very definition be unable to impact LOS as they would be interpreted by the practitioner in a similar fashion to true negatives. Hospital readmission could be one indirect method of identifying patients with false negative blood cultures, and no readmission among patients included in our study was due to bacteremia or sepsis. Additionally, because our study only included hospitalized patients, we excluded children who may have had blood cultures obtained in the ambulatory setting and were subsequently discharged, essentially resulting in a LOS of 0 days. Such patients would not typically be considered to have moderate or severe CAP if they were discharged, which makes blood culture obtainment in these patients more optional by most recommendations. Our assessment of vaccination status assumes a high prevalence of hospitalized children being completely vaccinated against pneumococcus and Hib. However, our method of assessment likely reflects clinicians’ perceptions of hospitalized patients’ vaccination status in the absence of refuting evidence.[24] Finally, blood culture obtainment may be related more to a general practice pattern of diagnostic testing and patient management which was unaccounted for in our propensity score. However, such confounding would only be present if the same person makes the decision to get blood cultures (and other testing) as the one who decides discharge, which is generally not the case for patients referred from ambulatory settings, particularly the ED.
Conclusion
Obtaining blood cultures in children hospitalized with CAP rarely results in identification of a causative pathogen and is associated with increased LOS. Our findings highlight the need to further refine the role of obtaining blood cultures in children hospitalized with CAP.
Author Contributions
Conceived and designed the experiments: RM DY MK TM SR VH BA EB. Performed the experiments: RM MK TM SR VH EB. Analyzed the data: RM DY MK SR EB. Contributed reagents/materials/analysis tools: RM DY MK TM SR VH BA EB. Wrote the paper: RM MK DY TM SR VH BA EB.
References
- 1. Shoham Y, Dagan R, Givon-Lavi N, Liss Z, Shagan T, et al. (2005) Community-acquired pneumonia in children: quantifying the burden on patients and their families including decrease in quality of life. Pediatrics 115: 1213–1219. pmid:15867027
- 2. Florin TA, French B, Zorc JJ, Alpern ER, Shah SS (2013) Variation in emergency department diagnostic testing and disposition outcomes in pneumonia. Pediatrics 132: 237–244. pmid:23878049
- 3. Brogan TV, Hall M, Williams DJ, Neuman MI, Grijalva CG, et al. (2012) Variability in processes of care and outcomes among children hospitalized with community-acquired pneumonia. Pediatr Infect Dis J 31: 1036–1041. pmid:22653486
- 4. Bradley JS, Byington CL, Shah SS, Alverson B, Carter ER, et al. (2011) The management of community-acquired pneumonia in infants and children older than 3 months of age: clinical practice guidelines by the Pediatric Infectious Diseases Society and the Infectious Diseases Society of America. Clin Infect Dis 53: e25–76. pmid:21880587
- 5. Heine D, Cochran C, Moore M, Titus MO, Andrews AL (2013) The prevalence of bacteremia in pediatric patients with community-acquired pneumonia: guidelines to reduce the frequency of obtaining blood cultures. Hosp Pediatr 3: 92–96. pmid:24340408
- 6. Shah SS, Dugan MH, Bell LM, Grundmeier RW, Florin TA, et al. (2011) Blood cultures in the emergency department evaluation of childhood pneumonia. Pediatr Infect Dis J 30: 475–479. pmid:21206393
- 7. Myers AL, Hall M, Williams DJ, Auger K, Tieder JS, et al. (2013) Prevalence of bacteremia in hospitalized pediatric patients with community-acquired pneumonia. Pediatr Infect Dis J 32: 736–740. pmid:23518826
- 8. Weddle G, Jackson MA, Selvarangan R (2011) Reducing blood culture contamination in a pediatric emergency department. Pediatr Emerg Care 27: 179–181. pmid:21346677
- 9. Ramsook C, Childers K, Cron SG, Nirken M (2000) Comparison of blood-culture contamination rates in a pediatric emergency room: newly inserted intravenous catheters versus venipuncture. Infect Control Hosp Epidemiol 21: 649–651. pmid:11083181
- 10. Hall KK, Lyman JA (2006) Updated review of blood culture contamination. Clin Microbiol Rev 19: 788–802. pmid:17041144
- 11. Bates DW, Goldman L, Lee TH (1991) Contaminant blood cultures and resource utilization. The true consequences of false-positive results. JAMA 265: 365–369. pmid:1984535
- 12. Feudtner C, Hays RM, Haynes G, Geyer JR, Neff JM, et al. (2001) Deaths attributed to pediatric complex chronic conditions: national trends and implications for supportive care services. Pediatrics 107: E99. pmid:11389297
- 13. Suissa S (2008) Immortal time bias in pharmaco-epidemiology. Am J Epidemiol 167: 492–499. pmid:18056625
- 14. Goldstein B, Giroir B, Randolph A, International Consensus Conference on Pediatric S (2005) International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med 6: 2–8. pmid:15636651
- 15. Shrier I, Platt RW (2008) Reducing bias through directed acyclic graphs. BMC Med Res Methodol 8: 70. pmid:18973665
- 16. Textor J, Hardt J, Knuppel S (2011) DAGitty: a graphical tool for analyzing causal diagrams. Epidemiology 22: 745. pmid:21811114
- 17. Westreich D, Cole SR (2010) Invited commentary: positivity in practice. Am J Epidemiol 171: 674–677; discussion 678–681. pmid:20139125
- 18. Neuman MI, Shah SS, Shapiro DJ, Hersh AL (2013) Emergency department management of childhood pneumonia in the United States prior to publication of national guidelines. Acad Emerg Med 20: 240–246. pmid:23517255
- 19. Mannix R, Chiang V, Stack AM (2012) Insurance status and the care of children in the emergency department. J Pediatr 161: 536–541 e533. pmid:22578580
- 20.
Leyenaar JK, Lagu T, Shieh MS, Pekow PS, Lindenauer PK (2014) Variation in Resource Utilization for the Management of Uncomplicated Community-Acquired Pneumonia across Community and Children's Hospitals. J Pediatr.
- 21. Schroeder AR (2014) The never-ending quest to detect bacteremia: time for a culture change. Hosp Pediatr 4: 85–87. pmid:24584977
- 22. Newman RE, Hedican EB, Herigon JC, Williams DD, Williams AR, et al. (2012) Impact of a guideline on management of children hospitalized with community-acquired pneumonia. Pediatrics 129: e597–604. pmid:22351891
- 23. Neuman MI, Hall M, Hersh AL, Brogan TV, Parikh K, et al. (2012) Influence of hospital guidelines on management of children hospitalized with pneumonia. Pediatrics 130: e823–830. pmid:23090342
- 24. Weddle G, Jackson MA (2014) Vaccine eligibility in hospitalized children: spotlight on a unique healthcare opportunity. J Pediatr Health Care 28: 148–154. pmid:23522560