Availability of objective criteria for predicting successful extubation could avoid unnecessary prolongation of mechanical ventilation and/or inadvertent premature extubation, but the predictors of successful extubation in children are unclear. This study was performed to detect and validate respiratory function predictors of successful extubation in children admitted to the pediatric critical care unit.
A retrospective chart review from 2010 to 2012 identified 463 patients, who were divided into a derivation cohort (n = 294) and a validation cohort (n = 169).
The incidence rate of failed extubation was 5% and 9% in the derivation and validation cohorts, respectively. The optimal cut-off values of crying vital capacity (CVC), peak inspiratory flow rate (PIFR), and maximum inspiratory pressure (MIP) were 17 ml/kg, 3.5 ml/sec/cm, and 50 cmH2O, respectively. The pass rates of CVC, PIFR, and MIP were 54.2%, 92.7%, and 55.5%, respectively. In the validation cohort, the successful extubation rate was 97.9% for patients who passed all 3 respiratory tests, 88.8% for those who passed at least one test, and 66.7% for those who failed all of the tests. Extubation failed in 5 patients who passed all three respiratory tests and failure was due to postoperative respiratory muscle fatigue or upper airway impairment.
We detected and validated predictors of successful extubation in critically ill children. A combination of CVC, PIFR, and MIP may be used to predict successful extubation for critically ill children. It is necessary to pay attention when extubating patients with postoperative respiratory muscle fatigue or upper airway impairment due to disturbance of consciousness and/or glottal edema even if they pass the respiratory function tests.
Citation: Toida C, Muguruma T, Miyamoto M (2017) Detection and validation of predictors of successful extubation in critically ill children. PLoS ONE 12(12): e0189787. https://doi.org/10.1371/journal.pone.0189787
Editor: Yu Ru Kou, National Yang-Ming University, TAIWAN
Received: June 1, 2017; Accepted: December 3, 2017; Published: December 18, 2017
Copyright: © 2017 Toida et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: There are ethical restrictions on sharing a de-identified data set underlying reported study, because all data include the sensitive patient information and all data are owned by the National Medical Center for children and Mothers and the Ethics Committee imposed them. Contact Information of the ethics committee; 2-10-1 Okura Setagaya-ku Tokyo, 157-8535 Tel: +81-3-3416-0181 Email Address: firstname.lastname@example.org.
Funding: This work was funded by a grant from the Mitsubishi Foundation (Grant No. 25324) to CT. The funder had no role in study design, data collection and analysis, detection to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Mechanical ventilation is a common treatment for critically ill children admitted to the pediatric critical care unit (PICU). While mechanical ventilation has various benefits, there are also several associated risks. It has been reported that unnecessary prolongation of mechanical ventilation increases the risk of airway trauma, infection, and unplanned extubation [1–2]. It has been reported that the extubation failure rate ranges from 16 to 22% when extubation is performed on the basis of clinical criteria [3–6]. Patients with failed extubation have higher rates of morbidity, mortality, as well as a longer ventilation time and ICU stay [7–9].
Several variables, including respiratory function parameters, may be associated with failed extubation in pediatric patients. However, the criteria for predicting successful extubation in this patient population remain unclear. The availability of objective criteria to predict successful extubation in children could avoid unnecessary prolongation of mechanical ventilation and/or premature extubation.
Therefore, this study was performed to identify and validate predictors of successful extubation in critically ill children admitted to PICU.
Materials and methods
Study setting and patient population
This was a single center study, conducted retrospectively from January 2010 to December 2012 in the PICU of the National Center for Children and Mothers (Tokyo, Japan). This PICU has 20 beds and admits an average of 1000 children each year, which is the largest number of critically ill children treated at a single center in Japan.
The inclusion criteria for this study were (1) an age < 16 years and (2) patients requiring tracheal intubation and mechanical ventilation for > 48 hours. Patients admitted to PICU after tracheotomy, patients intubated because of upper airway obstruction, patients transferred before extubation, and patients who died in PICU were excluded from this study. Accordingly, 463 patients were enrolled and were divided into a derivation cohort (n = 294) admitted to PICU from January 2010 to December 2011 and a validation cohort (n = 169) admitted to PICU from January 2012 to December 2012 (Fig 1).
463 patients were enrolled and were divided into a derivation cohort (n = 294) admitted to PICU from January 2010 to December 2011 and a validation cohort (n = 169) admitted to PICU from January 2012 to December 2012.
We used the NewportTM 3260 ventilator. Patients were usually placed on intermittent mandatory ventilation or synchronized intermittent mandatory ventilation in the pressure-control mode. The PICU attending physician weaned patients who fulfilled these criteria: (1) resolution of the primary reason for intubation; (2) no pneumonia, pulmonary atelectasis, or pleural effusion on X-ray films; and (3) the following mechanical ventilation parameters: FIO2 ≤ 0.40, peak inspiratory pressure (PIP) ≤ 25 cmH2O, pressure support (PS) ≤ 8 cmH2O, positive end expiratory pressure (PEEP) ≤ 5 cmH2O, and ventilation frequency ≤ 10 /min.
The timing of extubation was determined by the PICU attending physician based on mechanical ventilation parameters, the respiratory rate during spontaneous breathing, and the results of respiratory function evaluation before extubation. The following respiratory function parameters were evaluated with the Aivision respiratory function laboratory (Aivision Corporation, Tokyo, Japan): (1) crying vital capacity (CVC); (2) peak inspiratory flow rate (PIFR); and (3) maximum inspiratory pressure (MIP). We defined failure of extubation as the need for re-intubation and mechanical ventilation within 72 hours after extubation.
We retrospectively validated the predictors of successful extubation using split-sample validation. Therefore, the attending physicians only knew the values of the respiratory function parameters and were blinded to the results of the "all-3-tests" to determine whether extubation should be performed or not.
The following data were collected for each patient: demographic variables [age in months], clinical characteristics [predicted mortality calculated according to the pediatric mortality index2, origin of the patient, primary reason for admission, CVC, PIFR, MIP, and duration of mechanical ventilation before extubation], and outcome information [failed extubation rate, time to re-intubation, duration of mechanical ventilation and PICU stay].
Results are expressed as the median and interquartile range (25th–75th percentile) for continuous variables or as percentages for categorical variables. The Mann-Whitney U test was used for analysis of continuous variables and Fisher’s exact test was employed for categorical variables.
The accuracy of using respiratory function parameters to predict successful extubation was evaluated in the derivation and validation cohorts by calculating the area under the receiver operating characteristics curve (AUC) for each parameter. The optimal cut-off value for predicting successful extubation was defined as that achieving the maximum combination of sensitivity and specificity.
Patients were divided into three groups based on the number of respiratory function tests performed successfully: (1) all 3 tests; (2) at least one test; and (3) no tests. Then we calculated the successful extubation rate for each of these groups in the derivation and validation cohorts.
All statistical tests were two-sided and an α value of 0.05 was defined as indicating significance. All statistical analyses were performed using STATA software, version 12.1 (College Station, Texas, USA).
The National Medical Center for Children and Mothers Ethics Committee provided consent for the medical record to be used in this study. Data are available from the National Nation Medical Center for Children and Mothers Ethics Committee or researchers who meet the criteria for access to confidential data. The ethics committee waived the requirement for informed consent in individual patients.
There are ethical restrictions on sharing a de-identified data set, because all data including the patient information are owned by the National Medical Center for children and Mothers and the Ethics Committee imposed them.
Among 3,270 patients admitted to our PICU from 2010 to 2012, 463 patients met the inclusion criteria and their characteristics are shown in Table 1. The primary reasons for admission and total duration of mechanical ventilation differed between the derivation and validation cohorts, but other characteristics did not differ between them. The incidence rate of failed extubation was 5% and 9% in the derivation and validation cohorts, respectively.
Detection and accuracy of predictors of successful extubation
The optimal cut-off values of the respiratory function parameters were as follows: 17 ml/kg for CVC, 3.5 ml/sec/cm for PIFR, and 50 cmH2O for MIP. Patients with values of CVC, PIFR, and MIP higher than the optimal cut-off value were classified as passing each test. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of CVC, PIFR, and MIP are shown in Table 2. Pass rates for CVC, PIFR, and MIP were 54.2%, 92.7%, and 55.5%, respectively.
We classified the patients into three groups according to the number of respiratory tests they passed and we compared the successful extubation rate among these groups. In the validation cohort, the successful extubation rate was 97.9% in the group that passed all 3 tests, 88.8% in the group that passed at least one test, and 66.7% in the group that failed all of the tests (Table 3). The PPV and NPV for the “all-3-test” was 97.9% and 12.3%, in the validation dataset.
The AUC of each functional parameter and the “all-3-test” in validation dataset was as follows: the AUC of CVC was 0.58, the AUC of PIFR was 0.54, the AUC of MIP was 0.57, and the AUC of the “all-3-test” was 0.62 (Fig 2).
The AUC of CVC was 0.58, the AUC of PIFR was 0.54, the AUC of MIP was 0.57, and the AUC of the “all-3-test” was 0.62.
In the group passing all 3 tests from the derivation and validation cohorts, extubation failed in only 5 patients. The clinical characteristics of these 5 patients are listed in Table 4. Four patients were in PICU after surgery and one patient was admitted after cardiac arrest. The reason for re-intubation was respiratory muscle fatigue and deterioration of the respiratory status in 3 patients (Patients 1–3), while 2 patients (Patients 4 and5) had upper airway problems.
We investigated the availability of respiratory function parameters as predictors of successful extubation in critically ill children, and we were able to obtain objective criteria for predicting successful extubation based on evaluation of respiratory function. By assessing a combination three variables (CVC, PIFR, and MIP), it was possible to predict successful extubation of critically ill children admitted to PICU.
We determined the optimal cut-off values of CVC, PIFR, and MIP for predicting successful extubation. CVC assesses pulmonary function, while PIFR assesses airway resistance and MIP is an indicator of muscular strength and /or the state of the chest wall and lung. Previous studies in pediatric patients have shown that the CVC value predicting successful extubation was 15 ml/kg in neonates and infants less than 1 year old, while the predictive value of MIP was 45–60 cmH2O [10–13]. These values are similar to the results obtained in our study, which were MIP ≥ 17 ml/kg and MIP ≥ 50 cmH2O. However, judging from the AUCs for the individual variables, none of these variables demonstrated a high level of accuracy for predicting successful extubation, possibly because our study included children of various ages and with various diseases.
Instead, we demonstrated the possibility of predicting successful extubation in children of various ages with various diseases by evaluating a combination of CVC, PIFR, and MIP. The successful extubation rate was 97.9% in patients who passed all 3 of the respiratory function tests. In other words, the positive predictive value (PPV) of this combination of 3 variables was very high (97.9%). The 5 patients in whom extubation failed even though they passed all of the respiratory function tests had postoperative respiratory muscle fatigue or upper airway impairment due to disturbance of consciousness and/or glottal edema. Therefore, it is necessary to pay attention when extubating patients with these characteristics even if they pass the respiratory function tests.
Another problem is that the successful extubation rate was still a high 88% in patients who did not pass all 3 respiratory function tests. This suggests that we may have to consider another evaluation method in combination with respiratory function tests to overcome the low positive predictive value of respiratory evaluation.
This study had several limitations. First, this study was conducted at a single center in a limited population. It is also essential to research it by using recent data, but in this study we could only evaluate the data of a limited period from 2010 to 2012. Therefore, to generalize the results for larger groups, the study should have involved more participants at different hospitals. Second, a new method is generally validated through 3 steps—derivation, retrospective validation, and prospective validationーbut this study only covered the first 2 steps. Moreover, because the sample size of this study was small, we validated the predictors of successful extubation by using the method of split-sample validation. Therefore, in the future, the prospective validation studies including the design and analysis of prediction models are needed . Third, we did not have the assessment and trial as the objective decision criteria for extubation. Therefore, it is necessary to perform a prospective validation study using a protocol for extubation including respiratory function evaluation. In addition, we did not carry out subgroup analyses stratified by age or the underlying disease.
We identified and validated three respiratory function tests as predictors of successful extubation in critically ill children. By evaluating a combination of CVC, PIFR, and MIP, successful extubation may be predicted in the PICU setting. Physicians should carefully determine if extubation is appropriate by evaluatinth the results of these tests to prevent premature extubation. Moreover, it is necessary to pay attention when extubating patients with postoperative respiratory muscle fatigue or upper airway impairment due to disturbance of consciousness and/or glottal edema even if they pass the “all-3-tests.”
Authors (Chiaki Toida) have received a grant from “The Mitsubishi Foundation”. We acknowledge the support of Dr. Takeru Abe (Yokohama City University Medical Center), who provided purely technical help and writing assistance.
- 1. Ely EW, Baker AM, Dunagan DP, Burke HL, Smith AC, Kelly PT, et al: Effect on the duration of mechanical ventilation of identifying patients capable of breathing spontaneously. N Engl J Med 1996; 19: 1864–1869.
- 2. Krinsley JS, Barone JE: The drive to survive: Unplanned extubation in the ICU. Chest. 2005; 128: 560–566. pmid:16100138
- 3. Farias JA, Alia I, Esteban A, Golubicki AN, Olazarri FA: Weaning from mechanical ventilation in pediatric intensive care patients. Intensive Care Med. 1998; 24: 1070–1075. pmid:9840242
- 4. Khan N, Brown A, Venkataraman ST: Predictors of extubation success and failure in mechanically ventilated infants and children. Crit Care Med. 1996; 24: 1568–1579. pmid:8797633
- 5. Baumeister BL, El-Khatib M, Smith PG, Blumer JL: Evaluation of predictors of weaning from mechanical ventilation in pediatric patients. Pediatr Pulmonal. 1997; 24: 344–352.
- 6. El-Khatib MF, Baumeister B, Smith PG, Chatburn RL, Blumer JL: Inspiratory/maximal inspiratory pressure: does it predict successful extubation in critically ill infants and children? Intensive Care Med. 1996; 22: 264–266. pmid:8727443
- 7. Epstein SK, Ciubotaru RL, Wong JB: Effect on failed extubation on the outcome of mechanical ventilation. Chest. 1997; 112: 186–192. pmid:9228375
- 8. Thille AW, Harrois A, Schortgen F, Burn-Buisson C, Brochard L: Outcomes of extubation failure in medical intensive care unit patients. Crit Care Med. 2011; 39: 2612–2618. pmid:21765357
- 9. Kurackek SC, Newth CJ, Quasney NW, Rice T, Sachdeva RC, Patel NR, et al: Extubation failure in pediatric intensive care: A multiple-center study of risk factors and outcomes. Crit Care Med. 2003; 31: 2657–2664. pmid:14605539
- 10. Shimada Y, Yoshiya I, Tanaka K, Yamazaki T, Kumon K: Crying vital capacity and maximal inspiratory pressure as clinical indicators of readiness for weaning of infants less than a year of age. Anesthesiology. 1979; 51: 456–459. pmid:386858
- 11. Chiswick ML, Milner RD: Crying vital capacity. Measurement of neonatal lung function. Arch Dis Child. 1976; 51: 22–27. pmid:942225
- 12. Johnson C, de Carvalho WB, Piva J, Garcia PC, Fonseca MC: Risk factors for extubation failure in infants with severe acute bronchiolitis. Respir Care. 2010; 55: 328–333. pmid:20196883
- 13. Noizet O, Leclerc F, Sadik A, Grandbastien B, Riou Y, Dorkenoo A, et al: Does taking endurance into account improve the prediction of weaning outcome in mechanically ventilated children? Critical Care. 2005; 9: R798–R807. pmid:16356229
- 14. Steyerberg EW, Harrell FE Jr: Prediction models need appropriate internal, internal-external, and external validation. J Clin Equdemiol. 2016; 69: 245–247.