https://orcid.org/0000-0002-7208-8123
Figures
Abstract
Background
Endotracheal intubation with a flexible bronchoscope is a well-recognized airway management technique that anesthesiologists must master. Skill acquisition and knowledge must reach an appropriate level before trainees perform independent practice on patients. There are a paucity of evidence-based outcome measures of trainee competence in performing flexible bronchoscopy. The objectives of this study were to 1) construct a learning curve for flexible bronchoscope-guided orotracheal intubation for anesthesiology residents using the CUSUM method and 2) determine the number of procedures required to achieve proficiency.
Methods
This study included 12 first-year anesthesiology residents with no previous experience with flexible bronchoscopic intubation. Trainees attended theoretical and simulation training and performed flexible bronchoscope-guided orotracheal intubation in adult patients with normal airways under general anesthesia. Number of intubation attempts, intubation success rate, time to intubation, and incidence of dental and mucosal injuries were recorded. The cumulative sum (CUSUM) method was used to evaluate the learning curve of flexible bronchoscope-guided orotracheal intubation.
Results
Trainees performed flexible bronchoscope-guided orotracheal intubation on 364 patients. First-attempt intubation success occurred in 317 (87.1%) patients. Second-attempt intubation success occurred in 23 (6.3%) patients. Overall, the flexible bronchoscope-guided orotracheal intubation success rate was 93.4% (range, 85.3% to 100%). The mean number of orotracheal intubation procedures per trainee was 31 ± 5 (range, 23 to 40). All trainees crossed the lower decision boundary (H0) after 15.1 ± 5.6 procedures (range, 8 to 25 procedures). There was a significant decrease in median intubation time [39s (IQR: 30, 50) vs. 76s (IQR: 54, 119)] (P < 0.001) after crossing the lower decision boundary (H0) compared to before. There were no dental, mucosa, arytenoid or vocal cord trauma events associated with intubation.
Conclusions
Learning curves constructed with CUSUM analysis showed that all trainees (anesthesiologist residents) included in this study achieved competence (intubation success rates ≥ 80%) in flexible bronchoscope-guided orotracheal intubation. Trainees needed to perform 15 (range, 8 to 25) procedures to achieve proficiency. There was wide variability between trainees.
Citation: Cai X, Yue M, Liu X, Zhang L, Wu S, Shen W, et al. (2023) Learning curve for flexible bronchoscope-guided orotracheal intubation for anesthesiology residents: A cumulative sum analysis. PLoS ONE 18(7): e0288617. https://doi.org/10.1371/journal.pone.0288617
Editor: Nagy Bálint János, Medical School, University of Pecs, HUNGARY
Received: December 28, 2022; Accepted: June 30, 2023; Published: July 13, 2023
Copyright: © 2023 Cai et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no cmpeting interests exist.
Introduction
Successful airway management is a key component of patient safety. Endotracheal intubation is an essential skill for anesthesiologists, who must be familiar with various airway management devices and techniques. The flexible bronchoscope is a well-recognized airway management technique that is part of every difficult airway management algorithm and the gold standard for the management of most difficult airways [1–4]. The flexible bronchoscope provides operators “look around the corner” vision and high first-attempt intubation success, and is safe and well tolerated by patients [5–7].
Flexible bronchoscopy is a complex process that requires operator competence to minimize patient risk of complications, such as failed intubation, patient discomfort, hypoxemia, cardiac arrhythmias, myocardial infarction, respiratory depression, cardiorespiratory arrest, severe bleeding, pneumothorax, or mortality. Training in flexible bronchoscopy is multifacilated and must incorporate clinically relevant scenarios. Trainees in flexible bronchoscopy must be familiar with normal airway anatomy and learn technical skills, the indications, contraindications, risks and benefits of the procedure, and communication within a healthcare team and with patients. Skill acquisition and knowledge must reach an appropriate level before trainees perform independent practice on patients. However, there are a paucity of evidence-based outcome measures of trainee competence in performing flexible bronchoscopy.
A cumulative sum (CUSUM) chart is a statistical tool that can model a variable representing performance, productivity or efficiency as a function of another variable reflecting time or experience [8]. CUSUM charts were originally used to monitor processes in manufacturing industries but have recently been applied in healthcare to evaluate learning curves for surgical [9–12] and anesthetic procedures, such as epidural anesthesia, spinal and epidural anesthesia, central venous and arterial cannulation, and orotracheal intubation using direct laryngoscopy [13–17]. CUSUM charts emphasize failures; therefore, trainees with an unsatisfactory performance are quickly identified and immediate corrective measures can be taken.
The objectives of this study were to 1) construct a learning curve for flexible bronchoscope-guided orotracheal intubation for anesthesiology residents using the CUSUM method and 2) determine the number of procedures required to achieve proficiency.
Methods
Study design and setting
The study was conducted in Liaocheng People’s Hospital between August 2020 and January 2021. The protocol was approved by the Ethics Committee of Liaocheng People’s Hospital (2020006). The study was registered in the Chinese Clinical Trial Registry (ChiCTR 2000032166). Written informed consent was obtained from residents and patients.
Participants
Trainee inclusion criteria were: 1) first year anesthesiology resident at Liaocheng People’s Hospital; 2) acquired proficiency in tracheal intubation by direct laryngoscopy and video laryngoscopy; and 3) no previous experience with bronchoscope-guided intubation.
All trainees attended a theoretical lecture on using flexible bronchoscopy, observed a demonstration by an experienced anesthesiologist, and practiced for ≤ 1 hour on a commercially available bronchoscopy simulator (Olympus Company, BF-180). Within 1 week, trainees were permitted to practice on patients.
Patient inclusion criteria were: 1) age ≥ 18 years; 2) American Society of Anesthesiologists (ASA) physical status score Ⅰ~Ⅱ; and 3) undergoing elective surgery under general anesthesia with orotracheal intubation. Patient exclusion criteria were: 1) placement of a double-lumen endotracheal tube; 2) anticipated difficult airway; or 3) awake tracheal intubation.
Procedures
Patients were positioned supine on the operating table with a thin pillow under their head. Standard monitoring was initiated, including heart rate, electrocardiography, noninvasive blood pressure, oxygen saturation (SpO2), and capnography. After pre-oxygenation for 3 minutes, general anesthesia was induced with fentanyl or sufentanil, propofol, and cisatracurium. Mask ventilation with 100% oxygen was provided until complete muscle relaxation. A conventional polyvinylchloride or reinforced tracheal tube (7.5 mm for males, 7.0mm for females) was threaded over a flexible bronchoscope (4.5 mm diameter; TIC-SD-Ш; Zhejiang UE Medical Instrument Co., LTD, Zhejiang, China). Endotracheal intubation was performed by trainees under the supervision of an instructor. The trainee stood above the patient’s head holding the body of the bronchoscope in one hand and the insertion cord in the other. The flexible bronchoscope was inserted into the patient’s oral cavity and passed through the glottis into the trachea, such that the tracheal rings and carina were visible. The tracheal tube was advanced through the glottis under bronchoscopic guidance. The position of the tracheal tube was confirmed visually and by capnography. During intubation, an assistant opened the patient’s mouth and applied the jaw-thrust maneuver to facilitate advancement of the tracheal tube.
If the patient’s SpO2 dropped below 90%, intubation was immediately paused, and mask ventilation was used to raise the SpO2. Successful intubation was defined as flexible bronchoscope-guided tracheal intubation by trainees. Failed intubation was related to the inability to place the flexible bronchoscope or tracheal tube into the trachea by trainees, including, but not limited to, being unable to advance the bronchoscope through the vocal cords or advance the tracheal tube into the trachea. An intubation attempt was defined as entry of the flexible bronchoscope into the oral cavity. If the first intubation attempt failed, the trainee was permitted one additional attempt. Failure was defined as two unsuccessful attempts, after which the instructor secured the airway. Each trainee’s performance was assessed by the same single observer. Dental, mucosa, arytenoid or vocal cord trauma events associated with intubation were recorded.
Time taken for intubation was defined as the time from entry of the flexible bronchoscope into the oral cavity to withdrawal of the flexible bronchoscope from the oral cavity after successful intubation.
Data analysis
The CUSUM method was used to evaluate the learning curve for flexible bronchoscope-guided orotracheal intubation for first year anesthesiology residents. CUSUM is a sequential analysis of the cumulative performance of a dichotomized variable.
A CUSUM curve, showing the cumulative sum of deviations from the target value, around zero, for individual measurements was plotted. The x-axis was the timeline and the y axis was the cumulative sum of successes (S) and failures (1-S) of flexible bronchoscope-guided orotracheal intubation. The probability of type Ⅰ (α) and type Ⅱ (β) errors were specified as 0.1. Acceptable and unacceptable failure rates (p0 and p1, respectively, where p1 was set at twice p0) were specified as 20% and 40%, as the success rate of flexible bronchoscope-guided orotracheal intubation has been reported at 78–100%. [3,18–20]. The lower decision boundary H0 was -2.24 and the upper decision boundary H1 was 2.24. The minimum number of procedures needed to assess flexible bronchoscope-guided orotracheal intubation was calculated as 19 (Table 1).
If performance was a failure, the CUSUM sloped upward. If the CUSUM line rose above the upper decision boundary (H1), the trainee was considered incompetent for flexible bronchoscope-guided orotracheal intubation. If performance was successful, the CUSUM sloped downward. If the CUSUM line dropped below the lower decision boundary (H0), the trainee was considered competent for flexible bronchoscope-guided orotracheal intubation. If the CUSUM line remained between H0 and H1, training should have continued.
Results
This study included 12 trainees (first year anesthesiology residents). All trainees practiced on the bronchoscopy simulator for ≤ 1 hour. Trainees performed flexible bronchoscope-guided orotracheal intubation on 364 patients.
First-attempt intubation success occurred in 317 (87.1%) patients. Second-attempt intubation success occurred in 23 (6.3%) patients. Overall, the flexible bronchoscope-guided orotracheal intubation success rate was 93.4% (range, 85.3% to 100%). Instructors secured the airways in 24 (6.6%) patients.
The mean number of orotracheal intubation procedures per trainee was 31 ± 5 (range, 23 to 40). All trainees crossed the lower decision boundary (H0) after 15.1 ± 5.6 procedures (range, 8 to 25 procedures). The individual performance of each trainee is shown in Table 2. CUSUM curves for each trainee are shown in Fig 1.
Lines A—L represent the learning curves for each trainee (anesthesiologist residents). The lower decision boundary H0 was -2.24 and the upper decision boundary H1 was 2.24.
The minimum and maximum time for orotracheal intubation was 16 and 250 seconds, respectively. Time to intubation was stable after performing the procedure in 9 patients (Fig 2).
Data are median (interquartile range) with min and max.
There were significant increases in first-attempt intubation success rate [77.5% (IQR: 72.3%, 88.6%) vs. 100% (IQR: 94.5%, 100%)] and overall intubation success rate [88.3% (IQR: 83.1%, 90.9%) vs. 100% (IQR: 100%, 100%)] and a significant decrease in median intubation time [39s (IQR: 30, 50) vs. 76s (IQR: 54, 119)] (all P < 0.001, Table 3) after crossing the lower decision boundary (H0) compared to before crossing the lower decision boundary (H0).
There were no dental, mucosa, arytenoid or vocal cord trauma events associated with intubation.
Discussion
The objective of this study was to construct a learning curve for flexible bronchoscope-guided orotracheal intubation for anesthesiology residents using the CUSUM method and determine the number of procedures required to achieve proficiency. Findings showed that anesthesiology residents with no previous experience with bronchoscope-guided intubation had to perform a mean of 15 procedures in patients with normal airways under general anesthesia to achieve a flexible bronchoscope-guided orotracheal intubation success rate of 80%. There was a wide variability in the number of procedures each trainee needed to perform to achieve proficiency, indicating that trainees learned at different speeds.
Flexible bronchoscope-guided intubation can be performed nasally or orally in awake patients with topical or regional anesthesia alone, or in sedated or anesthetized patients. The nasal route is often used on patients with poor mouth opening or a large tongue as it courses past the nasopharynx with less obstruction by the tongue [21]. Awake flexible bronchoscope-guided intubation is strongly recommended in patients with anticipated difficult airways [2,6,22,23]. In this study, orotracheal intubation was performed in anesthetized apneic patients with normal airways as it is considered more difficult than nasal intubation of the awake patient. In anesthetized patients, relaxation of oral and pharyngeal muscles allows the larynx to become more anterior relative to other structures. Trainees were expected to be able to use the intubation techniques learned in anesthetized patients in the awake patient with minimal modification.
A previous study showed anesthesiologists achieved competence (first-attempt intubation success rates > 90% and intubation time of ≤ 2 minutes) in fiberoptic laryngoscopy and intubation in anesthetized patients with normal airways after 10 procedures [22], and all the trainees learned at the same rate. Several reasons may explain the disparate findings between the prior report and the present study. First, the prior report used logarithmic analysis of the mean (+/- SD) time for intubation of patients for all residents combined to generate learning curves, while the present study used the CUSUM method. Second, there was differential use of airway devices and techniques, such as the oropharyngeal airway, bite block, tongue root holder, and jaw thrust maneuver [24,25] that can facilitate airway opening and improve the intubation success rate. The prior report used a bite block to prevent airway obstruction and keep the flexible bronchoscope centered, thus facilitating intubation. In the present study, the jaw thrust was used as a positioning maneuver. In 6 (26.1%) patients with a failed first-attempt intubation, second-attempt intubation was successful after the jaw thrust maneuver was modified. Third, each study used a different type of flexible bronchoscope, which may explain differences in first-attempt intubation success rates (prior report: 93.5% vs. present study: 87.1%).
In the present study, patient factors, including the presence of secretions that impaired visibility, caused difficulties during flexible bronchoscope-guided orotracheal intubation in 6 (26.1%) of the 23 patients who underwent two endotracheal intubation attempts [26]. No patient received antisialagogues before surgery. Other challenges when performing this procedure include difficulties advancing the tracheal tube due to differences in the inner diameter of the endotracheal tube and the outer diameter of the flexible bronchoscope [19].
This study was associated with several limitations. First, only 12 residents in a single center were evaluated, and inter-individual differences were large. The minimum number of procedures required to master flexible bronchoscope-guided orotracheal intubation may not be applicable to more novice learners. Second, only adult patients with normal airways were included, and it is not clear if trainees can transfer their skills to obese patients or those with difficult airways, Third, trainees practiced on the bronchoscopy simulator for ≤ 1 hour. If simulation practice was increased, the number of procedures needed to achieve proficiency in flexible bronchoscope-guided orotracheal intubation may be decreased. Finally, a scoring system was not used to assess the performance of the trainees.
Conclusion
Learning curves constructed with CUSUM analysis showed that all trainees (anesthesiologist residents) included in this study achieved competence (intubation success rates ≥ 80%) in flexible bronchoscope-guided orotracheal intubation. Trainees needed to perform 15 (range, 8 to 25) procedures to achieve proficiency. There was wide variability between trainees.
References
- 1. Shen W, Cai X, Liu X, Zhang Z, Wang X, Yu A. Flexible Bronchoscope versus Video Laryngoscope for Orotracheal Intubation During Upper Gastrointestinal Endoscopic Surgery in Left Lateral Position: A Randomized Controlled Trial. Int J Gen Med. 2022;156097–104. pmid:35837133.
- 2. Collins SR, Blank RS. Fiberoptic intubation: an overview and update. Respir Care. 2014;59(6):865–78; discussion 878–80. pmid:24891196.
- 3. Wong J, Lee J, Wong T, Iqbal R, Wong P. Fibreoptic intubation in airway management: a review article. Singapore Med J. 2019;60(3):110–8. pmid:30009320.
- 4. Frerk C, Mitchell VS, McNarry AF, Mendonca C, Bhagrath R, Patel A, et al. Difficult Airway Society 2015 guidelines for management of unanticipated difficult intubation in adults. Br J Anaesth. 2015;115(6):827–48. pmid:26556848.
- 5. Ahmad I, El-Boghdadly K, Bhagrath R, Hodzovic I, McNarry AF, Mir F, et al. Difficult Airway Society guidelines for awake tracheal intubation (ATI) in adults. Anaesthesia. 2020;75(4):509–28. pmid:31729018.
- 6. Apfelbaum JL, Hagberg CA, Connis RT, Abdelmalak BB, Agarkar M, Dutton RP, et al. 2022 American Society of Anesthesiologists Practice Guidelines for Management of the Difficult Airway. Anesthesiology. 2022;136(1):31–81. pmid:34762729.
- 7. Heidegger T. Management of the Difficult Airway. N Engl J Med. 2021;384(19):1836–47. pmid:33979490.
- 8. Novoa NM, Varela G. Monitoring surgical quality: the cumulative sum (CUSUM) approach. Mediastinum. 2020;44. pmid:35118272.
- 9. Hayashi Y, Nakamura Y, Hirano T, Ito Y, Watanabe T. Cumulative sum analysis for the learning curve of minimally invasive mitral valve repair. Heart Vessels. 2021;36(10):1584–90. pmid:33772625.
- 10. Song X, Wang D, Sun X, Wang J, Liu Z, Liu Q, et al. Cumulative sum analysis of the learning curve for endoscopic resection of juvenile nasopharyngeal angiofibroma. Surg Endosc. 2018;32(7):3181–91. pmid:29368283.
- 11. Vargo J. Cumulative Sum Analysis and Endoscopic Ultrasound Training Competency: A Requiem for Expert Opinion. Clin Gastroenterol Hepatol. 2015;13(7):1326–7. pmid:25725441.
- 12. Cho SY, Choo MS, Jung JH, Jeong CW, Oh S, Lee SB, et al. Cumulative sum analysis for experiences of a single-session retrograde intrarenal stone surgery and analysis of predictors for stone-free status. PLoS One. 2014;9(1):e84878. pmid:24454757.
- 13. Komatsu R, Kasuya Y, Yogo H, Sessler DI, Mascha E, Yang D, et al. Learning curves for bag-and-mask ventilation and orotracheal intubation: an application of the cumulative sum method. Anesthesiology. 2010;112(6):1525–31. pmid:20463580.
- 14. Weil G, Motamed C, Biau DJ, Guye ML. Learning curves for three specific procedures by anesthesiology residents using the learning curve cumulative sum (LC-CUSUM) test. Korean J Anesthesiol. 2017;70(2):196–202. pmid:28367291.
- 15. Rujirojindakul P, McNeil E, Rueangchira-Urai R, Siripunt N. Learning curves of macintosh laryngoscope in nurse anesthetist trainees using cumulative sum method. Anesthesiol Res Pract. 2014;2014850731. pmid:24688537.
- 16. de Oliveira Filho GR. The construction of learning curves for basic skills in anesthetic procedures: an application for the cumulative sum method. Anesth Analg. 2002;95(2):411–6, table of contents. pmid:12145063.
- 17. Pius J, Noppens RR. Learning curve and performance in simulated difficult airway for the novel C-MAC® video-stylet and C-MAC® Macintosh video laryngoscope: A prospective randomized manikin trial. PLoS One. 2020;15(11):e0242154. pmid:33211728.
- 18. Jagannathan N, Sequera-Ramos L, Sohn L, Huang A, Sawardekar A, Wasson N, et al. Randomized comparison of experts and trainees with nasal and oral fibreoptic intubation in children less than 2 yr of age. Br J Anaesth. 2015;114(2):290–6. pmid:25377166.
- 19. Johnson C, Roberts JT. Clinical competence in the performance of fiberoptic laryngoscopy and endotracheal intubation: a study of resident instruction. J Clin Anesth. 1989;1(5):344–9. pmid:2627408.
- 20. Albrecht E, Schoettker P. Fiberoptic intubation. N Engl J Med. 2011;365(6):574–5; author reply 575–6. pmid:21830985.
- 21. Ma Y, Cao X, Zhang H, Ge S. Awake fiberoptic orotracheal intubation: a protocol feasibility study. J Int Med Res. 2021;49(1):300060520987395. pmid:33472482.
- 22. Rhee SH, Yun HJ, Kim J, Karm MH, Ryoo SH, Kim HJ, et al. Risk factors affecting the difficulty of fiberoptic nasotracheal intubation. J Dent Anesth Pain Med. 2020;20(5):293–301. pmid:33195807.
- 23. Alhomary M, Ramadan E, Curran E, Walsh SR. Videolaryngoscopy vs. fibreoptic bronchoscopy for awake tracheal intubation: a systematic review and meta-analysis. Anaesthesia. 2018;73(9):1151–61. pmid:29687891.
- 24. Cao X, Wu J, Fang Y, Ding Z, Qi T. A new self-designed "tongue root holder" device to aid fiberoptic intubation. Clin Oral Investig. 2020;24(12):4335–42. pmid:32748071.
- 25. Han SH, Oh AY, Jung CW, Park SJ, Kim JH, Nahm FS. The effect of the jaw-thrust manoeuvre on the ability to advance a tracheal tube over a bronchoscope during oral fibreoptic intubation. Anaesthesia. 2013;68(5):472–7. pmid:23573843.
- 26. Touré T, Williams SR, Kerouch M, Ruel M. Patient factors associated with difficult flexible bronchoscopic intubation under general anesthesia: a prospective observational study. Can J Anaesth. 2020;67(6):706–14. pmid:31953669.