Figures
Abstract
Background
Self-directed learning is the cornerstone of adult learning. The aim of the study was to investigate the improvement of core competency and increase interest to be a surgeon among medical students after a perioperative training through a structured learning with written record model. The mediating role of adult learning pattern on core competency was also examined.
Methods
A 2-week training protocol was based on a structural learning model which included a structured written record by the learner for postoperative immediate feedback. An adult learning questionnaire (ALQ) was developed to assess learners’ adult learning pattern and a clinical core competency questionnaire (CCCQ) was developed to assess learning outcomes. A two-way repeated measured of ANCOVA would be used to analyze the interaction effect of adult learning pattern and learning effect on learning outcomes.
Results
From Jan 2017 to Dec 2019, 412 medical students were enrolled in the study. The increase scores of CCCQ and a significant numbers of increase interest to be a surgeon were shown after the perioperative training. Two-way repeated measure ANOVA revealed that there were significant differences in change between pre- and post-CCCQ across four levels of ALQ (interaction effect F = 13.0, p <0.001). The more adult learning patterns medical students own, the more they will benefit from the training.
Citation: Chen N-C, Chang Y-T, Chang P-C, Chen C-S, Lai C-S (2022) Learning outcomes of structured perioperative teaching based on adult learning. PLoS ONE 17(1): e0262872. https://doi.org/10.1371/journal.pone.0262872
Editor: Hans-Peter Simmen, University Hospital Zurich, SWITZERLAND
Received: September 30, 2021; Accepted: January 6, 2022; Published: January 24, 2022
Copyright: © 2022 Chen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: BID, Briefing, Intraoperative teaching, and Debriefing; ALQ, Adult learning questionnaire; CCCQ, Clinical core competency questionnaire; ACGME, Accreditation Council for Graduate Medical Education; PR, percentile rank
1. Introduction
Nowadays, recruitment of surgical resident physicians has been challenging in Taiwan, and it is not unusual that teaching hospitals encounter difficulties in recruiting adequate numbers of surgical physicians. This problem can be attributed to one of the factors being the extremely heavy work load, and two, the shortage of systemic didactics in perioperative training [1, 2]. Effective perioperative training should provide students with more information about knowledge and skills for operating so that more interest and intention to being surgeons might be aroused. Both these factors can affect career choice for young physicians. However, to improve the working environment by reducing working hours might lead to inadequate training in the operating room. It is necessary to develop an effective learning environment to balance learning and teaching effectiveness and working load. More effort is required to attract and recruit more young physicians through effective surgical education and training.
Perioperative training is one of the most important components of surgical education and training [3]. Traditionally, surgical education is proceeded using an apprenticeship model [4], where the learner acts as an apprentice to the qualified surgeon, observing, studying, and eventually participating in real cases. Currently, surgical education is shifting toward an emphasis on teaching and learning efficiency in an operating room, in where trainees can reap the greatest benefits from every clinical opportunity by optimizing teaching [4]. To maximize the learning effectiveness for surgical trainees in the operating room, teaching and feedback are of critical importance. However, previous studies have suggested a disparity might exist between learners and teaching faculty in terms of perioperative teaching, including preoperative preparation, intraoperative and postoperative feedback [5–8]. Therefore, how learners make judgements and receive feedback about perioperative teaching and learning should be also taken into consideration, not only the faculty staff. The learning effect is decided by the attitude and learning strategies of the students themselves [9]. The tight pace in the operating room is an undoubted challenge for perioperative training, because it must be implemented in a very short period [8, 10, 11]. Therefore, effective teaching and learning through a structured learning model is of paramount importance.
Adult Learning theory is to develop skills for self-directed lifelong learning. The theory points out that adults learn best when they know why they need to learn something, they can use self-directed learning, the learning involves real-life situations, and the stimulus for learning is internal rather than external [12]. Adult Learning Theory has been developed for over two decades, and has been applied in the field of medical education as well [13], including surgical education [14]. Development of core competencies for surgeons have relied on education in the operating theatre [15]. Adult learning principles have been perceived that could be employed regularly to improve surgical training [14].
Several measurements for learning effect of medical education have been proposed. The Accreditation Council for Graduate Medical Education (ACGME) developed a competency program in 1999 [16]. The goal of this program was to demonstrate successful achievement of well-defined clinical education outcomes. Six competencies, namely patient care, medical knowledge, practice-based learning and improvement, interpersonal and communication skills, medical professionalism, as well as systems-based practice, have been put forth [16].
In Taiwan, medical clerkship rotation in each surgical sub-specialist division usually takes a short period of around two weeks, and to enhance their learning performance has effectively become a very important issue. This study was conducted to evaluate the learning effect of medical students undergoing their structural perioperative training, and aimed to clarify the triangular relationships between clinical core competencies, adult learning competency, and how the interest toward being surgeons increased.
2. Materials and methods
2.1. Structured learning model with written record
This study was conducted in an university teaching hospital in Taiwan from Jan 2017 to Dec 2019. Medical students experiencing their 2-week rotation in the Division of Plastic Surgery, Pediatric Surgery, and Thoracic Surgery were enrolled. The research protocol was approved by the Institutional Review Board.
A structural learning with written record model was developed through experts consensus meeting. The model involves reinforcement, correction, and generation of rules to guide future practice. The research team developed a 2-week learner-centered training protocol, including three sections of briefing, intraoperative teaching, and debriefing [10]. Faculty discussed the basic knowledge of surgery-related living anatomy, procedure, disease course, and possible outcome at the briefing section, while during the intraoperative teaching section, interaction between faculty members and learners occurred in several ways, such as real-time feedback, then during the debriefing section following surgery. Learner would be required to complete a perioperative written record, which included sections of diagnosis, surgical indication, type of operation, anatomy involved, postoperative care of the patient undergoing surgery. The written record functioned as a reflection of participation in the surgery in terms of medical knowledge, interaction with faculty, learning experience, and effects of self-learning. The intention was that the written record would allow learners to become aware of adult learning principles, then the teacher would closely review the written record and give direct feedback to the learners immediately after operation. Application of the problem-centered Questions and Answers (Q &A) interaction related to the patients’ condition could evoke the awareness of learning needs and learners’ clinical reasoning [11]. The structural learning model with written record designed in this study was based on adult learning pattern and clinical reasoning of teaching and learning.
2.2. Assessment
For the Adult Learning Questionnaire (ALQ), our research team developed a 6-item questionnaire to assess the adult learning pattern of the learners. The constructs of the ALQ were learner experience, self-directed learning, readiness to learn, orientation to learn, motivation to learn, and need to know [17–20]. Six items are “I know the need for learning in the operating room”; “I could share my learning experience in the operating room”; “I realize the concepts and methods of self-learning”; “I have been prepared for the surgical case”; “I know what I want to learn”; “I have good motivation to learn”. A 6-point scale for responses ranged from far below required, moderately below required, mildly below required, reach required, above required, and far above required. The possible score ranges were from 6 to 36 and a higher score was indicative of better adult learning pattern. Reliability was measured using internal consistency and Cronbach’s α was 0.93 (p< 0.001), revealing excellent reliability. The questionnaire was conducted after completing the perioperative training. Four levels of adult learning pattern among study participants based on quartiles of ALQ would be defined. They were the highest, the high, the low, and the lowest level of adopting adult learning pattern.
The Clinical Core Competency Questionnaire (CCCQ) was a 6-item self-assessed questionnaire, developed and based on 6 ACGME clinical core competencies. It was administered using 6-point scales (1: far below required, 2: moderately below required, 3: mildly below required, 4: reach required, 5: above required, and 6: far above required). Possible total scores ranged from 6 to 36, with higher scores indicating better core surgical competency. Cronbach’s α was equal to 0.93 (p <0.001), indicating excellent internal consistency. The questionnaires were learner-assessed before and after the 2-week rotation.
A question with three options (not at all, uncertain, and yes) was used to assess “interest to be a surgeon in the future”, before and after the 2-week rotation.
2.3. Data management/statistical analyses
Continuous variables were expressed as mean ± SD and categorical variables were percentages. The significance of difference of continuous variables across groups was tested using independent t-test or one-way ANOVA, as appropriate. The difference in the distribution of categorical variables was tested using Chi-square test. The level of significance was set at p < 0.05 (two-tailed). Total score of ALQ would divided a list of numbers into quarters, and they were the highest level group (≥ 75 percentile, 75PR), high group (between 50PR and 75PR), low group (between 25PR and 50PR), and lowest (< 25PR) group.
3. Results
Altogether, 412 medical students (173 interns and 239 clerks) were enrolled in this study and 136 (33%) were female. Mean of ALQ was 30.8 (SD = 3.7). A lower quartile, median, and upper quartile of total ALQ were 28, 31, and 35 respectively, and four groups were created accordingly to represent the highest, the high, the low, and the lowest adult learning pattern adopted. Means of CCCQ were 23.7 (SD = 4.7) before and 30.0 (SD = 3.6) after perioperative training respectively. Paired Student t-test revealed there was a significant increase between pre- and post-training CCCQ (29.5, p <0.001).
Fig 1 illustrates the change of CCCQ from pre-training to post-training by four levels of adult learning pattern. The results show the increase of CCCQ across all four levels of adult learning, and they were from 21.5 (SD = 5.0) to 26.0 (SD = 2.7) for the lowest group, 23.3 (SD = 4.1) to 29.3 (SD = 2.0) for the low group, 24.4 (SD = 4.3) to 31.4 (SD = 2.0) for the high group, and 25.8 (SD = 4.3) to 33.9 (SD = 2.3) for the highest group. To examine if there was a difference of increment among four groups, we conducted a two-way repeated measure ANOVA (Table 1). The results revealed that there were differences in changes between pre- and post-CCCQ across four groups (interaction effect F = 13.0, p <0.001). That is, more increment of CCCQ was found among the highest adult learning group after complement of the structured perioperative training.
ALQ: Adult Learning Questionnaire; CCCQ: Clinical Core Competency Questionnaire; PR: percentile.
The interest to be a surgeon in the future was 22 (5.3%) not at all, 181 (43.9%) uncertain, and 209 (50.7%) yes before perioperative training; while 14 (3.4%) not at all, 144 (35.0%) uncertain, and 254 (61.7%) yes after perioperative training. Increased interest was defined with responses of “not at all” before training becoming “uncertain” or “yes”; or those with responses of “uncertain” before training becoming “yes”. Totally, 61 (14.8%) students expressed increased interest to be a surgeon in the future (53 from undetermined to be positive, 7 from negative to be undetermined, and 1 from negative to be positive).
4. Discussion
The main findings of this study are as follow: (1) improvement of clinical core competency after completing the structural perioperative training; 2) improvement of clinical core competency was positively correlated with adult learning patterns; and 3) more learners expressed interest to be a surgeon in the future after perioperative training.
Roberts et al applied the briefing, intraoperative, and debriefing model for teaching in the operation room in 2009 [10], the modified structured perioperative teaching of this study, emphasizing the written record for debriefing, offers an effective learning and teaching model for perioperative training. The structured perioperative teaching model matched the learning styles with teaching styles by guided discovery learning [15]. Students’ perceptions of perioperative teaching by faculty surgeons were strongly associated with the model. Postoperative feedback played an important role to encourage and motivate the learners to furthered self-directed learning [21, 22]. Application of the clinical reasoning during debriefing feedback also effectively stimulate the learners to know what they have not known yet and what they need to know, and resulted in strong reflection and awareness of the importance of the adult learning. This inward awareness process made the students to actively learn better clinical competency related to the real patient, and adjusted and improved the self-weakness [11, 23]. The duty hours of surgical residents have been restricted by law since 2019 in Taiwan [24], in order to improve trainees’ well-being and patient safety [25]. In the structural perioperative teaching, the learners were briefed with the preoperative preparation, operative indications, and objectives of surgery by the attending surgeon beginning from scrubbing time to start of operation. During the intraoperative teaching, surgical anatomy, instrument handling, surgical technique, details of procedure, independent practice, clinical reasoning, teamwork, and ethical issues would be intensively discussed between trainers and trainees. The possible complications, postoperative care, and prognosis would be included in the debriefing after surgery. Our findings suggested that the medical students perceived self-improvement in surgical competency with this structural perioperative training model.
There was a substantial number of medical students expressing increased interest to be a surgeon by nearly 15% after the perioperative training. Regardless of pre- or post-training, the interest rates of being a surgeon in this study were higher than those expected and compared to results of previous a study [26]. A possible explanation of this finding was that positive response to the research question did not necessarily exclude other career choices among the young medical students. Most medical students keep their career choice at a broad range during the beginning of the clinical learning stage; however, in terms of enrollment of more young surgeons, the findings of this study remain positive, as personal interest is usually the main factor influencing the final decision of career choice among junior doctors [27]. More importantly, this perioperative training not only provided an effective training program for medical students but possibly an efficient method to recruit more young doctors into the surgical field as well.
The more adult learning patterns medical students adapted, the higher the improvement of surgical competency after the structural perioperative training gained. Medical education has been designed to equip learners with the knowledge, clinical skills, and professionalism required to be a competent physician who delivers patient care with quality. As the perioperative training in this study required learners to experience more self-directed experiential learning, feedback and more teacher-learner-interaction, it could be expected that medical students with more adult learning patterns would have more effective learning outcomes represented by competency. The study emphasizes that definitely clear learning effects refers to so-called aesthetic education with the theoretic background of phenomenology of perception, meaning that learners pick up information via a variety of channels such as visual observation, aural listening, oral communication, cutaneous sensation, with olfactory and tactile sensation, and at the same time they combine all these perceptions, construct new meanings of learning objectives given during self-directed learning, thoughtful acquisition of protocols, and hands-on practice as well [28]. In brief, the learning outcome revealed an optimistic result, which was similar to our previous study [21].
Our study has some limitations. Firstly, it was a quasi-experiment design without a control group, and although there were two measurable outcomes, being clinical core competency and interest to be a surgeon merited the perioperative training, it was still difficult to definitively confirm the effectiveness of an intervention without a controlled group. Secondly, as study participants were enrolled from a single teaching hospital, the findings should be cautiously extrapolated to other populations. Thirdly, assessment in this study mainly relied on self-rating, possibly leading to some degree of rater bias. An objective assessment, particularly for competency, would improve the study results. Finally, future studies with large study samples are necessary to confirm the findings.
5. Conclusions
A structural perioperative teaching model was re-developed, which included a written record for more focused feedback. The training improved clinical core competency and increased the interest of the students to be a future surgeon. The more adult learning patterns medical students develop, the more they will benefit from the training. Those whose interest in being surgeons increased improved their surgical competency more than their counterparts in this study.
Acknowledgments
The authors would like to acknowledge the contributions of all the participating students, colleagues, and research assistant Ching-Yu Hu who assisted with manuscript preparation.
References
- 1. Fairfax LM, Christmas AB, Green JM, Miles WS, Sing RF. Operative experience in the era of duty hour restrictions: is broad-based general surgery training coming to an end? Am Surg. 2010;76(6):578–82. Epub 2010/06/30. pmid:20583511.
- 2. Mattar SG, Alseidi AA, Jones DB, Jeyarajah DR, Swanstrom LL, Aye RW, et al. General surgery residency inadequately prepares trainees for fellowship: results of a survey of fellowship program directors. Ann Surg. 2013;258(3):440–9. Epub 2013/09/12. pmid:24022436.
- 3. Agarwala AV, Lane-Fall MB, Greilich PE, Burden AR, Ambardekar AP, Banerjee A, et al. Consensus Recommendations for the Conduct, Training, Implementation, and Research of Perioperative Handoffs. Anesth Analg. 2019;128(5):e71–e8. Epub 2019/04/18. pmid:30995210.
- 4. Reznick RK, MacRae H. Teaching surgical skills—changes in the wind. N Engl J Med. 2006;355(25):2664–9. Epub 2006/12/22. pmid:17182991.
- 5. Vollmer CM Jr, Newman LR, Huang G, Irish J, Hurst J, Horvath K. Perspectives on intraoperative teaching: divergence and convergence between learner and teacher. J Surg Educ. 2011;68(6):485–94. Epub 2011/10/18. pmid:22000535.
- 6. Rose JS, Waibel BH, Schenarts PJ. Disparity between resident and faculty surgeons’ perceptions of preoperative preparation, intraoperative teaching, and postoperative feedback. J Surg Educ. 2011;68(6):459–64. Epub 2011/10/18. pmid:22000531.
- 7. Butvidas LD, Anderson CI, Balogh D, Basson MD. Disparities between resident and attending surgeon perceptions of intraoperative teaching. Am J Surg. 2011;201(3):385–9; discussion 9. Epub 2011/03/04. pmid:21367384.
- 8. Chang YT, Lu PY, Lai CS. Disparity of perspectives between teachers and learners on perioperative teaching and learning. BMC Med Educ. 2020;20(1):244. Epub 2020/08/02. pmid:32736559; PubMed Central PMCID: PMC7393732.
- 9. Hammick M, Freeth D, Koppel I, Reeves S, Barr H. A best evidence systematic review of interprofessional education: BEME Guide no. 9. Med Teach. 2007;29(8):735–51. Epub 2008/02/01. pmid:18236271.
- 10. Roberts NK, Williams RG, Kim MJ, Dunnington GL. The briefing, intraoperative teaching, debriefing model for teaching in the operating room. J Am Coll Surg. 2009;208(2):299–303. Epub 2009/02/21. pmid:19228544.
- 11.
Lai CS, Shen CJ, Wang CN, Tsai JS, Yen JH. A practical way to enhance the intraoperative teaching and learning-anatomy-based clinical reasoning. The Association for Medical Education in Europe Annual Meeting; Helsinki 2017.
- 12.
Knowles MS, Holton EF III, Swanson RA. The adult learner: The definitive classic in adult education and human resource development: Rouledge; 2014.
- 13. Torre DM, Daley BJ, Sebastian JL, Elnicki DM. Overview of current learning theories for medical educators. Am J Med. 2006;119(10):903–7. Epub 2006/09/27. pmid:17000227.
- 14. Rashid P. Surgical education and adult learning: Integrating theory into practice. F1000Res. 2017;6:143. Epub 2017/03/31. pmid:28357046; PubMed Central PMCID: PMC5345767.
- 15. Kieu V, Stroud L, Huang P, Smith M, Spychal R, Hunter-Smith D, et al. The operating theatre as classroom: a qualitative study of learning and teaching surgical competencies. Educ Health (Abingdon). 2015;28(1):22–8. Epub 2015/08/12. pmid:26261110.
- 16. Leach DC. Evaluation of competency: an ACGME perspective. Accreditation Council for Graduate Medical Education. Am J Phys Med Rehabil. 2000;79(5):487–9. Epub 2000/09/20. pmid:10994894.
- 17. Knowles MSJP. The modern practice of adult education: Andragogy vs. 1970:51.
- 18.
Kidd JR. How adults learn. Revised Edition: Association Press; 1973.
- 19. Knox AB, Farmer HSJIRoE. Overview of counseling and information services for adult learners. 1977;23(4):387–414.
- 20.
Peters JM. Adult Education: Evolution and Achievements in a Developing Field of Study: ERIC; 1991.
- 21. Kim RH, Gilbert T, Ristig K, Chu QD. Surgical resident learning styles: faculty and resident accuracy at identification of preferences and impact on ABSITE scores. J Surg Res. 2013;184(1):31–6. Epub 2013/05/28. pmid:23706561.
- 22. Maruthappu M, Trehan A, Barnett-Vanes A, McCulloch P, Carty MJ. The impact of feedback of surgical outcome data on surgical performance: a systematic review. World J Surg. 2015;39(4):879–89. Epub 2014/12/03. pmid:25446487.
- 23.
Lai CS, Lu PY, Chen CL. Teaching clinical reasoning in surgery. In: Yang IM, editor. Clinical Reasoning. Taipei: Elsvier; 2017. p. 235–44.
- 24.
The Ministry of Health and Welfare of Taiwan. Assessment of the workload of residents in Taiwan [Article in Chinese] [cited 2020 22 Spet]. Available from: https://www.mohw.gov.tw/cp-2736-8859-1.html.
- 25. Wang TH, Drolet BC, Tsai KY, Liu YF. Residents’ perception of duty hour limits through teaching hospital accreditation status-experience in Taiwan. J Formos Med Assoc. 2017;116(5):398–401. Epub 2016/12/26. pmid:28012676.
- 26. Zarkovic A, Child S, Naden G. Career choices of New Zealand junior doctors. N Z Med J. 2006;119(1229):U1851. Epub 2006/02/25. pmid:16498478.
- 27. Du J, Sathanathan J, Naden G, Child S. A surgical career for New Zealand junior doctors? Factors influencing this choice. N Z Med J. 2009;122(1300):29–37. Epub 2009/08/26. pmid:19702013.
- 28. Iwaszkiewicz M, Darosa DA, Risucci DA. Efforts to enhance operating room teaching. J Surg Educ. 2008;65(6):436–40. Epub 2008/12/09. pmid:19059174.