Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Is online learning during the COVID-19 pandemic associated with increased burnout in medical learners?: A medical school’s experience

  • Sarah Hunt ,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Software, Supervision, Writing – original draft, Writing – review & editing

    sahunt@nosm.ca

    Affiliation Northern Ontario School of Medicine (NOSM) University, Thunder Bay, ON, Canada

  • Jenna Simpson,

    Roles Conceptualization, Writing – original draft, Writing – review & editing

    Affiliation Northern Ontario School of Medicine (NOSM) University, Thunder Bay, ON, Canada

  • Lyndon Letwin,

    Roles Conceptualization, Writing – original draft, Writing – review & editing

    Affiliation Northern Ontario School of Medicine (NOSM) University, Thunder Bay, ON, Canada

  • Bryan MacLeod

    Roles Conceptualization, Funding acquisition, Supervision, Writing – review & editing

    Affiliation Northern Ontario School of Medicine (NOSM) University, Thunder Bay, ON, Canada

Abstract

Introduction

The COVID-19 pandemic necessitated a shift to virtual curriculum delivery at Canadian medical schools. At the NOSM University, some learners transitioned to entirely online learning, while others continued in-person, in-clinic learning. This study aimed to show that medical learners who transitioned to exclusively online learning exhibited higher levels of burnout compared to their peers who continued in-person, clinical learning. Analysis of factors that protect against burnout including resilience, mindfulness, and self-compassion exhibited by online and in-person learners at NOSM University during this curriculum shift were also explored.

Methods

As part of a pilot wellness initiative, a cross-sectional online survey-based study of learner wellness was conducted at NOSM University during the 2020–2021 academic year. Seventy-four learners responded. The survey utilized the Maslach Burnout Inventory, the Brief Resilience Scale, Cognitive and Affective Mindfulness Scale–Revised, and the Self-Compassion Scale–Short Form. T-tests were utilized to compare these parameters in those who studied exclusively online and those who continued learning in-person in a clinical setting.

Results

Medical learners who engaged in online learning exhibited significantly higher levels of burnout when compared with learners who continued in-person learning in a clinical setting, despite scoring equally on protective factors such as resilience, mindfulness, and self-compassion.

Conclusion

The results discussed in this paper suggest that the increased time spent in a virtual learning environment during the COVID-19 pandemic might be associated with burnout among exclusively online learners, as compared to learners who were educated in clinical, in-person settings. Further inquiry should investigate causality and any protective factors that could mitigate negative effects of the virtual learning environment.

Introduction

The novel coronavirus disease (COVID-19) pandemic caused innumerable changes to workplaces and educational institutions across the globe. Public health efforts to control the pandemic led to strict regulations on gathering sizes and social interactions [1]. These public restrictions and a move to a virtual learning environment introduced new stressors for medical students and residents, already engaged in a rigorous training program [2]. Medical students expressed distress regarding the COVID-19 situation, and indicated that the move from an in-person, interactive learning environment to online learning led to feelings of unpreparedness and a sense of deficiency in their skills [36].

Though the COVID-19 pandemic has persisted for years, there are very few studies that analyzed the impacts of online curriculum delivery on medical learners. A 2020 study of Swiss medical students and residents found higher levels of burnout among non-involved students who transitioned to online learning, while students who remained involved in healthcare delivery experienced less burnout than their peers [7]. The investigators postulated that these differences were due to difficulties adapting to the online learning environment, concern about assessment performance, and increased isolation, and that involvement in pandemic response was a protective factor [7].

A study of Polish medical students found similar results. Medical learners were transitioned to online learning, then surveyed using validated resilience, well-being, and burnout inventories [8]. Students that volunteered, worked, or planned to work on frontline pandemic response showed lower levels of burnout including exhaustion, lower cynicism, higher academic efficacy, compared to students who transitioned to online learning [8].

Efforts to better contextualize the thoughts and feelings of Canadian medical students throughout the pandemic via validated means have been limited, leaving room for further investigation. Other publications have explored the pandemic’s effects on global medical students, but comparisons between exclusively online learners and learners who continued learning in-person in clinic in Canada have not been made [5].

The data for this publication was initially collected and analyzed as part of a longitudinal study on the effectiveness of a voluntary mindful self-compassion training for medical learners at NOSM University. Prior to the mindful self-compassion course, learners participated in a pre-course survey measuring various metrics of wellness such as mindfulness, self-compassion, resilience, and burnout. The initial intention of these baseline measurements was to make comparisons following completion of the mindful self-compassion course. However, the data collection was initiated during and continued throughout the COVID-19 pandemic, which provided a unique opportunity to collect and analyze wellness data during this unprecedented period of change to the learning environment.

Based on the observations reported in the Swiss and Polish studies discussed above [7, 8], the hypothesis was that NOSM University medical learners who were exclusively online during the COVID-19 pandemic would exhibit higher levels of burnout than those who continued in-person, clinical learning during the COVID-19 pandemic. The first study objective was to demonstrate that there were higher levels of burnout among exclusively online medical learners, compared to learners who continued in-person. The second objective was to examine factors that protect against burnout, including self-compassion, mindfulness, and resilience, to detect any differences in protective traits between these two groups that may help further explain observed differences in burnout. The overall intention of this study is to provide further evidence of the mental health impacts of online learning on medical learners in the context of the COVID-19 pandemic, thereby contributing to a growing body of literature that furthers our understanding of the consequences of COVID-19 on medical education.

Methods

A cross-sectional online survey-based study that measured learner well-being was conducted at NOSM University during the 2020–2021 academic year. Ethics approval was obtained by both Lakehead (#1468263) and Laurentian (#6020865) Universities prior to study commencement and was reaffirmed for the publication of this incidental finding. Learners were invited to complete the surveys via email invitations and word-of-mouth. Written consent was obtained from each of the participants via electronic consent forms. Learners who consented to the study completed the surveys on a voluntary basis.

Questionnaires & survey measures

The online survey was built using Google Forms. The Maslach Burnout Inventory [9] was used to measure symptoms of burnout including emotional exhaustion, cynicism, and low personal efficacy. The Brief Resilience Scale [10], Cognitive and Affective Mindfulness Scale–Revised [11], and the Self Compassion Scale—Short Form [12] were used to measure qualities that protect against burnout, including resilience, mindfulness, and self-compassion, respectively. Questionnaires were disseminated via email to interested learners on a voluntary basis. All survey responses were anonymous, as no identifying demographic information was collected. Surveys were collected between November 2020 and June 2021, corresponding to the second and third waves of the COVID-19 pandemic.

Participants

All NOSM University medical students from year one to year four (MS1-4), and all NOSM University residents in their first year of postgraduate training (PGY1) were invited to participate in the associated research study. At the time of survey collection, there were 128 exclusively online learners (MS1 and MS2) and 184 in-person learners (MS3, MS4 and PGY1) who received an invitation to participate in the research study. Demographic information regarding each of these classes were obtained from the NOSM University Undergraduate Medical Education and Postgraduate Education units, respectively, since this data was not obtained in the anonymous surveys. This data is summarized in Table 1.

Statistics

Data from questionnaires were converted to numerical scores. Two groups were created for comparative purposes. The first group contained learners who completed their medical education entirely online with no access to in-person learning or clinical exposure during the pandemic. Those who completed exclusively online medical education included first- and second-year medical students. The second group contained learners who continued their medical education in-person, specifically in teaching hospitals and clinics, during the pandemic. This group contained third- and fourth-year medical students, and first-year residents, who were permitted to continue in-person learning. Comparative analyses between those who learned exclusively online and those who continued in-person learning during the pandemic were conducted using T-tests, and significance was set at a value of p < .05. This allowed for identification of differences in burnout (specifically emotional exhaustion, cynicism, and personal efficacy), and protective factors such as resilience, mindfulness, and self-compassion among the two groups who experienced different learning environments during the pandemic. All statistics were carried out using GraphPad Prism 9 [13].

Results

Survey responses

Seventy-four respondents completed the questionnaires. Of these, 41 were learners who participated in exclusively online learning during the pandemic, and 33 were learners who were permitted to continue in-person learning at clinics and teaching hospitals throughout the COVID-19 pandemic. These responses were representative of 32% of exclusively online learners and 18% of in-person learners at NOSM University who were sent the survey during that time. These two groups of learners were compared.

Symptoms of burnout during COVID-19 pandemic

Differences in the frequency of burnout symptoms experienced by learners, depending on their learning environment (i.e., online or in a clinical setting), was elucidated using the data collected from the questionnaires. On average, learners who were exclusively online demonstrated burnout symptoms significantly more often than learners who continued in-person learning in a clinical setting during the COVID-19 pandemic. Specifically, learners who were confined to online learning reported emotional exhaustion and cynicism at a significantly higher frequency than learners who were able to continue learning in a clinical setting throughout the COVID-19 pandemic (Table 2). Learners who participated in exclusively online learning reported symptoms of exhaustion at least once per week, while learners who were permitted to continue in-person learning experienced symptoms of exhaustion less than a few times per month. Those who were learning online also experienced more feelings of cynicism at a frequency of greater than once per month, while those who continued learning in-person in a clinical environment experienced these feelings less than once per month. However, both cohorts reported feelings of personal efficacy at a similarly high frequency of more than once per week.

thumbnail
Table 2. Comparison of survey outcomes between online and in-person learners.

https://doi.org/10.1371/journal.pone.0285402.t002

Protective qualities equal among medical learners in online and in-person learning environments

Despite exclusively online learners experiencing symptoms of burnout at significantly higher frequencies, this group displayed equal levels of resilience, mindfulness, and self-compassion compared to those who continued in-person learning in a clinical environment (Table 2).

Discussion

This study aimed to demonstrate that medical learners who transitioned to exclusively online learning during the COVID-19 pandemic exhibited higher levels of burnout compared to those who continued in-person, clinical learning and participated in the COVID-19 response. These results confirm the hypothesis that NOSM University learners who were exclusively online learning during the pandemic experienced symptoms of burnout significantly more often than those learners who continued in-person learning during the COVID-19 pandemic, thereby following similar trends observed globally. This trend was observed despite equal levels of protective qualities including resilience, mindfulness, and self-compassion reported between the two groups, suggesting that learners who were exclusively online were equally as equipped as those who continued in-person clinical learning to tolerate circumstances that may lead to burnout. It is postulated that this phenomenon is the result of changes in the learning environment during the pandemic. Although our study is limited to observation of this phenomenon, we cannot provide evidence of a direct causation between online learning and burnout given the limitations of our study. As such, we attempted to provide explanations as to why we observed differing levels of burnout among our learners at NOSM University using existing evidence from the literature.

The results from this study demonstrate that NOSM University learners surveyed have similar levels of protective factors, including resilience, mindfulness, and self-compassion. The available literature suggests an inverse relationship between these factors and burnout [14, 15]. Research suggests that an increase in these factors support an individual’s ability to cope with stressful events and promote emotional balance, thereby protecting against burnout [14, 15]. Given the equivalent levels of protective factors among the two cohorts, our data suggests that a lack of protective factors, including resilience, is not associated with the observed increase in burnout among NOSM University learners. Therefore, there must be another explanation for the high levels of burnout among online learners observed in this study.

Social engagement is a well-established protective factor that is impacted by virtual learning and may contribute to the difference in levels of burnout between in-person and online learners. While social engagement was not studied directly in this case, the support from the literature and relevance to the lives of learners in the context of COVID-19 pandemic warrant some consideration. Social interaction has been established as an important protective factor against physician burnout [16]. As medical education moved online and public health guidelines restricted physical gathering, exclusively online learners became increasingly isolated and lacking social contact with classmates, mentors, and peers, potentially leaving them more susceptible to symptoms of burnout. It is possible that in-person learners benefited from continued social interaction with colleagues and patients, and were potentially protected from symptoms of burnout by this regular social engagement. Further studies on social connection are necessary to delineate the impact on learners and ascertain the degree to which they influence burnout in this setting.

Meaning of work may also have contributed to the differences in burnout observed in our cohort. Studies have demonstrated that physicians who have a sense of meaning in their lives have lower levels of burnout [17]. In the context of the pandemic, the learners who continued to work in clinics and hospitals and participated in the pandemic response likely had a greater sense of meaning in life compared to students who were learning from home and not involved in the pandemic response.

An additional factor that may have contributed to reduced symptoms of burnout among in-person learners may be the reduced hours for many primary care providers and specialists who were not part of the frontline response throughout the COVID-19 pandemic. For learners in these environments, their workload and working hours were often significantly reduced, resulting in a reduction in burnout [18, 19]. This change in the typical structure of the clinical education setting and workload may have contributed to the discrepancy between in-person learners and online learners.

Study limitations

The results reported were incidental findings, a limitation of the analysis. As a result of the incidental nature, there was no follow-up exploration regarding the participants’ experiences with burnout such as why they were experiencing symptoms of burnout. It is also important to acknowledge that there are differences beyond the pandemic between pre-clerkship and clerkship learners, and residents, including workload and assessment requirements. Additionally, participants were recruited on a voluntary basis from a small medical school in Northern Ontario, a limited sampled that may impact the generalizability of the results. Finally, it should also be noted that there is a lack of baseline scores for pre-pandemic burnout. Future studies should explore possible explanations including social connectedness as protective factors that may contribute to reduced symptoms of burnout, or examine other possible explanations including differences in workload and working hours in the different learning settings.

The results of this study are significant as the COVID-19 pandemic in Canada persists. Furthermore, medical schools continue to discuss the role of online learning post-pandemic. Aligning with these discussions, medical schools across the country will continue to have to make decisions balancing learning objectives, public health guidelines, and student well-being. The promotion of burnout by online learning pedagogy should be heavily considered in the decision-making process to support the mental health and well-being of medical learners across Canada.

Conclusion

With no clear end to the global COVID-19 pandemic, it is crucial to understand the impact of the online learning environment on the well-being of medical learners. The results discussed in this paper suggest that an increased reliance on online learning during the COVID-19 pandemic may significantly increase the rate of burnout among medical learners, compared to learners who were able to continue learning in a clinical setting. While the results suggest an association between burnout and online learning, the conclusions of this work are limited due to the incidental nature of the finding and the fact that our initial study on mindful self-compassion was not designed to answer this question. Future research should further explore with more detail the phenomena observed in this study and will likely provide additional insight into whether online learning is directly correlated with increased levels of burnout. As medical education continues to incorporate online learning as the COVID-19 pandemic persists and potentially beyond, we must consider the implications of these policy decisions on the well-being of learners.

References

  1. 1. Britton P.N., Hu N., Saravanos G., Shrapnel J., Davis J., Snelling T, et al. (2020). COVID-19 public health measures and respiratory syncytial virus. Lancet Child Adolescent Health,4(11), e42–3. pmid:32956616
  2. 2. Harries A.J., Lee C., Jones L., Rodriguez R.M., Davis J.A., Boysen-Osborn M., et al. (2021). Effects of the COVID-19 pandemic on medical students: A multicenter quantitative study. BMC Medical Education,21(1), 1–8. https://doi.org/10.1186/s12909-020-02462-1
  3. 3. Sharma D., & Bhaskar S., (2020). Addressing the Covid-19 burden on medical education and training: The role of telemedicine and tele-education during and beyond the pandemic. Frontiers of Public Health,8(838). https://doi.org/10.3389/fpubh.2020.589669
  4. 4. Lyons Z., Wilcox H., Leung L., & Dearsley O. (2020). COVID-19 and the mental well-being of Australian medical students: Impact, concerns and coping strategies used. Australasian Psychiatry,28(6), 649–52. pmid:32772729
  5. 5. Alsoufi A., Alsuyihili A., Msherghi A., Elhadi A., Atiyah H., Ashini A., et al. (2020). Impact of the COVID-19 pandemic on medical education: Medical students’ knowledge, attitudes, and practices regarding electronic learning. PloS One,15(11). pmid:33237962
  6. 6. Loda T., Löffler T., Erschens R., Zipfel S., & Herrmann-Werner A. (2020). Medical education in times of COVID-19: German students’ expectations–A cross-sectional study. Plos One, 15(11). pmid:33206678
  7. 7. Aebischer O., Weilenmann S., Gachoud D., Méan M., & Spiller T.R. (2020). Physical and psychological health of medical students involved in the coronavirus disease 2019 response in Switzerland. Swiss Medical Weekly, pmid:33306812
  8. 8. Forycka J., Pawłowicz-Szlarska E., Burczyńska A., Cegielska N., Harendarz K., & Nowicki M. (2022). Polish medical students facing the pandemic—Assessment of resilience, well-being and burnout in the COVID-19 era. PloS One, 17(1). pmid:35073318
  9. 9. Maslach C., Jackson S. E., & Leiter M. P. (1996). MBI: Maslach burnout inventory. CPP Incorporated.
  10. 10. Smith B.W., Dalen J., Wiggins K., Tooley E., Christopher P., & Bernard J. (2008). The brief resilience scale: assessing the ability to bounce back. International Journal of Behaviour Medicine,15(3),194–200. pmid:18696313
  11. 11. Feldman G., Hayes A., Kumar S., Greeson J., & Laurenceau J-P. (2007). Mindfulness and emotion regulation: The development and initial validation of the Cognitive and Affective Mindfulness Scale-Revised (CAMS-R). Journal of Psychopathology Behavioral Assessment, 29(3),177–90. https://doi.org/10.1007/s10862-006-9035-8
  12. 12. Raes F., Pommier E., Neff K.D., & Van Gucht D. (2011). Construction and factorial validation of a short form of the self-compassion scale. Clinical Psychology & Psychotherapy, 18(3), 250–5. https://doi.org/10.1002/cpp.702
  13. 13. Software GraphPad, Inc San Diego, USA
  14. 14. Wood E. A., Egan S.C., Ange B., Garduno H., Williams D.R., & Wyatt T.R. (2020). Association of self-reported burnout and protective factors in single institution resident physicians. Journal of Graduate Medical Education, 12(3), 284–90. pmid:32595847
  15. 15. Nerea J-P., Romero-Martín M, Ponce-Blandón J.A, Ramirez-Baena , Palomo-Lara J.C., & Gómez-Salgado J. (2021). The relationship between mindfulness and emotional intelligence as a protective factor for healthcare professionals: Systematic review. International Journal of Environmental Research and Public Health, 18(10). https://doi.org/10.3390/ijerph18105491
  16. 16. Lacy B.E., & Chan J.L. (2018). Physician burnout: The hidden health care crisis. Clinical Gastroenterology and Hepatology, 16(3), 311–7. pmid:28669661
  17. 17. Hooker S., Post R., & Sherman M. (2020). Awareness of meaning in life is protective against burnout among family physicians: A CERA Study. Family Medicine, 52(1), 11–6. https://doi.org/10.22454/FamMed.2019.562297
  18. 18. Osama M., Zaheer F., Saeed H., Anees K., Jawed Q., Syed S.H., et al. (2020).Impact of COVID-19 on surgical residency programs in Pakistan; A residents’ perspective. Do programs need formal restructuring to adjust with the “new normal”? A cross-sectional survey study. International Journal of Surgery,79, 252–6. pmid:32526265
  19. 19. Degraeve A., Lejeune S., Muilwijk T., Poelaert F., Piraprez M., Svistakov I., et al. (2020). When residents work less, they feel better: Lessons learned from an unprecedent context of lockdown. Progres en Urologie,30(16),1060–6. pmid:32917488