Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Physicians’ attitude towards webinars and online education amid COVID-19 pandemic: When less is more

  • Ismail Ibrahim Ismail ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    dr.ismail.ibrahim2012@gmail.com

    Affiliation Department of Neurology, Ibn Sina Hospital, Kuwait City, Kuwait

  • Ahmed Abdelkarim,

    Roles Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Visualization

    Affiliation Department of Neuropsychiatry, Faculty of Medicine, Alexandria University, Alexandria, Egypt

  • Jasem Y. Al-Hashel

    Roles Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Visualization

    Affiliations Department of Neurology, Ibn Sina Hospital, Kuwait City, Kuwait, Department of Medicine, Faculty of Medicine, Health Sciences Centre, Kuwait University, Kuwait City, Kuwait

Abstract

Background

Since the declaration of COVID-19 as a pandemic, all scientific medical activities were shifted to an online format, in the form of webinars, to maintain continuing medical education (CME). We aimed to assess physicians’ attitude among different medical specialties towards this sudden and unexpected shift of traditional face-to-face meetings into webinars, and to suggest future recommendations.

Methods

We conducted a cross-sectional, internet-based survey study using a 25-item questionnaire, from November 1 and November 15, 2020. The survey was created and distributed to physicians from different medical and surgical specialties and from different countries via several social media platforms, using a snowball technique.

Results

A total of 326 physicians responded; 165 (50.6%) were females, mean age of responders was 38.7 ± 7.5 years. The majority of responses (93.2%) came from Arab countries. Of them, 195 (59.8%) reported attending more webinars compared to the same period last year, with average of 3 per month. As regard to the general impression; 244 (74.8%) were “strongly satisfied” or “satisfied”, with the most satisfaction for “training courses: by 268 (82.2%), and “International conferences” by 218 (66.9%). However, 246 respondents (75.5%) felt overwhelmed with the number and frequency of webinars during the pandemic, 171 (52.5%) reported attending less than 25% of webinars they are invited to, 205 (62.8%) disagreed that webinars can replace in-person meetings after the pandemic, and 239 (73.3%) agreed that online meetings need proper regulations.

Conclusions

Webinars comprised a major avenue for education during COVID-19 pandemic, with initial general satisfaction among physicians. However, this paradigm shift was sudden and lacked proper regulations. Despite initial satisfaction, the majority of physicians felt overwhelmed with the number and frequency of webinars. Physicians’ satisfaction is crucial in planning future educational activities, and considering that this current crisis will most likely have long lasting effects, webinars should be viewed as complementing traditional in-person methods, rather than replacement. In this study, we are suggesting recommendations to help future regulation of this change.

Introduction

The world has been overtaken by coronavirus 2019 (COVID-19) pandemic since March 11, 2020. Since then, health care systems around the world have been struggling to contain this unprecedented public health crisis [1]. Most countries implemented lockdown and social distancing recommendations for fear of COVID-19 spread, and the majority of medical conferences and in-person scientific meetings were canceled. Many societies and educational institutes started using online-meeting applications to reach their relevant goals and needs, and the medical educational organizations and pharmaceutical companies were no exception [2]. The scientific activities were shifted to an online format, in the form of webinars, virtual conferences and online teaching courses. Webinars (web-based seminars) are one form of online communication tools that facilitate delivery of scientific information and sharing experiences among physicians. Thus, it best suited a time of movement restrictions and fear from a potentially fatal virus amid COVID-19 pandemic [3].

During the 6-month period following the pandemic, physicians have been invited to attend a lot of scientific webinars, while working to minimize the spread of COVID-19 outbreak. Webinars at this point were probably the only solution for continuing medical education (CME), however, months into the pandemic, their number and frequency has markedly increased. Physicians had difficulties in controlling their virtual agenda and struggled to participate in the extensive offer of webinars, teaching courses, medical representatives visits, board and committee meetings, in addition to telemedicine. It is not surprising that several physicians have felt “digital burnout” as suggested by some authors [4]. The ability of physicians to attend these online educational activities were compromised by several factors, and the lack of proper regulations as regard to the best teaching format, timing to conduct webinars, or methods for feedback, created several challenges amid COVID-19 crisis [5, 6].

Several studies have discussed these emerging challenges and disadvantages of online education amid COVID-19 pandemic [7, 8], however, there are limited data in the literature regarding physicians’ perception and satisfaction towards this sudden and unexpected shift in medical education. We believe that physicians’ satisfaction is crucial, not only for evaluation of the current practices, but also for planning of future strategies between in-person and virtual learning. In this survey study, we aim to assess physicians’ attitude, mainly in The Middle East and North Africa (MENA) region, towards webinars in comparison to the traditional in-person meetings, and to suggest future recommendations to regulate this change in practice.

Methods

Participants

This cross-sectional, internet-based study, was conducted between November 1 and November 15, 2020. The study was approved by the Institutional Review Board Committee of Ministry of health of the state of Kuwait. The survey was developed and distributed to physicians of different specialties and from different countries via several social medical networks using a snowball technique. Answering the survey was considered an implied consent to participate in the study, and all answers were confidential. The study follows the American Association for Public Opinion Research (AAPOR) reporting guideline.

Survey

A 25-item questionnaire was designed in English language, combining multiple choice and Likert response scale questions, with the option for respondents to provide further free text responses for some questions. A pilot study was conducted on a random sample of 25 physicians to determine the feasibility of using the questionnaire. Each author sent the questionnaire to a random of 10 physicians of their contacts, and 25 responded, which was considered a convenient sample. The survey was then modified as regard to formulation of the questions, formulation of response preferences, and the addition of certain demographic variables before distribution. The survey aimed to assess physicians’ attitude towards shifting scientific activities to online formats amid COVID-19 pandemic, using a 5-point Likert scale of agreeableness (’strongly disagree’, ’disagree’, ’neutral’, ’agree’, and ’strongly agree’) against certain questions. The self-administered survey was developed using “GoogleTM Forms”, which require participants to sign-in into their Google accounts to prevent multiple entries from respondents.

The educational activities can be different among medical specialties, but they mainly include; general online webinars, teaching courses on specific subjects (e.g. Botox injection), International annual conferences, or pharmaceutically-sponsored meetings discussing specific therapies.

The survey collected the following data from three domains: (1) demographic variables (age, gender, country of practice, specialty, years of experience, working role during the pandemic). (2) webinars-related variables (attendance, number of attendances per month, comparison to last year attendance, role in webinars, percentage of webinars attended in relation to the number of invitations). (3) physicians’ attitude towards webinars (general impression on shifting scientific meetings to online format, specific impression on shifting international conferences/ teaching courses versus pharmaceutically-sponsored meetings to online format, impression on the scientific content of international conferences versus pharmaceutically-sponsored meetings in online format, types of online meetings respondents prefer to attend, types of online meetings respondents reject to attend, factors determining attendance or rejection to attend online meetings, agreement on online meetings replacing in-person visits, feeling overwhelmed with the number and frequency of online meetings, agreement on the need for further regulations). In reporting the results, the data from the two columns of “strongly agree” and “agree”/ “strongly satisfied” and “satisfied” were combined and the data for “strongly disagree” and “disagree”/ “strongly dissatisfied” and “dissatisfied” were combined as well. Participants were asked at the end of the survey to give their opinion and to suggest recommendations for educational organizations, pharmaceutical companies, and policy makers, to improve physicians’ satisfaction beyond the COVID-19 pandemic.

The full survey instrument can be viewed as an appendix to this article (S1 Appendix).

The survey link was created and initially posted on the personal social media accounts of the primary investigators and on several medical groups on Facebook. Physicians were encouraged to recruit other colleagues by resending the link to their contacts through a “snow-ball technique”. The link was posted only once on each medical group, and twice on the personal accounts of the investigators. The survey continued until there was no more responses for 1 day. The survey was closed at 23:59, November 15, 2020.

Statistical analysis

Data were analyzed using SPSS statistical software version 25.0 (Armonk, NY: IBM Corp). The Kolmogorov- Smirnov non-parametric test was used to verify the normality of distribution of variables. Comparisons between groups for categorical variables were assessed using Chi-square test (Fisher’s Exact or Monte Carlo correction). Student t-test was used to compare two groups for normally distributed quantitative variables while Mann Whitney test was used to compare between two groups for not normally distributed quantitative variables. Significance of the obtained results was judged at the 5% level.

Results

In this survey, a total of 326 physicians responded to the online survey; 165 (50.6%) females, and 161 (49.4%) were males, with a mean age of 38.7 ± 7.5 years for all responders. Mean years of experience for the cohort was 11.8 ± 7.01 years. The respondents were mostly from Arab countries (93.2%); Egypt; 142 (43.6%), Kuwait; 122 (37.4%), UAE; 22 (6.7%), KSA; 13 (4%) and 27 (8.3%) from other countries. The response rate cannot be calculated in this study. During the pandemic, 172 physicians (52.8%) continued to practice their usual work, 80 (24.5%) were frontline healthcare worker, 38 (11.7%) partially worked, 24 (7.4%) practiced through "telemedicine services”, while 12 (3.7%) didn’t work during the pandemic. Physicians’ characteristics and their responses to the survey questions are summarized in Table 1. Of the respondents, the commonest specialties were neurology by 75 physicians (23%), psychiatry by 40 (12.3%), family medicine by 38 (11.6%), general surgery by 20 (6.1%), critical care by 17 (5.2%), internal medicine by 16 (4.9%), radiology by 16 (4.9%), and 104 physicians (31.9%) from other specialties, as summarized in Table 2.

thumbnail
Table 1. Distribution of the survey respondents according to different parameters (n = 326).

https://doi.org/10.1371/journal.pone.0250241.t001

thumbnail
Table 2. Distribution of the studied cases according to the different specialties (n = 326).

https://doi.org/10.1371/journal.pone.0250241.t002

The majority of physicians; 318 (97.5%) attended webinars or online meetings during the first 6 months of the pandemic, with 195 (59.8%) reported attending more webinars compared to the same period last year. The average median was 3 (0–20) webinars per month, compared to 0 (0–1) in the past year. More than half of the respondents; 171 (52.5%) reported attending less than 25% of webinars they are invited to, 72 (22.1%) attended 25–50%, 55 (16.9%) attended 50–75%, while only 28 (8.6%) reported attending more than 75%. Most of the respondents; 270 (82.8%) were “mostly attendees”, 41 (12.6%) were “equally speakers and attendees”, and 15 (4.6%) were “mostly speakers”.

As regard to the general impression on shifting scientific meetings to online format, 244 (74.8%) were “strongly satisfied” or “satisfied”, 49 (15%) were neutral, while 33 (10.1%) were “strongly dissatisfied” or “dissatisfied”. Almost the same results were obtained when asked about their impression on shifting international conferences and teaching courses to online format; 243 (74.5%) were “strongly satisfied” or “satisfied”, 42 (12.9%) were neutral, and 41 (12.5%) were “strongly dissatisfied” or “dissatisfied”. However, these results differed when asked about shifting pharmaceutically-sponsored meetings; only 135 (41.4%) were “strongly satisfied” or “satisfied”, 90 (27.6%) were neutral, while 101 (30.9%) were “strongly dissatisfied” or “dissatisfied”.

As regard to impression on the scientific content of the international conferences in online format; 267 (81.9%) were “strongly satisfied” or “satisfied”, 44 (13.5%) were neutral, and 15 (4.6%) were “strongly dissatisfied” or “dissatisfied”. These results also changed when asked about the scientific content of the pharmaceutically-sponsored meetings; 120 (36.8%) were “strongly satisfied” or “satisfied”, 86 (26.4%) were neutral, and 120 (36.8%) were “strongly dissatisfied” or “dissatisfied”. The commonest types of meetings respondents preferred to attend were training courses by 268 (82.2%), international conferences by 218 (66.9%), local/regional conferences by 167 (51.2%), and the least was commercial/ pharmaceutically-sponsored meetings by 29 (8.9%) respondent. Findings are illustrated in Table 3, and Fig 1.

thumbnail
Fig 1. Stacked bar chart of Likert questions.

The figure shows 5 bar charts describing the impression of physicians towards shifting scientific activities into online format, the impression differences between international conferences and pharmaceutically-sponsored activities, and the perception of the scientific content of these activities during the pandemic.

https://doi.org/10.1371/journal.pone.0250241.g001

thumbnail
Table 3. Distribution of survey responses according to satisfaction with different webinars and online meetings (n = 326).

https://doi.org/10.1371/journal.pone.0250241.t003

The commonest reported factors for determining attendance were; scientific content by 297 (91.1%), CME certification by 164 (50.3%), speaker’s name and experience by 158 (48.5%), annual international conferences by 156 (47.9%), and personal relations with the inviting party by 61 (18.7%) respondent. The commonest reported factor for declining to attend was the timing of the meeting by 284 (87.1%), followed by the scientific content by 228 (69.9%), lack of CME certification by 115 (35.3%), personal factors by 85 (26.1%), speakers in the meeting by 75 (23%), and lack of personal relations with the inviting party by 50 (15.3%) respondent.

When asked if webinars can replace in-person meetings after the pandemic; 205 respondents (62.8%) reported “strongly disagree” or “disagree”, in comparison to 105 (32.2%) who reported “strongly agree” or “agree”. Moreover, 246 (75.5%) agreed or strongly agreed that they felt overwhelmed with the number and frequency of webinars during the pandemic, with 239 (73.3%) agreed or strongly agreed that webinars and online meetings need further regulations. Findings are illustrated in Table 4, and Fig 2.

thumbnail
Fig 2. Stacked bar chart of Likert questions.

The figure shows 3 bar charts describing the questions regarding being overwhelmed with webinars, the need for further regulations, and if webinars can replace traditional in-person methods after the pandemic.

https://doi.org/10.1371/journal.pone.0250241.g002

thumbnail
Table 4. Distribution of the survey responses according to agreeableness to different items (n = 326).

https://doi.org/10.1371/journal.pone.0250241.t004

A statistical comparison was performed between satisfied and non-satisfied groups, and there were no significant differences as regard to age (p = 0.601), gender (p = 0.593), years of clinical practice (p = 0.620), and role amid the pandemic (p = 0.563). However, there was a statistically significant difference regarding the role during online meetings, where “mostly speakers” reported more satisfaction compared to “mostly attendees” (p = <0.001). Findings are summarized in Table 5.

thumbnail
Table 5. Comparison between satisfied and non-satisfied groups on shifting scientific meetings into webinars with different parameters (n = 277).

https://doi.org/10.1371/journal.pone.0250241.t005

Discussion

The COVID-19 pandemic has caused a major disruption to the conventional medical education across the world, and webinars were used in an attempt to maintain teaching and learning. This phenomenal shift of concepts has led to an increase in webinar usage in 2020 compared to the same period in 2019, by more than 300% in one study [9] and up to 3250% in another [10]. This is not the first time when traditional educational activities are suspended in a time of a major crisis. SARS coronavirus (SARS-CoV) and H1N1 Flu outbreaks also negatively impacted educational activities in a large number of countries around the globe, enforcing “emergency remote teaching” as a feasible option [11]. However, the current circumstances are unique and different in its global magnitude and the more likely long-lasting effects after the pandemic.

In this study, nearly two-thirds of physicians attended more meetings during the first 6 months of the pandemic compared to the same period last year, and the majority reported initial satisfaction. This satisfaction was higher with “International conferences” and “teaching courses” compared to pharmaceutically-sponsored meetings (74.5% vs 41.4%, p = <0.001). Moreover, the satisfaction with the scientific content was also higher between the aforementioned two types of meetings (81.9% vs 36.8%, p = <0.001). This interesting disparity in satisfaction might be attributed to the higher number, frequency, and overlapping activities of pharmaceutically-sponsored meetings, probable perceived biases, or due to dominance of early COVID-19-related topics at that time. Moreover, International conferences are annual events, that usually lack commercial biases, and are eligible for higher CME accreditation, than pharmaceutically-sponsored events.

However, the majority (75.5%) reported feeling overwhelmed with the frequency of online meetings during this period, more than half (52.5%) attended less than 25% of webinars they are invited to, and (73.3%) felt the need for proper regulations of this practice. Furthermore, 62.8% disagreed that online format can replace in-person meetings afterwards.

These findings were in line with other surveys by Figueroa et al. [12] and Al-Ahmari et al. [13], where around 60% to 70% of physicians believed that webinars should not replace face-to-face traditional teaching after the pandemic, respectively. Moreover, similar findings were found among medical students in a study that included 13 medical schools, where 54.8% disagreed that e-learning could be used for clinical teaching [14].

Interestingly, similar findings extended to physicians’ attitude towards online consultations with patients. In a survey study of 140 physicians from Lebanon, the vast majority of responders disagreed, or remained undecided, as to whether “telemedicine” can replace face-to-face consultations [15].

Respondents reported several reasons for dissatisfaction including: the overwhelming number and frequency, lack of scheduling, increase screen time exposure especially with shifting practice to telemedicine, technical difficulties, increased stress from either attending too many or too little webinars for fear of missing out on educational activities, in addition to disturbance of work/life balance, as most webinars occur during weekends or after working hours. In a study evaluating challenges to online medical education during the COVID-19 pandemic in Saudi Arabia [5], poor communication (59%), lack of assessment (57.5%), technology-related issues (56.5%), online inexperience (55%), pandemic-related anxiety or stress (48%), time management (35%), and technophobia (17%) were the commonly reported factors. In the same study, 62.5% of respondents preferred combining online with traditional face-to-face education, 25.5% preferred traditional face-to-face, and only 12.0% preferred online education alone.

The “Anywhere-Anytime” feature of webinars were found to be especially beneficial at the beginning of COVID-19 pandemic. However, this same feature was reported to be one the most relevant reasons for dissatisfaction. Physicians’ satisfaction largely affects the willingness to continuously use the platform. Online education advantages are numerous including time and location flexibility, being less costly, possibility of self-paced education, and accommodation of a wider audience. However, they also pose several disadvantages such as technical difficulties, less communication with attendees, slow response time with low Internet connection, increase distraction during webinars, limited feedback and assessment, and absence of socialization in comparison to the traditional ways [16, 17]. Moreover, it is well known that high screen time exposure can be linked to increase stress, sleep disturbance, fatigue, anxiety and depression [18, 19]. Furthermore, little evidence has been presented regarding the efficiency and efficacy of online education compared to traditional methods, especially with the huge differences between countries in digital advancement [20], in addition to difficulties to replicate in-person clinical bedside experiences virtually.

Higher satisfaction among speakers in comparison to attendees can be understood in the light of several studies, showing that acceptance of change is affected primarily by the degree to which individuals are involved in the change process. In other words, participation in implementing the various aspects of online education leads to significantly less resistance to this change [21].

Recommendations

William Osler once said, “Medicine is learned by the bedside and not in the classroom” [22].

With this in mind, and though attending webinars is optional, it became a major avenue to maintain the provision of medical education remotely for the time being. The debate about their benefits and limitations is still ongoing, and despite earlier attempts to regulate online education in general [23, 24], the majority of respondents agreed that regulations are needed, as part of preparation for future pandemics or other disruptions to medical education. The following recommendations are suggested based on our survey findings, and a review of the current literature [2534].

1-Webinars should be regulated through the local/ regional scientific organizations to arrange for the timing, frequency, and topics, in order to avoid repetition and overlapping activities and to help limiting screen-time exposure. In numerous everyday domains, it has been demonstrated that increasing the number of options can lead to a choice paralysis and decrease satisfaction; the so-called “paradox of choice” [25]. A predetermined monthly schedule can be helpful in avoiding overwhelm and burnout.

2- Inconvenient timing was found to be the most important concern in our survey. Most respondents preferred avoiding working hours and weekends, to avoid disruption of work/life balance, however, time zone differences still remain an important challenge for International events. Studies have shown that the best time to hold a webinar is mid-week, with a strong preference for Tuesday and Wednesday [26].

3- Research in the field of “brain-based learning” has resulted in some useful “learner-centered” techniques for planning the content of webinars to maintain high attention and concentration levels: e.g. sessions should be 20 minutes or less, followed by 5 minutes of discussion, stimulation of as many of the learner’s senses as possible using images, question-response modules, games, or role-playing, and to provide timely assessment and feedback [26].

4- Webinars should be concise, well-structured, and having clear objectives. Most general webinars should not be longer than one hour in total, whereas webinars presenting highly technical content, or webinars for training purposes, can be up to a maximum of 1.5 hours [27, 28].

5- Speakers should be highly qualified, well known, and respected in their field. If more than one speaker is required, those with opposing views can be chosen, to make the discussion livelier.

6-The scientific content should be novel, updated, and non-biased. The virtual experience should be enriched with multimodal learning elements including videos, images, and audio files, rather than merely presenting slides, in order to attract and engage more audience. Moreover, emphasis on social interaction among participants is crucial [29, 30].

7- The “two-way interaction” of teaching must be implemented. Knowledge assessment can be made prior to and after webinars, to ensure better understanding of the subjects. An interactive Q&A during live sessions is also beneficial [31, 32].

8—CME accreditation is important to ensure high quality of webinars, as physicians usually require a specified number of credits annually to maintain medical licenses.

9- Technical issues should be addressed, in order to ensure digital equity. Internet connection problems is a difficulty that needs to be anticipated, as not all attendees/speakers have access to the same amount of bandwidth [33, 34].

10-A recorded version of the lectures can be kept for a specific period of time, to allow for better self-paced learning.

Limitations

Our study has some limitations which should be stated. First, being a cross-sectional survey study carries a potential for certain biases. Moreover, respondents self-selected themselves into the study via social media, which may be prone to selection bias, with nearly third of respondents from neurology and psychiatry. However, the other two-thirds came from a representative sample of different medical and surgical specialties. Furthermore, the majority of respondents were from physicians working in MENA countries, which could limit the generalizability of our results to other geographical regions. The results of this survey should be interpreted as descriptive, aiming to assess attitude of a defined population, towards a specific target, during a specific period of time. Second, our study was not designed to allow for sub-analysis of physicians’ satisfaction according to different medical or surgical specialties, and further research is needed to understand satisfaction can differ between specialties. Finally, the survey was not validated, due to time constraints during the COVID-19 crisis, and the need to assess the outcome in a timely manner, which might limit the reliability in assessing physicians’ attitude. However, we conducted a pilot study on a random sample of 25 physicians before distributing the survey, to determine its feasibility.

Conclusion

The impact of COVID-19 pandemic on medical education has been significant all over the world. Webinars and online meetings provided the best avenue for teaching during this global crisis. Despite its several advantages, this paradigm shift came suddenly and without proper preparation from the educational organizations, and lacked proper regulations. Physicians in our study showed initial satisfaction with this shift, with higher satisfaction levels for “International conferences” and “teaching courses” compared to “pharmaceutically-sponsored meeting”. However, the majority felt overwhelmed with the number and frequency of webinars, more than half attend less than quarter of webinars they were invited to, and most respondents thought it needs proper regulations. Moreover, two-thirds of physicians disagreed that webinars can replace in-person meetings. Considering that this current crisis will most likely have long lasting effects, webinars should be viewed as complementing traditional in-person methods, rather than replacement, while aiming for normalcy.

The findings and recommendations from this study highlight the importance of physicians’ satisfaction in future planning of long-term strategies for online medical education. Further general and specialty-specific studies are needed to modify and refine proper online educational tools.

Supporting information

Acknowledgments

We would like to express our thanks and gratitude to our colleagues who participated by answering this survey study.

References

  1. 1. Phelan AL, Katz R, Gostin LO. The novel coronavirus originating in Wuhan, China: challenges for global health governance. Jama. 2020 Feb 25;323(8):709–10. pmid:31999307
  2. 2. Ahmed H., Allaf M. and Elghazaly H. (2020) ‘COVID-19 and medical education’, The Lancet. Online First. Published: March 23, 2020. https://doi.org/10.1016/S1473-3099(20)30226-7.
  3. 3. Li L, Xv Q, Yan J. COVID-19: the need for continuous medical education and training. The Lancet Respiratory Medicine. 2020 Apr 1;8(4):e23. pmid:32192586
  4. 4. Wroclawski M, Heldwein FL. Editorial Comment: Digital Physician Burnout in the “New Normal” Workplace. Journal of Endourology. 2020 Nov 5. pmid:32781833
  5. 5. Rajab MH, Gazal AM, Alkattan K. Challenges to Online Medical Education During the COVID-19 Pandemic. Cureus. 2020 Jul 2;12(7):e8966. pmid:32766008; PMCID: PMC7398724.
  6. 6. Ferrel MN, Ryan JJ. The impact of COVID-19 on medical education. Cureus. 2020 Mar;12(3). pmid:32368424
  7. 7. Dedeilia A, Sotiropoulos MG, Hanrahan JG, Janga D, Dedeilias P, Sideris M. Medical and surgical education challenges and innovations in the COVID-19 era: a systematic review. in vivo. 2020 Jun 1;34(3 suppl):1603–11. pmid:32503818
  8. 8. Paudel P. Online education: Benefits, challenges and strategies during and after COVID-19 in higher education. International Journal on Studies in Education. 2021;3(2):70–85.
  9. 9. Nepal PR. Role of Webinars in Medical Educations during Pandemic of COVID 19. Eastern Green Neurosurgery. 2020 Jun 3;2(2):1–2.
  10. 10. Navia A, Berner JE, Pereira N, Reissis D, Rakhorst H, Cuadra A. Have We Passed the Peak? The COVID-19 Plastic Surgery Webinar Pandemic. Aesthet Surg J. 2020;40(9):NP569–NP573. pmid:32643754
  11. 11. Cauchemez S, Van Kerkhove MD, Archer BN, Cetron M, Cowling BJ, Grove P, et al. School closures during the 2009 influenza pandemic: national and local experiences. BMC infectious diseases. 2014 Dec 1;14(1):207. pmid:24739814
  12. 12. Figueroa F, Figueroa D, Calvo-Mena R, Narvaez F, Medina N, Prieto J. Orthopedic surgery residents’ perception of online education in their programs during the COVID-19 pandemic: should it be maintained after the crisis?. Acta Orthopaedica. 2020 Jun 12:1–4. pmid:32539473
  13. 13. Al-Ahmari AN, Ajlan AM, Bajunaid K, Alotaibi NM, Al-Habib H, Sabbagh AJ, et al. Perception of Neurosurgery Residents and Attendings on Online Webinars During COVID-19 Pandemic and Implications on Future Education. World Neurosurgery. 2020 Nov 9. pmid:33181378
  14. 14. Alsoufi A, Alsuyihili A, Msherghi A, Elhadi A, Atiyah H, Ashini A, et al. Impact of the COVID-19 pandemic on medical education: Medical students’ knowledge, attitudes, and practices regarding electronic learning. PloS one. 2020 Nov 25;15(11):e0242905. pmid:33237962
  15. 15. Helou S, El Helou E, Abou-Khalil V, Wakim J, El Helou J, Daher A, et al. The effect of the COVID-19 pandemic on physicians’ use and perception of telehealth: The case of Lebanon. International journal of environmental research and public health. 2020 Jan;17(13):4866.
  16. 16. Radović-Marković M. Advantages and disadvantages of e-learning in comparison to traditional forms of learning. Annals of the University of Petroşani, Economics. 2010;10(2):289–98.
  17. 17. Goh PS, Sandars J. A vision of the use of technology in medical education after the COVID-19 pandemic. MedEdPublish. 2020 Mar 26;9.
  18. 18. Kummer TF, Recker J, Bick M. Technology-induced anxiety: Manifestations, cultural influences, and its effect on the adoption of sensor-based technology in German and Australian hospitals. Information & Management. 2017 Jan 1;54(1):73–89.
  19. 19. Rosen L, Carrier LM, Miller A, Rokkum J, Ruiz A. Sleeping with technology: cognitive, affective, and technology usage predictors of sleep problems among college students. Sleep health. 2016 Mar 1;2(1):49–56. pmid:29073453
  20. 20. Adedoyin OB, Soykan E. Covid-19 pandemic and online learning: the challenges and opportunities. Interactive Learning Environments. 2020 Sep 3:1–3.
  21. 21. Mitchell LD, Parlamis JD, Claiborne SA. Overcoming faculty avoidance of online education: From resistance to support to active participation. Journal of Management Education. 2015 Jun;39(3):350–71.
  22. 22. Bliss M. William Osler: A life in medicine. Oxford University Press; 1999 Nov 18.
  23. 23. Guanci G. Best practices for webinars. Creative nursing. 2010 Aug 1;16(3):119–21.
  24. 24. Mbati L, Minnaar A. Guidelines towards the facilitation of interactive online learning programmes in higher education. International Review of Research in Open and Distributed Learning. 2015;16(2):272–87.
  25. 25. Bassett RL. The Paradox of Choice: Why More is Less. How the Culture of Abundance Robs us of Satisfaction. Journal of Psychology and Christianity. 2007 Apr 1;26(1):87.
  26. 26. Bedford N., 2016. Webinar Best Practices.
  27. 27. Reyna J, Todd B, Hanham J. A Practical Framework to Design Educational Webinars in the Age of COVID-19. InEdMedia+ Innovate Learning 2020 Jun 23 (pp. 265–271). Association for the Advancement of Computing in Education (AACE).
  28. 28. Molay K. Best Practices for Webinars: Increasing attendance, engaging your audience, and successfully advancing your business goals. Adobe Systems Incorporated. Retrieved September. 2009;29:2011.
  29. 29. Zoumenou V, Sigman-Grant M, Coleman G, Malekian F, Zee JM, Fountain BJ, et al. Identifying best practices for an interactive webinar. Journal of Family & Consumer Sciences. 2015 Jun 1;107(2):62–9.
  30. 30. Hilliard JD, Rahman M, Chambless LB, Asthagiri AR, Fogleson MA, Angelos C. Evaluation of CNS Webinars Format Based on Participant Engagement. Neurosurgery. 2020 Nov 15;67(Supplement_1).
  31. 31. Foster MJ, Shurtz S, Pepper C. Evaluation of best practices in the design of online evidence-based practice instructional modules. Journal of the Medical Library Association: JMLA. 2014 Jan;102(1):31. pmid:24415917
  32. 32. Chen T, Peng L, Yin X, Rong J, Yang J, Cong G. Analysis of user satisfaction with online education platforms in China during the COVID-19 pandemic. InHealthcare 2020 Sep (Vol. 8, No. 3, p. 200). Multidisciplinary Digital Publishing Institute.
  33. 33. Reyna J, 2020, ’Twelve Tips for COVID-19 friendly learning design in medical education’, MedEdPublish, 9, [1], 103, https://doi.org/10.15694/mep.2020.000103.1
  34. 34. Schifferdecker KE, Reed VA. Using mixed methods research in medical education: basic guidelines for researchers. Medical education. 2009 Jul;43(7):637–44. pmid:19573186