Correction
21 Nov 2024: The PLOS ONE Staff (2024) Correction: What can be learned from lecturers’ knowledge and self-efficacy for online teaching during the Covid-19 pandemic to promote online teaching in higher education. PLOS ONE 19(11): e0314398. https://doi.org/10.1371/journal.pone.0314398 View correction
Figures
Abstract
The experience of graduate degree lecturers in the natural sciences when they switched to online teaching during the Covid-19 pandemic is described. The shift to online teaching throughout the pandemic provided an opportunity to evaluate how lecturers integrate technology into their teaching and what they need to improve their remote teaching. This study used a twofold perspective of TPACK (Technological Pedagogical Content Knowledge) and self-efficacy in online education. Its data were derived from pre-and post-questionnaires, comprising closed and open-ended questions, given at the start and end of the semester. We found that lecturers focused on learning and applying technological and techno-pedagogical knowledge but paid less attention to the integration of three components: technology, pedagogy, and scientific content. Although no statistically significant differences in lecturers’ perceived self-efficacy was found between the start and the end of the semester, at the end of the semester we found a statistically significant correlation between the variables involved in building self-efficacy in online teaching: (1) satisfaction with online teaching and the belief that (2) technology promotes teaching, student interactions, participation, and engagement. Our results enabled us to identify the knowledge aspects that lecturers implemented initiatively and to better understand what aspects required more professional development training. In addition, the results emphasized the importance of developing the lecturers’ self-efficacy for online teaching. These insights can help to improve and enhance online teaching in higher education.
Citation: Blonder R, Feldman-Maggor Y, Rap S (2022) What can be learned from lecturers’ knowledge and self-efficacy for online teaching during the Covid-19 pandemic to promote online teaching in higher education. PLoS ONE 17(10): e0275459. https://doi.org/10.1371/journal.pone.0275459
Editor: Di Zou, The Education University of Hong Kong, HONG KONG
Received: December 13, 2021; Accepted: September 15, 2022; Published: October 5, 2022
Copyright: © 2022 Blonder et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Integrating technology into higher education teaching and learning requires changing both the lecturers’ knowledge of educational technology and their beliefs, stands, and pedagogical perceptions [1, 2]. In the past few years, universities worldwide have significantly expanded distance learning, using integrated video-based technological means, such as online homework lectures and lessons that complement traditional classes [3]. Numerous universities have been offering whole courses that are open to the public on the internet [4]. Although online learning and its recognition have been discussed in Israel as well [5], frontal instruction was the most widespread mode of academic teaching before the Covid-19 outbreak. Most lecturers adhered to the traditional lecture mode, using technology only to support frontal teaching [6]. However, the Covid-19 outbreak caused all the higher education lecturers to switch to online teaching immediately and without preparation [7]. These enable us to examine those lecturers’ beliefs and knowledge when they switched to online teaching with the Covid-19 outbreak. No less important is revealing how practical experience using technological tools in teaching affected the lecturers’ knowledge and beliefs.
To this end, we chose two perspectives: one refers to the lecturers’ knowledge and the other to their beliefs regarding online teaching. Both perspectives (knowledge and beliefs) represent essential components of quality online teaching [8]. TPACK (Technological pedagogical content knowledge) [9] is used to address the necessary knowledge to integrate technology into teaching, and self-efficacy in online teaching [10] is used to address the lecturers’ beliefs regarding their ability to teach online.
TPACK is based on the Shulman’s theoretical framework of teachers’ pedagogical content knowledge (PCK) [11]. It expands PCK by characterizing the types of knowledge required to promote effective integration of technology into teaching while considering content and pedagogy [12]. The TPACK framework proposes seven distinct categories of teacher knowledge. In addition to the three categories suggested by Shulman [11, 13], the TPACK framework includes four more categories related to technology: Technological Knowledge (TK) represents knowledge on how to use technologies (e.g., how to operate computer programs and different technological applications). Technological Pedagogical Knowledge (TPK) is an extension of general pedagogical knowledge (PK). It represents the integration of technology with general pedagogical strategies (e.g., how to engage students in technology-oriented activities and evaluate online learning). Teachers who possess this kind of knowledge understand the impact of technology on general pedagogical practices that are not content-specific. Technological Content Knowledge (TCK) represents knowledge of technological tools that practitioners use within a specific discipline. In science education, it represents the technological knowledge that a scientist would have and that teachers want their students to acquire (e.g., use of databases by scientists [14]). Finally, TPACK represents the ability of teachers or lecturers to combine those three knowledge components (technology, pedagogy, and content) to advance their teaching objectives. TPACK is primarily achieved when a teacher knows how technological tools transform pedagogical strategies and content representations for teaching particular topics, and how technological tools in education and representations affect a student’s understanding of these topics (e.g., the use of visualization tools to support students’ understanding of scientific phenomena [15, 16]). Online teaching is a notable example of implementing TPACK in curricular teaching [17–19].
Studies have indicated that teachers who undergo training that includes TPACK tend to realize that this approach to implementing technology in teaching promotes teaching and contributes to the learning process. Teachers who undergo such training understand that content, pedagogy, and technology must be integrated rather than perceived as separate components in their teaching [20, 21].
TPACK is recognized as one of the leading theoretical frameworks for analyzing technology integration in teaching [22]. Most of the existing literature about TPACK has focused on school teachers [23]. Whereas, the literature on TPACK and higher education is far less developed. For example, in a research book on the topic of TPACK published in 2016 [24], only one chapter out of 20 was devoted to TPACK in higher education. Nevertheless, some important studies were conducted in the context of higher education [24–27]. These works focused on teacher education, specifically on the development of pre-service teacher TPACK [24], faculty development programs [25, 26], and course design [27]. In the current research, we aimed to expand the existing research on TPACK and higher education. Specifically, we studied the TPACK of lecturers who had to teach online when there were no other alternatives and did not receive appropriate professional training.
However, TPACK is insufficient when new technology is adopted. In a recent review dealing with the integration of computational chemistry in chemistry courses, Tuvi-Arad [28] presented several challenges that inhibit the integration of advanced technology. First, she mentioned the TK of the lecturers and that they should be familiar with the relevant software. However, in her thorough review, she found evidence that lecturers’ self-efficacy beliefs and attitudes can influence technology integration. This insight is supported in a previous review of research about TPACK [29], which concluded with a suggestion to conduct an interdisciplinary study of TPACK with other theoretical frameworks related to the study of technology integration. The current study was designed to address this aspect and investigate how the TPACK framework intersects with the self-efficacy construct derived from Bandura’s social cognitive theory [10].
To employ an innovative technological tool in teaching, lecturers must believe that they can use a particular tool and enhance the students’ learning [10]. A sense of self-efficacy indicates the extent to which one is confident of functioning under different conditions and achieving the desired results. This belief affects that person’s decisions, choices, perseverance, and the ability to cope with various tasks throughout life [10]. A sense of self-efficacy gradually develops in an ongoing learning process, whereby a person accumulates knowledge from numerous sources about their functioning in different areas [30]. Bandura lists four resources that contribute to developing self-efficacy: (1) Past experiences (mastery experience), (2) Observing models (vicarious experience), (3) Positive feedback from one’s surroundings (verbal persuasion), and (4) Physical and psychological sensations and reactions (physiological state). Together, these four resources affect one’s perceived self-efficacy and the ability to realize one’s skills [10, 31]. According to Skinner (1996) [32], when self-efficacy is defined as an individual’s conviction that he or she can produce a controlling response, then high self-efficacy also implies the belief that a controlling response (a means–ends connection) already exists. However, in the current research, we follow a relevant definition of self-efficacy in the context of teaching that was provided by Gibson and Dembo (1984) [33]. The authors emphasized two components of teaching self-efficacy beliefs. The first is the belief that effective teaching can influence learning (outcome expectancy beliefs), and the second is having confidence in one’s own teaching abilities (self-efficacy beliefs). Having these two components should facilitate teachers to have a longer persistence, provide a greater focus in the classroom, and allow the teachers to exhibit different types of feedback, compared with teachers who have lower expectations concerning their ability to influence student learning [33].
This definition by Gibson and Dembo (1984) was adopted by other educational researchers [33] in science education research [34], and it is also applicable for science teaching using technology [35]. A strong sense of self-efficacy in using a technological tool is a vital precondition for lecturers to apply that tool in teaching [36]. Teachers with a high self-efficacy perception are more open to new ideas and are more willing to experience new methods and offer students new and unique learning opportunities and experiences [37]. To help lecturers develop this confidence, it is necessary to help them accumulating mastery experiences, engaging in vicarious experiences as well as persuasion that are likely to boost teachers’ self-efficacy [35, 38, 39].
As already mentioned, developing self-efficacy in using technology for teaching is a gradual, ongoing process [40]. However, the Covid-19 outbreak created circumstances in which higher education lecturers faced the need to implement new technological capabilities [41] instantly. The Weizmann Institute, for example, postponed the opening of the second semester by a week, and the lecturers underwent a short training course in the use of Zoom (https://zoom/us) to enable online teaching, which was similar to many other academic institutions worldwide [42]. These efforts enabled lecturers to better prepare for online teaching in the second semester of 2020, which was conducted entirely online using technological tools. Unlike previous research that studied lecturers who had switched to distance teaching, in the present study, the lecturers could not choose whether they wanted to switch to online instruction, since the Covid-19 crisis forced all of them to initiate online teaching [43]. A recent qualitative study, conducted in six universities in two countries, dealt with the challenges of online and e-learning systems. It identified five factors that influenced the successful use of an e-learning system during the Covid-19 pandemic [44]. The self-efficacy beliefs of lecturers and students were one of these factors, along with technological factors, trust, and cultural aspects. Therefore, there is a need to explore lecturers’ self-efficacy beliefs and knowledge while they are forced to shift to online teaching.
Methodology
The study aimed to characterize the knowledge of science lecturers at the Weizmann Institute, explore their views about online teaching, and investigate the knowledge and self-efficacy they had developed over a semester-long course in online teaching.
Research questions
Q1) What variables contribute to developing lecturers’ perceived self-efficacy in online teaching?
Q2) Which TPACK components did higher education science lecturers implement in online teaching?
This research compared the findings of pre-and post-questionnaires completed by Weizmann Institute of Science lecturers. The questionnaire’s development followed the theoretical TPACK and self-efficacy frameworks and included 14 multiple-choice questions on a rating scale, analyzed statistically, as well as open-ended questions that underwent qualitative analysis. The questionnaire was developed at the beginning of the pandemic (March 2020) and was validated using 197 high-school chemistry teachers [45]. These analyses enabled pre-post comparisons that examined how a semester of online teaching under Covid-19 circumstances affected the research variables and their correlation.
The study population
Forty-six lecturers, who taught a course in the second semester of 2020, completed the preliminary (pre-) questionnaire, and 89 lecturers completed the post-questionnaire. The post-questionnaire was distributed in two cycles: the first cycle followed the second semester in 2020 and the second cycle followed the first semester in 2021 (each lecturer answered the post-questionnaire only once). The pre- and post-responses were not paired due to ethical restrictions. The lecturers all taught advanced degree courses offered to M.Sc. and Ph.D. natural science students at the Weizmann Institute. The lecturers’ teaching field, experience in online teaching, age, and characteristics regarding the courses are presented in Table 1.
Research tools
All the lecturers and teaching assistants, who taught in the second semester of 2020, received by email an anonymous research questionnaire that the Institute’s ethics committee had approved. The questionnaire was re-mailed to them in the last week of the semester. The data that support the findings of this study are available from the corresponding author upon reasonable request. The research received IRB (Institutional Review Board) approval from the Weizmann Institute of Science Ethics Committee and participants’ written consent was obtained.
The questionnaire consists of three main parts. The first part collected information about the lecturers’ background, including faculty, age, and previous experience in online teaching. The second part was an attitude questionnaire that comprised 14 questions about five variables (for original data see S5 Table in the Supporting Information section). Two of the five variables are components of self-efficacy in online teaching [35], presented in Table 2. The pre-questionnaire included four of the five categories. In developing the questionnaire, we applied a previous questionnaire developed to measure the views of chemistry teachers regarding online teaching during the Covid-19 period [45]. To validate the variables, we used factor analysis and a Cronbach’s alpha test (Table 2). In the third part, the respondents had to provide detailed answers to the following open questions:
- What efforts did you put into preparing and teaching the online course?
- Did you lack any knowledge or equipment in teaching the online course?
- What do you think are the disadvantages and advantages of online teaching, and what difficulties (if any) did you encounter in teaching the online course?
The three parts of the questionnaire provide data that are of a different nature (quantitative and qualitative) but are complementary. Whereas the quantitative part enabled us to look for correlations between the variables, the qualitative data explained the revealed phenomena [46].
Data analysis
Since the data were not normally distributed, we used the non-parametric test approach. The Wilcoxon two-sample test for non-paired pre-and post-comparisons was applied to analyze the differences between the pre-post-questionnaire. Then, we conducted a Spearman correlation test paired to examine correlations between the research variables. We based on Xiao et al. [47] to evaluate the strength of the relationship between the variables: The high strength of relationship: r value is above 0.5; Moderate strength of relationship: r value is above 0.3 and less than 0.5; We did not include in Fig 1 weak correlation–below to 0.3.
# High strength of relationship: r value is above 0.5.
To analyze the qualitative data, we used an inductive approach based on the TPACK theoretical framework [48]. Similar to Graham [49]. First, we checked the lecturers’ answers to the open questions against the TPACK knowledge components described in the Introduction. Next, we identified additional components that were impossible to categorize as one of the TPACK knowledge components. These components were found by using grounded theory [50, 51]. One of the authors performed the qualitative analysis, which the three researchers later discussed to resolve any discrepancies. We achieved an entire agreement after a discussion. The same methodology was applied in the qualitative analysis of the advantages and disadvantages of online teaching reported by the participants.
Results
Here we present separately the research findings obtained by analyzing different parts of the questionnaire. We will begin with the quantitative analysis findings, followed by those of the qualitative analysis.
Results of the quantitative analysis
The questionnaire’s multiple-choice questions underwent statistical analysis to assess the lecturers’ views about different variables related to online teaching—a Wilcoxon two-sample test of all five variables (see S1 Table and the descriptive statistics presented in S2 Table, in the supplementary materials). Regarding the lecturers’ views in the pre-and post-questionnaires, we could not identify any statistically significant differences between the addressed variables. However, in calculating the correlations between the quantitative variables, we found a different trend in the pre-and post-questionnaires. Only one significant correlation (moderate) emerged in the pre-questionnaire (S3 Table) between the lecturers’ perceived self-efficacy and technology promotes interactions (r = 0.360, p = <0.0001). However, in the post-questionnaire, positive and significant Spearman correlations emerged between the variables, as shown in S4 Table and Fig 1.
Different variables were found to be high/moderate correlated with the two components of self-efficacy. The correlation between these two components was examined, and a low correlation was found. The first component of self-efficacy, “Perceived self-efficacy in online teaching,” was highly significantly correlated with “Satisfaction with online teaching” (r = 0.60, p<0.0001), “Technology promotes interactions” (r = 0.53, p<0.0001), and “Student participation and engagement” (r = 0.55, p<0.0001). The second component of self-efficacy, the variable “Belief that technology promotes teaching” was significantly (moderately) correlated with “Satisfaction with online teaching” (r = 0.40, p = 0.0003) and “Technology promotes interactions” (r = 0.31, p = 0.0041).
Significant Spearman correlations (S4 Table) that were found only in the post-questionnaire might indicate variables related to the development of self-efficacy. Fig 1 summarizes the quantitative findings and shows the moderate and high correlations between variables that were found.
Results of the qualitative analysis
The knowledge lecturers used for online teaching.
In the questionnaire completed before online teaching began, the lecturers answered two questions regarding their preparation for online teaching: (1) What efforts did they make in preparing and teaching the online course and (2) what knowledge and equipment did they lack in order to complete the task. These two questions reappeared in the post-questionnaire. Namely, both questions were aimed at determining the current knowledge they used in preparing for remote teaching (question 1) and the knowledge they still need to acquire in order to teach online. Table 3 and Fig 2 present the knowledge components according to the TPACK framework.
Both "Missing knowledge" and "Effort invested" were characterized by TPACK components. The number of participants was used to calculate the percentages for each question.
As Fig 2 shows, the lecturers reported that their preparations for the online course differed from what they had planned prior to teaching online. Forty-eight percent of the lecturers reported about preparations concerning the category “technological knowledge (TK),” i.e., learning how to operate technological tools for education. A smaller portion of the lecturers (42%) reported in the post-questionnaire that they had made great efforts to learn TK in order to teach online. In the techno-pedagogical category (TPK), the lecturers reported that they made considerable efforts in the online implementation of various pedagogies (41% in the pre- and 58% in the post-questionnaire). About 17% of the pre-questionnaire respondents and of the post-questionnaire respondents said they made no effort to adjust the course to the online environment. Notably, most of those lecturers taught in the Faculty of Life Sciences and used presentations. We also noted that the lecturers made increased efforts to address the emotional needs of their students. However, this aspect was mentioned by only 9% of the lecturers in the pre-questionnaires and by 17% in the post-questionnaire.
Knowledge that the lecturers lacked for online teaching
As part of their preparations for online teaching, lecturers had to indicate what additional knowledge or equipment they needed for online education. Their answers related to knowledge were categorized according to the TPACK components. We analyzed the answers regarding equipment and provided the Weizmann Institute with information regarding what equipment should be purchased for the lecturers. Before online teaching began, equipment was a serious issue. Eighteen of the 46 lecturers complained that they lacked the equipment required for distance teaching. Although several teachers still lacked appropriate equipment at the end of the semester, their number decreased (15 of 89). To address this problem, the Institute purchased online teaching equipment for lecturers during the 2021 academic year. In addition, 15 classrooms are currently being modified for hybrid teaching with online teaching equipment. The classes will mainly serve lecturers who use a whiteboard.
The number of lecturers who stated that they needed no additional knowledge was increased in the post-questionnaire (from 24% to 35%). In contrast to the decreased need for equipment noted at the end of the online teaching semester, the lecturers’ need for various technological knowledge related to pedagogy (TPAK, TPK) increased after they had experienced online teaching (Fig 2). Only three lecturers mentioned the need for comprehensive knowledge about TPACK before the semester began, four lecturers indicated that they needed it at the end of the semester. Such knowledge included, for example, dedicated teaching applications in mathematics and technology, allowing students to perform lab experiments remotely [52]. The need for additional TPK increased after the lecturers had taught during the online semester (from 16% to 23%), since the lecturers had invested much effort to develop their TPK during the semester, much more than they had expected (from 41% to 58%).
Advantages and disadvantages of online teaching
The lecturers were requested to provide their input regarding their experience and the challenges they had to cope with during online teaching. They cited both the advantages and disadvantages of their experience. We then categorized their attitudes to reflect different aspects of their experience (see Table 4). The lecturers often reported certain aspects as both advantages and disadvantages of online teaching, as explained in the following and presented in Fig 3. In the pre-questionnaire, only four lecturers (9%) found no advantages in online teaching. Forty-two respondents (92%) mentioned that online teaching had advantages and made 61 statements about its teaching advantages. Eighty-nine lecturers completed the post-questionnaire. Fourteen of them (16%) found no advantages in online teaching; 75 respondents (84%) thought that online teaching had advantages, and made 127 statements regarding the advantages, divided into categories.
In contrast to the finding that only some lecturers found no advantages in online teaching, all the lecturers mentioned negative aspects regarding online teaching (95 statements in the pre questionnaire, and 155 statements in the post-questionnaire).
Some of these aspects in the pre questionnaire concerned only the lecturer, others only the students, but most were concerned both. The main negative factor in distance learning was the difficulty maintaining lecturer-student interaction, mentioned by 37% of the lecturers. This disadvantage had several aspects: difficulty maintaining lecturer-student contact, lack of the students’ physical presence, lack of group work and peer learning, difficulty in remote communication, and the absence of body language and feedback, making communication even more difficult. Another significant negative aspect was the difficulty that the lecturers had with techno-pedagogical knowledge (TPK). They were used to applying a specific pedagogy in face-to-face teaching and mentioned that under the new circumstances, they would not be able to conduct discussions and respond to questions during the lectures.
However, after having experienced online teaching over the semester, the lecturers indicated that the number of disadvantages mentioned had increased. Again, the main negative factor concerned the interaction between lecturers and students. However, in the post-questionnaire, the lecturers mentioned negative factors categorized as techno-pedagogical knowledge (TPK). They indicated that the changed teaching mode and the difficulty in evaluating students’ understanding hindered distance teaching and learning. The difficult interaction with the students may also constitute an emotional disadvantage. Interestingly, the number of lecturers who found no advantage in online teaching increased in the post-questionnaire. After having experienced online teaching, about 16% of the post-questionnaire respondents indicated that they found no advantage in distance learning.
The main aspect mentioned in both the pre-and post-questionnaires as promoting distance teaching and learning concerned the learning environment and included techno-pedagogical advantages related to students. Quite a few lecturers noted that distance learning was more convenient since it was not location-dependent, it was flexible in terms of time and did not require commuting. From the techno-pedagogical perspective, the online learning materials and asynchronous learning provided students with a different learning experience and served as significant promoters of learning.
A positive aspect of distance learning that emerged as particularly relevant to the Covid-19 crisis concerned learning continuity. In both questionnaires, the lecturers indicated that the mere existence of the distance teaching option was a significant advantage in itself; had it not been for this technology, none of the courses would have been taught at all.
Discussion
In the discussion, we provide answers to the research questions and discuss the results.
1) What variables contribute to developing lecturers’ perceived self-efficacy in online teaching?
In online teaching, self-efficacy beliefs consist of two aspects: (1) self-efficacy in teaching in an online environment and (2) the belief that technology promotes teaching and learning [34, 35, 53]. The present study measured these aspects before and after a whole semester of online teaching. No significant difference in lecturers’ self-efficacy in online teaching emerged between the administration of the pre-and post-questionnaires. However, the literature reports that experience helps develop a sense of self-efficacy [54]. A possible explanation for this may be that developing self-efficacy in teaching, specifically in online teaching, is a process that occurs over a long time [30, 40], whereas in the present case, the lecturers had to develop online teaching skills over a single semester. Namely, the one-semester Covid-19 teaching experience was insufficient to influence their self-efficacy beliefs. Another possible explanation is that to develop a sense of self-efficacy, one must consider an experience as favorable, as is discussed next. This results are similar to what was found in a study that investigated instructional changes of higher education lecturers from 201 institutions regarding online teaching and learning [55], that have found only small changes in beliefs about online teaching.
As shown in Fig 1, the lecturers’ satisfaction with online teaching, their views about students’ participation and engagement, and their perception that technology promotes interactions are highly and significantly correlated with their perceived self-efficacy in implementing technology in teaching. In addition, the lecturers’ satisfaction with online teaching and their perception that technology can promote interactions are significantly (but moderately) correlated with the lecturers’ belief that technology can promote teaching.
The correlations presented in Fig 1 are derived from the existing psychological literature on self-efficacy. Namely, they consist of two components [53]. Next, we compare these correlations to the findings of the qualitative analysis.
Satisfaction with online teaching and the belief that technology promotes learning
The correlations presented in Fig 1 indicate that satisfaction with online teaching is correlated with the belief that technology promotes teaching. The qualitative analysis revealed that at the end of the semester, after having experienced online teaching, about 16% of the lecturers did not find any factors that promoted learning in an online environment. They also identified more negative than positive aspects regarding teaching in a technological environment. This means that the lecturers’ satisfaction with online teaching was low. This could lead to a low belief in the ability of technology to promote teaching.
Analysis of the negative aspects mentioned by the lecturers revealed that 37% of them were concerned with the limited interaction between lecturers and students and among the student body. Research literature dealing with online teaching mentions that one important reason why lecturers favor online teaching is their impression that it makes the students more engaged in interactive communication with the lecturers and their co-learners [56, 57]. A connection emerged between the lecturers’ satisfaction and better student performance and a correlation between the lecturers’ and the students’ satisfaction with online courses. Various factors may affect student satisfaction, including lecturer-student interaction, learner-content interaction [58], and self-efficacy in using the internet [59, 60]. Students also mentioned convenience as a reason for their satisfaction with an online course, whereas the lack of interaction had the greatest effect on their dissatisfaction [61]. The higher the self-efficacy in technology-based learning, the higher was the satisfaction with an online course, and vice versa [62].
Under the circumstances of Covid-19, the need arose to switch to online teaching to overcome the emergency measures caused by the pandemic [7]. This switch required speedy learning of online teaching tools and the skills necessary to use them. In this situation, both the lecturers and students faced numerous challenges, making it more challenging to generate and maintain satisfaction than under normal conditions. Weidlich and Kalz (2021) [63] applied the resilience perspective to the experiences of the higher education lecturers. They found that the shift to online teaching and learning at higher education institutes, upon the outbreak of Covid-19, was influenced by the personality traits of the lecturers, as well as their previous experience. These variables supported their resilience and their ability to maintain quality teaching despite the challenges brought about by the pandemic. These results support the current study because self-efficacy beliefs were positively connected to resilience (e.g., [64]).
The variables “Technology promotes interactions”, “Student participation and engagement”, and “Belief in self-efficacy in online teaching”
The present research findings indicate that personal experience and environmental feedback are correlated with self-efficacy in technology-supported teaching, thus in agreement with the self-efficacy framework [10, 31]. Interaction emerged as an important variable in distance teaching, given the physical distance between the lecturer and learner [65]. As already mentioned, interaction (or the lack of it) emerged as a central disadvantage of the online learning, much like the extent of student engagement. This aspect is essential in the context of online learning since online teaching and learning could reduce student engagement [66]. When such factors inhibit learning, the lecturers have a negative teaching experience that undermines their belief in their ability to teach online. Evidence from similar studies that investigated teachers’ self-efficacy in technology-based teaching and learning supports these findings [31, 35, 67].
2) Which TPACK components did higher education science lecturers implement in online teaching?
The current study revealed that the lecturers made significant efforts to acquire varied knowledge upon switching to online teaching. After categorizing the bodies of knowledge they had implemented according to the TPACK framework, we discovered that the main effort concerned learning and implementing TK and TPCK (Fig 2). The trend emerged with regard to TPK, and the number of lecturers who implemented such knowledge in their teaching increased. Whereas the effort concerned TK described. Very few lecturers indicated that they made an effort to integrate technological-pedagogical content (TPACK, Fig 2) both before the semester began and at its end. A similar picture emerged in mapping the specific types of knowledge that the lecturers stated that they had lacked. The analysis revealed that the lecturers had been focusing on learning the technologies required for online teaching (TK), as well as ways to use the emerging technologies as pedagogical tools (TPK) in teaching (in particular, to generate interaction). Very few lecturers described how they used technological tools to enhance the learning of certain scientific content (TPACK) in their courses. Moreover, the lecturers seldom mentioned any need to learn or implement such tools. A full implementation of the TAPCK requires rethinking about the course content and pedagogy in light of the applied technology and was rarely detected in the current study. Similar results were obtained in a study that investigated instructional changes investigated by university faculty during the Covid-19 pandemic [55]. They have applied the Puentedura’s Substitution-Augmentation-Modification-Redefinition (SAMR) model analyzed the level of instructional changes made by faculty [68]. Their analysis reveal that “university educators, on average, converted their existing courses to online courses with some functional improvements (Augmentation) and a modest revision of critical course redesign components (Modification), without quite reaching the level of creating new tasks that were previously inconceivable (Redefinition). This level of change may be regarded as a substantial outcome given that educators were required to create online courses in a short period of time and without much preparation or assistance.” [53, p. 13].
Lecturers at the institutes of higher education are experts in content knowledge (CK) and have experience in lecture-based teaching (PK). However, even those lecturers with many years of teaching experience are novices regarding online teaching. Analysis of the results revealed that the lecturers initially focused on learning how to use the technological tools (TK) in order to be able to teach their course (for example, using Zoom). Discussions have been underway at the Weizmann Institute about the need to learn how to use the learning management system Moodle, which the Institute lecturers do not universally use. Moodle is extensively used worldwide, with over 212 million users (stats.moodle.org). The system’s Hebrew version is in broad use in Israel’s institutes of higher education and at the high-school level [69] since it addresses the needs of both administrators and educators [70]. Given the need that arose during the covid pandemic, the Moodle system was made available for use by all of the Institute’s lecturers starting in the 2021 academic year.
During the semester, the lecturers said they sensed a lack of contact with the students and had little interaction that required learning and implementing the techno-pedagogical (TPK) knowledge. To resolve this problem, the lecturers resorted to using technological tools such as conducting polls or learning in small groups using the “breakout rooms” option in a way to make the students more engaged in the process. They identified the importance of being socially present in an online course, defined as vital in various studies of learning in online environments as was reported in previous studies [71, 72]. They also pointed out the difficulty of engaging students in learning under the extraordinarily difficult conditions of the Covid-19 pandemic. Oliveira et al. (2021) [73], who conducted a study regarding ICT platforms during the pandemic, found that the experience of using the ICT platforms was generally positive. However, both students and lecturers negatively perceived the need for personal adaptations [73]. Under these pandemic conditions, lecturers had to learn to implement different knowledge, which we termed “emotional support” [74]. This difficulty has repeatedly appeared in numerous articles dealing with online teaching under Covid-19 conditions [75]. Although emotional presence occurs spontaneously in frontal teaching, in an online course, it is only possible if the lecturer makes a specific effort. It is a vital component of online learning [74].
As online teaching novices, very few lecturers have time to spare to learn and implement technological tools capable of promoting the teaching of their specific course (i.e., TPACK knowledge). Moreover, they even fail to mention this body of knowledge as lacking. In their learning of online teaching, the Weizmann Institute lecturers began by acquiring the most general technological knowledge (TK). Then, they applied those tools to their pedagogy, namely, using techno-pedagogical knowledge (TPK). Finally, they implemented tools that responded to their students’ socio-emotional state of mind during this crisis period. Interestingly, similar findings were reported before the pandemic [49] and they also emerged in a study conducted during the pandemic in China, which investigated how Chinese universities prepared for distance learning during the Covid-19 crisis [76]. Lecturers in China’s top universities also focused on the technical aspects of transitioning to an online environment rather than on the pedagogy of online teaching of course content. The situation in the UK was similar, where rapid online immigration interfered with the pedagogical performance and the personal lives of lecturers [77]. These findings significantly contribute to the research about TPACK in institutes of higher education.
We assume that the lecturers’ way of transforming their course to an online platform also affected their different learning bodies of knowledge. The Weizmann Institute lecturers had the option of participating in two online sessions given by the first author of this article, which offered guidance in using Zoom for online teaching, as was done in other places around the world [42, 43]. This should be followed by learning and implementing technological tools in content teaching. To this end, we recommend holding online teaching sessions for specialized groups of lecturers teaching the same field of knowledge (for example, mathematics or life sciences). As was shown in different studies during the pandemic that teaching each of the disciplines requires specific understanding of technology that can be applied for teaching (e.g., mathematics teaching during the pandemic [78]. In such sessions, the TPACK body of knowledge would interest all the group members; this could promote learning this complex knowledge and its implementation at the Weizmann Institute.
Research limitations
The study had limitations regarding the quantitative part of the research. Although we included more than 50% of the lecturers in the second semester, the number of lecturers (46 in the pre, 89 in the post) who filled out the questionnaire was not high. We, therefore, present here a correlation analysis rather than a more advanced statistical analysis. In addition, we used an unequal sample size in the pre-and the post-samples. This is important if certain assumptions are not met, such as homoscedasticity, but these are irrelevant in Wilcoxon tests. Namely, the sample sizes do not have to be similar in this case.
Owing to economic reasons during the pandemic, short scales were applied to the questionnaire’s items. We hope that the results will serve as a basis for further research and advanced statistical analysis.
Research implication
Pokhrel and Chhetri (2021), who reviewed the challenges and opportunities in higher education during the pandemic, suggest that “The Covid-19 pandemic has provided us with an opportunity to pave the way for introducing digital learning.” [79, p. 133]. In this study, we drew conclusions and learned lessons that can be applied more generally from this pandemic to improve online teaching in higher education institutions. The evaluation of lecturers’ TPACK and self-efficacy can assist in the future design of professional development programs for online teaching in higher education. Specifically, we identified the need for graduate science training programs to integrate the TPACK components. In addition, weidentified the need to advance the professional development of lecturers in online teaching, specifically, the need to support the development of self-efficacy for online teaching in higher education.
Pajares (1992) argued that knowledge and belief are intertwined [80]. This is supported by a number of past studies that found a link between TPACK and a sense of self-efficacy among teachers and emphasized the importance of the teachers’ feelings about the integration of technologies. Joo et al, for example, showed that TPACK may influence the self-efficacy beliefs of teachers and indicated that this consequently affects the integration of technology [81]. Another study pointed to TPACK as predicting the sense of self-efficacy for integrating technology in teaching among preservice teachers [82]. However, in this research our focus was on the individual contribution of each theory (TPACK and self-efficacy) to the overall teaching experience. Future research could examine their mutual effect and examine, for example, whether acquiring TPACK correlates with the level of self-efficacy.
Nowadays, the need for such professional development programs for higher education lecturers is stronger than ever. Although some countries are experiencing some sort of return to normal, most higher education institutions are still shifting back and forth between in-person and online teaching or integrating some kind of hybrid model. Furthermore, going forward, many academic institutions are considering integrating online and hybrid education as their default model. This reality stresses the need to rethink the existing teaching methods as well as the growing importance of introducing online teaching methods in professional development training. Our findings can contribute to the development of more efficient professional development and training regarding online teaching.
Conclusion
Here, we identified the specific knowledge and skills required to teach in institutes of science higher education under the current difficult circumstances of Covid-19, and we examined factors that might help to develop self-efficacy in technology-based instruction. Note that these findings reflect the situation during an ongoing emergency but could be applicable to online instruction in general [7]. In future research of online teaching in higher education institutes, one should distinguish between the general characteristics of online teaching and specific phenomena that emerged during this time, as a result of the pandemic, for example. Lecturers should receive guidance to facilitate their gradual learning of knowledge and skills required for emergency online teaching. Special attention should be given to identify the best way to obtain this knowledge in a way that will include attention to lecturers’ attitudes and that will support the development of self-efficacy for online teaching, since knowledge and self-efficacy together can improve online teaching, and both are vital both under routine circumstances and during an emergency.
Supporting information
S1 Table. Wilcoxon two-sample test for non-paired pre-and post-comparisons.
https://doi.org/10.1371/journal.pone.0275459.s001
(PDF)
S2 Table. Descriptive statistics of quantitative research variables means and standard deviation.
https://doi.org/10.1371/journal.pone.0275459.s002
(PDF)
S3 Table. Correlation (Pearson test) between quantitative variables in the pre-questionnaire.
https://doi.org/10.1371/journal.pone.0275459.s003
(PDF)
S4 Table. Correlation (Pearson test) between quantitative variables in the post-questionnaire.
https://doi.org/10.1371/journal.pone.0275459.s004
(PDF)
References
- 1.
Fullan M, Stiegelbauer S. The new meaning of educational change. New York: Teachers College Press; 1991.
- 2. Kahveci A, Gilmer PJ, Southerland SA. Understanding chemistry professors’ use of educational technologies: An activity theoretical approach. International Journal of Science Education. 2008;30(3):325–51.
- 3. Johnson L, Becker SA, Estrada V, Freeman A. NMC horizon report: 2014 K. The New Media Consortium; 2014.
- 4. De Waard I, Koutropoulos A, Hogue RJ, Abajian SC, Keskin NÖ, Rodriguez CO, et al. Merging MOOC and mLearning for increased learner interactions. International Journal of Mobile and Blended Learning (IJMBL). 2012;4(4):34–46.
- 5. Goldschmidt R. Online academic learning and its acknowledgment. The Knesset Research and Information Center. (In Hebrew) 2013. Available from: http://m.knesset.gov.il/Activity/Info/MMM/Pages/document.aspx?docId=CAS-56772-R8B5C0.
- 6. Feldman-Maggor Y, Rom A, Tuvi-Arad I. Integration of open educational resources in undergraduate chemistry teaching–a mapping tool and lecturers’ considerations. Chemistry Education Research and Practice. 2016;17(2):283–95.
- 7. Hodges C, Moore S, Lockee B, Trust T, Bond A. The difference between emergency remote teaching and online learning. Educause review. 2020;27:1–12.
- 8.
Gess-Newsome J. A model of teacher professional knowledge and skill including PCK: results of the thinking from the PCK summit. In: Berry A, Friedrichsen PJ, Loughran JJ, editors. Re-examining pedagogical content knowledge in science education. New York, NY: Routledge; 2015. p. 28–42.
- 9. Mishra P, Koehler MJ. Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record. 2006;108(6):1017–54.
- 10.
Bandura A. Self-efficacy: The exercise of control. New York, NY: Freeman; 1987.
- 11. Shulman LS. Knowledge and teaching–foundations of the new reform. Harvard Educational Review. 1987;57:1–22.
- 12. Archambault LM, Barnett JH. Revisiting technological pedagogical content knowledge: Exploring the TPACK framework. Computers & Education. 2010;55(4):1656–62.
- 13. Shulman LS. Those who understand: Knowledge growth in teaching. Educational Researcher. 1986;15:4–14.
- 14. Tuvi-Arad I, Blonder R. Technology in the service of pedagogy: Teaching with chemistry databases. Israel Journal of Chemistry. 2019;59(6–7):572–82.
- 15. Cox S, Graham CR. Diagramming TPACK in practice: Using an elaborated model of the TPACK framework to analyze and depict teacher knowledge. TechTrends. 2009;53(5):60.
- 16. Voogt J, Fisser P, Pareja Roblin N, Tondeur J, van Braak J. Technological pedagogical content knowledge–a review of the literature. Journal of Computer Assisted Learning. 2013;29(2):109–21.
- 17. Angeli C, Valanides N. Epistemological and methodological issues for the conceptualization, development, and assessment of ICT–TPCK: Advances in technological pedagogical content knowledge (TPCK). Computers & Education. 2009;52(1):154–68.
- 18. Jimoyiannis A. Designing and implementing an integrated technological pedagogical science knowledge framework for science teachers professional development. Computers & Education. 2010;55(3):1259–69.
- 19. Lee T-H, Shen P-D, Tsai CW. Enhance low-achieving students’ learning involvement in Taiwan’s higher education: an approach via e-learning with problem-based learning and self-regulated learning. Teaching in Higher Education. 2010;15(5):553–65.
- 20. Niess ML. Preparing teachers to teach science and mathematics with technology: Developing a technology pedagogical content knowledge. Teaching and Teacher Education. 2005;21(5):509–23.
- 21. Koehler MJ, Mishra P, Yahya K. Tracing the development of teacher knowledge in a design seminar: Integrating content, pedagogy and technology. Computers & Education. 2007;49(3):740–62.
- 22. Valtonen T, Leppänen U, Hyypiä M, Sointu E, Smits A, Tondeur J. Fresh perspectives on TPACK: pre-service teachers’ own appraisal of their challenging and confident TPACK areas. Education and Information Technologies. 2020;25(4):2823–42.
- 23. Graham CR. Theoretical considerations for understanding technological pedagogical content knowledge (TPACK). Computers & Education. 2011;57(3):1953–60.
- 24. Herring MC, Koehler MJ, Mishra P, editors. Handbook of Technological Pedagogical Content Knowledge (TPACK) for Educators Routledge; 2016.
- 25. Rienties B, Brouwer N, Bohle Carbonell K, Townsend D, Rozendal A-P, van der Loo J, et al. Online training of TPACK skills of higher education scholars: a cross-institutional impact study. European Journal of Teacher Education. 2013;36(4):480–95.
- 26. Brinkley-Etzkorn KE. Learning to teach online: Measuring the influence of faculty development training on teaching effectiveness through a TPACK lens. The Internet and Higher Education. 2018;38:28–35.
- 27. Maor D. Using TPACK to develop digital pedagogues: a higher education experience. Journal of Computers in Education. 2017;4(1):71–86.
- 28. Tuvi-Arad I. Computational chemistry in the undergraduate classroom –Pedagogical considerations and teaching challenges. Israel Journal of Chemistry. 2022;62(1–2):e202100042.
- 29. Chai C-S, Koh JH-L, Tsai C-C. A review of technological pedagogical content knowledge. Educational Technology & Society. 2013;16(2):31–51.
- 30. Bandura A. The explanatory and predictive scope of self-efficacy theory. Journal of Social and Clinical Psychology. 1986;4:359–73.
- 31. Usher EL, Pajares F. Sources of self-efficacy in school: Critical review of the literature and future directions. Review of Educational Research. 2008;78:751–96.
- 32. Skinner EA, 71, 549–570. A guide to constructs of control. Journal of Personality and Social Psychology. 1996;71:549–70.
- 33. Gibson S, Dembo MH. Teacher efficacy: A construct validation. Journal of Educational Psychology. 1984;76:569–82.
- 34.
Blonder R, Benny N, Jones MG. Teaching self-efficacy of science teachers. In: Evans RH, Luft J, Czerniak C, Pea C, editors. The role of science teachers’ beliefs in international classrooms: From teacher actions to student learning. Rotterdam: Sense Publishers; 2014. p. 3–15.
- 35. Blonder R, Rap S. I like Facebook: Exploring Israeli high school chemistry teachers’ TPACK and self-efficacy beliefs. Education and Information Technologies. 2017;22(2):697–724.
- 36. Albion PR. Self-efficacy beliefs as an indicator of teachers’ preparedness for teaching with technology. In: Price JD, Willis J, Willis DA, Jost M, Boger-Mehall S, editors. Society for Information Technology & Teacher Education International Conference 1999: Association for the Advancement of Computing in Education (AACE); 1999. p. 1602–8.
- 37. Tschannen-Moran M, Hoy Woolfolk A. Teacher efficacy: capturing an elusive construct. Teaching and Teacher Education. 2001;17(7):783–805.
- 38. Ertmer PA, Ottenbreit-Leftwich AT. Teacher technology change: How knowledge, confidence, beliefs, and culture intersect. Journal of Research on Technology in Education. 2010;42(3):255–84.
- 39. Blonder R, Jonatan M, Bar-Dov Z, Benny N, Rap S, Sakhnini S. Can You Tube it? Providing chemistry teachers with technological tools and enhancing their efficacy beliefs. Chemistry Education Research and Practice. 2013;14:269–85.
- 40. Topkaya EZ. Pre-service English language teachers’ perceptions of computer self-efficacy and general self-efficacy. Turkish Online Journal of Educational Technology-TOJET. 2021;9(1):143–56.
- 41. UNESCO. UNESCO, COVID-19 Educational disruption and response. 2020. Available from: https://en.unesco.org/themes/education-emergencies/coronavirus-school-closures.
- 42. Stafford V. EdTech review: Teaching through Zoom–what we’ve learned as new online educators. Journal of Applied Learning & Teaching. 2020;3(2):1–4.
- 43. Crawford J, Butler-Henderson K, Rudolph J, Malkawi B, Glowatz M, Burton R, et al. COVID-19: 20 countries’ higher education intra-period digital pedagogy responses. Journal of Applied Learning & Teaching. 2020;3(1):8–28.
- 44. Almaiah MA, Al-Khasawneh A, Althunibat A. Exploring the critical challenges and factors influencing the E-learning system usage during COVID-19 pandemic. Education and Information Technologies. 2020;25(6):5261–80. pmid:32837229
- 45. Rap S, Feldman-Maggor Y, Aviran E, Shvarts-Serebro I, Easa E, Yonai E, et al. An applied research-based approach to support chemistry teachers during the COVID-19 pandemic. Journal of Chemical Education. 2020;79(9):3278–84. pmid:32952213
- 46.
Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. 2 ed. U.S.A: SAGE; 2011.
- 47. Xiao C, Ye J, Esteves RM, Rong C. Using Spearman’s correlation coefficients for exploratory data analysis on big dataset. Concurrency and Computation: Practice and Experience. 2016;28(14):3866–78.
- 48.
Glesne C. Becoming qualitative researchers: An introduction. 3rd ed. New York: Pearson Education, Inc.; 2006.
- 49. Graham CR, Borup J, Smith NB. Using TPACK as a framework to understand teacher candidates’ technology integration decisions. Journal of Computer Assisted Learning. 2012;28(6):530–46.
- 50. Chi MTH. Quantifying qualitative analyses of verbal data: A practical guide. The Journal of the Learning Sciences. 1997;6(3):271–315.
- 51. Gläser-Zikuda M, Järvelä S. Application of qualitative and quantitative methods to enrich understanding of emotional and motivational aspects of learning. International Journal of Educational Research. 2008;47(2):79–83.
- 52. Yonai E, Shimoni E, Kahil K, Blonder R. Authentic science learning during COVID-19: The adaptive design of a SEM outreach activity. The Biophysicist. 2022.
- 53. Enochs LG, Riggs IM. Further development of an elementary science teaching efficacy belief instrument: A preservice elementary scale. School Science and Mathematics. 1990;90(8):694–706.
- 54. Ropp MM. Exploring Individual Characteristics Associated with Learning to Use Computers in Preservice Teacher Preparation. Journal of Research on Computing in Education. 1999;31(4):402–24.
- 55. Lee J, Jung I. Instructional changes instigated by university faculty during the COVID-19 pandemic: the effect of individual, course and institutional factors. International Journal of Educational Technology in Higher Education. 2021;18(1):52. pmid:34778539
- 56. Hartman J, Dziuban C, Moskal P. Faculty satisfaction in ALNs: A dependent or independent variable. Journal of Asynchronous Learning Networks. 2000;4(3):155–79.
- 57. Fredericksen E, Pickett A, Shea P, Pelz W, Swan K. Factors influencing faculty satisfaction with asynchronous teaching and learning in the SUNY learning network. Online Learning Journal (OLJ). 2000.
- 58. Feldman-Maggor Y, Blonder R, Tuvi-Arad I. Let them choose: Optional assignments and online learning patterns as predictors of success in online general chemistry courses. The Internet and Higher Education. 2022;55:100867.
- 59. Kuo Y-C, Walker AE, Belland BR, Schroder KEE. A predictive study of student satisfaction in online education programs. The International Review of Research in Open and Distributed Learning. 2013;14(1):16–39.
- 60. Chu RJ, Chu AZ. Multi-level analysis of peer support, Internet self-efficacy and e-learning outcomes–The contextual effects of collectivism and group potency. Computers & Education. 2010;55(1):145–54.
- 61. Cole MT, Shelley DJ, Swartz LB. Online instruction, e-learning, and student satisfaction: A three year study The International Review of Research in Open and Distributed Learning. 2014;15.
- 62. Artino AR. Motivational beliefs and perceptions of instructional quality: predicting satisfaction with online training*. Journal of Computer Assisted Learning. 2008;24(3):260–70.
- 63. Weidlich J, Kalz M. Exploring predictors of instructional resilience during emergency remote teaching in higher education. International Journal of Educational Technology in Higher Education. 2021;18(1):43. pmid:34778533
- 64.
Schwarzer R, Warner LM. Perceived self-efficacy and its relationship to resilience. In: Prince-Embury S, Saklofske DH, editors. Resilience in Children, Adolescents, and Adults: Translating Research into Practice. New York, NY: Springer New York; 2013. p. 139–50.
- 65.
Moore MG, Kearsley GG. Distance education: A system view. New York, NY: Wadsworth; 1996.
- 66. Tsay CH-H, Kofinas AK, Trivedi SK, Yang Y. Overcoming the novelty effect in online gamified learning systems: An empirical evaluation of student engagement and performance. Journal of Computer Assisted Learning. 2020;36(2):128–46.
- 67. Zimmerman BJ. Self-efficacy: An essential motive to learn. Contemporary Educational Psychology. 2000;25(1):82–91. pmid:10620383
- 68.
Puentedura R. 2006. Available from: http://hippasus.com/resources/tte/.
- 69.
Aviran E, Easa E, Livne S, Blonder R. Implementation of a personalized online learning system towards creating hybrid learning and teaching in chemistry classes. In: Glick D, Cohen A, Chang C, editors. Early warning systems and targeted interventions for student success in online courses: IGI Global; 2020. p. 90–110.
- 70. Kotzer S, Elran Y. Development of E-Learning environments combining learning skills and science and technology content for junior high school. Procedia—Social and Behavioral Sciences. 2011;11:175–9.
- 71. Garrison DR, Anderson T, Archer W. Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education. 1999;2(2–3):87–105.
- 72. Rap S, Blonder R. Let’s Face(book) it: Analyzing interactions in social network groups for chemistry learning. Journal of Science Education and Technology. 2016;21(1):62–76.
- 73. Oliveira G, Grenha Teixeira J, Torres A, Morais C. An exploratory study on the emergency remote education experience of higher education students and teachers during the COVID-19 pandemic. British Journal of Educational Technology. 2021;52(4):1357–76. pmid:34219758
- 74. Cleveland-Innes M, Campbell P. Emotional presence, learning, and the online learning environment. The International Review of Research in Open and Distributed Learning. 2012;13(4):269–92.
- 75. Darling-Hammond L, Hyler ME. Preparing educators for the time of COVID … and beyond. European Journal of Teacher Education. 2020;43(4):457–65.
- 76.
Wu Z. How a top Chinese university is responding to coronavirus. https://wwwweforumorg/agenda/2020/03/coronavirus-china-the-challenges-of-online-learning-for-universities. 2020.
- 77. Watermeyer R, Crick T, Knight C, Goodall J. COVID-19 and digital disruption in UK universities: afflictions and affordances of emergency online migration. Higher Education. 2021;81(3):623–41. pmid:32836334
- 78. Ní Fhloinn E, Fitzmaurice O. How and why? Technology and practices used by university mathematics lecturers for emergency remote teaching during the COVID-19 pandemic. Teaching Mathematics and its Applications: An International Journal of the IMA. 2021;40(4):392–416.
- 79. Pokhrel S, Chhetri R. A Literature Review on Impact of COVID-19 Pandemic on Teaching and Learning. Higher Education for the Future. 2021;8(1):133–41.
- 80. Pajares MF. Teachers’ beliefs and educational research: Cleaning up a messy construct. Review of Educational Research. 1992;62(3):307–32.
- 81. Joo YJ, Park S, Lim E. Factors influencing preservice teachers’ intention to use technology: TPACK, teacher self-efficacy, and technology acceptance model. Journal of Educational Technology & Society. 2018;21(3):48–59.
- 82. Abbitt JT. An investigation of the relationship between self-efficacy beliefs about technology integration and technological pedagogical content knowledge (TPACK) among preservice teachers. Journal of digital learning in teacher education. 2011;27(4):134–43.