Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Development of a blended MOOC implementation model for English language learning: An interpretive structural modeling approach

  • Anh Tuan Pham ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    anhpt66@fe.edu.vn

    Affiliations Department of Management, Universiti Teknologi PETRONAS, Perak, Malaysia, English Department, FPT University, Can Tho City, Vietnam

  • Muhammad Ridhuan Tony Lim Abdullah

    Roles Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing, Conceptualization

    Affiliation Department of Management, Universiti Teknologi PETRONAS, Perak, Malaysia

Abstract

The integration of Massive Open Online Courses (MOOCs) into traditional English language education has created new opportunities for scalable, flexible, and inclusive learning. However, existing studies on MOOCs and blended learning remain largely descriptive and lack a structured framework that prioritizes key implementation elements for effective integration into formal education. This study develops a structured implementation model for blended MOOCs (bMOOCs) tailored to undergraduate English as a Foreign Language (EFL) instruction. This gap is particularly evident in specific contexts such as Vietnam, where institutional conditions, technological readiness, and learner characteristics significantly influence implementation effectiveness. Using the Interpretive Structural Modelling (ISM), the research identifies and validates 20 key sub-indicators grouped into three interconnected phases: planning, implementation, and evaluation. The model emphasizes the importance of analyzing learners’ backgrounds and motivations, setting clear learning objectives, and selecting appropriate materials and technologies. During implementation, the focus shifts to effective instructional strategies, learner participation, and technical support. The evaluation phase prioritizes formative assessment and timely feedback to promote continuous improvement and engagement. This learner-centered approach addresses common challenges in blended learning environments. The model offers practical guidance for stakeholders in EFL education, such as administrators, educators, and curriculum developers, seeking to enhance English language education through blended MOOCs. Practical implications for the implementation of blended MOOCs in EFL instruction are also addressed to enhance the quality of English language instruction in the digital age.

1. Introduction

Online courses have been widely implemented in educational settings due to advancements in digital technologies [1]. This trend is gaining popularity in developed countries but remains limited in developing contexts due to costs and educational inequalities [2]. High-quality online programmes are often delivered by prestigious institutions such as Harvard, Stanford, Cambridge, and Oxford, which employ effective pedagogical and strategic approaches to enhance educational quality and sustainability [3,4].

Therefore, developing countries are encouraged to adopt online learning modes to improve educational quality [2]. Massive Open Online Courses (MOOCs), introduced by Siemens and Downes in 2008, have played a key role in the transformation of online learning [5]. During the COVID-19 pandemic, MOOCs have become an important alternative to face-to-face instruction and supported the continuation of education during institutional closures [6]. In the post-pandemic period, many institutions have adopted blended learning models that combine online and classroom-based activities [79]. However, concerns about limited interaction and feedback in fully online MOOCs have led to the emergence of blended MOOCs (bMOOCs), which integrate MOOC content into face-to-face classrooms to address these limitations [10,11].

Previous studies report that blended MOOCs can enhance learner–instructor interaction, learner autonomy, and academic performance, indicating their potential to improve engagement and learning outcomes in higher education [12,13,1417]. In EFL education, MOOCs have been widely used to extend language practice beyond the classroom and are considered a useful tool for English language programmes [10,1821]. Research further indicates that MOOC-based blended learning can improve learner engagement, motivation, and course achievement in EFL contexts [2225]. However, despite these benefits, existing studies primarily focus on the effectiveness of MOOCs or blended learning in isolation, with limited attention to how key implementation elements should be systematically structured and prioritized. This lack of a structured implementation framework makes it difficult for institutions to effectively integrate MOOCs into formal teaching practices.

In Vietnam, English is a compulsory subject and an essential skill for academic and professional development [26,27]. However, traditional classrooms face challenges such as large class sizes and limited practice time, which restrict opportunities for meaningful language use [2832]. Although MOOCs provide flexible access to English learning resources, they often lack sufficient interaction and feedback [3336]. Additionally, institutional constraints, technological readiness, and learner characteristics in the Vietnamese context further complicate the effective integration of MOOCs into formal curricula. Blended MOOCs, therefore, present a promising solution for improving learner engagement and language development in EFL education [22,24,25]. Despite growing interest in this approach, there is still a lack of a comprehensive and hierarchical framework that identifies the interrelationships among critical implementation factors, particularly within specific educational contexts such as Vietnam. This study aims to address this gap by proposing a structured blended MOOC implementation model for undergraduate EFL education. Unlike previous studies that primarily focus on individual aspects of MOOCs or blended learning, this study develops a comprehensive and hierarchical implementation model using the ISM and MICMAC approaches. The study uniquely identifies the interrelationships among indicators and classifies them based on driving and dependence power, providing a structured framework for decision-making in EFL blended MOOC contexts.

2. Literature review

2.1. Blended Learning

Blended learning (BL) refers to an instructional approach that combines in-person classroom experiences with online learning components within a single course [37]. Educational institutions have increasingly adopted this model due to its capacity to enhance student engagement, interaction, and persistence when compared to conventional online learning formats [3841]. One of the major strengths of BL is its adaptability, offering benefits to both learners and instructors since it promotes student autonomy, improves academic performance, and helps create a more integrated learning mode between traditional and virtual teaching methods [42].

Additionally, BL enables learners to access a wide range of learning materials at any time and from anywhere, making it easier for them to study at their own pace [43]. For instructors, this mode may help reduce teaching load and create opportunities for more efficient classroom management [44]. Regarding advantages, BL is considered an effective teaching method in higher education contexts [45]. However, there remains a lack of empirical research into how BL is implemented across different academic programs and course types, particularly from the perspective of institutional leaders.

There is also ongoing debate regarding the balance between online and face-to-face instruction. Some suggest a ratio of 30% in-person learning to 70% online [46], while others propose a 20/80 format [44]. These differences highlight the need for more comprehensive guidelines on BL implementation in higher education.

2.2. Blended MOOCs

To improve the quality of university education, blended MOOCs (bMOOCs) have emerged as a promising mode that integrates MOOC instruction with classroom-based one [36]. In a bMOOC setting, educators either design their own digital materials or utilize existing MOOC resources created by experts. This model enhances interaction, supports student-centered learning, facilitates better assessment and feedback, and accounts for diverse learning styles and behavior patterns [36]. Moreover, by shifting some content delivery online, instructors can focus classroom time on discussions and problem-solving activities [47]. However, learners often find this model unfamiliar and are required to take more responsibility for their learning and class engagement [48]. Despite its potential, research on how blended MOOCs can be effectively applied in specific programs such as EFL remains limited.

2.3. Blended MOOCs in English language learning

In the context of English language education, the use of blended MOOCs in EFL classrooms is still underexplored. English, which is a skill-based subject, presents challenges when integrating MOOCs with conventional classrooms [49]. Besides, students with limited English proficiency often struggle to follow online lectures or engage in peer communication, which can result in frustration and a preference for traditional classroom settings [50]. While MOOCs are generally suitable for teaching receptive skills such as listening and reading, they are less effective for productive skills such as writing and speaking, which require more direct teacher involvement and feedback [51,52]. Despite these challenges, blended MOOCs retain their effectiveness in English teaching and learning [22,23,53]. Therefore, more investigation is needed to develop a context-specific implementation framework that addresses these gaps.

2.4. Indicators and sub-indicators for blended MOOC implementation in EFL programs

A comprehensive literature review was conducted to explore the primary indicators for a blended MOOC implementation framework for English courses. To review the indicators for blended MOOC implementation for EFL programmes, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses approach (PRISMA) was employed as guidelines for the selection of indicators, which follows four phases: identification, screening, eligibility, and analysis [54]. The sources included journal articles, conference proceedings, extracted from Google Scholar, Elsevier, and Web of Science, with a publication range from 2014 to 2024. The same string of search words: “MOOCs or Massive Open Online Courses” AND “blended learning or blended classes” AND “EFL or English as a Foreign Language” AND “indicators or sub-indicators or success factors” was used for each of the databases. In Fig 1, this PRISMA flow diagram illustrates the systematic process of selecting articles for a review. Initially, 215 records were identified from databases based on inclusion criteria such as peer-reviewed status, English language, full-text availability, and publication between 2015 and 2024. After screening, 82 duplicate records were excluded, leaving 158 records for further assessment. From these, 76 full-text articles were accessed to determine eligibility. Articles were then excluded if they were not related to MOOCs or blended learning (27 articles), did not focus on higher education (10 articles), or were systematic reviews (6 articles). Finally, 33 articles met all criteria and were included in the final review.

thumbnail
Fig 1. A flow diagram of the study selection based on PRISMA.

https://doi.org/10.1371/journal.pone.0338980.g001

The literature was analysed and synthesized by themes and was then categorized into six key indicators: analysis of learners, objectives, course materials and technology, teaching methodologies, learner participation, and feedback and assessment, with 21 sub-indicators in total.

As blended learning continues to shape the future of English language education, the integration of MOOCs (Massive Open Online Courses) into undergraduate English programs demands a structured and context-sensitive implementation model. Drawing on existing research, this review synthesizes six key indicators and their sub-indicators that underpin the successful integration of blended MOOCs in EFL learning environments: analysis of learners, objectives, course materials and technology, teaching methodologies, learners’ participation, and feedback and assessment.

The first indicator is the “analysis of learners”, which involves understanding students’ backgrounds, motivations, and digital familiarity with MOOCs. Clearly defined learner backgrounds, including age, learning styles, and English proficiency, are essential to tailoring instruction to diverse needs [5558]. In MOOC settings, students’ familiarity with digital platforms also plays a critical role, as low digital literacy can hinder engagement and progress [59,60]. Moreover, intrinsic motivation and goal-setting are strongly associated with learner persistence in online environments [23,33,58], especially in self-directed MOOC models where autonomous learning is essential.

The second indicator focuses on learning “objectives”, which must be measurable and aligned with student proficiency levels. Clear objectives provide a guide for both learners and instructors, directing the selection of materials and assessments [10,61]. In blended MOOC environments, it is also crucial that learning outcomes are achievable within a defined timeframe [62,63] and aligned with learner needs and abilities [64], allowing for realistic goal-setting and meaningful progress.

“Course materials and technology” is the third indicator, which addresses both access and pedagogical relevance. The availability of MOOCs through learning management systems (LMS), social platforms, and open resources enhances flexibility and accessibility [10,65]. However, materials must also be linguistically appropriate and engaging. Studies emphasize the importance of using various teaching content, such as videos, quizzes, and readings, which support different English language skills and learner preferences [23,33].

“Teaching methodologies” then highlights the importance of balancing online self-paced activities with offline mentoring [36,66]. Blended instruction in EFL contexts must also draw from effective language teaching methods [22,67] and incorporate multimedia and interactive tools to support comprehension [68]. Learning support mechanisms, such as technical or academic support, are essential for maintaining learner engagement in digital environments with MOOCs [69,70].

“Learners’ participation” is critical for engagement and interactions. Regular interaction with peers and instructors enhances motivation and learning outcomes [67,71]. Offline mentoring sessions [72], collaborative learning activities [12], and self-regulation skills [73,74] are all important indicators of active participation in blended models.

Lastly, the indicator “feedback and assessment” plays a central role in monitoring progress and evaluation. Effective MOOC-based EFL instruction includes both formative and summative assessment strategies [71,75] and offers feedback through peer, instructor, or automated systems [67]. Instant feedback can inform syllabus revisions [76], while offline final exams may be used to assess learning outcomes [77,78], particularly in formal university settings Table 1. In general, these six indicators provide a comprehensive framework for designing and evaluating blended MOOC implementation in undergraduate English learning.

thumbnail
Table 1. The proposed indicators and sub-indicators for a blended MOOC implementation model for English Learning.

https://doi.org/10.1371/journal.pone.0338980.t001

3. Methodology

The development of a blended MOOC implementation model is based on the integrated view and experts’ decisions, so interpretive structural modeling (ISM) was employed in this study to develop the model. Accompanied by ISM, the Fuzzy Delphi method was initially applied to assess the indicators and sub-indicators for blended MOOC implementation. ISM is used to examine the relationships among blended MOOC indicators and sub-indicators as well as a structural model based on the relationships for blended MOOC implementation for an undergraduate EFL programme. ISM was developed by Warfield to analyze and solve complex issues in socio-economics [83]. However, past studies also proved that ISM was widely used in the fields of knowledge management, engineering, and information systems [8487]. In higher education, ISM was also adopted to tackle the issues related to technical and social education [88,89]. ISM is useful to help the participants in groups structure their views and others to reach a consensus through a mathematical language application, such as words, diagrams, and mathematics [90]. Therefore, in this study, the employment of ISM to develop a blended MOOC implementation model for undergraduate EFL learning is applicable.

In the decision-making process, the Fuzzy Delphi method was employed. 15 selected experts were involved to give opinions on the importance of the indicators and sub-indicators through online questionnaires. In this study, one round of the FDM was conducted, as consensus among the experts was achieved in the first round. The level of agreement was determined based on predefined threshold criteria, including the threshold value (d ≤ 0.2) and the agreement level (A ≥ 0.5). Since all indicators satisfied these conditions, no additional rounds were required.

Ethical approval for the study was granted by the Research Ethics Committee of FPT University under reference number 20250205.02. Written informed consent was obtained from all participants via a self-administered online questionnaire. Participants were assured that their responses would be used solely for research purposes, and all data were handled with strict confidentiality throughout the study. The qualified experts must have experience in the related fields of MOOC and blended learning. The selection of experts should follow the criteria [91]: 1) The experts should have good knowledge of the topic being studied, 2) They should have experience working in the field, with at least five years of related experience, 3) The experts need to be fully committed and take part in the study until it is completed, and 4) There should be no personal connection or interest that could affect their opinions or cause bias in the study. The experts included diverse stakeholders, such as administrators, lecturers, curriculum developers, ICT engineers, MOOC instructors, and EFL undergraduates. Although experts should have rich experience in working with MOOCs, the undergraduate students were considered experts as their voices and experience were valuable, and they are the main users of MOOC-based blended learning, so their perspectives provide practical knowledge about learning experiences that may not be fully captured by administrators or lecturers alone [92]. In this study, undergraduate participants were therefore treated as experiential contributors whose views reflected real learner interaction with MOOCs, platform usability, motivation, and assessment practices.

The experts’ demographic information is displayed in Table 2.

Data collection procedures were carried out at the studied institution from August 10, 2024 to May 25, 2025, including surveys and interviews. The data were analyzed based on 5 steps, as in Fig 2.

  1. Step 1: Identifying the indicators through Fuzzy Delphi method (FDM)

To assess the indicators for a blended MOOC implementation model for English language learning, the Fuzzy Delphi Method (FDM) was chosen due to its effectiveness in minimizing subjectivity and ambiguity while promoting agreement among experts. This method is frequently employed to identify relevant ideas or variables linked to a particular issue or challenge. Originally introduced by Kaufmann and Gupta, FDM is a well-regarded tool in decision-making processes [93]. It combines elements from fuzzy set theory and the traditional Delphi method [94]. Essentially, FDM merges the structured, iterative process of the Delphi technique with the flexibility of fuzzy logic to support more accurate expert judgment. The FDM itself relies on multiple rounds of surveys to gather and refine expert opinions on a specific topic [95]. By integrating fuzzy logic, FDM enables experts to express their views in a more nuanced way, beyond simple yes/no answers, making it especially useful for exploring the complex needs involved in implementing blended MOOCs for English language education. The FDM involves several steps: from identifying indicators taken from the literature to assessing these indicators based on fuzzy logic. The defuzzification value (A) was used to rank the indicators, following the formula: A = 1/3*(m1 + m2 + m3). The assessment of the indicators and sub-indicators was based on a 7-point Likert scale questionnaire (between 1 = extremely not important and 7 = extremely important). The linguistic scale was employed to compute the data (see Table 3). To examine whether an indicator is accepted, the threshold value of consensus is achieved through d and is used to measure agreement between the evaluations made by the experts. The consensus value should have a cut point of 0.2 or below to define group consensus. However, the total consensus must exceed 75% for validation purposes [96,97]. If this threshold is not met, additional rounds of FDM are required to achieve satisfactory agreement among the experts. Therefore, the 75% consensus level in obtaining the results ensures that the findings are reliable and valid.

thumbnail
Table 3. The linguistic scale for the fuzzy Delphi method questionnaire.

https://doi.org/10.1371/journal.pone.0338980.t003

  1. Step 2: Determining the contextual relationship phrase and relation phrase

The experts identified and agreed upon the contextual relationship phrase “In order to develop a blended MOOC implementation model for English learning, the indicator” and the phrase “MUST be conducted before” is the relation phrase. As an example, two indicators “i” and “j” are determined through the statement “In order to develop a blended MOOC implementation model for English learning, the indicator “i” MUST be conducted before the indicator “j”. Experts’ votes “Yes” or “No” were used to determine the relationships among the indicators.

  1. Step 3: Developing a Structural Self-interaction Matrix (SSIM) and final reachability matrix

SSIM is used to represent the relationships and interactions among the elements (indicators) in a system. It is a square matrix that represents the self-interactions or feedback of the elements (indicators) in the system [96]. Specifically, the associated direction of the relationships between two elements (e.g., element i and j) is denoted by using four symbols: a) V for the relation from element i to j; b) A for the relation from element j to i; c X for both direction relations and d) O for no relation between i and j.

The construction of the reachability matrix was to classify the elements into different levels. This was achieved based on SSIM (Step 2) by replacing V, A, X, and O as 1 and 0, as given below. The replacement of 1s and 0s are as follows:

“If the entry (i, j) in SSIM is V, the entry (i, j) in the target matrix becomes 1, and the entry (i, j) becomes 0,

If the entry (i,j) in SSIM is A, the entry (i,j) in the target matrix becomes 0, and entry (i, j) becomes 1,

If the entry(i,j) in SSIM is X, the entry (i,j) in the target matrix becomes 1 and the entry (i, j) also becomes 1, and

If the entry (i, j) in SSIM is O, the entry (i, j) in the target matrix becomes 0, and the entry (j, i) also becomes 0”.

The ISM software helps to generate the model based on the concept of paring comparison and transitive logic. The transitive logic for any of three elements (a, b, and c) is drawn: a ◊ b (a has the relation to b); b ◊c (b has the relation to c); and a ◊ c or a◊ b ◊ c (a has the relation to c). The output of this step is also known as the conical matrix.

  1. Step 4: Determining the level of partition of the matrix

Using the reachability matrix generated in Step 3, the elements were categorized based on their influence. This classification relied on two key sets for each element: the reachability set and the antecedent set. The reachability set includes the element itself and all other elements it can help to achieve. In contrast, the antecedent set consists of the element and others that contribute to its accomplishment. This categorization is crucial for constructing the model, as it assigns elements to hierarchical levels. The process involved identifying the intersection between the reachability and antecedent sets. Elements found in both sets were designated as occupying the upper levels within the Interpretive Structural Modelling (ISM) hierarchy, indicating their prominent role in influencing other factors.

  1. Step 5: Developing the model

To categorize the indicators—a conical matrix (or finalized reachability matrix) was used in conjunction with the Matrice d’Impacts Croisés Multiplication Appliquée à un Classement (MICMAC) method. Originally introduced by Duperrin and Godet, MICMAC serves as a structured analytical tool designed to examine both direct and indirect relationships among variables and evaluate their levels of influence and interaction [98]. The central aim of MICMAC analysis is to explore how much influence a variable exerts (driving power) and how much it relies on others (dependence power) [99].

These two values—driving and dependence—are calculated from the finalized matrix by summing the values in each row (to determine influence) and each column (to assess dependence). Once calculated, the data can be plotted on a two-dimensional grid known as the driver-dependence diagram. In this diagram, the horizontal axis represents how dependent a variable is, while the vertical axis reflects how much influence it exerts on other elements.

Based on these two dimensions, elements are grouped into four main categories:

  1. 1) Autonomous cluster: These indicators have minimal influence and low dependence, and they tend to be weakly connected to the overall system.
  2. 2) Independent cluster: These indicators have a strong influence but low dependence, meaning they significantly drive the system and are often considered key or core activities.
  3. 3) Dependent cluster: These indicators rely heavily on others but exert little influence themselves.
  4. 4) Linkage cluster: These indicators show both high influence and high dependence, making them volatile and highly interconnected; changes to these elements can have wide-ranging effects, including feedback loops that affect the element itself.

4. Results

4.1. Identifying and assessing the indicators and sub-indicators for a blended MOOC implementation model for English language learning

As per the consensus from the panel of experts, 20 out of 21 elements were accepted as the key sub-indicators for a blended MOOC implementation framework. However, one sub-indicators “The revision of course syllabi based on feedback and performance data” was rejected by the experts (A = .611, d = .260, 60% of expert consensus).

Among the most critical sub-indicators identified, the expert consensus validated the importance of motivation in learning environments, so learners’ motivation was ranked as the most important. The element “learners’ motivation and goals to learn English” was most agreed upon (A = 0.893; d = 0.060, consensus = 100%) that motivated learners are more likely to involve themselves and thus gain better results in English blended MOOCs and also consistent with earlier investigations stating that intrinsic motivation is the basis for proper access because it leads to sustained use and higher completion rates in online environments.

The second most important sub-indicator (A = 0.860; d = 0.103) is “clearly defined learners’ backgrounds”, with a consensus of 80%, which includes understanding the learners’ ages, preferred methods of learning, and degrees of English ability. This element emphasizes how important it is to tailor course design to each learner’s specific needs.

“The suitability of teaching materials such as textbooks, videos, and quizzes” was ranked third by an A value of 0.856, a threshold “d” of.031, and 93% expert consensus. Therefore, resources of teaching materials are essential for keeping students interested by ensuring their quality as well as their compliance with pedagogic demands. “The variety of teaching content that develops English language skills” stood in fourth place (A = .842, d = .069, 93% expert consensus), following closely after the appropriateness of teaching materials. This emphasizes the need for integrating various teaching modalities to serve different learners’ needs and enhance their outputs.

Eighty percent of the experts agreed that the element “clearly defined and measurable learning objectives” was essential, ranking fifth (A = .833, d = .085). In the context of blended MOOCs, clearly defined objectives let learners achieve the goals of the course, how they will be assessed, and what they are expected to achieve. They also provide instructors with a parameter for assessing students’ achievements against the learning outcomes intended for the course Table 4.

thumbnail
Table 4. The consensus of sub-indicators for blended MOOC implementation for English learning.

https://doi.org/10.1371/journal.pone.0338980.t004

At the bottom of the ranking is the sub-indicator of “the offline final examinations to re-evaluate students’ English performance.” This indicator was rated the lowest (A = 0.731) with a 87% consensus among the experts, thus making it the least prioritized aspect in the bMOOC framework. While offline final exams are usually viewed as the traditional mainstay of language learning assessments, their relevance in the blended MOOC context has increasingly been questioned.

To examine whether student participation affected the stability of the indicator structure, a brief subgroup sensitivity comparison was conducted between academic experts (n = 12) and student participants (n = 3). Both groups accepted the same 20 sub-indicators and rejected the same sub-indicator. The overall defuzzified mean values were highly similar (academic experts: A = 0.803; students: A = 0.794), with a negligible difference (ΔA = 0.009). The general ranking patterns remained consistent. This indicates that the indicator synthesis was stable and was not disproportionately influenced by student-only perspectives (See Table 5).

thumbnail
Table 5. Subgroup sensitivity comparison between academic experts and student participants.

https://doi.org/10.1371/journal.pone.0338980.t005

4.2. Determining the contextual relationship phrase and relation phrase

The experts identified and agreed upon the contextual relationship phrase “In order to develop a blended MOOC implementation model for English learning, the sub-indicator” and the phrase “MUST be conducted before” is the relation phrase. As an example, two sub-indicators “b” and “c” are determined through the statement “In order to develop a blended MOOC implementation model for English learning, the sub-indicator “a” MUST be conducted before the sub-indicator “b”. Experts’ votes “Yes” or “No” were used to determine the relationships among the indicators.

4.3. Developing a Structural Self-interaction Matrix (SSIM) and final reachability matrix (conical matrix)

An enabling relationship matrix was established as the structural self-interacted matrix (SSIM) in Table 6 below. The relationships between an indicator “a” and the other indicator “b” are defined as follows:

thumbnail
Table 6. Structural Self-interaction Matrix (SSIM).

https://doi.org/10.1371/journal.pone.0338980.t006

V → row indicator influences corresponding column indicator

A → row indicator is influenced by the corresponding column indicator

X → row and corresponding column indicators influence each other

O → row and corresponding column indicators have no relationship

The final reachability matrix (see Table 7) shows the driving and dependence powers for each indicator. The figures in each row, summed horizontally, represent the driving power, meaning how many other indicators (including itself) can influence or help accomplish. In contrast, the vertical total in each column shows the dependence power, which reflects how many other indicators (including itself) can contribute to achieving that particular indicator.

4.4. The blended MOOC implementation model for English language learning

The model serves as a proposed guide for implementing MOOC-based blended learning in undergraduate English courses (see Fig 3). After the model was generated using the ISM software, the experts agreed to refine the model for improved suitability. The model was categorized into three phases: planning phase, implementation phase, and evaluation phase. The planning phase consists of all indicators and sub-indicators that help in understanding learners, setting goals, and designing learning content and objectives. The implementation phase includes all indicators and sub-indicators that facilitate course delivery, provide technical support, grant access to MOOCs, and encourage active participation and interaction. The evaluation phase encompasses all indicators and sub-indicators that assist in assessing student progress, delivering feedback, and conducting final assessments to ensure that learning outcomes are achieved. The arrows in the model indicate the movement from one indicator to another, following the hierarchical relationships, in a sequence of developing a blended MOOC implementation model for undergraduate English courses. Specifically, sub-indicator 1 must be considered before sub-indicators 5 and 9. In addition, the sub-indicators that share the same box mean that the sub-indicators could be considered in any sequence or simultaneously, as the sub-indicators complement one another (e.g., sub-indicators 3 and 4).

thumbnail
Fig 3. The proposed blended MOOC implementation model for English learning.

https://doi.org/10.1371/journal.pone.0338980.g003

All the sub-indicators were partitioned into a reachability matrix. Partitioning the reachability matrix involves identifying, for each sub-indicator, its reachability set (elements it can influence) and antecedent set (elements that influence it). An element is assigned to a level if its reachability set is equal to the intersection of the reachability and antecedent sets. This process is repeated iteratively, removing assigned elements at each step, until all sub-indicators are organized into hierarchical levels (see Table 8). The sub-indicators were then categorized into hierarchical levels (See Table 9).

thumbnail
Table 8. Partitioning of reachability matrix.

https://doi.org/10.1371/journal.pone.0338980.t008

thumbnail
Table 9. Level partition of reachability matrix.

https://doi.org/10.1371/journal.pone.0338980.t009

The MICMAC (Cross-Impact Matrix Multiplication Applied to Classification) analysis for the blended MOOC implementation model for English language learning, using the ISM (Interpretive Structural Modelling) method, reveals how different indicators and sub-indicators relate to each other in terms of influence and dependence. As in Fig 4, the results indicate that most key sub-indicators (1, 2, 3, 4, 5, 6, and 9) fall within the independent sub-indicators area, which suggests they have a strong influence on the system but depend less on other sub-indicators. These should be given priority when designing the model, as improving them would have a significant overall impact. Besides, two sub-indicators (7 and 19) fall into the linkage cluster, meaning they are both influential and dependent since they are sensitive and should be carefully considered, because any change can affect the system. Sub-indicators 11, 12, 13, 15, 16, 17, 18, and 20 are dependent sub-indicators; they rely on other factors and mainly show results or outcomes of the model. Finally, there are no autonomous sub-indicators, showing that most sub-indicators are connected in some way and none are isolated. This structure highlights that focusing on strong, independent drivers could help build a hierarchical blended MOOC implementation model for English learning. The results reveal that learner analysis and institutional support are the key driving factors with high driving power and low dependence. These elements form the foundational layer of the model. In contrast, learner outcomes and engagement-related factors exhibit high dependence power, indicating that they are largely influenced by other elements in the system.

thumbnail
Fig 4. Matrice d’Impacts Croises Multipl ication Applique a Classement (MICMAC) Analysis for sub-indicators.

https://doi.org/10.1371/journal.pone.0338980.g004

5. Discussion

The development of a blended MOOC implementation model for undergraduate English learning was based on six main indicators: analysis of learners, objectives, course materials and technologies, teaching methodologies, learners’ participation, and feedback and assessment. As in Fig 3, the model was classified into three phases: planning phase, implementation phase and evaluation phase.

The planning phase underscores learner analysis as the key driver of the model. “Clearly defined learners’ backgrounds” (sub-indicator 2) and “learners’ motivation and goals to learn English” (sub-indicator 1) were ranked highest in the independent cluster in the MICMAC analysis (Fig 4), indicating a high level of influence within the system. These findings suggest that effective blended MOOC design must begin with a clear understanding of learner profiles, proficiency levels, learning preferences, and motivational factors. In EFL contexts, where learning progress depends heavily on sustained practice and interaction, inadequate learner analysis is often associated with misalignment between course design and learner needs. Motivation is also perceived to influence engagement and persistence, which are critical in MOOC-based blended environments where self-regulation is required. The prominence of these learner-related indicators, therefore, highlights the central role of pre-instructional analysis in ensuring effective and sustainable blended MOOC implementation. These findings are consistent with prior studies that emphasize the importance of learner analysis in MOOC design, where understanding learner characteristics significantly improves alignment between instructional design and learner needs [55,56,58].

The indicator “objectives” also emerged as influential in the planning phase, particularly “clearly defined and measurable learning objectives” (sub-indicator 5). Teaching materials and content (sub-indicators 3 and 4) were also highly ranked, emphasizing the need for high-quality, accessible, and linguistically appropriate resources. Clear learning outcomes and suitable materials should be established before selecting teaching methodologies to ensure instructional coherence and alignment with learner needs [61,62,64]. In EFL MOOCs, well-designed videos, quizzes, and reading materials support the development of both receptive and productive skills and accommodate learners with different proficiency levels [10,23]. This sequencing highlights that instructional methods should be selected only after goals and materials are clearly defined, preventing unfocused or ineffective teaching practices in technology-mediated learning environments. This finding aligns with previous research highlighting that clearly defined objectives and well-structured materials are critical for maintaining instructional coherence in blended and online learning environments [61,62].

The second key finding highlights the importance of technology in the implementation phase. “Technical learning support” and “learners’ familiarity with MOOC platforms” (sub-indicators 7 and 19) were identified as linkage variables in the MICMAC analysis, indicating that technological access and platform familiarity play a central role in maintaining the stability of the blended MOOC model [65]. These indicators are both influential and highly dependent, suggesting that changes in surrounding instructional or support conditions may be associated with changes in the overall performance of the model. Without adequate infrastructure and platform familiarity, learners may experience technical barriers that interrupt learning continuity and reduce engagement. This result supports earlier findings that technological readiness and platform usability are key determinants of learner engagement and persistence in MOOCs [65].

In addition, “availability and accessibility of MOOCs” (sub-indicator 11), together with built-in support mechanisms, are considered important for reducing cognitive overload and sustaining learner engagement [48,69]. Peer and instructor interaction (sub-indicator 17) and offline mentoring sessions (sub-indicator 15) further promote active participation, social presence, and collaborative learning in EFL blended MOOCs. These design features reflect a shift away from passive video-based learning typical of MOOCs toward more communicative and socially grounded learning environments [19,52]. Meaningful interaction fosters a sense of community and supports deeper learning, which are commonly linked to motivation and retention [67]. This finding highlights that technological elements in blended MOOCs should be designed not only for content delivery but also to facilitate interaction and guided support.

The third major finding relates to the evaluation phase, where appropriate assessment methods (sub-indicator 16) and instructor and peer feedback (sub-indicator 8) were rated more important than traditional offline final examinations (sub-indicator 20), which had the lowest driving and independent power in the MICMAC analysis. This result suggests the use of formative and continuous assessment with timely feedback as more suitable approaches for EFL blended MOOCs, as they reduce learner isolation, support self-regulation, and better reflect gradual language development than summative final examinations [71,73,77]. In language learning, progress is often incremental and skill-specific; therefore, relying solely on final examinations may not fully capture learners’ continuous improvement in listening, speaking, reading, and writing skills. The lower ranking of offline final examinations further indicates a shift toward learner-centred evaluation practices that emphasize learning processes rather than single high-stakes assessments. This result reinforces previous studies suggesting that formative assessment and continuous feedback are more effective than summative approaches in supporting language development in EFL contexts [71,73].

More interestingly, the proposed model would be beneficial to a real educational EFL setting through three phases. In the planning phase, instructors first review learner profiles using placement tests and short surveys to identify students’ English levels, learning preferences, and motivation. Based on this information, clear learning objectives are set, such as improving academic writing coherence. Suitable MOOCs on writing and grammar are then selected as the main online learning materials. In the implementation phase, students watch MOOC videos and complete online quizzes before attending weekly face-to-face mentoring sessions. Classroom time is used for guided writing practice, peer feedback, and teacher support. Technical assistance is provided through the learning management system, and student participation is encouraged through group activities and regular progress checks. In the evaluation phase, student learning is monitored using formative quizzes, writing portfolios, and peer-feedback rubrics rather than relying only on a final examination. Continuous feedback enables instructors to adjust teaching activities and provide additional support to students who show low engagement or slow progress. This guidance shows how the proposed model can guide practical teaching decisions in real EFL classroom settings. Compared to previous studies, this research contributes by offering a structured ISM-based model that not only identifies key indicators but also explains their hierarchical relationships and influence within the system.

6. Conclusion

This study presents a structured and validated model for implementing blended MOOCs in undergraduate English language learning. Developed through the Interpretive Structural Modelling (ISM), the model is organized into three phases: planning, implementation, and evaluation. In the planning phase, understanding learners’ backgrounds, needs, and motivations is emphasized as the foundation for designing effective instruction. Clear learning objectives and suitable, engaging course materials are identified as essential components for aligning pedagogy with learner expectations. The implementation phase highlights the importance of accessible technology, appropriate teaching methodologies, and opportunities for active learner participation, both online and face-to-face. Technical support and familiarity with MOOC platforms are also critical for sustaining engagement. In the evaluation phase, the model prioritizes formative assessment and continuous feedback over traditional final examinations, promoting a more supportive and responsive learning environment. This learner-centered approach ensures that instruction is flexible, inclusive, and aligned with contemporary practices in digital education. The proposed model addresses key challenges in EFL instruction by bridging the gap between traditional teaching and online learning through the mode of blended MOOCs. It offers a practical guideline for diverse stakeholders, such as educators, curriculum designers, and institutional leaders seeking to enhance English language learning.

7. Implications, limitations, and recommendations

The proposed blended MOOC implementation model offers practical implications grounded in the hierarchical structure identified through ISM analysis. Elements with high driving power should be prioritized, as they form the foundation for subsequent stages. At the foundational level, learner analysis, learning objectives, and content and technology selection were identified as primary drivers. Therefore, educators and administrators should prioritize understanding learner characteristics and aligning course objectives before investing in advanced instructional strategies or engagement tools. At the implementation level, instructional strategies and learner participation depend on these foundational elements. This indicates that efforts to enhance engagement will only be effective when clear objectives and appropriate technological support are already in place. At the evaluation level, assessment and feedback were found to be highly dependent elements. Thus, timely feedback and formative assessment should be strengthened after the successful implementation of planning and instructional processes. By following this hierarchy, institutions can address common challenges in bMOOCs, such as low student motivation and high dropout rates. For example, prioritizing learner needs and appropriate instructional design can reduce learner frustration and disengagement, thereby improving retention and overall learning outcomes.

While the proposed blended MOOC implementation model offers a structured approach to English instruction in higher education, several limitations should be acknowledged. Firstly, the model was developed based on expert input and literature analysis within the specific context of Vietnamese higher education. This context-specific design may limit the generalizability of the findings to other educational systems with different technological infrastructures or pedagogical traditions. Local institutional conditions such as large class sizes, exam-oriented curricula, and policy-driven English requirements may influence the relevance and priority of some indicators. Therefore, the direct transfer of the model to other national or disciplinary contexts may require contextual adaptation. The second limitation is that this study focused on expert validation rather than large-scale classroom implementation. Although the indicators were validated through expert consensus, empirical testing is still needed to examine the model’s suitability in real EFL teaching contexts and to evaluate its effects on learner engagement and learning outcomes over time. In particular, the absence of longitudinal classroom data makes it difficult to assess the long-term impact of the model on learner engagement and language proficiency development. Finally, the rapid evolution of educational technology, particularly artificial intelligence–based learning tools, may influence the long-term applicability of some indicators and sub-indicators. Future research should pilot the model in diverse institutional settings to assess its practical effectiveness and scalability. Longitudinal studies involving both educators and learners could provide deeper insights into how the model supports language acquisition and sustained engagement. Furthermore, future studies may investigate the integration of AI-driven learning analytics and personalized feedback mechanisms to improve learner support and progression tracking in blended MOOC environments.

Acknowledgments

The authors would like to thank the participating experts for their valuable contributions to this study.

References

  1. 1. Timotheou S, Miliou O, Dimitriadis Y, Sobrino SV, Giannoutsou N, Cachia R, et al. Impacts of digital technologies on education and factors influencing schools’ digital capacity and transformation: A literature review. Educ Inf Technol (Dordr). 2023;28(6):6695–726. pmid:36465416
  2. 2. Devkota KR. Inequalities reinforced through online and distance education in the age of COVID-19: The case of higher education in Nepal. Int Rev Educ. 2021;67(1–2):145–65. pmid:33678863
  3. 3. Voudoukis N, Pagiatakis G. Massive Open Online Courses (MOOCs): Practices, trends, and challenges for the higher education. EJEDU. 2022;3(3):288–95.
  4. 4. Alario-Hoyos C, Pérez-Sanagustín M, Cormier D, Delgado-Kloos C. Proposal for a Conceptual Framework for Educators to Describe and Design MOOCs. Journal of Universal Computer Science. 2014;20(1):6–23.
  5. 5. Zhu M, Sari AR, Lee MM. A comprehensive systematic review of MOOC research: Research techniques, topics, and trends from 2009 to 2019. Education Tech Research Development. 2020;68(4):1685–710.
  6. 6. Salas-Rueda R-A, Castañeda-Martínez R, Eslava-Cervantes A-L, Alvarado-Zamorano C. Teachers’ Perception About MOOCs and ICT During the COVID-19 Pandemic. Cont Ed Technol. 2022;14(1):ep343.
  7. 7. Alhazzani N. MOOC’s impact on higher education. Soc Sci Humanit Open. 2020;2(1):100030. pmid:34171022
  8. 8. Xie 7, Siau K, Nah FF-H. COVID-19 pandemic – online education in the new normal and the next normal. Journal of Information Technology Case and Application Research. 2020;22(3):175–87.
  9. 9. Singh J, Steele K, Singh L. Combining the Best of Online and Face-to-Face Learning: Hybrid and Blended Learning Approach for COVID-19, Post Vaccine, & Post-Pandemic World. Journal of Educational Technology Systems. 2021;50(2):140–71.
  10. 10. Feitosa de Moura V, de Souza CA, Noronha Viana AB. The use of massive open online courses (moocs) in blended learning courses and the functional value perceived by students. Computers & Education. 2021;161:104077.
  11. 11. Littenberg-Tobias J, Reich J. Evaluating access, quality, and equity in online learning: A case study of a MOOC-based blended professional degree program. The Internet and Higher Education. 2020;47:100759.
  12. 12. Edumadze JKE, Govender DW. The community of inquiry as a tool for measuring student engagement in blended massive open online courses (MOOCs): a case study of university students in a developing country. Smart Learn Environ. 2024;11(1):19.
  13. 13. Zhang Y, Liu S, Li C, Hao A. Impact of a MOOC-based blended learning model on performance, satisfaction, and perceptions in a histology course for Chinese medical students. AMEP. 2025;16:1501–10.
  14. 14. Pham AT. Blended MOOCs in higher education: Analyzing student interaction and satisfaction. Cont Ed Tech. 2025;17(1):ep550.
  15. 15. Chan V. Enhancing translation technology skills through blended learning: a study of student perceptions and satisfaction with bMOOC in higher education. Front Educ. 2025;10:1613880.
  16. 16. Nguyen HTT, Le HV, Ly PTK, Hanh MTC. Exploring the Transformative Potential of Blended Learning with MOOCs: A Case Study in Vietnamese Higher Education Amidst the COVID-19 Pandemic. rEFLections. 2025;32(2):1219–42.
  17. 17. Ding Y, Shen H. Delving into learner autonomy in an EFL MOOC in China: a case study. Computer Assisted Language Learning. 2022;35(3):247–69.
  18. 18. Alkamel M, Al-Badani RKH. Utilizing massive open online courses (MOOCs) to enhance English language proficiency among Yemeni EFL learners. JES. 2024;1(1):1–15.
  19. 19. Etemadfar P, Barati H, Dabbaghi A. The effect of flipped classroom integrated with MOOCs on intermediate EFL learners’ self-regulated learning strategies in writing. JELTL. 2024;(Online First).
  20. 20. Jitpaisarnwattana N, Chalmers H. Can I MOOC to Catch up? The Effects of Using an LMOOC as a Remedial Tool for EFL Students in Thailand. ELT. 2021;15(1):37.
  21. 21. Wang N, Chen J, Tai M, Zhang J. Blended learning for Chinese university EFL learners: learning environment and learner perceptions. Computer Assisted Language Learning. 2021;34(3):297–323.
  22. 22. Zubkov AD. MOOCs in Blended English Teaching and Learning for Students of Technical Curricula. In: Anikina Z, editor. Integrating Engineering Education and Humanities for Global Intercultural Perspectives. Cham: Springer International Publishing. 2020:39–46.
  23. 23. Wu H, Luo S. Integrating MOOCs in an Undergraduate English Course: Students’ and Teachers’ Perceptions of Blended Learning. Sage Open. 2022;12(2).
  24. 24. Abdel-Maksoud NF. Investigating the Effect of Blending MOOCs with Flipped Classroom on Engagement in Learning and Course Grades. IER. 2019;2(2):p8.
  25. 25. “Fesol SFA, Salam S. Towards MOOC for technical courses: A blended learning empirical analysis. In: 2016 4th International Conference on User Science and Engineering (i-USEr), Melaka, Malaysia, 2016. 116–21. https://doi.org/10.1109/IUSER.2016.7857945
  26. 26. Tran PFM, Tanemura K. English in Vietnam. World Englishes. 2020;39(3):528–41.
  27. 27. Ngoc Truong TN, Wang C. Understanding Vietnamese college students’ self-efficacy beliefs in learning English as a foreign language. System. 2019;84:123–32.
  28. 28. Aoumeur H. The Impact of Class Size on Teaching and Learning English as a Foreign Language: The Case of the Department of English at Abdelhamid Ibn Badis University. AWEJ. 2017:8:(2):349–61.
  29. 29. Nguyen TH, Warren W, Fehring H. Factors Affecting English Language Teaching and Learning in Higher Education. ELT. 2014;7(8):94–105.
  30. 30. Todd RW. The effects of class size on English learning at a Thai university. ELT Research Journal. 2012;1(1):80–8.
  31. 31. Li KL, Razali AB. Idea sharing: Process-based approach to writing in Malaysian English education. PASSA. 2019;58:319–41.
  32. 32. Mittal P, Lata P. Transforming the Traditional Indian English Teaching Classroom into Skill-Based Teaching. SSRN Journal. 2022.
  33. 33. Uchidiuno JO, Ogan A, Yarzebinski E, Hammer J. Going global: Understanding English language learners’ student motivation in English-language MOOCs. Int J Artif Intell Educ. 2018;28(4):528–52.
  34. 34. Liyanagunawardena TR, Adams AA, Williams SA. MOOCs: A systematic study of the published literature 2008-2012. IRRODL. 2013;14(3):202.
  35. 35. Veletsianos G, Shepherdson P. A systematic analysis and synthesis of the empirical MOOC literature published in 2013–2015. IRRODL. 2016;17(2):198–221.
  36. 36. Yousef AMF, Chatti MA, Schroeder U, Wosnitza M. A usability evaluation of a blended MOOC environment: An experimental case study. IRRODL. 2015;16(2).
  37. 37. Wong L, Tatnall A, Burgess S. A framework for investigating blended learning effectiveness. Education + Training. 2014;56(2/3):233–51.
  38. 38. Edward CN, Asirvatham D, Md. Johar MdG. Effect of blended learning and learners’ characteristics on students’ competence: An empirical evidence in learning oriental music. Educ Inf Technol. 2018;23(6):2587–606.
  39. 39. Ghazal S, Al-Samarraie H, Aldowah H. ‘I am still learning’: Modeling LMS critical success factors for promoting students’ experience and satisfaction in a blended learning environment. IEEE Access. 2018;6:77179–201.
  40. 40. Ismail S. Teaching Approach using Microsoft Teams: Case Study on Satisfaction versus Barriers in Online Learning Environment. J Phys Con Ser. 2021;1874(1):012020.
  41. 41. Poon J. A cross-country comparison on the use of blended learning in property education. Property Management. 2014;32(2):154–75.
  42. 42. Spring KJ, Graham CR, Hadlock CA. The current landscape of international blended learning. IJTEL. 2016;8(1):84–105.
  43. 43. Chang-Tik C. Impact of learning styles on the community of inquiry presences in multi-disciplinary blended learning environments. Interactive Learning Environments. 2018;26(6):827–38.
  44. 44. Owston R, York DN, Malhotra T. Blended learning in large enrolment courses: Student perceptions across four different instructional models. AJET. 2019;35(5):29–45.
  45. 45. Van Laer S, Elen J. Adults’ self-regulatory behaviour profiles in blended learning environments and their implications for design. Tech Know Learn. 2020;25(3):509–39.
  46. 46. Anthony B. Exploring the role of blended learning for teaching and learning effectiveness in institutions of higher learning: An empirical investigation. Educ Inf Technol. 2019;24(6):3433–66.
  47. 47. Estévez-Ayres I, Alario-Hoyos C, Pérez-Sanagustín M, Pardo A, Crespo-García RM, Leony D, et al. A methodology for improving active learning engineering courses with a large number of students and teachers through feedback gathering and iterative refinement. Int J Technol Des Educ. 2014;25(3):387–408.
  48. 48. Ramírez-Donoso L, Pérez-Sanagustín M, Neyem A, Alario-Hoyos C, Hilliger I, Rojos F. Fostering the use of online learning resources: results of using a mobile collaboration tool based on gamification in a blended course. Interactive Learning Environments. 2021;:1–15.
  49. 49. Ding Y, Shen H. English language moocs in china: learners’ perspective. Eurocall. 2020;28(2):13.
  50. 50. Eriksson T, Adawi T, Stöhr C. ‘Time is the bottleneck’: a qualitative study exploring why learners drop out of MOOCs. J Comput High Educ. 2017;29(1):133–46.
  51. 51. Kasch J, van Rosmalen P, Löhr A, Klemke R, Antonaci A, Kalz M. Students’ perceptions of the peer-feedback experience in MOOCs. Distance Education. 2021;42(1):145–63.
  52. 52. Vorobyeva AA. Language acquisition through massive open online courses (MOOCs): opportunities and restrictions in educational university environment. XL. 2018;11(2):136–46.
  53. 53. Li G. A Study on the Blended-Teaching Mode Combining MOOCs and Flipping Classroom in College English Teaching. In: Proceedings of the 7th International Conference on Education, Management, Information and Mechanical Engineering (EMIM 2017), 2017. https://doi.org/10.2991/emim-17.2017.256
  54. 54. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. pmid:25554246
  55. 55. Bayeck RY. Exploratory study of MOOC learners’ demographics and motivation: The case of students involved in groups. Open Praxis. 2016;8(3):223.
  56. 56. Hsu L. What makes good LMOOCs for EFL learners? Learners’ personal characteristics and Information System Success Model. Computer Assisted Language Learning. 2023;36(1–2):1–25.
  57. 57. Montgomery AP, Hayward DV, Dunn W, Carbonaro M, Amrhein CG. Blending for student engagement: Lessons learned for MOOCs and beyond. AJET. 2015;31(6).
  58. 58. Rabin E, Henderikx M, Kalman MY, Kalz M. What are the barriers to learners’ satisfaction in MOOCs and what predicts them? The role of age, intention, self-regulation, self-efficacy and motivation. AJET. 2020;36(3):119–31.
  59. 59. Asli MF, Hamzah M, Ibrahim AAA, Ayub E. Problem characterization for visual analytics in MOOC learner’s support monitoring: A case of Malaysian MOOC. Heliyon. 2020;6(12):e05733. pmid:33426320
  60. 60. Dagenais C, Hot A, Bekelynck A, Villemin R, Mc Sween-Cadieux E, Ridde V. MOOC-based blended learning for knowledge translation capacity-building: A qualitative evaluative study. PLoS One. 2024;19(2):e0297781. pmid:38335193
  61. 61. Conijn R, Van den Beemt A, Cuijpers P. Predicting student performance in a blended MOOC. J Comput Assist Learn. 2018;34(5):615–28.
  62. 62. Bralić A, Divjak B. Integrating MOOCs in traditionally taught courses: achieving learning outcomes with blended learning. Int J Educ Technol High Educ. 2018;15(1).
  63. 63. Yousef AMF, Sumner T. Reflections on the last decade of MOOC research. Comput Appl Eng Educ. 2021;29(4):648–65.
  64. 64. Pilli O, Admiraal W. Students’ Learning Outcomes in Massive Open Online Courses (MOOCs): Some Suggestions for Course Design. Yuksekogretim Derg. 2017;7(1):46–71.
  65. 65. Sanchez-Gordon S, Lujan-Mora S. Accessible blended learning for non-native speakers using MOOCs. In: 2015 International Conference on Interactive Collaborative and Blended Learning (ICBL), Mexico City, Mexico, 2015:19–24. https://doi.org/10.1109/ICBL.2015.7387645
  66. 66. Bernard RM, Borokhovski E, Schmid RF, Tamim RM, Abrami PC. A meta-analysis of blended learning and technology use in higher education: from the general to the applied. J Comput High Educ. 2014;26(1):87–122.
  67. 67. Almutairi F, White S. How to measure student engagement in the context of blended-MOOC. ITSE. 2018;15(3):262–78.
  68. 68. Chang C. Enhancing EFL University Students’ Readiness for Learning Academic Content in English: the Effectiveness of Combining MOOCs with Data-Driven Learning Activities in an English Language Classroom. English Teaching & Learning. 2023;48(3):439–64.
  69. 69. Gregori EB, Zhang J, Galván-Fernández C, Fernández-Navarro F de A. Learner support in MOOCs: Identifying variables linked to completion. Computers & Education. 2018;122:153–68.
  70. 70. Zhao S, Song J. Students’ Perceptions of a Learning Support Initiative for b-MOOCs. Int J Emerg Technol Learn. 2020;15(21):179.
  71. 71. Julia K, Peter VR, Marco K. Educational scalability in MOOCs: Analysing instructional designs to find best practices. Computers & Education. 2021;161:104054.
  72. 72. Ho TTN, Pham H-H, Sivapalan S, Dinh V-H. The adoption of blended learning using Coursera MOOCs: A case study in a Vietnamese higher education institution. AJET. 2022;121–38.
  73. 73. Apridayani A, Han W, Waluyo B. Understanding students’ self-regulated learning and anxiety in online English courses in higher education. Heliyon. 2023;9(6):e17469. pmid:37426789
  74. 74. Chen J. Effects of learning analytics-based feedback on students’ self-regulated learning and academic achievement in a blended EFL course. System. 2024;124:103388.
  75. 75. Avgerinos E, Karageorgiadis A. The importance of formative assessment and the different role of evaluation in MOOCS. In: 2020 IEEE Learning With MOOCS (LWMOOCS), Antigua Guatemala, Guatemala, 2020. 168–73. https://doi.org/10.1109/LWMOOCS50143.2020.9234320
  76. 76. Buch B, B Christiansen R, Hansen D, Kristine Petersen A, Skovbjerg Sørensen R. Using the 7Cs Framework for Designing MOOCs in Blended Contexts - New Perspectives and Ideas. ujer. 2018;6(3):421–9.
  77. 77. Wu B, Liu L. Personalized Hybrid Recommendation Algorithm for MOOCs Based on Learners’ Dynamic Preferences and Multidimensional Capabilities. Applied Sciences. 2023;13(9):5548.
  78. 78. Qin X. Research on the Teaching Model of English Teaching Quality Evaluation under the Background of MOOC. SCPE. 2024;25(4):2304–18.
  79. 79. Uchidiuno J, Koedinger K, Hammer J, Yarzebinski E, Ogan A. How do English language learners interact with different content types in MOOC videos? Int J Artif Intell Educ. 2018;28(4):508–27.
  80. 80. Yousef AMF. Effective design of blended MOOC environments in higher education. Aachen, Germany: RWTH Aachen Univ. 2015. https://publications.rwth-aachen.de/record/479221
  81. 81. Martín-Monje E, Castrillo MD, Mañana-Rodríguez J. Understanding online interaction in language MOOCs through learning analytics. Computer Assisted Language Learning. 2018;31(3):251–72.
  82. 82. Jiang Y, Peng J-E. Exploring the relationships between learners’ engagement, autonomy, and academic performance in an English language MOOC. Computer Assisted Language Learning. 2023;1–26.
  83. 83. Warfield JN. Toward Interpretation of Complex Structural Models. IEEE Trans Syst, Man, Cybern. 1974;SMC-4(5):405–17.
  84. 84. Hughes DL, Dwivedi YK, Rana NP, Simintiras AC. Information systems project failure – analysis of causal links using interpretive structural modelling. Production Planning & Control. 2016;27(16):1313–33.
  85. 85. Samantra C, Datta S, Mahapatra SS, Debata BR. Interpretive structural modelling of critical risk factors in software engineering project. Benchmarking: An International Journal. 2016;23(1):2–24.
  86. 86. Singh MD, Kant R. Knowledge management barriers: An interpretive structural modeling approach. International Journal of Management Science and Engineering Management. 2008;3(2):141–50.
  87. 87. Talib F, Rahman Z, Qureshi MN. Analysis of interaction among the barriers to total quality management implementation using interpretive structural modeling approach. Benchmarking: An International Journal. 2011;18(4):563–87.
  88. 88. Fathi M, Ghobakhloo M, Syberfeldt A. An interpretive structural modeling of teamwork training in higher education. Education Sciences. 2019;9(1):16.
  89. 89. Mitra Debnath R, Shankar R. Improving service quality in technical education: use of interpretive structural modeling. Quality Assurance in Education. 2012;20(4):387–407.
  90. 90. Janes FR. Interpretive structural modelling: a methodology for structuring complex issues. Transactions of the Institute of Measurement and Control. 1988;10(3):145–54.
  91. 91. Yusof N, Hashim NL, Hussain A. A review of fuzzy Delphi method application in human-computer interaction studies. In: presented at the The 5th Innovation and Analytics Conference & Exhibition (IACE 2021). Kedah, Malaysia, 2022. 040026. https://doi.org/10.1063/5.0094417
  92. 92. Tolkacheva K. Students become experts: Changing the roles in the learning process. In: International Technology, Education and Development Conference. Valencia, Spain, 2016. 5553–8. https://doi.org/10.21125/inted.2016.0331
  93. 93. Kaufmann A, Gupta MM. Fuzzy mathematical models in engineering and management science. Amsterdam; New York N.Y., U.S.A: Elsevier Science Pub. Co. 1988.
  94. 94. Murray TJ, Pipino LL, van Gigch JP. A pilot study of fuzzy set modification of Delphi*. HSM. 1985;5(1):76–80.
  95. 95. Ishikawa A, Amagasa M, Shiga T, Tomizawa G, Tatsuta R, Mieno H. The max-min Delphi method and fuzzy Delphi method via fuzzy integration. Fuzzy Sets and Systems. 1993;55(3):241–53.
  96. 96. Attri R, Dev N, Sharma V. Interpretive Structural Modelling (ISM) approach: An Overview. Research Journal of Management Sciences. 2013;2(2):3–8.
  97. 97. Chen CT. Extensions of the TOPSIS for group decision-making under fuzzy environment. Fuzzy Sets and Systems. 2000;114(1):1–9.
  98. 98. Duperrin JC, Godet M. SMIC 74—A method for constructing and ranking scenarios. Futures. 1975;7(4):302–12.
  99. 99. Mandal A, Deshmukh SG. Vendor Selection Using Interpretive Structural Modelling (ISM). International Journal of Operations & Production Management. 1994;14(6):52–9.