https://orcid.org/0000-0001-7995-2263
Figures
Abstract
Background
Blended learning in DESEC only started after the introduction of the internet in recent 5 years. However, there is still no research paying attention to this region, because the area is remote and research subjects are not easily accessible. This article has potential application value in helping the government and educational institutions to make decisions on blended learning strategies supporting poverty alleviation through education in poor and remote areas and ethnic region. The study will be the first to examine satisfaction and continuance intention of blended learning in the DESEC.
Objective
To identify junior high students’ perception of satisfaction and continuance intention for blended learning in DESEC.
To identify the strongest factors affecting junior high students’ satisfaction and continuance intention of blended learning in DESEC.
Methods
A subsample of 635 junior high students participated online survey with consent of their parents verbally in computer room in schools under teacher’s instruction. Data was coded and analyzed to generate descriptive statistics and inferential statistics. Structural equation model was used to evaluate the model of satisfaction and continuance intention of blended learning.
Results
The level for evaluating students’ agreement on each of item were interpreted “agree” (3.76–3.89). The model explained variances (R2) of Continuance Intention, Satisfaction and Perceived usefulness were 0.665,0.766,0.718 respectively. Information quality, self-efficacy and confirmation directly and indirectly contribute to junior high students’ satisfaction with blended learning, which further confirmed their continuance intention of blended learning.
Conclusion
Information quality was the strongest factor affecting the junior high students’ continuance intention of using blended learning, while confirmation was the strongest factor affecting the junior high students’ satisfaction of using blended learning in DESEC. Junior high students do not have a strong and distinct perception on satisfaction and continuance intention for blended learning in DESEC.
Citation: Li C, Phongsatha T (2022) Satisfaction and continuance intention of blended learning from perspective of junior high school students in the directly-entering-socialism ethnic communities of China. PLoS ONE 17(12): e0270939. https://doi.org/10.1371/journal.pone.0270939
Editor: Mudassir Khan, King Khalid University, SAUDI ARABIA
Received: June 19, 2022; Accepted: November 15, 2022; Published: December 1, 2022
Copyright: © 2022 Li, Phongsatha. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The Directly-Entering-Socialism Ethnic Groups (DESEG), also called Ethnic Groups with Cross-Stage Development, refers to the ethnic groups who were in the end of primitive society when the People’s Republic of China was found [1]. The Communist Party of China implemented a special direct transition policy, which helped DESEG achieve a historic leap directly entering socialist society from primitive society [2]. Most of the directly-entering-socialism ethnic communities are located in barren mountainous areas, with poor natural conditions, relatively backward infrastructure construction such as transportation, sanitation, communication, and housing [3]. People’s living standards are very low, and resource are relatively scarce [4]. Unity and progress of the ethnic minorities in this region is related to the harmony and stability of the China. It is a place that the Chinese government attaches great importance to.
Using modern information technology to drive the overall development of education in ethnic minority areas has become a useful experience in China’s poverty alleviation work. At present, blended learning, a successful outcome of the combination of modern information technology and education, has been widely used in higher education, primary and secondary education, and has become a research hotspot in the field of educational technology in China. However, there is a huge gap between rural schools and urban schools in terms of the application technology, and a new imbalance in education is forming [5], letting alone schools in DESEC where technology application confronts challenges and hardships. Intergenerational updates of information technology equipment lag far behind urban schools [6]. Each administrative unit in different regions has their own independent data centers and application platforms, but resource cannot be interconnected and shared due to inconsistent construction standards, resulting in information isolation [7]. The lack of digital resource is a fatal shortcoming affecting the operation of online teaching in rural schools [8]. In addition, highly educated teachers or excellent teachers cannot be retained [9].
Blended learning in DESE only started after the introduction of the internet covering the schools in recent 5 years. But, the researches on blended learning dissertations are mainly concentrated in the field of higher education. There is almost no research pay attention to blended learning in DESEC of China due to the remoteness and not easily accessible population. Considering the equality and equity of education and the strategic position of this region, researchers want to break down such barriers. It sees that in recent years, the Chinese government has done a lot of work in training teachers’ information literacy, which has achieved certain achievements. Equipment renewal requires a lot of money and investment that needs to be solved periodically. Therefore, this research focused on the student subjective sensation in blended learning system. The study aimed at examining junior high students’ satisfaction and continuance intention for blended learning in DESEC, so as to guide government and educational institutions in future decision-making on blended learning strategies.
Materials and methods
Previous research and research model
Self-Determination Theory (SDT) is a psychologically organismic and empirical theory that focuses on human behavior and individual development [10]. The theory explained that behavior continuum came from the intrinsic motivation, which means individual has intention to act for its inherent satisfactions [11]. To pursue better measures for explaining and predicting user acceptability of computers, Davis developed and validated the Theory of Acceptance Model (TAM), with Perceived Usefulness (PU) and Perceived Ease of Use (PEOU) [12]. The two variables are hypothesized as two primary relevance for user acceptance of information technology. Perceived Usefulness (PU) refers to the degree to which a person believes that using a particular system would enhance his/her job performance, and it is one of extrinsic motivators [13–15]. Combining Davis et al.’s formulation of TAM and Expectation-Confirmation Theory (ECT) [16,17] from the consumer behavior literature to illustrate I/S continuance, Bhattacherjee developed ECM. The model suggests that user’ continence intention of IS depends on users’ confirmation, PU as well as satisfaction [18]. Continuance intention refers to a person’s psychological intention to do something consistently. People will act their previous behavior again with an approachable reinforcement [19]. Satisfaction is used to describe users’ satisfactory feelings towards his or her adoption of a system [20]. Confirmation is the degree of users’ perception of the congruence between expectation use and actual performance [18]. Perceived usefulness and satisfaction are powerful predictors of individuals’ intention to use continence in B2C services. ECM is one of the most extensively utilized models on users’ continuance intention of the information system. Hence, it leads to the hypothesis:
H01: Perceived usefulness does not affect continuance intention of blended learning.
Ha1: Perceived usefulness affects continuance intention of blended learning.
H02: Perceived usefulness does not affect satisfaction intention of blended learning.
Ha2: Perceived usefulness affects satisfaction intention of blended learning.
H03: Satisfaction does not affect continuance intention of blended learning.
Ha3: Satisfaction affects continuance intention of blended learning.
H04: Confirmation does not affect satisfaction of blended learning.
Ha4: Confirmation affects satisfaction of blended learning.
H05: Confirmation does not affect PU of blended learning.
Ha5: Confirmation affects PU of blended learning.
Researchers expanded ECM with two external variables which modified PU to predict junior high students’ behavior in blended settings [12]. Bandura proposed Social Cognitive Theory (SCT). He proved the predictive generality and explanatory of self-efficacy theory on illustrating human affect, motivation, and action [21]. Self-efficacy (SE) is level of individual confidence in one’s ability to organize action to achieve specific tasks [22], and it affects what behaviors individual decide to perform [23]. Hence, it leads to the hypothesis:
H06: Self-efficacy does not affect perceived usefulness of blended learning.
Ha6: Self-efficacy affects perceived usefulness of blended learning.
DeLone and McLean organized diverse research, introduced the quality constructs (information quality, system quality and service quality) and proposed an I/S success model [24]. Many previous research found information quality is the most critical factor, comparing with system quality and service quality, to understand users’ behavioral intention towards IS [13,25,26]. Information quality refers to the qualitative and desired characteristics of contents and form that the Information System (I/S) generates [24]. Hence, it leads to the hypothesis:
H07: Information quality does not affect perceived usefulness of blended learning.
Ha7: Information quality affects perceived usefulness of blended learning.
Researchers sorted out satisfaction, self-efficacy, information quality, perceived usefulness, and confirmation based on the theories discussed above and literature review to describe the junior high school students’ satisfaction and continuance intention of blended learning. The research model tried to facilitate analysis from psychological (satisfaction, self-efficacy, confirmation), technological (perceived usefulness, information quality), and behavioral factors (continuance intention) [27]. The research model is depicted in Fig 1.
Scope of the research, design and target population
The characteristics of the population in this study was identified as students who were middle school students, were experiencing the blended learning, and living in the Direct-Entering-Socialism-Ethic Communities (DESEC). In order to conduct the study, the Cangyuan Va Autonomous County (short for Cangyuan, Yunnan province, southwest China) was selected. Because Cangyuan is typical representative of the DESEC and the key supported demonstration base for blended learning. The scope of the study was limited to recruit 3 schools in Cangyuan where students are able to access to online resources and take part in the classroom activities under the guidance of teachers, which required that schools were capable to provide internet and terminal equipment for blended learning. The students in K7 were too young to understand the questions well according to the researchers’ previous data collection because the common method bias was serious. Hence, the target population of this study was high junior students in K8-K9 who had been experiencing blended learning at three middle schools in Cangyuan.
Sample size and sampling technique
The sample size in this study was determined by using the Structural Equation Modeling. The anticipated effect size in this study was 0.2, and the desired level of statistical power was 0.8. According to 6 latent variables and 25 observed items, the recommended minimum sample size was 403. This study applied the judgement sampling and quota sampling for selecting the samples from the three middle schools in Cangyuan. In the end, a total of 635 valid questionnaires were received.
Research instruments
The questionnaire of this study consisted of three main parts. The first part was screening questions, which helped researcher to filter the target population. The second part was items for measuring independent variables and dependent variable. For this part, the five-point Likert scale was used to measure these variables. The five-point Likert scale ranging from Strongly Disagree = 1; Disagree = 2; Undecided = 3; Agree = 4; and Strongly Agree = 5 was applied to examine factors related to students’ continuance intention of blended learning. The third part is demographics demographic information (ethnicity, gender, blended learning experience, online study time, and occupation of guardians) of the respondents.
In addition, the Index of Item-Objective Congruence (IOC) [28] was conducted by inviting 3 qualified experts, who evaluated the items of variables to ensure the validity of the scale [29]. The study conducted a cut-off score to evaluate items in each of the construct: core 1 (I am sure the item can measure the construct), 0 (I am not sure the item can measure the construct), or -1 (I am sure the item cannot measure the construct). The items should be removed if IOC score lower than 0.5 level rating [30]. At last, 25 items (4 items mearing perceived usefulness [12,31,32]; 4 items mearing Satisfaction [31,33,34]; 4 items mearing Confirmation [35,36]; 4 items mearing Self-efficacy [36–38]; 5 items mearing Information Quality [31,39,40]; and 4 items mearing Continuance Intention [36,41,42] were validated shown as Table 1. In need of special note that the attention check question (IQ1*) of which meaning was opposite to the IQ1, i.e., “B-learning doesn’t provide me sufficient contents I want” was designed to filter invalid respondents who were randomly choosing the answer without reading contents [43].
Data collection
Participants were informed about the study content by their instructor and gave verbal assent in the classroom. All respondents were anonymous. The data collection procedure was organized in the computer room in the school. In this study, data collection was conducted through two stages, which were pilot test and main survey from September 2021 to January 2022. Researchers conducted pilot test to ensure the internal consistency reliability of the scale before the data collection process [44]. The Cronbach’s alpha of each construct calculated by SPSS. Qualitative descriptors of satisfaction (α = .939), confirmation (α = .912), perceived usefulness (α = .866), self-efficacy (α = .854), information quality (α = .895), and continuance intention (α = .884) are satisfactory [21].
Guidance was designed for students when answering the questions. Respondents’ answers were recorded and collected by WJX.cn online. Guide teacher were invited to make sure students correctly understand the meaning of each item. Thus, the researcher firstly trained relative teachers who was responsible to the survey. The questionnaire for students were distributed when the students were having their information technology course. Teachers emphasized that the students should finish the questionnaire by themselves without any communication among them. Students were asked to listen carefully to the teacher when answering the item under the teachers’ administration.
Data analysis
After data collection, Statistical Package was used for statistical treatment to analyze and interpret data into meaningful results. IBM Statistical Package for the Social Science (SPSS) and AMOS version 23 software was applied in this study. Statistical treatment in this study included descriptive statistics and inferential statistics. The Cronbach’s Alpha coefficient and the Corrected Item-Total Correlation (CITC) was analyzed to ensure the internal consistency of the questionnaire. The study applied confirmatory factor analysis (CFA) to measure the validity. Before CFA, the study first performed exploratory factor analysis for checking correlation matrix, anti-image correlation matrix and the Kaiser-Meyer-Olikn (KMO) and the Bartlett’s sphere by SPSS to make sure data were suitable for CFA. The study chose Maximum Likelihood (ML) for structural equation models (SEM) to evaluate the model. Statistical significance of this study was set at p<0.05.
Results
Demographic characteristics of respondents
Demographic characteristics of junior high students were shown in Table 2 (N = 635). A total of 635 valid questionnaires were obtained in this study, of which 341 students (53.7%) were from K8, and 294 students (46.3%) were from K9. There were 319 male students (50.2%), and 316 female students (49.8%). The sample size was composed of Han people and 7 directly-entering-socialism groups, which were Va, Dai, Yi, Ladhull, Bai, Blang, and Yao in DESEC. And most of middle school students were Va people (84.4%). Most of students’ guardians were farmer (88.7%) coming from rural region.
Demographic characteristics of respondents’ experiences of blended learning
Table 3 revealed that whiteboard (67.7%), phone (53.4%) and computer (40%) were the three most accessible devices for blended learning (n = 635). Junior high school students’ blended learning experience period were more than 1 years. Most of students (55%) experienced blended learning for less than 3 years. There was still part of students reported that they hardly had time studying online in the classroom (22.9%) or after school (19%). Most students only could spend 0.5–1 hour studying online both in classroom (50.6%) and after school (45%).
Descriptive statistics of measurement scales
According to Cho & Teo, five level for evaluating the mean value of students’ level of agreement on each of item in the 5-point Likert scale were interpreted Strongly Agree (4.21–5.00), Agree (3.41–4.20), Uncertain (2.61–3.40), Disagree (1.81–2.60), and Strongly Disagree (0.00–1.80) [45]. The interpretation of students’ level of agreement on 6 variables were all “Agree”(3.76–3.89), as shown in Table 4.
Reliability and validity
In the study, six dimensions’ Cronbach’s Alpha ranged from 0.863 to 0.889 (see Table 5). It indicated that the intrinsic consistency reliability of the scale questions was satisfactory [46]. CITC values of items in this study shown as followed table ranged from 0.648 to 0.797, which was higher than 0.50 [47]. Thus, the instrument was reliable. All variable correlations in the correlation matrix were more than 0.3, the measure of sampling adequacy (MAS) values of a single variable on the diagonal of the reflection image correlation matrix in the study were greater than 0.5. Kaiser-Meyer-Olkin (KMO) value was 0.960, which meant very suitable when the value was higher than 0.9 [48], and the approximate chi-square of the Bartlett’s Test of Sphericity was large, and the p-value was significant (X2 = 9342.4, p< 0.01) indicated that correlations between items were sufficiently large [49]. All index met the conditions for factor analysis.
The result of CFA found that the factor loading values greater than 0.5 [50]. AVE value exceeded 0.50 which meant it was adequate for convergent validity. The CR values exceeded the limit of 0.6 for achieving convergent validity. The value of Critical Ratio (C.R.) is equal to the ratio between Estimate and the Standard Error of Estimate, which is equivalent to the T-value. If C.R. is higher than 1.96, the parameter estimate value reaches a significant level of 0.05 [51]. All significances were at the 0.001 significant levels (p<0.001). Therefore, it proved that all constructs were reliable and validated for further analysis.
Table 6 showed that the square root of the average variance extracted value was larger than the corresponding correlation coefficient, indicating that the discriminant validity of scale in this study was good [52].
Model fit and model result
Structural equation modeling (SEM) result was presented in Table 7. All the parameters, i.e. CMIN/df (= 2.974<3.0), GFI (= 0.918>0.90), AGFI (= 0.892>0.85), CFI (= 0.958 >0.95), NFI (= 0.938>0.90) and RMSEA (= 0.056 <0.08) met the standard. It indicated that the model was acceptable.
Hypothesis testing
The result of the structure model including standardized path coefficients(β), t-values, p-value, and explained variances (R2) was shown in Fig 2. The higher the value of R2, the higher the degree of interpretation, and the better the model. When R2, at least, is equal to or higher than 0.1(R2≥0.1), the model explaining Continuance Intention (R2 = 0.665), Satisfaction (R2 = 0.766) and Perceived usefulness(R2 = 0.718) were acceptable [53]. It indicates the research model in this study gained good explanatory power. Perceived usefulness (β = 0.593, p < 0.001) significantly impacted continuance intention [54–56]. Satisfaction (β = 0.397, p < 0.001) significantly impacted continuance intention [14,57,58]. Perceived usefulness (β = 0.317, p < 0.001) significantly affected satisfaction [59,60]. Confirmation (β = 0.567, p < 0.01) significantly affected satisfaction [14,61]. Information quality (β = 0.632, p < 0.001) significantly affected perceived usefulness [61,62]. Self-efficacy (β = 0.384, p < 0.001) significantly affected perceived usefulness [63]. However, confirmation(T-value = -1.401, p>0.05) did not statistically significantly affect perceived usefulness [62,64]. This is contrary to previous findings [25,65]. Hence, H01, H02, H03, H05, H06, and H07 were supported. H04 were not supported, thus the study accepted Ha4.
T-values and p-value are in parentheses, ***p<0.001.
Total effect (TE) is the accumulation of direct and indirect effects of a relationship path [66]. Direct, indirect, and total effects of relationships between variables were shown in Table 8. Total effects imposed on Satisfaction of blended learning, from strongest to weakest, was Confirmation (0.511***), Perceived Usefulness (0.337***), information Quality (0.211***), Self-efficacy (0.118***). Total effects exerted on Continuance Intention of blended learning, from most to least, was Perceived Usefulness (0.645***), Satisfaction (0.406***), Information Quality (0.404***), Self-efficacy (0.226***) and Confirmation (0.145***). Total effect of information Quality (0.628***) imposed on Perceived Usefulness was higher than Self-efficacy (0.350***).
Discussion
Instrument for blended learning was insufficient, especially mobile device in classroom in DESEC. Most students spent little time studying online. Why students face-to-face learning accounts for the majority of blended learning. And students’ agreement on each of item were interpreted as “Agree”, but not “Strongly Agree”. All conditions above limited junior students’ perception on blended learning in DESEC.
In this study, perceived usefulness was the most important factor affecting continuance intention, which is not consistent with most of previous studies proposing that satisfaction was the strongest predictor of continuance intention [27]. It indicated that usefulness overwhelms satisfaction as long as it improves students’ academic performance in DESEC where students’ performance was only evaluated by test score in exam-oriented assessment system.
Information quality was the most important antecedent acting on junior high students’ perceived usefulness of blended learning in DESEC, which further explained junior high students’ satisfaction and continuance intention of blended learning. Providing higher information quality increases the perceived usefulness by enhancing the fit between content and user’s information requirements [67]. Nowadays, the content of resources online is more focused on "teaching", and there is a serious shortage of high-quality information for students to learn independently in rural areas. What’ more, these resources only focus on students’ academic performance, and almost ignore moral education, physical education, art and labor education in China [7]. Thus, the critical direction of enhancing blended learning is to provide junior high students in DESEC with diverse learning resources based on their characteristics, interests and needs, and make prestigious teachers’ classes easily accessible through online technology.
Confirmation was the most important antecedent acting on junior high students’ satisfaction of blended learning in DESEC in this model. However, confirmation did not affect perceived usefulness. Bhattacherjee gave the hypothesis based on the cognitive dissonance theory. It suggests if user pre acceptance usefulness perceptions are disconfirmed during actual use, they may experience cognitive disorder [18]. Then users may remedy this dissonance by elevating their perceived usefulness. Further studies need to be conducted to explain the association between confirmation and perceived usefulness.
With technologies advancing rapidly, machines will replace humans in experience-based predictions, decision making, optimizations, data analysis, and others [68]. Machine learning is becoming essential for teaching and learning. In this way, by providing the learning algorithm with experience data, the model in this study will be used to train machine predicting students’ satisfaction and enhancing their continuance intention of blended learning in the future [69–71].
Conclusion
The study enhances the understanding of blended learning of middle school students on their satisfaction and intention to continue blended learning in DESEC. Perceived usefulness is the strongest predictor of continuance intention, while Confirmation was the strongest predictor acting on junior high students’ satisfaction of blended learning in DESEC. Perception of blended learning for junior high students formed, but is not strong in DESEC. Instrument for blended learning is insufficient, especially mobile device in classroom. Perceived usefulness overwhelms satisfaction as the strongest predictor of continuance intention, and traditional learning (face to face) still takes advantage for an exam-oriented assessment system in DESEC.
Acknowledgments
The authors would like to acknowledge the efforts of the data collectors involved in the study.
References
- 1. Yang HB. An Analysis on the Early Founding of China’s Straight Area in Yunnan Education across its Development and History. Journal of Chuxiong Normal University. 2015;30(7):92–95.Chinese.
- 2. Wang JY, Tang Y. Cultural Lag: research on Female Education for Ethnic Groups Directly Entering the Socialist Society in Yunnan. Journal of Chuxiong Normal University. 2020;35(4):131–137. Chinese.
- 3. Mai WH. Yunnan: the whole “DESE family” get rid of poverty. Xiaokang. 2020;1(35):38–41. Chinese.
- 4. You WQ, Zeng YL. Research on the Development Drives of China’s Smaller-populated Ethnic Groups——Based on the Poverty Alleviation Practice of Yunnan DESE. Yunnan Social Sciences. 2020;1(6):117–124. Chinese.
- 5. Lei L-h. A Research Review on the Balanced Development of Urban and Rural Education Promoted by Educational Informatization in China. e-Education Research. 2019;1(2):38–44. Chinese.
- 6. Wang SL. Collaborative development of urban and rural schools: Strategic practice of regional deep blended learning. Educational Science Research. 2022;1(8):93–96.Chinese.
- 7. L Y. Research on the strategy of implementing "Internet + education" in rural districts and counties under the background of epidemic prevention and control. Chinese Journal of ICT in Education. 2021;1(3):75–78. Chinese.
- 8. Ning BT, Gao XX. Back to the Origin of Education: the Effectiveness, Problems and Trend of Online Teaching in Primary Schools. Chinese Journal of ICT in Education. 2020;1(11):46–51.Chinese.
- 9. L Y, Yang HX. The dilemma and countermeasures of the informatization development of urban and rural compulsory education. Journal of Educational Science of Hunan Normal University. 2022; 21(3): 97–108. Chinese.
- 10. Deci EL, Ryan RM. The general causality orientations scale: self-determination in personality. Journal of Research in Personality. 1985;19(2):109–134.
- 11. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist. 2000;55(1):68–78. pmid:11392867
- 12. Davis FD. A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results [dissertation]. Massachusetts Institute of Technology: Wayne State University; 1986.
- 13. Cheng YM. Why do users intend to continue using the digital library? An integrated perspective. Journal of Information Management. 2014;66(6):640–662.
- 14. Cheng YM. Quality antecedents and performance outcome of cloud-based hospital information system continuance intention. Journal of Enterprise Information Management. 2020;33(3): 654–683.
- 15. Lee YC. An empirical investigation into factors influencing the adoption of an e-learning system. Online Information Review. 2006; 30(5): 517–541.
- 16. Oliver RL. A cognitive model of the antecedents and consequences of satisfaction decisions. Journal of Marketing Research. 1980;17(4):460–469.
- 17. Oliver RL. Cognitive, Affective, and Attribute Bases of the Satisfaction Response. Journal of Consumer Research. 1993;20(10):418–430.
- 18. Bhattacherjee A. Understanding information systems continuance: an expectation confirmation model. MIS Quarterly. 2001; 25(3):351–370.
- 19. Niu Z, Cole CD, Schneider R. Motivation to Share on a Mobile Social Network: A Qualitative Study of Motivation Behavior. e-Journal of Social & Behavioural Research in Business. 2021; 12(1):1–13.
- 20. Seddon PB. A respecification and extension of the DeLone and McLean model of IS success. Information systems research. 1997;8(3): 240–253.
- 21. Bandura A. Social Foundations of Thought and Action. Prentice-Hall; 1986.
- 22.
Bandura A. Self-efficacy: The exercise of control. New York, NY: W.H. Freeman and Company; 1997.
- 23. Pekkala K, van Zoonen W. Work-related social media use: The mediating role of social media communication self-efficacy. European Management Journal. 2022; 40(1): 67–76.
- 24. DeLone WH, McLean ER. Information systems success: the quest for the dependent variable. Information Systems Research. 1992;3(1): 60–95.
- 25. Cheng YM. What drives cloud ERP continuance? An integrated view. Journal of Enterprise Information Management. 2018;31(5):724–750.
- 26. Cheng YM. A hybrid model for exploring the antecedents of cloud ERP continuance: Roles of quality determinants and task-technology fit. International Journal of Web Information Systems. 2019;15(2):215–235.
- 27. Yan M, Filieri R, Gorton M. Continuance intention of online technologies: A systematic literature review. International Journal of Information Management. 2021;58:102315.
- 28. Rovinelli RJ, Hambleton RK. On the use of content specialists in the assessment of criterion-referenced test item validity. Dutch Journal of Educational Research. 1976;2:49–60.
- 29. Hambleton RK. Criterion-referenced testing and measurement: A review of technical issues and developments. Review of Educational Research. 1978;48(1):1–47.
- 30. Tangviriyapaiboon D, Sirithongthaworn S, Apikomonkon H, Suyakong C, Srikummoon P, Kawilapat S, et al. Development and psychometric evaluation of a Thai Diagnostic Autism Scale for the early diagnosis of Autism Spectrum Disorder. Autism Research. 2022;15(2):317–327. pmid:34697914
- 31. Almaiah M A, Alismaiel O A. Examination of factors influencing the use of mobile learning system: An empirical study. Education and Information Technologies, 2019,24(1): 885–909.
- 32. Alkhawaja MI, Abd Halim MS, Abumandil MSS, et al. System Quality and Student’s Acceptance of the E-learning System: The Serial Mediation of Perceived Usefulness and Intention to Use. Contemporary Educational Technology. 2022;14(2): ep350.
- 33. Mohamed N., Hussein R., Zamzuri N. H. A., & Haghshenas H. Insights into individual’s online shopping continuance intention. Industrial Management & Data Systems.2014; 114(9): 1453–1476.
- 34. Warren L, Reilly D, Herdan A, Lin Y. Self-efficacy, performance and the role of blended learning. Journal of Applied Research in Higher Education. 2020;13(1):98–111.
- 35. Joo S, & Choi N. (2016). Understanding users’ continuance intention to use online library resources based on an extended expectation-confirmation model. The Electronic Library, 34(4): 554–571.
- 36. Yang H, Cai J, Yang H H, et al. Examining key factors of beginner’s continuance intention in blended learning in higher education. Journal of Computing in Higher Education, 2022 May: 1–18. pmid:35637707
- 37. Mohammadi S, Isanejad O. Presentation of the extended technology acceptance model in sports organizations. Annals of Applied Sport Science. 2018; 6(1): 75–86.
- 38. Vermunt J D, Donche V. A learning patterns perspective on student learning in higher education: state of the art and moving forward. Educational psychology review. 2017;29(2): 269–299.
- 39. Leon S. (2018). Service mobile apps: a millennial generation perspective. Industrial Management & Data Systems, 118(9): 1837–1860.
- 40. Alfaki I A. Delone and McLean information systems success model in a blended-learning context. International Journal of Information and Communication Technology Education. 2021;17(4): 1–17.
- 41. Ghazali E, Mutum DS, Woon M-Y. Exploring player behavior and motivations to continue playing Pokémon GO. Information Technology & People. 2019;32(3): 646–667.
- 42. Li Y, Nishimura N, Yagami H, et al. An empirical study on online learners’ continuance intentions in China. Sustainability. 2021;13(2): 889.
- 43. Pei W, Mayer A, Tu K, et al. Attention please: Your attention check questions in survey studies can be automatically answered. Proceedings of The Web Conference. 2020 April: 1182–1193.
- 44. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3): 297–334.
- 45. Cho EY, Teo A. Students’ motivational orientations and attitude toward English learning: A study in the Deep South of Thailand. Asian Social Science. 2014;10(13):46–54.
- 46. Passias P G, Pierce K E, Krol O, et al. Health-related quality of life measures in adult spinal deformity: can we replace the SRS-22 with PROMIS?. European Spine Journal. 2022; 31(5): 1184–1188. pmid:35013830
- 47. Li M, He S, Wang J. Development and validation of a new short form of the self-management ability questionnaire for patients with chronic periodontitis. Community Dent Oral Epidemiol. 2022;50(3): 147–224.
- 48. Liu H. Advanced Statistics for Psychology. Renmin University of China Press; 2019.Chinese.
- 49. Purba J, Samuel S, Budiono S. Collaboration of digital payment usage decision in COVID-19 pandemic situation: Evidence from Indonesia. International Journal of Data and Network Science. 2021;5(4): 557–568.
- 50. Yang Y, Peng D, Xie F. A Study on the Effects of TAM/TPB-based Perceived Risk Cognition on User’s Trust and Behavior Taking Yu’ebao, a value-added Payment Product, as an Example. Management Review. 2016; 28(06):229–240.Chinese.
- 51. Alias N, Awang Z, Muda H, Mazlan NH. Supporting the Policy Implementation Performance of Public Primary School Leaders in Malaysia: A Confirmatory Factor Analysis (CFA) of Public Leadership. The Journal of Management Theory and Practice (JMTP). 2021 October: 1–7.
- 52. Rönkkö M, Cho E. An updated guideline for assessing discriminant validity. Organizational Research Methods, 2022, 25(1): 6–14.
- 53. Falk R, Miller N. A Primer for Soft Modeling. University of Akron Press; 1992.
- 54. Suriazdin S A, Hidayanto A N, Maulida M, et al. Technology Attractiveness and Its Impact on MOOC Continuance Intention. International Journal of Emerging Technologies in Learning. 2022; 17(4):239–250.
- 55. Wang X, Lu A, Lin T, Liu S, Song T, Huang X, et al. Perceived usefulness predicts second language learners’ continuance intention toward language learning applications: a serial multiple mediation model of integrative motivation and flow. Education and Information Technologies. 2022;27: 5033–5049.
- 56. Kim R, Song HD. Examining the influence of teaching presence and task-technology fit on continuance intention to use MOOCs. The Asia-Pacific Education Researcher. 2020; 31(4): 395–408.
- 57. Tam C, Barroso M, Cruz-Jesus F. Understanding the determinants of users’ continuance intention to buy low-cost airline flights online. Journal of Hospitality and Tourism Technology. 2022;13(2): 264–280.
- 58. Ramadhan A, Hidayanto AN, Salsabila GA, Wulandari I, Jaury JA, Anjani NN. The effect of usability on the intention to use the e-learning system in a sustainable way: A case study at Universities Indonesia. Education and Information Technologies. 2022; 27(2):1489–1522.
- 59. Wang T, Lin CL, Su YS. Continuance intention of university students and online learning during the COVID-19 pandemic: A modified expectation confirmation model perspective. Sustainability. 2021;13(8):1–15.
- 60. Ashrafi A, Zareravasan A, Rabiee Savoji S, Amani M. Exploring factors influencing students’ continuance intention to use the learning management system (LMS): A multi-perspective framework. Interactive Learning Environments. 2020 February:1–23.
- 61. Li Y, Nishimura N, Yagami H, Park HS. An empirical study on online learners’ continuance intentions in China. Sustainability. 2021; 13(2): 889.
- 62. Suzianti A, Paramadini SA. Continuance intention of e-learning: The condition and its connection with open innovation. Journal of Open Innovation: Technology, Market, and Complexity. 2021;7(1):97–110.
- 63. Qin C, Liu Y, Mou J, Chen J. User adoption of a hybrid social tagging approach in an online knowledge community. Aslib Journal of Information Management. 2019; 71(2):155–175.
- 64. Joo YJ, Kim N, Kim NH. Factors predicting online university students’ use of a mobile learning management system (m-LMS). Educational Technology Research and Development. 2016;64(4): 611–630.
- 65. Shiau WL, Yuan Y, Pu X, Ray S, Chen CC. Understanding fintech continuance: perspectives from self-efficacy and ECT-IS theories. Industrial Management & Data Systems. 2020;120(9):1659–1689.
- 66. Raykov T, Marcoulides GA. A method for comparing completely standardized solutions in multiple groups. Structural equation modeling.2000;7(2):292–308.
- 67. Lin H F. The role of online and offline features in sustaining virtual communities: an empirical study. Internet Research.2007;17(2):119–138.
- 68. Zhou ZH. Machine learning. Springer Nature;2021.
- 69.
Rashid E, Ansari MD, Gunjan VK, Khan M. Enhancement in teaching quality methodology by predicting attendance using machine learning technique. In: Gunjan VK, Zurada JM, Raman B, Gangadharan GR, editors. Modern approaches in machine learning and cognitive science: a walkthrough, Springer, Cham;2020. pp. 227–235.
- 70. Sethi K, Jaiswal V, Ansari MD. Machine learning based support system for students to select stream (subject). Recent advances in computer science and communications.2020; 13(3):336–344.
- 71.
Rashid E, Ansari M, Gunjan VK. Innovation and Entrepreneurship in the Technical Education. In: ICCCE 2021. Springer, Singapore;2022.pp. 1199–1203.