https://orcid.org/0000-0001-9727-7804
Figures
Abstract
Game-based virtual reality phone applications can create a realistic environment to prepare for clinical applications and improve students’ knowledge of and compliance with standard precautions. An experimental study was performed among 126 nursing students’ from the third and fourth nursing levels to determine the effect of online education and game-based virtual reality phone applications related to standard precautions. Students were divided randomly into two groups; the experimental group used online education and game-based virtual reality phone applications, while the control group used traditional education. The study was performed between July and August 2019 to prevent clashes with lectures and midterm and final examinations. A tool package including knowledge, attitude, and compliance with standard precautions was used in pre-and post-tests among nursing students. The results showed that the knowledge of, attitudes towards, and compliance with standard precautions differed between the two groups. The performance of the experimental group of nursing students significantly improved with online instruction and game-based virtual reality phone applications. This study demonstrated the effectiveness of online education and game-based virtual reality phone application among nursing students.
Citation: AL-Mugheed K, Bayraktar N, Al-Bsheish M, AlSyouf A, Aldhmadi BK, Jarrar M, et al. (2022) Effectiveness of game-based virtual reality phone application and online education on knowledge, attitude and compliance of standard precautions among nursing students. PLoS ONE 17(11): e0275130. https://doi.org/10.1371/journal.pone.0275130
Editor: Heng Luo, Central China Normal University, CHINA
Received: April 6, 2022; Accepted: September 10, 2022; Published: November 3, 2022
Copyright: © 2022 AL-Mugheed et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
A Hospital-Acquired infection (HAI) is an infection created in a hospital setting that was neither incubating at the time of admission nor represented two days or more after admission [1]. The World Health Organization emphasizes that HAIs have become a crucial and universal issue for patient safety, impacting hundreds of millions globally [2]. HAIs are a concern in developing nations, impacting up to 25% of hospitalized patients [3]. HAI contributes to prolonged hospitalization, lengthened patient care, increased care expenses, and increased suffering of patients and their families due to HAI complications [4, 5].
The World Health Organization considers standard precautions the first line of defense for preventing the spread of infections [2]. Standard precautions are principles and practices applied to protect a healthcare professional’s team and patients and reduce the risk of transmission from pathogens [1]. These precautions include hand washing, hand rub, gowns, gloves, masks, goggles, and face shields [1]. Studies of low- and middle-income countries indicated that nursing students’ knowledge, attitude, and compliance with standard precautions were low and inadequate [6, 7]. Al-Rawajfah and Tubaishat (2015) conducted a study that evaluated knowledge and practice of standard precautions among nursing students in Jordan; students had overall satisfactory knowledge, with a mean of 13.8 out of 18 [6]. In Darawad and Al-Hussami’s study, students showed inadequate knowledge of infection control precautions. In a multi-university study in Saudi Arabia, nursing students reported moderate compliance regarding standard precautions during their clinical practice [7]. These results may be attributed to dissatisfaction and lack of infection control course content in nursing schools [8], weak clinical experience, or lack protective supplies [9]. During clinical training, these might impact students’ compliance and performance regarding standard precautions skills and may become a cross-infection source [9]. In this regard, prevention and education are significant aspects of nursing.
The educational process of health professions like nursing is unique because a student must not just understand concepts but be able to use practices in real-life situations, which are desired competencies for graduation [10]. Nursing lecturers face several challenges in modern teaching methods in transitioning a student from an inexperienced to an experienced practitioner [11, 12]. For this reason, using an innovative approach, like virtual reality, is essential.
In recent years, online education and new technologies have increased in nursing education. Online education has been supported for its capacity to de-centralize the teaching process and evolve from conventional learning to a student-centered approach [13, 14]. This approach allows students to use different technologies to help them understand educational lectures prior to the class and then to apply this knowledge based on instructors supervision [15]. Online education allows faculty lecturer to engage large groups of students simultaneously with synchronous and asynchronous learning options [16]. During online classes, students can utilize time via problem solving, group discussions, and active learning activities [17]. Several studies indicated that online education is an innovative method, helps with knowledge retention, and is a more exciting way to acquire knowledge about standard precautions than other tactics [18, 19].
Virtual reality (VR) is an artificial computer-created setting examined by sensory stimuli and is a social constructivism approach to learning [20]. It is a powerful education method that engages students in active participation, problem-solving and interactive teaching [21]. VR is a three-dimensional computer-based simulation that reinforces pragmatic student education in a clinical setting. It provides students the feeling of being present engaging their sensory organs [22, 23]. A virtual environment facilitates and boosts the education of many students at once and at locations without instructor engagement during undertaking learning or practice [24]. The literature indicates that virtual reality improves nursing students’ knowledge and skills outcomes compared to traditional approaches [25, 26]. A review identifying the impacts of integrating virtual reality in nursing education programs found increased enjoyment and engagement in learning, a willingness to learn without feeling bored, and enhanced competence and confidence among students [23].
Along these lines, a game-based virtual reality phone application is a gamification technology that offers students opportunities to experience real-life perspectives and touch things not actually there [25]. Using a game-based virtual reality phone application, a teacher creates a game scenario and content and uploads it to a phone application. Then, pre-class learning based on the game is conducted, the application is downloaded, and the game is played [11, 27]. A game-based virtual reality phone application capitalizes on features that dramatize a situation, make participating fun, and utilize outcomes for learning [25]. In this method, the content of games is drawn from realist-life situations and shifted to computer situations on mobile phones, tablets, and iPad devices. This method allows students access to information at any time and place and assists students in gaining individual theoretical and practical time to achieve skill proficiency [11, 25]. Several advantages of game-based virtual have been noticed. These include improved skills and knowledge, self-efficacy, psychomotor skills, and self-learning [25, 27]. Therefore, it enhances student satisfaction, retention in the learning process, and easy access to information [26].
Using two educational approaches online instruction and virtual reality have significantly improved knowledge acquisition and satisfaction among undergraduate nursing students [19, 28–30]. Furthermore, it has great potential in providing experiential, repeatable learning opportunities for students to learn collaboratively [31, 32]. The learning outcomes involved not only pedagogical achievements (e.g. knowledge), but also enjoyment, satisfaction, and clinical experience [33]. Clinical experience offers sense to the learning process, allowing for authentic and genuine learning to occur [34]. Existing evidence suggests that positive clinical experiences increase feelings of enjoyment and satisfaction, which translate into applying gained knowledge to clinical practice [35]. Further studies are needed to increase evidence regarding the effectiveness of innovative educational methods to improve the quality of nursing education.
Objectives
The study’s main objective was to assess the effectiveness of online instruction and game-based virtual reality phone applications compared with traditional education related to knowledge, attitudes, and compliance with standard precautions among nursing students.
Research hypotheses
H1. Nursing students who complete online instruction will have higher knowledge toward standard precautions than the traditional educational group.
H2. Nursing students who complete online instruction will have higher attitudes toward standard precautions than the traditional educational group.
H3. Nursing students who complete a game-based VR phone application will exhibit higher compliance with standard precautions than the traditionally-lab class.
Methods
Study setting and sample
The study was conducted among nursing students at one of the largest universities in North Cyprus. The target comprised international students at the third and fourth- nursing levels because they have enough clinical practice credit hours and are close to graduation. The sample size was calculated using Raosoft sample calculator software, with a margin of error of 0.05, 95% confidence level, and 50% response distribution. The recommended minimum sample size was 100.
The total number of students at the third and fourth-nursing levels was 135, and 126 met the following inclusion criteria. They were to have attended and passed two main courses of the nursing program, Fundamentals of Nursing and Medical-Surgical Nursing, have a smartphone with an Android system, have Internet access, and have enough credit hours of clinical practice. Students who did not have the main professional courses or enough credit hours of clinical practice were excluded.
The students were divided randomly into the experimental and control groups. Each group began with 63 students; however, 4 students did complete the pre-test in the control group, and their data was dropped from the analysis. The experimental group’s participation rate was 100%, while the control group’s was 96%. See Fig 1.
Study tool
Study researchers set up the tool package according to relevant literature and Centers for Disease Control and Prevention guidelines concerning knowledge, attitude, and compliance with standard precautions [1, 6–8].The demographic characteristics of the nursing students include age, gender, nursing level, and a previous infection control course. The knowledge of and attitudes toward standard precautions were developed based on previous studies [6, 8]; knowledge of standard precautions involved 18 items, and 16 items were attitudes toward standard precautions. The maximum high knowledge score was 18, “yes,” answers were recorded as 1, and “no” as 0. The cut-off points for good knowledge were > 9. The maximum high attitude score was 16, “yes,” answers were recorded as 1, and “no” received 0. The cut-off points for good attitude were > 8.
The last section included a checklist for compliance with standard precautions [7, 8]. The checklists involved 14 hand hygiene items, personal protective equipment, 11 items, and sharp safety, 10 items, and transmission-based precautions, 15 items. The observational checklist for compliance with standard precautions included 50 items with three options per item; completely done was 2, partially done was 1, and not done was 0. The total mean performance ranged from 0–100, with 50–100 categorizing high performance and 0–49 categorizing low performance. The cut-off point and pass level in practical exams were 50%.
A professor of infectious disease consultant examined all study tools to prevent inaccuracy and difficulty in understanding and validated them. The content validity analysis showed CVI scores above 0.87, demonstrating excellent content validity. The findings of the psychometrics revealed acceptable reliability and validity (Cronbach’s alpha = 0.74). The reliability consistency coefficients were 0.75, 0.73, 0.68, for knowledge, attitude, and compliance subscales, respectively.
The researchers prepared the educational content regarding standard precautions in line with the recent recommendations of the US Centers for Disease Control and Prevention 2016 [1]. Topics of the educational material included: emerging infectious diseases, hospital-acquired infections, infection control precaution guidelines, and standard precautions (hand hygiene, personal protective equipment, sharps safety, transmission-based precautions). Three experts in infection control reviewed the educational content to assess its content validity, and modifications were made based on the experts’ recommendations.
Ethical approval
Ethical approval was obtained from the university’s institutional review board (No. 2019\71\877). Participants were given informed consent and received a code number to be more assured of privacy and complete confidentiality. Students were reassured that participation was voluntary and would not affect their grades. After the ethical approval, the study was carried out during the summer period of July and August 2019 to prevent clashing with midterm and final exam dates and lectures.
Implementation
Experimental group.
Pre-Experiment. The course began in July 2019. The study group received an email that included the link to create an account in the e-learning platform. A pre-test exam before the intervention was held in the classroom, with 40 minutes for completion, which included the first and second parts related to knowledge and attitude toward standard precautions. For the standard precautions observation exam, the principal investigator arranged the observations exam station in the fundamentals of nursing laboratory, which was included four stations. The first station assigned hand hygiene, the second station assigned personal protective equipment, the third station featured sharps safety, and the last station included transmission-based precautions. Each student approved the start of the observation exam to prevent forcing and stress. No feedback or correction was provided on their performance.
Intervention. Five live lessons lasting 10 to 15 minutes each were recorded and uploaded to the e-learning platform so students could re-listen and re-watch them. Quizzes followed each live lesson to ensure students had learned suitable knowledge and evaluated themselves. The total duration was 5 running weeks in July and August 2019.
The second intervention was related to standard precautions compliance using game-based virtual reality phone applications divided into two parts; the first part included a video regarding steps demonstration of standard precautions compliance checklists. The total duration of the video was 3 minutes. The second part was the game, created using Adobe Flash Professional CC and Adobe Flash CS6. The game had four scenarios; the first scenario was related hand hygiene (the 1min, 30s) followed by personal protective equipment (2 min, 15s), sharps safety (1min, 43s), and transmission-based precautions (3min, 23s). The total play game was 8 min, 11s.
To ensure that the game-based virtual reality phone application worked and downloaded correctly, the students downloaded game applications on their mobile phones in the fundamentals nursing laboratory according to the principal investigator’s instructions. After confirming that students downloaded the game correctly, they were given one week to play and re-play the games at will. During this week, the principal investigator randomly divided the students into 3 groups, with 21 students in each group, to enhance team-based learning. After completing the week, each group demonstrated the standard precautions compliance within two hours in the laboratory on the same day under the supervision of the principal investigator.
Post-Intervention tests. The students repeated the second part of the standard precautions’ knowledge and attitude test held in the classroom in August 2019. For the standard precautions observation exam, the student was asked to repeat the observation exam in a fundamentals nursing laboratory with the same evaluation criteria as the pre-test.
Control group
Pre-Intervention. The course began in July 2019. The course was held for each group separately to prevent clashes between groups. The principal investigator arranged the classroom to perform the pre-test exam regarding knowledge and attitude of standard precautions. A standard precautions observation exam the same as for the experimental group was given. The pre-test exam items, observation exam, instructor, examiner, and completion were as same as the experimental group.
Intervention. Traditional teaching methods like PowerPoint presentation slides and printouts were applied for knowledge and attitude of standard precautions in the classroom. The students received five lectures; the duration of each lecture, the number of weeks, and the total lecture durations were the same as the experimental group. Each student received a hard copy of the material at the end of each topic. The students had a one-hour class in the laboratory, using PowerPoint presentation slides and hardcopy material to learn about complying with standard precautions. There were no further interventions or demonstrations related to standard precautions.
Post-Intervention test. The knowledge and attitude of standard precautions exams were repeated in the classroom, and a standard precautions observation exam was repeated the same as in the experimental group.
Data analysis
Data were analyzed using the Statistical Package for Social Science (SPSS) version 20. Frequency and percentages were conducted to analyze the descriptive statistics of the participants. The Kolmogorov–Smirnov normality assessment test confirmed the normality distribution data, and parametric tests were used. An independent sample t-test was conducted for group comparison, and paired t-tests compare the score for each group before and after the intervention. Statistical significance was set at p< 0.05.
Results
Table 1 presents the demographic statistics. The results illustrated that the mean age of students in the control group was 23.1± 8.3 years, while it was 22.9±6.8 years in the experimental group. Most participants were female in both groups. The fourth nursing class was featured, and most students in both groups had received previous infection control education. There was no statistically significant difference between both groups concerning descriptive characteristics at p > 0.05. Thus, the homogeneity was confirmed in both groups in the study.
An independent t-test of the mean scores of standard precautions knowledge, and attitude domains between the online education and traditional learning groups showed no statistically significant difference in mean scores between the two groups in the pre-test (p = 0.11, p = 0.13) respectively. However, after the intervention, the online education group had higher mean scores for standard precautions knowledge and attitude domains than the traditional lecture group (p = 0.001, p = 0.002).
In a pre-test and post-test comparison of the mean scores of standard precautions knowledge domain pretest (M = 9.5±2.4, posttest M = 12.3±1.1 p = 0.10), and attitude domain pretest (M = 6.1±1.4, posttest M = 9.3±2.5 p = 0.15) in the traditional learning group, the paired t-test showed no statistically significant improvement.
However, the online education group showed statistically significant improvement in mean scores of standard precautions knowledge domain pretest (M = 10.4±2.6, posttest M = 13.2±2.7 p = 0.002), and attitude domain (M = 8.7±2.2, posttest M = 11.2±1.5 p = 0.003) in the post-test compared with the pre-test (Table 2).
A comparison of the mean scores of standard precautions compliance domains between the game-based virtual reality phone application and laboratory class groups with the independent t-test showed no statistically significant difference in all compliance domains mean scores between the two groups in the pre-test (p = 0.21, p = 0.19, p = 0.11, p = 0.10 respectively). However, the results showed a statistically significant difference; the game-based virtual reality phone application group had higher mean scores of compliance domains than the traditional lecture group (p = 0.01, p = 0.01, p = 0.02, p = 0.04) (Table 3).
In the pre-test and post-test comparison of the mean scores of standard precautions in compliance domains in the traditional learning group, the paired t-test showed no statistically significant improvement. However, in the game-based virtual reality phone application, the results showed statistically significant improvement in mean scores of all compliance domains in the post-test compared with the pre-test (Table 3).
Discussion
In this experimental design performed to assess the effectiveness of online instruction and game-based virtual reality phone application and traditional education on knowledge, attitude, and compliance with standard precautions among nursing students. The results showed significant improvement in both educational approaches the online education and game-based virtual reality phone applications compared with traditional education and traditionally-lab class.
The online education group showed significant compared with traditional education group in terms of knowledge and attitudes of standard precautions. The results confirmed the effectiveness of online teaching methods for nursing students in standard precautions education. In recent studies, the online teaching methods significantly improved nursing students related standard precautions knowledge and attitudes [18, 19, 36]. The significant improvement can be attributed to multiple topics and various teaching used for the intervention group. Moreover, online instruction provides opportunities for learners to repeat materials and use their knowledge in practice. Online learning focuses on learner-to-learner and teacher-to-student interaction so that students can obtain effective feedback at the right time [37, 38]. As online learning environments are improved with different technology ways, students expect teachers to keep technical proficiency in order to maintain online courses free of challenges such as technical issues and Interaction and engagement during using communication platforms [39].
Another finding was that the mean scores regarding compliance with standard precautions among participants who used game-based virtual reality phone applications were significantly increased compared to the traditionally-lab class. The significant improvements may be explained that the kind of these applications lets students re-watch and re-play at any place and time, allows students to learn to apply the standard precautions without errors according to the followed procedural steps so that it might have helped the student use this skill correctly during the standard precautions’ observation exam, and become more independent learning, where nursing students can go at their own pace, without the pressure of traditionally scheduled instruction [40, 41]. Studies in the relevant literature show the effectiveness of game-based virtual reality phone applications in education [25, 42]. In Bayram and Caliskan’s study, the experimental group improved more than the control group after using a game-based virtual reality phone application [25]. A study on nursing students showed that the game-based virtual reality application significantly improved advanced life support [42]. Tsai et al. assessed the effectiveness of computer games for increasing nurses’ understanding of chronic obstructive pulmonary disease, finding that their COPD care knowledge scores significantly improved after playing the game [27]. However, game-based virtual reality applications have proven valuable in teaching psychomotor skills and enhance the visual clinical environment, such as personal protective equipment and sharps safety, which are too tough to understand through a single observation in the traditionally-lab class. In addition the game virtual simulation offered an identical experience of a real clinical condition where they could see the effect of their clinical practice decisions in the virtual scenario without creating patient harm [43].
Conversely, the overall mean scores of the traditional group showed no statistically significant difference, which did not align with an experimental study performed among Jordanian nursing students in terms of infection prevention [36]. Traditional teaching is seen as monotonous and focuses on assessment paradigms that promote educators’ ability to repeat facts without really understanding the content. Educators may feel more comfortable using traditional teaching [29, 44]. However, educational methods should be improved in parallel with new technology to increase the effectiveness of nursing education, and encourage effective learning and improve students’ professional knowledge and skills.
The current study has limitations that need to be addressed. First, experiments produce artificial situations and results; results may only apply to one situation and may be difficult to replicate. Second, the study was implemented in one nursing school, and the results cannot be generalized. Third, no observations confirmed that students played the game entirely after leaving the laboratory.
Conclusion
The results showed that integrated online education and game-based virtual reality phone applications showed statistically significant improvements toward standard precautions to traditional lectures. Based on the study results, using online education and game-based virtual reality phone application effectively transmits theoretical knowledge to practice among students and prepares them for professional life. This study contributes to a better understanding of the effectiveness of innovative educational methods in nursing education. The study results may help develop educational strategies in nursing. School managers and faculty members should improve methods used in nursing education in parallel with new technology to improve nursing students’ knowledge, attitude, and compliance regarding standard precautions. Qualitative research can be conducted to evaluate students’ views on new educational approaches more deeply in the future.
References
- 1.
Centers for Disease Control and Prevention. 2016. Hospital-acquired infection. https://www.cdc.gov/hai/index.html.Accessed: March 4, 2016.
- 2. World Health Organization, 2019. The burden of health care-associated infection worldwide https://www.who.int/infection-prevention/publications/burden
- 3. Bardossy AC, Zervos J, Zervos M. Preventing Hospital-acquired Infections in Low-income and Middle-income Countries: Impact, Gaps, and Opportunities. Infect Dis Clin North Am. 2016; 30 (3), 805–818. pmid:27515149
- 4. Heister T, Kaier K, Wolkewitz M. Estimating the burden of nosocomial infections: time dependency and cost clustering should be taken into account. Am J Infect Control. 2017; 45(1): 94–95. pmid:27836389
- 5. Nasiri A, Balouchi A, Rezaie-Keikhaie K, Bouya S, Sheyback M, Rawajfah OA. Knowledge, attitude, practice, and clinical recommendation toward infection control and prevention standards among nurses: A systematic review. Am J Infect Control. 2019; 47(7), 827–833. pmid:30612817
- 6. AL-Rawajfah OM, Tubaishat A. Nursing students’ knowledge and practices of standard precautions: a Jordanian web-based survey. Nurse Educ Today. 2015; 35 (12), 1175–1180. pmid:26043655
- 7. Alshammari F, Jonas PC, Alquwez N, Almazan J, Alsolami F, Tork H, et al., Compliance with standard precautions during clinical training of nursing students in Saudi Arabia: A multi-university study. J Infect Dev Ctries. 2018; 12(11):937–945. pmid:32012122
- 8. Al-Hussami M, Darawad M. Jordanian nursing students’ knowledge of, attitudes towards, and compliance with infection control precautions. Nurse Educ Today. 2013;33(6): 580–583. pmid:22789874
- 9. Askarian M, Memish ZA, Khan AA. Knowledge, practice, and attitude among Iranian nurses, midwives, and students regarding standard isolation precautions. Infect Control Hosp Epid. 2007; 28 (2), 241–244.
- 10. Öztürk D, Nurcan Ç, Zehra GB, Ayise K, Hatice K. Determining the effect of periodic training on the basic psychomotor skills of nursing students. Nurse Educ Today. 2015; 35(2): 402–407. pmid:25466792
- 11. Butt A, Kardong-Edgren S, Ellertson A. Using game-based virtual reality with haptics for skill acquisition. Clin Simul Nurs. 2018; 16: 25–32. https://doi.org/10.1016/j.ecns.2017.09.010
- 12. Irwin P, Coutts R. A systematic review of the experience of using second life in the education of undergraduate nurses. J Nurs Educ. 2015; 54 (10): 572–577. pmid:26431517
- 13. AL-Mugheed K, Bayraktar N. Effectiveness of flipped classroom among nursing students on venous thromboembolism (VTE). Niger J Clin Pract. 2021; 24 (10): 1463–1470. pmid:34657011
- 14. AL-Mugheed K, Bayraktar N. Effectiveness of a venous thromboembolism course using flipped classroom with nursing students: A randomized controlled trial. 2021; 30(3): 623–629. pmid:33782992
- 15. Al‐Hammouria MM, Rababahb JA, Rowland ML, Tetreaultd AS, Aldalaykeha M. Does a novel teaching approach work? A students’ perspective. Nurse Educ Today. 2020;85:104229. pmid:31738975
- 16. Kumar A, Sarkar M, Davis E, Morphet J, Maloney S, Ilic D, et al. Impact of the COVID-19 pandemic on teaching and learning in health professional education: a mixed methods study protocol. BMC Med Educ. 2021; 21 (1): 439. pmid:34412603
- 17. Pei L, Hongbin Wu. Does online learning work better than offline learning in undergraduate medical education? A systematic review and meta-analysis. Med Educ Online. 2019; 24 (1): 1666538. https://doi.10.1080/10872981.2019.1666538.
- 18. Xiong P, Zhang J, Wang X, Wu TL, Hall BJ. Effects of a mixed media education intervention program on increasing knowledge, attitude, and compliance with standard precautions among nursing students: A randomized controlled trial. American Am J Infect Control. 2017; 45(4): 389–395. https://doi.10.1016/j.ajic.2016.11.006.
- 19. Kappes MS. Influence of undergraduate nursing student teaching methods on learning standard precautions and transmission-based precautions: Experimental research. Nurse Educ Today. 2018; 61,101–105. pmid:29195210
- 20.
Merriam-Webster Virtual Reality. https://www.merriam-webster.com/dictionary/virtual. Accessed October 2, 2019.
- 21. Huang HM, Rauch U, Liaw SS. Investigating learners’ attitudes toward virtual reality learning environments: based on a constructivist approach. Comput Educ. 2010; 55 (3): 1171–1182. https://doi.org/10.1016/j.compedu.2010.05.014.
- 22. Jenson CE, Forsyth DM. Virtual reality simulation: using three-dimensional technology to teach nursing students. Comput Inform Nu 2012; 30 (6): 312–318. pmid:22411409
- 23. Fealy S, Donovan J, Alison H, Graham K, McNeill L, Sweet L, et al., The integration of immersive virtual reality in tertiary nursing and midwifery education: A scoping review. Nurse Educ Today. 2019; 79:14–19. pmid:31078869
- 24. Chau M, Sung WK, Lai S, Wang M. Evaluating students’ perception of a three-dimensional virtual world learning environment. Know Manag E-Learn. 2013; 5 (3):323–333. https://doi.org/10.34105/j.kmel.2013.05.023.
- 25. Bayrama SB, Caliskan N. Effect of a game-based virtual reality phone application on tracheostomy care education for nursing students: A randomized controlled trial. Nurse Educ Today. 2019; 79: 25–31. pmid:31102793
- 26. Hansona J, Andersena P, Dunnb PK. The effects of a virtual learning environment compared with an individual handheld device on pharmacology knowledge acquisition, satisfaction and comfort ratings. Nurse Educ Today. 2020; (92): 104518 https://doi.org/10.1016/j.nedt.2020.104518.
- 27. Tsai SL, Chai S, Chuang KH. The effectiveness of a chronic obstructive pulmonary disease computer game as a learning tool for nursing students. Open J Nurs. 2015; 5(7): 605. https://doi:10.4236/ojn.2015.57064.
- 28. Gill M, Andersen E, Hilsmann N. Best practices for teaching pharmacology to undergraduate nursing students: a systematic review of the literature. Nurse Educ Today. 2019; 74: 15–24. pmid:30554030
- 29. Oliveira LB, Díaz JR, Carbogim FC, Rodrigues AB, Püschel AA. Effectiveness of teaching strategies on the development of critical thinking in undergraduate nursing students: a meta-analysis. Revista da Escola de Enfermagem da USP. 2016; 50 (2), 350–359. pmid:27384217
- 30. Jd Lima-Lopes, Rui CN Camila TL, Marina BR Elizabeth AS, Alba BL. Efficacy of a video during bed bath simulation on improving the performance of psychomotor skills of nursing undergraduates: A randomized clinical trial. Int J Nurs Stud. 2019; 99, 103333. pmid:31450084
- 31. Williams D, Stephen LA, Causton P. Teaching interprofessional competencies using virtual simulation: a descriptive exploratory research study. Nurse Educ Today.2020; 93, 104535. pmid:32717697
- 32. Xu Y, Lau Y, Cheng LJ, Lau ST. Learning experiences of game-based educational intervention in nursing students: A systematic mixed-studies review. Nurse Educ Today. 2021; 107:105139. pmid:34563963
- 33. Kiili K. Digital game-based learning: towards an experiential gaming model. Internet High Educ. 2005; 8, 13–24. https://doi.org/10.1016/j.iheduc.2004.12.001444
- 34. Bonet N, Barnekow A, Mata MT, Gomar C, Tost D. Three-dimensional game-based cardiopulmonary bypass training. Clin Simul Nurs. 2021; 50, 81–91. http://doi.org/10.1016/j.ecns.2020.08.007.
- 35. Koivisto JM, Niemi H, Multisilta J, Eriksson E. Nursing students’ experiential learning processes using an online 3D simulation game. Educ Inf Technol. 2017; 22, 383–398. https://doi.org/10.1007/s10639-015-9453-x
- 36. Al-Hussami M, Darawad M. Compliance of nursing students with infection prevention precautions: Effectiveness of a teaching program. Am J Infect Control. 2013;41(4): 332–336. pmid:23036481
- 37. Keys E, Luctkar-Flude M, Tyerman J, Sears K, Woo K. Developing a virtual simulation game for nursing resuscitation education. Clin Simul Nurs. 2020; 39: 51–54. https://doi.org/10.1016/j.ecns.2019.10.009.
- 38. Wolfensberger A, Anagnostopoulos A, Clack L. Effectiveness of an edutainment video teaching standard precautions–a randomized controlled evaluation study. Antimicrob Resist Infect Control 2019; 8:82. pmid:31139365
- 39. Jones K, Polyakova-Norwood V, Raynor P, Tavakoli A. Student perceptions of faculty caring in online nursing education: A mixed-methods study. Nurse Educ Today. 2022; 112:105328. pmid:35303542
- 40. Ching-Yi C, Min-Huey C, Yang JC. Facilitating nursing students’ skill training in distance education via online game-based learning with the watch-summarize-question approach during the COVID-19 pandemic: A quasi-experimental study. Nurse Educ Today. 2022; 109, 105256. pmid:34968932
- 41. Ghoman SK, Patel SD, Cutumisu M, Hauff P, Jeffery T, Brown MG, et al. Serious games, a game changer in teaching neonatal resuscitation? Review. Arch Dis Child Fetal Neonatal Ed. 2020; 105, 98–107. http://doi.org/10.1136/archdischild-2019-317011
- 42. Boada I, Rodriguez-Benitez A, Garcia-Gonzalez JM. Using a serious game to complement CPR instruction in a nurse faculty. Comput Meth Prog Bio. 2015; 122 (2):282–291. https://doi.10.1016/j.cmpb.2015.08.006.
- 43. Adhikari R, Kydonaki C, Lawrie J, O’Reilly M, Ballantyne B, Whitehorn J, et al. A mixed-methods feasibility study to assess the acceptability and applicability of immersive virtual reality sepsis game as an adjunct to nursing education. Nurse Educ Today. 2021; 103:104944. pmid:34015677
- 44. Staykova MP, Deidira VS, Daniele IS. Back to the Basics and Beyond: Comparing Traditional and Innovative Strategies for Teaching in Nursing Skills Laboratories. Teach Learn Nurs. 2016; 12(2):152–157. http://doi.org/10.1016/j.teln.2016.12.001.