https://orcid.org/0000-0001-9854-7247
Figures
Abstract
Introduction
As the frequency of infectious diseases rises, it’s more important than ever to pay attention to the competency level of front-line nurses as the primary force in front-line rescue, which has an impact on the quality of anti-epidemic response. This paper aims to construct the competency evaluation index system for front-line nurses during the outbreak of major infectious diseases.
Materials and methods
This study combined literature review, critical incident technique interviews, and semi-structured in-depth interviews, as well as two rounds of Delphi expert correspondence, to construct a competence evaluation index system for front-line nurses during the outbreak of major infectious diseases. The study used purposive sampling to select 26 experts from 11 provinces and cities across China to conduct two rounds of Delphi expert consultation, and the indicators were selected based on the mean importance score > 3.5 and the coefficient of variation < 0.25, and the weights of the indicators were calculated by the Analytic Hierarchy Process. The effective recovery rates of the two rounds of correspondence questionnaires were 93.1% and 96%.
Results
The effective recovery rates of the two rounds of correspondence questionnaires were 93.1% and 96%, the authority coefficients of experts were 0.96 and 0.98, the Kendall’s coordination coefficients of the first, second, and third level indexes were 0.281, 0.132, and 0.285 (P < 0.001), 0.259, 0.158, and 0.415 (P < 0.001). The final index system includes 4 primary indicators (Knowledge System of Infectious Diseases, Nursing Skills for Infectious Diseases, Related Professional Abilities for Infectious Diseases, and Comprehensive Quality), 10 secondary indicators, and 64 tertiary indicators.
Conclusion
The competency evaluation index system of front-line nurses during the outbreak of major infectious diseases is scientific, reasonable, and practical, which can provide a scientific basis for nursing managers to accurately understand, describe, analyze, and evaluate the competence level of nursing staff and scientifically implement the allocation of human resources in the future, as well as serve as a content framework for subsequent training programs.
Citation: Bai X, Gan X, Yang R, Zhang C, Luo X, Luo C, et al. (2022) Construction of a competency evaluation index system for front-line nurses during the outbreak of major infectious diseases: A Delphi study. PLoS ONE 17(7): e0270902. https://doi.org/10.1371/journal.pone.0270902
Editor: Ahmed Mancy Mosa, Al Mansour University College-Baghdad-Iraq, IRAQ
Received: January 27, 2022; Accepted: June 19, 2022; Published: July 1, 2022
Copyright: © 2022 Bai et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting information files.
Funding: This work was supported by Chongqing Science and Health Joint Medical Research Project (2020FYYX011) and The Chinese Nursing Association’s 2020 Annual Project on Scientific Research (ZHKY202004). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Public health events have often occurred, including Severe Acute Respiratory Syndrome (SARS), human avian influenza, influenza A (H1N1), avian influenza A (H7N9), Ebola hemorrhagic fever, the Middle East Respiratory Syndrome (MERS), and Novel Coronavirus Disease 2019 (COVID-19) in 2019 have appeared in recent years [1]. These infectious diseases are not only dangerous to public health, but they also harm the economy and society. Nurses are the main force in the rescue of public emergencies, and their core emergency response capability has a direct impact on the quality of the overall medical rescue, which is critical for public health, social stability, and economic growth [2]. The health emergency response capability of medical personnel is primarily reflected in their competency, and those with high competency quality can provide technical-intellectual support for medical rescue with maximum efficacy, ensuring smooth rescue and reducing disability and mortality [3]. Front-line nursing staff in anti-epidemic positions should not only have solid professional knowledge and skills but also be able to provide relevant protection, emergency rescue, physical and mental stress, and care in epidemic emergencies if we want to effectively respond to infectious disease epidemics.
Background
Although studies have been developed in recent years to evaluate the competency of health personnel at different levels during public disaster emergencies, few studies have focused in-depth on front-line nursing personnel fighting epidemics during major infectious disease epidemics. Current research on nurse competency evaluation has focused on nursing students [4], specialist nurses [5], and nursing managers [6] in routine clinical practice, and the results obtained were only on the competencies required in routine situations and did not address the competencies required during major infectious disease epidemics. Ablah et al. [7] used systematic evaluation and Delphi methods to develop a competency quality evaluation model for medical personnel for establishing a training program for competency in public health emergencies. The model includes 18 competencies in 4 major learning domains, which provides a reference value for the development of related training courses. Kan et al. [8] constructed a core emergency response capacity indicator system for healthcare workers during infectious disease emergencies in 2018, which included three primary indicators (emergency prevention capabilities for infectious disease outbreaks, infectious disease outbreak preparedness capacity, and infectious disease outbreak rescue capacity), 11 secondary indicators, and 38 tertiary indicators. Ma et al. [9] constructed a core competency evaluation index system for advance nursing staff in emergency response to public health emergencies, including three primary indicators (first aid nursing skills, infectious disease-related knowledge, and emergency response capabilities), 12 secondary indicators, and 52 three indicators. Lin et al. [10] developed an evaluation index system for community nurses’ rescue ability to respond to public health emergencies, which included four primary indicators (public health emergency prevention capacity, public health emergency rescue preparedness, rescue capacity for public health emergencies, and recovery capacity for public health emergencies), 15 secondary indicators, and 51 tertiary indicators. However, a review of the above studies reveals that the constructed competency assessment tools are not specific to the competency characteristics of nursing staff in the context of special public health events such as infectious disease epidemics, and there are fewer studies on the competency evaluation system of front-line nursing staff to combat major infectious disease epidemics. In practice, once a severe infectious disease epidemic, such as COVID-19, happens, medical institutions across the country must deploy nursing manpower in a timely and emergency way, as well as create a manpower reserve to ensure front-line human resources. However, due to the lack of a unified nursing job competency evaluation tool for major infectious disease outbreaks, the criteria for nurses to join the pool are mostly based on the principle of “department-based and consistent work,” which takes into account basic factors like title, years of experience, and age [11, 12]. However, this approach makes it difficult to scientifically and systematically assess the level of nurses’ competence.
With the increased frequency of public disasters in recent years, such as outbreaks of infectious disease epidemics, it is critical to construct a competency evaluation index system for front-line nurses during the outbreak of major infectious diseases that fulfills the job characteristics of front-line nursing personnel in the battle against epidemics. Thus, this study aims to:
- Construction of a competency evaluation index system for front-line nurses during the outbreak of major infectious diseases.
- Provide the scientific foundation for nursing managers to accurately understand, describe, analyze, and evaluate the competency level of front-line nurses and scientifically implement the allocation, training, and use of human resources.
- Provide a theoretical direction for the training of anti-epidemic nursing staff.
Materials and methods
Design
To create a draft of the index system, we used qualitative study and literature research. The Delphi study was carried out to investigate expert evaluation to competency evaluation index system for front-line nurses during the outbreak of major infectious diseases from August to October 2021.
The Delphi study is an anonymous feedback approach in which the experts do not know each other and are unable to exchange opinions during the procedure. Questionnaires with the questions to be asked to obtain expert viewpoints are used in multiple rounds of consultation until an agreement is established [13]. This method of individual consultation can prevent them from discussing or exchanging ideas [14]. As a result, the strategy is thought to be effective. We also formed a research team consisting of one professor, three nurse leaders, two postgraduate students, and one graduate students. They are in charge of reviewing literature, selecting specialists, sending out and collecting correspondence questionnaires, as well as organizing and analyzing proposals and data.
Participants
In conducting the Delphi study, the number of experts ranged from 5 to 20, 15 to 60, or even more than 1,000 [15]. In this study, purposive sampling was used to select 29 experts, and a total of 27 experts responded to the questionnaire given to 29 experts in the first round, with a response rate of 93.1%. In the second round, questionnaires were given to 27 experts, and a total of 26 experts responded, with a response rate of 96%. The subject finally selected 26 experts from 11 provinces and cities, including Chongqing, Beijing, Liaoning, Sichuan, Shandong, Hubei, and Zhejiang and other provinces. Experts were chosen based on the following criteria: (I) bachelor’s degree or above; (II) intermediate level certificate or above; (III) medical and nursing specialists who undertook COVID-2019 or other infectious diseases epidemic prevention; (IV) voluntary participation.
Data collection
Construction an evaluation index system.
In this study, an interview outline was initially developed based on the STAR tool [16], literature review [17, 18], competency iceberg model [19], and research objectives, and interviews were conducted with nursing managers and nurses who had worked in anti-epidemic work after discussion in the subject group. The inclusion criteria for front-line nursing managers were: (I) managers who undertook the front-line nursing management of the COVID-19 or other infectious diseases anti-epidemic; (II) intermediate level certificate or above; (III) willing to fully express their real experiences and feelings about the front-line nursing management and the competency of front-line nursing staff. Inclusion criteria for front-line nursing staff: (I) have completed COVID-19 or other infectious diseases anti-epidemic front-line nursing work; (II) have a nurse practitioner certificate; (III) willing to fully express their true experience and feelings about front-line nursing job competency. We conducted semi-structured interviews and critical incident interviews with 13 nursing managers and 11 nurses who had participated in the anti-epidemic in eight hospitals in Chongqing from March 2021 to May 2021. The outline of the interviews is shown in S1 File. The researcher obtained informed consent from the respondents before the interviews and converted the recordings into textual information within 48 hours of the interview.
The data was organized and analyzed with Nvivo 12.0, and the competency elements were extracted using inductive content analysis [20]. Finally, a competency evaluation index system containing 4 primary indicators, 12 secondary indicators, and 67 tertiary indicators was initially constructed by combining literature research and qualitative research.
The first draft of the expert correspondence questionnaire.
The expert correspondence questionnaire included four parts: (I) an introduction to the study, including the research background, purpose and significance, instructions for filling out the questionnaire, and the identity of the researcher; (II) basic information of experts: gender, age, degree, title, and professional field, etc.; (III) the competency evaluation index system of front-line nurses during the outbreak of major infectious diseases expert consultation form: the importance of the index was as assessed by way of the Likert 5-level scoring method, very important = 5, relatively important = 4, general = 3, less important = 2, unimportant = 1. At the same time, experts could make suggestions for additions, deletions, and modifications; (IV) experts’ familiarity with the study content and the index judgment.
Delphi consulting and feedback cycle.
To begin with, a correspondence questionnaire was circulated and collected by email or WeChat after the experts gave their informed consent. Meanwhile, experts scored and revised each item. After the first round of questionnaire collection, the team members summarized and analyzed the experts’ opinions, and made adjustments to the indicators after discussion based on the mean value assignment > 3.5 and coefficient of variation < 0.25 [21]. After the revision, the second round of expert consultation was conducted, and the first round of expert consultation was attached. After the second round of consultation, the results were discussed, counted, and analyzed again to finalize the index system.
Ethical
The study was conducted in line with the guidelines of the Declaration of Helsinki and was authorized by the Ethics Committee of the Second Affiliated Hospital of Chongqing Medical University, Chongqing, China (Protocol code 114; approved on 4 November 2020). Before the survey, the experts were informed of the study’s goal and verbal consent was gained from them. Participants could exit and withdraw from the survey at any time during the survey.
Quality control
To ensure the representativeness and reliability of the study results, we used inclusion criteria to select experts. Therefore, 26 experts from 11 provinces and cities, including Chongqing, Beijing, Liaoning, Sichuan, Shandong, Hubei, and Zhejiang, etc., were selected. The research team summarized and analyzed the experts’ opinions. We used Kendall’s coordination coefficient and chi-square value to test the significance of experts’ opinions and assure the results’ reliability during the data analysis procedure.
Data analysis
SPSS 25.0 statistical software was used to analyze the data. The measurement data were described by mean ± standard deviation, and the count data were described by frequency and percentage. The enthusiasm of the experts was expressed as the effective recovery rate of the questionnaire, the expert authority coefficient was expressed as the mean of judgment coefficient and familiarity coefficient, and the degree of expert opinion coordination was expressed as the Kendall’s harmony coefficient, Kendall’s coordination coefficient ranges between 0 (no agreement) and 1 (complete agreement), and the difference was considered statistically significant at P<0.05. The weights of the indicators were calculated by the Analytic Hierarchy Process.
Results
Experts’ fundamental information
According to the inclusion criteria of experts, this study finally, using a purposive sampling method, selected 26 experts from 11 provinces and cities in China, including Chongqing, Beijing, Liaoning, Sichuan, Shandong, Hubei, and Zhejiang, etc. All the experts had experience in infectious disease rescue. Their average age was 44.42 (SD 7.00) years old. Their average working years was 23.15 (SD 9.06) years. The demographic information of the experts is shown in the Table 1.
Experts’ enthusiasm
The motivation of the experts was assessed based on the return rate of the questionnaires. In the first round, 29 questionnaires were distributed and 27 effective questionnaires were returned, with a return rate of 93.1%; in the second round, 27 questionnaires were distributed and 26 effective questionnaires were returned, with a return rate of 96%.
Expert authority coefficient and the degree of opinion coordination
In the two rounds of expert consultation, the authority coefficients were 0.96 and 0.98, respectively, which met the criteria of the expert consultation authority coefficient > 0.7 [22]. The Kendall’s coordination coefficients of the first, second, and third level indicators were 0.281, 0.132, and 0.285, respectively, in the first round of expert consultation (Table 2). The Kendall’s coordination coefficients of the first, second, and third level indicators were 0.259, 0.158, and 0.415, respectively, in the second round of expert consultation (Table 3). The Kendall’s test had statistical significance (all p<0.001).
The competency evaluation index system for front-line nursing staff during the outbreak of major infectious diseases
The Delphi method was used to conduct two rounds of consultation in this study. In the first round, the research team amended 13 indicators, removed 4 indicators, merged 2 indicators, and added 6 indicators based on the exclusion criteria and experts’ opinions, combining them with the discussion of the study group. In the second round, the research team changed 7 indicators, eliminated 6 indicators, and merged 1 indicator. After two rounds of expert consultation, an indicator system containing 4 primary indicators, 10 secondary indicators, and 64 tertiary indicators was finally formed. The first level indicators include those referring to the Knowledge System of Infectious Diseases, Nursing Skills for Infectious Diseases, Related Professional Abilities for Infectious Diseases, and Comprehensive Quality. The Analytic Hierarchy Process was used to calculate the index weights. In terms of weight, Nursing Skills for Infectious Diseases had the highest weight (0.345), followed by Related Professional Abilities for Infectious Diseases (0.292), Knowledge System of Infectious Diseases (0.198), and Comprehensive Quality (0.165) had the smallest weight (Table 4).
Discussion
The competency evaluation index system of front-line nurses during the outbreak of major infectious diseases is scientific and reliable
Based on the competency “iceberg model,” this study constructs an index system through various methods such as literature research, interviews, and the Delphi method, which includes 4 primary indicators (knowledge system of infectious diseases, nursing skills for infectious diseases, related professional abilities for infectious diseases, and comprehensive quality), 10 secondary indicators, and 64 tertiary indicators. The study system scientifically and comprehensively included the competencies necessary for nursing staff to respond to major infectious disease events. The 26 correspondence experts came from 11 provinces and cities across China, and the study area covered a wide range of areas, so this study ensured the authority and representativeness of the experts. At the same time, compared with previous studies [8, 9, 23, 24], this study presents for the first time the more specialized techniques such as ventilator, extracorporeal membrane oxygenation using and monitoring skills (ECMO), continuous renal replacement therapy skills (CRRT), prone ventilation, tracheal intubation/incision, and cricothyroid puncture, which are difficult for nurses, but it was found through the preliminary study that it is still necessary for nurses to be familiar with these techniques if they want to go to the front-line rescue, and nursing managers can improve nurses’ technical level in this area by holding training courses, technical competitions, scenario simulations, or examinations in order to adequately and effectively respond to an outbreak of major infectious disease. Li et al. [25] also showed that hospital managers should pay attention to the above techniques and include them in their daily training programs to improve the effectiveness of the technical reserve and ensure that nursing staff can be proficient in case of an emergency. In addition, compared with studies such as Kan et al. [8] and Ma et al. [9], this study also emphasizes for the first time the invisible characteristics that nursing staff should possess, which have been mostly ignored in previous studies, and it is worth noting that these invisible characteristics are also one of the decisive forces influencing anti-epidemic rescue; As managers, they can examine and understand the invisible characteristics of nurses by examining their evaluations by leaders, colleagues, and patients in order to pick nursing personnel with high competency levels for front-line rescue.
Analysis on the characteristics of the competency evaluation index system of front-line nurses during the outbreak of major infectious diseases
The index system constructed in this study includes 4 primary indicators, 10 secondary indicators and 64 tertiary indicators. From large to small, the weights are nursing skills for infectious diseases, related professional abilities for infectious diseases, knowledge system of infectious diseases and comprehensive quality. "Nursing Skills for Infectious Diseases" has the largest weight, indicating that it is crucial for nurses to master relevant nursing skills in order to be competent in front-line nursing. Among the secondary indicators, "Protection skills of infectious diseases" accounts for the largest weight, which is similar to the research results of Wu [26]. Among them, the weight of "Skills for Putting On and Taking Off Protective Equipment" is the highest, because it is a prerequisite for emergency rescue to correctly wear and take off protective equipment and protect yourself in the face of infectious disease. Simultaneously, it also advises that managers should focus on protection skills in the training of nursing staff, so as to effectively cut off the transmission path of infectious diseases and minimize the occurrence of occupational exposure events [27]. The tertiary indicator "Cardiopulmonary Cerebral Resuscitation Skills" under the secondary indicator "Critical Care Skills" has the highest weight, because cardiopulmonary cerebral resuscitation can save the patient’s life and reduce mortality to the greatest extent once the patient has had cardiac arrest and respiratory arrest. The weight of "Specimen Collection, Preservation, and Transportation Skills" in the secondary index "Basic Nursing Skills" is the largest, because in order to further understand the patient’s condition, nurses need to accurately collect, preserve, and transport the patient’s blood, sputum, pharyngeal swab, and other specimens, so as to ensure that medical staff can timely and accurately obtain the most accurate and real-time condition dynamics.
The first level indicator "Related Professional Abilities for Infectious Diseases" ranked second, and the second level indicator "Emergency Response Abilities" had the largest weight, of which "Suicide Emergency Response Abilities" had the highest weight. This may be because the isolated disease area is in a closed and high-pressure state, the patients are separated from their relatives, and with the rapid development of infectious diseases, recurring conditions, and the absence of effective drugs, so patients are prone to anxiety, helplessness, fear, and other psychological conditions that eventually lead to suicide behavior because the patients cannot bear all kinds of pressure [28]. This demonstrates that, in the event of a severe infectious disease pandemic, nurses should be able to calmly deal with patients’ suicidal conduct and save their lives in time. The tertiary indicator "Psychological Risk Identification Abilities" under the secondary indicator "Psychological Crisis Intervention Abilities" has the highest weight, because the outbreak of infectious diseases often develops rapidly and the condition is complex, patients and their families do not understand the basic knowledge of the disease, which can easily lead to patients’ emotional excitement, fear, and even extreme behavior [29], so timely identification of the psychological changes of patients can provide appropriate psychological intervention and social support to help patients overcome difficulties and setbacks. The highest weight was given to the tertiary indicator "Condition Observation and Disposal Abilities" under the secondary indicator "Complementary Response Abilities for Iinfectious Diseases", which may be due to the condition of patients with sudden infectious diseases being complex and changing rapidly, and there being a shortage of nursing staff. Therefore, under the condition of limited human resources, it is an essential ability for front-line nursing staff to timely detect the changing conditions of patients and take nursing measures in advance.
The primary indicator "Knowledge System of Infectious Diseases" ranked third, and the second level indicator "Basic Knowledge of Infectious Diseases" had the largest weight, among which "Preventive Measures for Infectious Diseases" had the highest weight, indicating that it is more important for nurses to correctly prevent the further occurrence and spread of infectious diseases in the epidemic situation of infectious diseases. This suggests that taking strict preventive measures can eliminate the spread of infectious diseases at the source, thus reducing the number of infections and casualties and curbing the development of infectious diseases. The highest weight is given to the tertiary indicator "Knowledge of Caring for Complex Cases of Infectious Diseases with Combined Chronic Diseases" under the secondary indicator “Related Knowledge of Infectious Diseases,” because the number of patients in the isolation ward is large and their conditions are complicated, and there are not only patients with simple infectious diseases, but also patients with other diseases combined with infectious diseases, such as hypertension, diabetes, tumors, and other diseases, nurses need to provide corresponding individualized care, so nurses should not only master the nursing knowledge of infectious diseases but also master the nursing knowledge of other diseases.
The primary indicator "Comprehensive Quality" has the smallest weight, and the secondary indicator "Ideology and Morality" has the largest weight, among which “Spirit of Dedication” has the highest weight, indicating that experts believe that the invisible characteristics of nursing staff, such as “Spirit of Dedication,” should not be ignored. Personal traits are located at the bottom of the competency model and are potential and deep-level characteristics of individuals, which are not easy to observe, develop, and change, and are the determinants of personal competence [30], suggesting that managers should pay attention to the exploration of invisible traits and provide positive guidance when selecting and training anti-epidemic nursing staff. The tertiary indicator "Physical Quality" under the secondary indicator "Physical and Mental Qualities" has the highest weight, because the workload in the front-line isolation ward is heavy, and nurses need to wear airtight protective equipment, so they are prone to breathing difficulties, dizziness, sweating, rapid heart rate, physical exertion, and other symptoms during work, so having a strong body can ensure that the subsequent anti-epidemic work is carried out smoothly and effectively.
Significance of this study
At present, competency assessment tools have been constructed for different levels of health personnel in sudden public emergency disaster events at home and abroad, but there are many classifications of public disaster events, and few studies have systematically explored the competency of front-line nursing personnel in targeted situations, and there is a lack of unified and effective assessment tools for assessing the competency of nursing staff. The competency assessment index system of front-line nursing staff during sudden major infectious disease epidemics constructed in this study is more targeted and comprehensive compared with previous studies, which can clarify their competency requirements to understand the weaknesses of nursing personnel’s competency and conduct targeted training. Meanwahile, the index system can also provide a scientific basis for nursing managers to accurately understand, describe, analyze, and evaluate the competency level of front-line nursing staff and scientifically implement the allocation of human resources in the future, as well as provide a theoretical direction for the training of anti-epidemic nursing staff.
Conclusion
Based on the competency “iceberg model,” this study constructed the competency evaluation index system of front-line nurses during the outbreak of major infectious diseases through literature research, qualitative interviews, expert correspondence, and the Analytic Hierarchy Process. The index system is scientific and reasonable, and it may be used by nursing managers to evaluate the competency level of front-line nurses, clarify the weak points of nursing staff competency, and provide targeted training for the weak points so as to improve the comprehensive competency of nursing staff. It can also provide a reference basis for nursing managers to understand, evaluate, and select nursing staff for major infectious disease emergency rescue tasks and provide a content framework for subsequent training programs. However, the initially constructed index system is still limited to the theoretical framework, and the next step could be to transform the index system into a questionnaire and conduct a large-scale application to verify its scientificity and practicality and further improve the assessment tool.
Supporting information
S2 File. Consultation questionnaire(first round).
https://doi.org/10.1371/journal.pone.0270902.s002
(DOCX)
S3 File. Consultation questionnaire(second round).
https://doi.org/10.1371/journal.pone.0270902.s003
(DOCX)
S4 File. Consultation questionnaire (first round) in Chinese.
https://doi.org/10.1371/journal.pone.0270902.s004
(DOCX)
S5 File. Consultation questionnaire (second round) in Chinese.
https://doi.org/10.1371/journal.pone.0270902.s005
(DOCX)
Acknowledgments
Thank you to all the experts who participated in this study during their busy schedules.
References
- 1. Fang XE, Chen DP, Cheng KY, Mao YJ, Lu M, Tang LL, et al. Cross-cultural adaptation, validity, and reliability of the Chinese version of the Nurses’ Perceptions of Disaster Core Competencies Scale (NPDCC). Ann Palliat Med. 2020; 9(5):3304–3312. pmid:33065785
- 2. Murphy GT, Mackenzie A, Alder R, Langley J, Hickey M, Cook A. Pilot-testing an applied competency-based approach to health human resources planning. Health Policy Plan. 2013;28(7):739–49. pmid:23193192
- 3.
Xu S. Study on the construction of a competency index system for flood disaster rescue nurses. Master’s thesis, Jinzhou Medical University. 2018.
- 4. Liu Y, Aungsuroch Y, Sha L, Gunawan J, Zeng D. Construction of evaluation indexes of nursing students’ quality and safety competencies: A Delphi study in China. J Prof Nurs. 2021; 37(3):501–509. pmid:34016306
- 5. Zhang X, Meng K, Chen S. Competency framework for specialist critical care nurses: A modified Delphi study. Nurs Crit Care. 2020;25(1): 45–52. pmid:31373155
- 6. García AG, Pinto-Carral A, Villorejo JS, Marqués-Sánchez P. Nurse Manager Core Competencies: A Proposal in the Spanish Health System. Int J Environ Res Public Health. 2020;17(9): 3173. pmid:32370186
- 7. Ablah E, Weist EM, McElligott JE, Biesiadecki LA, Gotsch AR, Keck CW, et al. Public health preparedness and response competency model methodology. Am J Disaster Med. 2013;8(1):49–56. pmid:23716373
- 8. Kan T, Chen CL, Huang Y, Liu JJ, Wang YX, Gui L. Construction of a core emergency response capability index system for medical and nursing staff in infectious disease emergencies. Chinese Journal of Nursing. 2018;53(04):461–466.
- 9. Ma RH, Huang XY, Tong CY, Li XY. Construction of a core competency evaluation index system for advance nursing staff in emergency response to public health emergencies. Chinese Nursing Education. 2021;18(06):485–489.
- 10. Lin Y, Zhu XH, Chen Y. Construction of the evaluation indicators for community nurses’ rescue ability to respond to public health emergencies. Chinese Journal of Nursing. 2021;56(8):1158–1164.
- 11. Han L, Ma YX, Yue SQ, Song XR, Ding ZH, Yan HT, et al. Nursing human resource management in the prevention and control of novel coronavirus pneumonia in the western region. Chinese Journal of Nursing. 2020;55(03):355–358.
- 12. Zhong S, Cao X, Jiang Y, Li J, Cheng Y, Gu B, et al. Implementation and effectiveness of a nursing human resources deployment program for the emergency treatment of novel coronavirus pneumonia. China Nursing Management. 2020;20(02):226–229.
- 13. Campos-Luna I, Miller A, Beard A, Leach M. Validation of mouse welfare indicators: a Delphi consultation survey. Sci Rep. 2019; 9(1):10249. pmid:31308479
- 14. Black M, Matthews LR, Millington MJ. Using an adapted Delphi process to develop a survey evaluating employability assessment in total and permanent disability insurance claims. Work. 2018;60(4):539–548. pmid:30103361
- 15. Belton I, MacDonald A, Wright G, & Hamlin I. Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process. Technological Forecasting and Social Change. 2019;147:72–82.
- 16. Fernandez CS. The behavioral event interview: avoiding interviewing pitfalls when hiring. J Public Health Manag Pract. 2006;12(6):590–593. pmid:17041309
- 17.
Wang M. A study on the competency model of head nurses in tertiary general hospitals. PhD thesis, Jilin University. 2015.
- 18.
Zhang J. A study on the competency evaluation model of responsible nurses in maternity wards with mothers and infants. PhD thesis, The Second Military Medical University. 2013.
- 19.
Spencer LM, Spencer SS. Competence at work: models for superior performance. New York: John Wiley & Sons, Ine. 1993:222–226.
- 20. Elo S, Kyngäs H. The qualitative content analysis process. Journal of Advanced Nursing. 2008;62(1):107–115. pmid:18352969
- 21. Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. Journal of Clinical Epidemiology. 2014;67(4):401–409. pmid:24581294
- 22. Chang AM, Gardner GE, Duffield C, Ramis M-A. A Delphi study to validate an advanced practice nursing tool. J Adv Nurs. 2010;66(10):2320–2330. pmid:20626481
- 23. Qiao WL, Yang WH. Construction of an evaluation system for emergency nurses’ ability to respond to public health emergencies. China Nursing Management. 2014;14(07):696–699.
- 24. Bian H, Yu P, Liu HY, Bai YM. Construction of nurse competency indicators in public health emergencies based on the iceberg model. Chinese Journal of Practical Nursing. 2021;37(27):2122–2127.
- 25. Li H, Gu MP, Yang XH. A survey and analysis of the ability of nurses in general hospitals to respond quickly to major infectious disease outbreaks. Journal of Nursing. 2021;36(04):58–61.
- 26. Wu C, Wu P, Li P, Cheng F, Du Y, He S, et al. Construction of an index system of core competence assessment for infectious disease specialist nurse in China: a Delphi study. BMC Infect Dis.2021;21(1):791. pmid:34376141
- 27. Ma R, Huang X, Tong C, Li X. Construction of core competency evaluation index system for advance nurses in emergency rescue of public health emergencies. Chinese Nursing Education. 2021;18(6):485–489.
- 28. Sher L. The impact of the COVID-19 pandemic on suicide rates. QJM. 2020;113(10):707–712. pmid:32539153
- 29. Zheng Y, Li D, Yan J, Chen H, Zhang N, Jiang X, et al. A study on the current situation of nurses’ stress and its influencing factors during the novel coronavirus pneumonia outbreak. Chinese Journal of nursing. 2020;55: 98–101.
- 30. Man G, Gu X, Zhao J. Construction of a competency model for specialized nurses in the operating room. Journal of nursing. 2013;28(12):42–44.