Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Factors affecting mental health of health care workers during coronavirus disease outbreaks (SARS, MERS & COVID-19): A rapid systematic review

  • Niels De Brier ,

    Contributed equally to this work with: Niels De Brier, Stijn Stroobants

    Roles Data curation, Formal analysis, Investigation, Methodology, Writing – original draft

    Niels.Debrier@rodekruis.be

    Affiliation Centre for Evidence-Based Practice, Belgian Red Cross, Mechelen, Belgium

  • Stijn Stroobants ,

    Contributed equally to this work with: Niels De Brier, Stijn Stroobants

    Roles Conceptualization, Data curation, Investigation, Validation, Writing – review & editing

    Affiliation Humanitarian Services, Belgian Red Cross, Mechelen, Belgium

  • Philippe Vandekerckhove,

    Roles Conceptualization, Funding acquisition, Supervision, Validation, Writing – review & editing

    Affiliations Belgian Red Cross, Mechelen, Belgium, Department of Public Health and Primary Care, Faculty of Medicine, KU Leuven, Leuven, Belgium

  • Emmy De Buck

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Writing – original draft

    Affiliations Centre for Evidence-Based Practice, Belgian Red Cross, Mechelen, Belgium, Department of Public Health and Primary Care, Faculty of Medicine, KU Leuven, Leuven, Belgium, Cochrane First Aid, Mechelen, Belgium

Factors affecting mental health of health care workers during coronavirus disease outbreaks (SARS, MERS & COVID-19): A rapid systematic review

  • Niels De Brier, 
  • Stijn Stroobants, 
  • Philippe Vandekerckhove, 
  • Emmy De Buck
PLOS
x

Abstract

Introduction

The novel Coronavirus Disease (COVID-19) outbreak currently puts health care workers at high risk of both physical and mental health problems. This study aimed to identify the risk and protective factors for mental health outcomes in health care workers during coronavirus epidemics.

Methods

A rapid systematic review was performed in three databases (March 24, 2020) and a current COVID-19 resource (May 28, 2020). Following study selection, study characteristics and effect measures were tabulated, and data were synthesized by using vote counting. Meta-analysis was not possible because of high variation in risk factors, outcomes and effect measures. Risk of bias of each study was assessed and the certainty of evidence was appraised according to the GRADE methodology.

Results

Out of 2605 references, 33 observational studies were selected and the identified risk and protective factors were categorized in ten thematic categories. Most of these studies (n = 23) were performed during the SARS outbreak, seven during the current COVID-19 pandemic and three during the MERS outbreak. The level of disease exposure and health fear were significantly associated with worse mental health outcomes. There was evidence that clear communication and support from the organization, social support and personal sense of control are protective factors. The evidence was of very low certainty, because of risk of bias and imprecision.

Conclusion

Safeguarding mental health of health care workers during infectious disease outbreaks should not be treated as a separate mental health intervention strategy, but could benefit from a protective approach. This study suggests that embedding mental health support in a safe and efficient working environment which promotes collegial social support and personal sense of control could help to maximize resilience of health care workers. Low quality cross-sectional studies currently provide the best possible evidence, and further research is warranted to confirm causality.

Introduction

The novel Coronavirus Disease (COVID-19) outbreak, triggered by infection with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has rapidly evolved into a global pandemic [1]. Similar yet less widespread coronavirus epidemics have occurred in the past, notably the severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome (MERS) outbreaks [2, 3]. A common feature of emerging infectious diseases is their rapid increase in incidence, which pressures and potentially exceeds the limits of health care service capacities [4, 5].

The current public health emergency exerts significant physical and mental burden on patients, and also health care workers (HCWs) represent a group at specific risk [6]. Typically, they account for a large percentage of patients in infectious disease outbreaks since they provide care for confirmed or suspected cases and/or generally maintain close contacts while physical distancing is warranted [7, 8]. Moreover, high rates of mental health problems among physicians, nurses and hospital-based personnel during coronavirus disease outbreaks have been frequently described [9, 10]. Mental health problems generally involve a constellation of changes in thinking, feeling and/or behavior, which are deemed undesirable by the person experiencing them and/or by his environment. Such changes can present within a broad range of severity from life’s daily hassles to diagnosable psychiatric disorders. Pappa et al. [11] and da Silva [12] provide early evidence that a high proportion of HCWs experience significant levels of anxiety, depression, stress and insomnia during the COVID-19 pandemic and Pan et al. [10] confirmed that the anxiety level of Chinese HCWs significantly increased during the outbreak of COVID-19. Another recent meta-analysis revealed that HCWs exposed to SARS/MERS/COVID-19 reported symptoms of e.g. fear, insomnia, psychological distress, burnout and anxiety [13]. Although these recent meta-analyses clearly indicate high pressure on the mental health of HCWs during the COVID-19 pandemic, personal, social and organizational factors associated with their vulnerability or resilience have not been synthesized.

Considering their great personal risk and pivotal role in tackling this global health crisis, adequate mental health care for HCWs is imperative [1416]. Although plenty of psychosocial initiatives are described, the most effective strategies in a pandemic context are currently unclear [17, 18]. We performed a rapid systematic review to identify the best possible evidence on risk and protective factors for psychological outcomes in HCWs during coronavirus epidemics. Our results may inform decisions to safeguard HCW’s mental health during this and future respiratory infectious disease outbreaks.

Methods

Because of the timely relevance of the findings to support time-sensitive decisions during the COVID-19 pandemic, we decided to conduct a rapid systematic review. Due to time constraints inherent to the development of a rapid systematic review, no protocol for the systematic literature searches was registered beforehand with PROSPERO. The reporting of the systematic literature reviews was done according to the steps outlined in Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) (see S1 Table) [19].

We conducted a systematic literature search in three databases (MEDLINE, via the PubMed interface, Embase, via the Embase.com interface and PsycINFO, via the APA PsycNET database) and the NIPH systematic and living map on COVID-19 evidence (PubMed results supplemented by regular updates with material retrieved by searches performed by organizations such as World Health Organization, WHO and Centers for Disease Control and Prevention, CDC) [20] to answer the following research question: What are risk factors/protective factors (I) for the mental health (O) of HCWs during a coronavirus disease outbreak, epidemic or pandemic (P)?

Two information specialists independently developed a search strategy based on search terms describing the HCW, the epidemic, and either mental health outcomes or interventions (full search strategies can be found in S1 Text). In the NIPH living COVID-19 map, the retrieved records were filtered on terms related to HCWs within the category of “experiences and perceptions; consequences; social, political, economic aspects”, covering studies on mental health. Searches in the databases were ran on March 24, 2020 and in the selected COVID-19 resource on May 28, 2020 to identify the latest studies on COVID-19. Retrieved references from the three databases were imported in Endnote, duplicates were removed, and study selection was performed by one reviewer, and selected studies were critically evaluated by the second reviewer until consensus was reached.

Studies were eligible if they addressed the PICO question and met the following inclusion and exclusion criteria:

  • Population: Included: studies targeted at all staff which are/were active within a health care setting (e.g. a whole hospital or specific unit, health center, or community health network) during an outbreak of a coronavirus infection, causing the following diseases: SARS, MERS, COVID-19. Excluded: studies dealing with other infectious disease outbreaks (e.g. ebola and H1N1 virus).
  • Risk or protective factors: Included: studies describing any modifiable risk factor or protective factor, which is relevant to take into account when developing either prevention programs or mental health interventions for HCWs in the context of an infectious disease outbreak. Risk factors are here defined as characteristics at organizational, social and personal level that putatively precede and are associated with poor mental health outcomes in HCWs. Protective factors are positive influences that may protect HCWs for developing mental health problems during coronavirus disease outbreaks. Modifiable factors include behaviors, experiences and exposures that may be controlled and changed for maximizing resilience of HCWs during and after these crises. Examples of modifiable factors are: direct contact with patients, dissatisfaction with procedures, changes in work demands, being quarantined as HCW, fear of infection, stigma, vulnerability, clear communication of directives, professional support, social support, perceived self-efficacy, sufficient precautionary measures, training in protection, … We adhered to the author’s interpretation on the classification of risk/protective factors and outcome measures. Excluded: studies describing non-modifiable factors such as gender, age, family history and professional title and factors associated with impact on personal life. Relevant factors were discussed with content experts. Studies solely dealing with prevalence or incidence rates of mental health outcomes are excluded since no data on risk or protective factors can be extracted.
  • Outcome: Included: any mental health outcome or psychological wellbeing. Mental health problems can present within a broad range of severity. Hence, we not only focused on mental health outcomes reflecting psychiatric symptoms and/or caseness, but also included studies assessing mental health symptomatology reflecting common emotional and social undesirable changes in thinking, feeling and/or behavior. Mental health outcomes included physical symptoms such as pain and fatigue in as far as they were part of mental health questionnaires and thus considered putatively related to psychological suffering. Mental health outcomes were considered in the immediate, short- and long-term as long as association with risk/protective factors directly relevant to the disease outbreak could be examined. Excluded: physical health problems related to the inflammatory responses of the human body such as fever, cough, myalgias, chills, headaches, dyspnea, sore throat, nausea/vomiting and diarrhoea.
  • Study design: Included: (i) the studies of a systematic review if the search strategy and selection criteria were clearly described and if at least three electronic databases were searched; (ii) experimental studies: (quasi or non-)randomized controlled trial (RCT), controlled before and after studies or controlled interrupted time series and (iii) observational studies: cohort and case-control studies, controlled before and after studies and controlled interrupted time series and cross-sectional studies, but measures should have controlled for confounding factors (e.g. matching, multivariate regression analyses). Excluded: cross-sectional studies which did not control for confounding factors, case series, letters, qualitative studies, conference abstracts, PhD theses and publications that had not been subject to peer review.
  • Other: Only English language studies were included and there were no restrictions regarding publication date or status.

Study characteristics (study type, country, epidemic, population, relevant risk factors for which confounding was taken into account, relevant outcomes with their measurement tool) and study findings [mean difference (MD), adjusted odds ratio (aOR), or regression coefficient (β)] were extracted and tabulated. A p-value < 0.05 was considered statistically significant.

Since meta-analysis was not possible because of a high variety in factors, outcomes and effect measures (adjusted for different confounding factors), we synthesized the data where possible using vote counting based on direction of effect by comparing the number of comparisons showing harm and benefit, regardless of the statistical significance or size of their results [21]. A binomial test (RStudio) was used to assess the significance of evidence for the existence of an effect in either direction. A p-value < 0.05 was considered statistically significant.

Limitations in observational study designs were analyzed by assessing the eligibility criteria, methods for exposure and outcome variables, the strategies for controlling for confounding factors, and follow-up, according to the GRADE (Grading of Recommendations Assessment, Development and Evaluation) criteria. This evaluation was followed by a certainty rating of the body of evidence according to the GRADE methodology [22].

Results

Out of 2605 references we selected 33 relevant studies (29266 participants) (Fig 1), of which 32 cross-sectional studies, and one uncontrolled before-and-after study. Five studies that fulfilled our predefined eligibility criteria were identified through the specific COVID-19 resource. The majority of the included studies dealt with the mental health of HCWs during the SARS epidemic (n = 23), seven studies during the COVID-19 outbreak in Chinese hospitals and three studies surveyed hospital staff during the MERS epidemic. The studies reported on a wide range of mental health outcomes which could be categorized in eight categories, based on the measurement scales that were used and detailed in Table 1: acute stress disorder/post-traumatic stress (mainly based on versions of the Impact of Event Scale), anxiety-related symptoms, depression-related symptoms, (perceived) stress, emotional exhaustion and burnout, sleep problems (including insomnia symptoms), anger and general symptoms of psychopathology including nonspecific outcomes such as mental distress, emotional distress, psychological distress, psychological disorder, psychiatric morbidity, psychiatric symptoms, general mental health and negative emotional experience. Acute stress/post-traumatic stress symptoms was the most reported outcome. The study characteristics, including exact outcome measures and scales used, are summarized in Table 1 and S2 Table. Relevant risk factors and protective factors were clustered in six and four thematic categories, respectively, as described below and in S3 Table (detailed summary of findings table)

thumbnail
Table 1. Study characteristics.

Outcome measures sharing the same number in superscript belong to the same thematic category.

https://doi.org/10.1371/journal.pone.0244052.t001

We identified six categories of risk factors which might be associated with poor mental health in HCW. In first instance, evidence was found that HCWs exposed to coronavirus were at risk of developing mental health problems with 30 of 34 comparisons showing harm (88%, 95%CI [73%;97%], p<0.001) (Table 2) [6, 9, 24, 26, 28, 30, 32, 33, 3540, 44, 46, 48, 52]. The risk factors included, amongst others, direct contact with patients, working in high risk units, high risk of exposure, and working on the frontline. Three studies reported that HCWs in China being in contact with COVID-19 patients were at significantly higher risk of experiencing symptoms related to post-traumatic stress (aOR: 1.60, 95%CI [1.25;2.04], p<0.001) [33], depression (aOR: 1.52, 95%CI [1.11;2.09], p = 0.01 and aOR: 2.016, 95%CI [1.102;3.685], p = 0.023) [33, 36], anxiety (aOR: 1.57, 95%CI [1.22;2.02], p<0·001 and aOR: 2.062, 95%CI [1.349;3.153], p = 0.001) [33, 36], insomnia (aOR: 2.97, 95%CI [1.92;4.60], p<0.001) [33], fear (aOR: 1.408, 95%CI [1.025;1.933], p = 0.034) [36] and general mental health problems (β: 5.347, 95%CI [3.831;8.184], p<0.001) [30]. A study by Zhang et al. [52] could not demonstrate a significant association between contact with COVID-19 patients and insomnia symptoms (aOR: 1.252, 95%CI [0.960;1.632], p = 0.098). Other studies were conducted during (or after) the SARS epidemic and, when placing a higher value on the largest studies (n>1000), indicate that being exposed (daily) to SARS (aOR: 1.62, 95%CI [1.1;2.4], p = 0.017 and aOR: 1.33, 95%CI [1.19; 1.49], p<0.05) was clearly associated with psychiatric morbidity or more stress at work, respectively [9, 32]. Of note, a study by Maunder et al. [38] could not demonstrate a significant association between contact with SARS patients and post-traumatic symptomatology (β: 0.002, 95%CI [-0.054;0.059], p = 0.95).

thumbnail
Table 2. Synthesis of the impact of identified risk and protective factors on the development of mental health problems based on vote counting of the direction of effect.

The unknown directions of effect represent the factors which did not significantly contribute to the multivariate regression analyses and of which the direction of effect was not reported.

https://doi.org/10.1371/journal.pone.0244052.t002

Secondly, the included studies (n = 4) suggested that HCWs who were quarantined (100%, 95%CI [48%;100%], p = 0.063) have worse mental health outcomes in all five comparisons (Table 2) [6, 23, 35, 37]. The largest studies (n>500) indicate that being quarantined is associated with post-traumatic stress (aOR: 2.09, 95%CI [1.00;4.37], p<0.05) or depression (aOR: 5.06, 95%CI [2.12, 12.10], p<0.05) [6, 35]. Of note, quarantine was not identified as a significant risk factor in the univariate analysis, and thus not entered in the regression models of Maunder et al. [39]. Smaller studies (n = 2) also reported significant associations between quarantine and development of acute stress disorder [23] and anger [37]. The latter study could not demonstrate a significant impact of time spent in quarantine on emotional exhaustion [37].

Thirdly, the body of evidence on job stress and dissatisfaction could not demonstrate a clear association with mental health problems but only a suggestive trend, with nine of the 11 comparisons showing harm (82%, 95%CI [48%;98%], p = 0.065) (Table 2) [26, 31, 35, 38, 41, 42, 46, 48, 49]. When focusing on the larger studies (n>500), Maunder et al. [38] found a clear association between job stress and post-traumatic stress (β: 0.208, 95%CI [0.162;0.254], p<0.001), while Liu et al. [35] could not demonstrate a significant association between job stress and depression (aOR: 0.60, 95%CI [0.16;2.19], p>0.05). Tam et al. [48] also reported that job-related stress was significantly associated with psychiatric morbidity (aOR: 4.06, 95%CI [2.28;7.23], p<0.05). Smaller studies (n = 4) found that job stress, impact on work life, working hours per week and being involuntary conscripted to a high risk unit, were significantly associated with burnout, post-traumatic stress, total stress load, or depression and stress reactions, respectively [26, 31, 41, 46]. The latter risk factor was not significantly associated with the presence of symptoms related to anxiety or general mental distress [26, 49]. Moreover, job stress related to precautionary measures or hospital procedures was significantly associated with emotional distress (aOR: 2.9, 95% [1.9;4.6], p<0.05) in a study of Nickell et al. [42], while Maunder et al. [38] found no association between dissatisfaction with procedures and post-traumatic stress.

Fourthly, evidence exists that HCWs experiencing fear or perceiving more risk of becoming infected or infecting others may increasingly suffer from mental health problems with 12 of 13 comparisons showing harm (92%, 95%CI [64%;100%], p = 0.003) (Table 2). Fear of infection and perception of risk were generally significantly associated with post-traumatic stress, anxiety, depression, insomnia, and (mental) distress [6, 29, 35, 38, 42, 4547, 49, 52], while a significant association between perception of risk to others or family and post-traumatic stress or mental distress could not be demonstrated [46, 49]. Of note, the study by Kim and Choi [31] was not able to demonstrate a significant association between fear for MERS-infection and burnout.

Lastly, although a suggestive trend exists that stigma, including avoidance and social isolation (100%, 95%CI [40%;100%], p = 0.125) [38, 39, 42, 43, 49], and loss of control and emotional disruption (100%, 95%CI [29%;100%], p = 0.250) [29, 45, 49] can be associated with mental distress, no significant relationship could be demonstrated due to the low number of events (Table 2).

Furthermore, four categories of factors which may protect HCWs from developing mental health problems during coronavirus disease outbreaks were identified (“protective factors”). First, 11 out of 12 comparisons (92%, 95%CI [62%;100%], p = 0.006) indicated that HCWs who receive clear communication and support from the organization were less likely to develop mental health problems (Table 2) [24, 27, 30, 37, 46, 48]. The clear communication of directives and precautionary measures was statistically associated with psychiatric symptoms (aOR: 0.51, 95% CI [0.29;0.90], p = 0.020), while a statistical association could not be demonstrated with post-traumatic stress [24]. The provision of support and adequate insurance and compensation by the organization was significantly associated with relieved feelings of anger (β: 0.24, 95%CI [0.13;0.35], p = 0.000) and reduced psychiatric morbidity (aOR: 0.52, 95%CI [0.29;0.93], p<0.05), respectively [37, 48]. Very recently, Kang et al. [30] demonstrated that HCWs who accessed mental health care services were at lower risk of developing mental health problems (β: -0.868, 95%CI [-1.385;-0.289], p = 0.001) during the COVID-19 outbreak. Other factors such as confidence in the information provided and expressing opinions through staff unions or mass media were not statistically significant in multivariate logistic regression analyses [46, 48]. More in particular, there is evidence that implementing a supportive prevention program, including the availability of a mental health team, training, detailed manpower allocation, and adequate equipment, substantially improved symptoms of anxiety and depression along with sleep quality of the nursing staff [27]. In line with this result, perception of adequate counseling and psychological support from the employer was found to statistically lower the psychiatric morbidity of HCWs (aOR: 0.53, 95%CI [0.31;0.89], p<0.05) [48].

Regarding physical safety and training, the body of evidence could not demonstrate a clear association, but only provided a suggestive trend that provision of physical safety and training protects HCWs from developing mental health problems with eight of the 11 comparisons showing benefit (73%, 95%CI [39%;94%], p = 0.227) (Table 2) [34, 3739, 42, 46, 48, 50, 52]. Evidence exists that perceived adequacy of training and support was negatively associated with post-traumatic stress (β: -0.22, 95%CI [-0.38;-0.06], p = 0.01), burnout (β: -0.27, 95%CI [-0.44;-0.10], p = 0.002) [39], and psychological disorder (β: -0.20, p = 0.03) [34]. Similarly, trust in precautionary measures, equipment and infection control initiatives also protected HCWs from emotional exhaustion (β: -0.15, 95%CI [-0.26;-0.05], p = 0.005), concern for personal or family health (aOR: 0.4, 95%CI [0.3;0.5], p<0.05) or state anger (β: -0.14, 95%CI [-0.25;-0.03], p = 0.011) [37, 42]. Moreover, HCWs who are uncertain regarding effective disease control during the current COVID-19 pandemic might be at high risk of facing insomnia symptoms (aOR: 3.297, 95%CI [1.284;8.469], p = 0.013) [52]. On the contrary, Wong et al. [50] found that training in handling infectious disease outbreaks was significantly associated with increased anxiety amongst HCW (aOR: 5.41, 95%CI [1.02;28.79], p = 0.048). No statistical associations between doubt about protection, unprotected exposure, infection control measures/guidelines, infection prevention training and protective facilities and mental health outcomes could be demonstrated [38, 39, 46, 48, 52].

Next, HCWs perceiving social support are more resilient against mental distress with 11 of 13 comparisons showing benefit (85%, 95%CI [55%;98%], p = 0.022) (Table 2) [24, 25, 31, 48, 51]. Of particular interest, Xiao et al. [51] found that levels of social support for HCWs who recently treated patients with COVID-19 infection, were significantly associated with self-efficacy (β: 0.023, 95%CI [0.011;0.035], p<0.001), and negatively associated with degree of anxiety (β: –0.781, 95%CI [-0.948;-0.614], p<0.0001) and stress (β: -0.704, 95%CI [-1.161;-0.247], p = 0.003). A clear association with sleep quality could not be demonstrated. There is evidence that especially the support from supervisors and colleagues is beneficially associated with post-traumatic stress (aOR: 0.33, 95% CI [0.16;0.69], p = 0.003) and psychiatric symptoms (aOR: 0.35, 95% CI [0.17;0.69], p = 0.003), while a significant effect could not be demonstrated for support from family or the ability to talk about concerns [24, 48]. Other studies (n = 2) reported social support measures to be related to significantly lower levels of emotional exhaustion or burnout [25, 31]. Four other social support factors such as sense of coherence, interaction and appreciation by the community did not statistically contribute to regression model analyses.

The included studies (n = 4) indicated that factors related to sense of control and coping ability are associated with HCWs resilience against the development of mental health problems in all six comparisons (100%, 95%CI [54%;100%], p = 0.031) (Table 2) [29, 37, 43, 45]. Levels of vigor and hardiness were negatively associated with perceived stress, emotional exhaustion, mental health, and state anger [37, 43]. Significant associations of perceived self-efficacy or coping ability in HCWs could not be demonstrated [29, 45]. Specific coping strategies were not included in our data synthesis, but it was shown that venting, humor, and altruistic acceptance were coping strategies related to a statistically significant decrease of post-traumatic stress or morbidity or symptoms of depression during the SARS outbreak [6, 35, 44], while for other strategies this association could not be demonstrated [44]. Very recently, Zhu et al. [53] indicated that positive coping by HCWs during the COVID-19 pandemic was significantly associated with lower risk of developing depression- or anxiety-related symptoms.

Finally, we assessed the limitations in study design for all included studies individually (Fig 2 and S4 Table). The 33 studies included were observational studies, leading to an initial “low” certainty level. The certainty of evidence was downgraded (-1) for limitations in study design. All but one study had a cross-sectional design, and no causal relationships can be inferred. We assessed the studies at high risk of recall (mostly studies dealing with MERS and SARS epidemic) and selection bias, with about 20% of the studies having a response rate lower than 50%. The response rate varied between 10.5 and 94.9%. The overall certainty of evidence was further downgraded because of imprecision (-1) due to limited sample sizes, large variability of the results and/or lack of data, resulting in “very low”-certainty evidence meaning that any estimate of effect is very uncertain.

thumbnail
Fig 2. Risk of bias graph showing each item presented as percentages across all observational studies with green: Low risk of bias, yellow: Unclear risk of bias, red: High risk of bias and grey: Not applicable.

https://doi.org/10.1371/journal.pone.0244052.g002

Discussion

We identified 32 cross-sectional studies and 1 before-and-after study. Most of the studies were performed during the SARS outbreak (n = 23), while seven very recent studies were executed during the current COVID-19 pandemic and three during the MERS outbreak. A relatively large body of evidence resulted in the following risk factors: level of disease exposure and health fear. A limited number of studies also suggested being quarantined as HCW, job stress and dissatisfaction, and stigma as risk factors. We also identified factors that are protective for mental health problems, including clear communication and support from the organization, social support, and sense of control and coping ability. Less compelling evidence was found about providing physical safety and training to HCWs as protective factors. We included seven studies on COVID-19 that fulfilled our selection criteria but since the pandemic is still raging, other studies will probably come available the coming months and years. The results of this rapid review will not only serve as a knowledge base for supporting the HCWs during the current acute outbreak but will also allow hospital-based managers and decision-makers to prepare prevention programs for a second wave or other infectious disease outbreaks in the future.

This systematic review has several limitations. First, because of time pressure of making timely relevant results available during the COVID-19 pandemic, no protocol was registered with PROSPERO, study selection and data extraction was done by only one reviewer and only English language studies were included. The latter has resulted in the exclusion of some studies, particularly from Asian countries. However, we were able to detect 33 individual studies against the predefined eligibility criteria of which about 80% were conducted in Asia. We only screened a limited number of databases. Moreover, relevant bibliographies and clinical trial registries were not searched. On the other hand, we used a sensitive search strategy, checked a very comprehensive COVID-19 resource and two reviewers independently compared the included studies against the selection criteria. A formal assessment of publication bias was not possible due to large variation in outcome measures and effect sizes. Second, the quality of the included studies was very low, as the majority of studies had a cross-sectional design, which made it difficult to infer causal relationships from the results. However, within the available cross-sectional studies, we decided to only focus on those studies that controlled for confounding factors. Of note, the included studies did not involve the occupational mental health of HCWs prior to the disease outbreak as a control measure. Recent systematic reviews, identified through an abbreviated literature search and screening, clearly showed that especially occupational stress and burnout are already highly prevalent (even as high as 80%) among medical doctors and nurses in the pre-pandemic workplace [5457]. Estimates are however complicated due to variability in definitions and assessment methods and differences between regions and occupational roles [54, 57]. A cross-sectional study prior to the current pandemic in Spain showed that, although burnout is a major problem among nurses working in emergency departments, the average level of perceived stress was found within a normal range [58]. The study by McAlonan et al. [40] showed that the perceived stress levels in both high- and low-risk HCWs during the SARS outbreak were higher than the normative value of a US community sample. Furthermore, two (meta-analytic) prevalence studies performed during the current COVID-19 pandemic showed that levels of anxiety and depression of the HCWs during the outbreak in China were significantly higher than that of the HCWs during the non-outbreak period or the national norm [10, 59]. Third, since there was a high variation in effect measures, risk factors, and measurement tools, it was difficult to synthesize the findings, and we used vote counting based on direction of effect as synthesis method. As a consequence, statistical heterogeneity could not be assessed. To avoid fragmentizing the body of evidence, we combined several mental health outcomes in this analysis, for the different categories of risk/protective factors. Vote counting provides no information on magnitude of effect and takes no account of the differences in relative sizes of each study. Since the mental health outcomes were grouped and the risk and protective factors were clustered in ten thematic categories, this synthesis method is hence not a nuanced approach. Indeed, these thematic categories (in)directly involve multiple affiliated factors and, by way of example, witnessing multiple deaths could be related to ‘level of disease exposure’ and risk of transmission to family was presently categorized under ‘risk perception and fear’. Nonetheless the results of the individual studies were tabulated and extensively discussed.

The findings of this systematic review are highly relevant for supporting the HCWs facing the current COVID-19 pandemic and advanced the conclusions of previous systematic evaluations. One review (search date 2009) dealt with the relation of the occurrence of work-related critical incidents and mental health of HCWs, and confirmed that treating victims of terror or disease outbreaks or, more general, treating patients in critical care treatments, had a small to medium impact on post-traumatic stress symptoms, anxiety, and depression in HCWs compared with a control, non-exposed group [60]. However, this review did not identify risk or protective factors determining the mental health status of HCWs, and the population was not limited to disease outbreaks. Very recent meta-analyses confirmed that HCWs exposed to (SARS, MERS or) COVID-19 suffered from a wide range of mental health problems but no risk or protective factors were identified [1013]. Another systematic review [61] studied the psychological wellbeing of HCWs involved in the SARS epidemic (search date 2015). The data were synthesized in a thematic narrative analysis. The review concluded that the mental health impact of SARS on HCWs was associated with occupational role, training/preparedness, high-risk work environments, quarantine, role-related stressors, perceived risk, social support, social rejection/isolation and impact of SARS on personal or professional life. In addition to the evidence from the SARS epidemic, the current systematic review now also includes more recent evidence from other coronavirus epidemics, such as MERS and COVID-19. An added value of the current study is the focus on studies that used methods to take into account confounding factors, and the use of quantitative data extraction and synthesis for listing which factors are significantly associated with worse or better mental health outcomes. The body of evidence identified in this study indicates that especially the provision of support (programs) by health care organizations, social support (by colleagues) and personal sense of control and coping ability putatively benefit the mental health of HCW. At the same time, the review quantitatively substantiated that high-risk work environments and health fear put HCWs at risk of mental health problems.

Although the reviewers searched for specific mental health interventions for supporting HCWs during coronavirus disease outbreaks, there was little if any evidence for such interventions. However, several risk and protective factors for mental health of HCWs on the organizational, social and personal level were identified. The available evidence in the context of coronavirus disease outbreaks therefore suggests that safeguarding their mental health should not be treated as a separate mental health intervention strategy, but requires an integrated protective approach. Embedding access to mental health support in a safe and efficient working environment which promotes collegial social support and personal sense of control could help to maximize resilience of health workers during the current global health crisis. Our review might have several implications for practice and we formulated a number of considerations and recommendations:

  • Sense of support by the organization: Apart from structural support and efficient communication, monitoring of well-being of HCWs is recommended. Monitor from a viewpoint of supportive concern. Awareness by HCWs of internal (e.g. a mental health support team) and external mental health initiatives (e.g. mental health hotlines or websites, contact information of mental health organizations) should be ensured. Actively refer HCWs to such initiatives in case of concern.
  • Provide opportunity to talk, listen to concerns and offer empathic support: these guidelines protect mental health in general and empathic and supportive interactions between colleagues as well as with supervisors should be promoted. Providing specific occasions to share concerns and support could be helpful. Training such supportive skills could provide further benefit.
  • Protect physical safety: providing a safe working environment and adequate and timely information about the required precautionary measures, could help to correct overly strong risk perceptions if applicable. In general, promote consulting trustworthy sources of information about the epidemic. Adequate formal training could further protect both physical and mental health.
  • Reduce the impact of changing job demands (unfamiliar tasks, changing working conditions, work overload, …): this could include clear definitions and communication of changed duties, and safeguarding sufficient rest is available. Considerations for the COVID-19 outbreak by the WHO [62] for example suggest to initiate, encourage and monitor work breaks.
  • Maximize sense of control of HCWs: the aforementioned provision of information, clear communication and efficient organization could partially contribute in this respect. Normalize stress reactions and praise achievements. Promote the idea of challenge instead of threat in light of the outbreak. Paying attention to feelings and cognitions of control could be beneficial in resilience training programs.
  • HCWs that are quarantined should receive continuous support from supervisors and colleagues. Quarantine should not last longer than necessary. Of note, attention should also be paid to HCWs who are self-quarantined to avoid infecting family members.
  • Provide additional attention to HCWs in high-risk occupations. The above recommendations might be specifically beneficial for this subgroup, which proves vulnerable to developing mental health problems.

Our review also highlights the need for future research, with a focus on better study designs. These could include proper control group and longitudinal designs, with a follow-up measurement after the crisis period. In addition, studies defining a specific exposed and non-exposed group (cohort-type studies) or a case and control group (case-control type studies), where both groups are properly matched based on important confounding variables, would provide useful information. Since we only identified one study that measured the impact of a specific program, including mental health aspects, there is a clear need for studies reporting on the effectiveness of concrete mental health interventions.

Lastly, the multiple uncertainties about the COVID-19 outbreak and the rapidly growing research make it necessary to provide the scientific community with high-quality and timely updates of the relevant evidence. As this review deals with time sensitive results, we screened for additional relevant experimental or observational studies in the NIPH living COVID-19 map during the publication process (search date Oct 26). In this time period, no high-quality studies at low risk of bias which could substantially impact on the review’s conclusions were identified. Eight additional cross-sectional studies, which suffer from coexisting methodological issues, fulfilled the eligibility criteria. These studies did not reveal any new risk factors and further underpin the findings of this review. When briefly discussing the risk factors, studies by Cai et al. [63] and Wankowicz et al. [64] confirmed that the rate of mental health problems is significantly increased in frontline HCWs. Further, there is growing evidence that risk perception and health fear are independent factors for developing mental distress [65, 66] while Sarboozi Hoseinabadi et al. [67] could not demonstrate a significant association between fear of COVID-19 infection and burnout symptomatology. It was also confirmed that loneliness because of social isolation as well as job stress are associated with increased mental distress or burn-out symptomatology, respectively [66, 67]. Regarding the protective factors, further evidence shows that receiving adequate information and availability of protective measures are significantly associated with reduced severity of mental health problems [66, 68, 69]. Sarboozi Hoseinabadi et al. [67] could not demonstrate a significant association between social support from family and friends or hospital resources and COVID-19-related burnout. Finally, Huang et al. [70] found that problem-coping style is the common influencing factor for anxiety in nurses. It is of note that the studies of Arpacioglu et al. [65] and García-Fernández et al. [68] included HCWs as well as non-HCWs and results between groups could not be distinguished.

In conclusion, several organizational factors, including clear communication and directives, and organizational support seem paramount in addition to protective factors such as HCWs perceptions of coping ability and social support. Future efforts should especially target HCWs working on the frontline. Our results may inform decisions to safeguard the mental health of HCWs during this and future respiratory infectious disease outbreaks. Due to the high variation in outcome measures, risk factors, and measurement tools, it was not possible to perform a meta-analysis but the data were synthesized by using vote counting based on direction of effect. Although it is difficult to infer causal relationships from the evidence, cross-sectional studies currently provide the best possible evidence for developing practical recommendations in this context. High-quality controlled studies are needed for establishing casual relationships and identifying the most effective interventions.

Acknowledgments

We thank Koen Van Praet (Psychosocial Intervention Service, Belgian Red Cross) for useful input to our findings.

References

  1. 1. Cucinotta D, Vanelli M. WHO declares COVID-19 a Pandemic. Acta Biomed. 2020;91(1): 157–60. pmid:32191675
  2. 2. Anderson RM, Fraser C, Ghani AC, Donnelly CA, Riley S, Ferguson NM, et al. Epidemiology, transmission dynamics and control of SARS: the 2002–2003 epidemic. Philos Trans R Soc Lond B Biol Sci 2004;359(1447): 1091–105. pmid:15306395
  3. 3. Mackay IM, Arden KE. MERS coronavirus: diagnostics, epidemiology and transmission. Virol J. 2015;12: 222. pmid:26695637
  4. 4. Arabi YM, Murthy S, Webb S. COVID-19: A novel coronavirus and a novel challenge for critical care. Intensive Care Med. 2020;46: 833–6. pmid:32125458
  5. 5. Xie J, Tong Z, Guan X, Du B, Qiu H, Slutsky AS. Critical care crisis and some recommendations during the COVID-19 epidemic in China. Intensive Care Med. 2020;46(5): 837–40. pmid:32123994
  6. 6. Wu P, Fang Y, Guan Z, Fan B, Kong J, Yao Z, et al. The psychological impact of the SARS epidemic on hospital employees in China: Exposure, risk perception, and altruistic acceptance of risk. Can J Psychiat. 2009;54(5): 302–11.
  7. 7. Malave A, Elamin EM. Severe acute respiratory syndrome (SARS)-lessons for future pandemics. Virtual Mentor. 2010;12(9): 719–25. pmid:23186878
  8. 8. Park JE, Jung S, Kim A, Park JE. MERS transmission and risk factors: A systematic review. BMC Public Health. 2018;18(1): 574. pmid:29716568
  9. 9. Chong M-Y, Wang W-C, Hsieh W-C, Lee C-Y, Chiu N-M, Yeh W-C, et al. Psychological impact of severe acute respiratory syndrome on health workers in a tertiary hospital. British J Psychiat. 2004;185(2): 127–33. pmid:15286063
  10. 10. Pan R, Zhang L, Pan J. The anxiety status of chinese medical workers during the epidemic of COVID-19: A meta-analysis. Psychiatry Investig. 2020;17(5): 475–80. pmid:32403209
  11. 11. Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain Behav Immun. 2020;88: 901–7. pmid:32437915
  12. 12. da Silva FCT, Neto MLR. Psychiatric symptomatology associated with depression, anxiety, distress, and insomnia in health professionals working in patients affected by COVID-19: A systematic review with meta-analysis. Prog Neuropsychopharmacol Biol Psychiatry. 2021;104: 110057. pmid:32777327
  13. 13. Salazar de Pablo G, Vaquerizo-Serrano J, Catalan A, Arango C, Moreno C, Ferre F, et al. Impact of coronavirus syndromes on physical and mental health of health care workers: Systematic review and meta-analysis. J Affect Disord. 2020;275: 48–57. pmid:32658823
  14. 14. Bao Y, Sun Y, Meng S, Shi J, Lu L. 2019-nCoV epidemic: address mental health care to empower society. Lancet. 2020;395(10224): e37–e8.
  15. 15. Chen Q, Liang M, Li Y, Guo J, Fei D, Wang L, et al. Mental health care for medical staff in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(4): e15–e6. pmid:32085839
  16. 16. Xiang YT, Yang Y, Li W, Zhang L, Zhang Q, Cheung T, et al. Timely mental health care for the 2019 novel coronavirus outbreak is urgently needed. Lancet Psychiatry. 2020;7(3): 228–9. pmid:32032543
  17. 17. Li W, Yang Y, Liu ZH, Zhao YJ, Zhang Q, Zhang L, et al. Progression of mental health services during the COVID-19 Outbreak in China. Int J Biol Sci. 2020;16(10): 1732–8. pmid:32226291
  18. 18. Zhang J, Wu W, Zhao X, Zhang W. Recommended psychological crisis intervention response to the 2019 novel coronavirus pneumonia outbreak in China: A model of West China hospital. Precis Clin Med. 2020;3: 3–8.
  19. 19. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLOS Med. 2009;6(6): e1000097.
  20. 20. NIPH [Internet]. NIPH systematic and living map on COVID-19 evidence; 2020 [cited 2020 May 28]. Available from https://www.nornesk.no/forskningskart/NIPH_mainMap.html.
  21. 21. McKenzie J, Brennan S. Chapter 12: Synthesizing and presenting findings using other methods. In: Higgins JPT TJ, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane Handbook for Systematic Reviews of Interventions version, 2nd Edition. Chichester, UK: John Wiley & Sons. 2019. Available from www.training.cochrane.org/handbook.
  22. 22. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650): 924–6. pmid:18436948
  23. 23. Bai Y, Lin CC, Lin CY, Chen JY, Chue CM, Chou P. Survey of stress reactions among health care workers involved with the SARS outbreak. Psychiatr Serv. 2004;55(9): 1055–7. pmid:15345768
  24. 24. Chan AO, Huak CY. Psychological impact of the 2003 severe acute respiratory syndrome outbreak on health care workers in a medium size regional general hospital in Singapore. Occup Med (Lond). 2004;54(3): 190–6.
  25. 25. Chang KH, Gotcher DF, Chan MY. Does social capital matter when medical professionals encounter the SARS crisis in a hospital setting. Health Care Manage Rev. 2006;31(1): 26–33. pmid:16493270
  26. 26. Chen C-S, Wu H-Y, Yang P, Yen C-F. Psychological distress of nurses in Taiwan who worked during the outbreak of SARS. Psychiatr Serv. 2005;56(1): 76–9. pmid:15637196
  27. 27. Chen R, Chou K-R, Huang Y-J, Wang T-S, Liu S-Y, Ho L-Y. Effects of a SARS prevention programme in Taiwan on nursing staff's anxiety, depression and sleep quality: A longitudinal survey. Int J Nurs Stud. 2006;43(2): 215–25. pmid:15927185
  28. 28. Chen NH, Wang PC, Hsieh MJ, Huang CC, Kao KC, Chen YH, et al. Impact of severe acute respiratory syndrome care on the general health status of healthcare workers in Taiwan. Infect Control Hosp Epidemiol. 2007;28(1): 75–9. pmid:17230391
  29. 29. Ho SMY, Kwong-Lo RSY, Mak CWY, Wong JS. Fear of severe acute respiratory syndrome (SARS) among health care workers. J Consult and Clin Psychol. 2005;73(2): 344–9. pmid:15796643
  30. 30. Kang L, Ma S, Chen M, Yang J, Wang Y, Li R, et al. Impact on mental health and perceptions of psychological care among medical and nursing staff in Wuhan during the 2019 novel coronavirus disease outbreak: A cross-sectional study. Brain Behav Immun. 2020;87: 11–7. pmid:32240764
  31. 31. Kim JS, Choi JS. Factors influencing emergency nurses' burnout during an outbreak of Middle East respiratory syndrome coronavirus in Korea. Asian Nurs Res. 2016;10(4): 295–9. pmid:28057317
  32. 32. Koh D, Lim MK, Chia SE, Ko SM, Qian F, Ng V, et al. Risk perception and impact of severe acute respiratory syndrome (SARS) on work and personal lives of healthcare workers in Singapore: what can we learn? Med Care. 2005;43(7): 676–82. pmid:15970782
  33. 33. Lai J, Ma S, Wang Y, Cai Z, Hu J, Wei N, et al. Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019. JAMA Netw Open. 2020;3(3): e203976. pmid:32202646
  34. 34. Lancee WJ, Maunder RG, Goldbloom DS. Prevalence of psychiatric disorders among Toronto hospital workers one to two years after the SARS outbreak. Psychiatr Serv. 2008;59(1): 91–5. pmid:18182545
  35. 35. Liu X, Kakade M, Fuller CJ, Fan B, Fang Y, Kong J, et al. Depression after exposure to stressful events: Lessons learned from the severe acute respiratory syndrome epidemic. Compr Psychiatry. 2012;53(1): 15–23. pmid:21489421
  36. 36. Lu W, Wang H, Lin Y, Li L. Psychological status of medical workforce during the COVID-19 pandemic: A cross-sectional study. Psychiatry Res. 2020;288: 112936. pmid:32276196
  37. 37. Marjanovic Z, Greenglass ER, Coffey S. The relevance of psychosocial variables and working conditions in predicting nurses' coping strategies during the SARS crisis: An online questionnaire survey. Int J Nurs Stud. 2007;44(6): 991–8. pmid:16618485
  38. 38. Maunder RG, Lancee WJ, Rourke S, Hunter JJ, Goldbloom D, Balderson K, et al. Factors associated with the psychological impact of severe acute respiratory syndrome on nurses and other hospital workers in Toronto. Psychosom Med. 2004;66(6): 938–42. pmid:15564361
  39. 39. Maunder RG, Lancee WJ, Balderson KE, Bennett JP, Borgundvaag B, Evans S, et al. Long-term psychological and occupational effects of providing hospital healthcare during SARS outbreak. Emerg Infect Dis. 2006;12(12): 1924–32. pmid:17326946
  40. 40. McAlonan GM, Lee AM, Cheung V, Cheung C, Tsang KWT, Sham PC, et al. Immediate and sustained psychological impact of an emerging infectious disease outbreak on health care workers. Can J Psychiatry. 2007;52(4): 241–7. pmid:17500305
  41. 41. Mo Y, Deng L, Zhang L, Lang Q, Liao C, Wang N, et al. Work stress among Chinese nurses to support Wuhan in fighting against COVID-19 epidemic. J Nurs Manag. 2020;28: 1002–9. pmid:32255222
  42. 42. Nickell LA, Crighton EJ, Tracy CS, Al-Enazy H, Bolaji Y, Hanjrah S, et al. Psychosocial effects of SARS on hospital staff: survey of a large tertiary care institution. CMAJ. 2004;170(5): 793–8. pmid:14993174
  43. 43. Park JS, Lee EH, Park NR, Choi YH. Mental health of nurses working at a government-designated hospital during a MERS-CoV outbreak: A cross-sectional study. Arch Psychiatr Nurs. 2018;32(1): 2–6. pmid:29413067
  44. 44. Sim K, Chong PN, Chan YH, Soon WS. Severe acute respiratory syndrome-related psychiatric and posttraumatic morbidities and coping responses in medical staff within a primary health care setting in Singapore. J Clin Psychiatry. 2004;65(8): 1120–7. pmid:15323599
  45. 45. Son H, Lee WJ, Kim HS, Lee KS, You M. Hospital workers’ psychological resilience after the 2015 Middle East respiratory syndrome outbreak. Soc Behav Personal. 2019;47(2): 1–13.
  46. 46. Styra R, Hawryluck L, Robinson S, Kasapinovic S, Fones C, Gold WL. Impact on health care workers employed in high-risk areas during the Toronto SARS outbreak. J Psychosom Res. 2008;64(2): 177–83. pmid:18222131
  47. 47. Su T-P, Lien T-C, Yang C-Y, Su YL, Wang J-H, Tsai S-L, et al. Prevalence of psychiatric morbidity and psychological adaptation of the nurses in a structured SARS caring unit during outbreak: A prospective and periodic assessment study in Taiwan. J Psychiatr Res. 2007;41(1–2): 119–30. pmid:16460760
  48. 48. Tam CWC, Pang EPF, Lam LCW, Chiu HFK. Severe acute respiratory syndrome (SARS) in Hongkong in 2003: Stress and psychological impact among frontline healthcare workers. Psychol Med. 2004;34(7): 1197–204. pmid:15697046
  49. 49. Wong TW, Yau JK, Chan CL, Kwong RS, Ho SM, Lau CC, et al. The psychological impact of severe acute respiratory syndrome outbreak on healthcare workers in emergency departments and how they cope. Eur J Emerg Med. 2005;12(1): 13–8. pmid:15674079
  50. 50. Wong WCW, Wong SYS, Lee A, Goggins WB. How to provide an effective primary health care in fighting against severe acute respiratory syndrome: The experiences of two cities. Am J Infect Control. 2007;35(1): 50–5. pmid:17276791
  51. 51. Xiao H, Zhang Y, Kong D, Li S, Yang N. The effects of social support on sleep quality of medical staff treating patients with coronavirus disease 2019 (COVID-19) in January and February 2020 in China. Med Sci Monit. 2020;26: e923549. pmid:32132521
  52. 52. Zhang C, Yang L, Liu S, Ma S, Wang Y, Cai Z, et al. Survey of insomnia and related social psychological factors among medical staff involved in the 2019 novel coronavirus disease outbreak. Front Psychiatry. 2020;11: 306. pmid:32346373
  53. 53. Zhu J, Sun L, Zhang L, Wang H, Fan A, Yang B, et al. Prevalence and influencing factors of anxiety and depression symptoms in the first-line medical staff fighting against COVID-19 in Gansu. Front Psychiatry. 2020;11: 386. pmid:32411034
  54. 54. Rotenstein LS, Torre M, Ramos MA, Rosales RC, Guille C, Sen S, et al. Prevalence of burnout among physicians: A systematic review. JAMA. 2018;320(11): 1131–50. pmid:30326495
  55. 55. Clough BA, March S, Chan RJ, Casey LM, Phillips R, Ireland MJ. Psychosocial interventions for managing occupational stress and burnout among medical doctors: A systematic review. Syst Rev. 2017;6(1): 144. pmid:28716112
  56. 56. Li H, Cheng B, Zhu XP. Quantification of burnout in emergency nurses: A systematic review and meta-analysis. Int Emerg Nurs. 2018;39: 46–54. pmid:29361420
  57. 57. Woo T, Ho R, Tang A, Tam W. Global prevalence of burnout symptoms among nurses: A systematic review and meta-analysis. J Psychiatr Res. 2020;123: 9–20. pmid:32007680
  58. 58. Portero de la Cruz S, Cebrino J, Herruzo J, Vaquero-Abellán M. A Multicenter Study into Burnout, Perceived Stress, Job Satisfaction, Coping Strategies, and General Health among Emergency Department Nursing Staff. J Clin Med. 2020;9(4): 1007. pmid:32252444
  59. 59. Xu J, Xu Q-h, Wang C-m, Wang J. Psychological status of surgical staff during the COVID-19 outbreak. Psychiatry Res. 2020;288: 112955. pmid:32302815
  60. 60. De Boer JC, Lok A, van't Verlaat E, Duivenvoorden HJ, Bakker AB, Smit BJ. Work-related critical incidents in hospital-based health care providers and the risk of post-traumatic stress symptoms, anxiety, and depression: A meta-analysis. Soc Sci Med. 2011;73(2): 316–26. pmid:21696873
  61. 61. Brooks SK, Dunn R, Amlot R, Rubin GJ, Greenberg N. A systematic, thematic review of social and occupational factors associated with psychological outcomes in healthcare employees during an infectious disease outbreak. J Occup Environ Med. 2018;60(3): 248–57. pmid:29252922
  62. 62. WHO [Internet]. Mental health and psychosocial considerations during the COVID-19 outbreak; 2020 [cited 2020 April 3]. Available from https://www.who.int/docs/default-source/coronaviruse/mental-health-considerations.pdf
  63. 63. Cai Q, Feng H, Huang J, Wang M, Wang Q, Lu X, et al. The mental health of frontline and non-frontline medical workers during the coronavirus disease 2019 (COVID-19) outbreak in China: A case-control study. J Affect Disord. 2020;275: 210–5. pmid:32734910
  64. 64. Wańkowicz P, Szylińska A, Rotter I. Assessment of mental health factors among health professionals depending on their contact with COVID-19 patients. Int J Environ Res Public Health. 2020;17(16): 5849. pmid:32806699
  65. 65. Arpacioglu S, Gurler M, Cakiroglu S. Secondary traumatization outcomes and associated factors among the health care workers exposed to the COVID-19. Int J Soc Psychiatry. 2020. Published online July 8. pmid:32635786
  66. 66. Maciaszek J, Ciulkowicz M, Misiak B, Szczesniak D, Luc D, Wieczorek T, et al. Mental health of medical and non-medical professionals during the peak of the COVID-19 pandemic: A cross-sectional nationwide study. J Clin Med. 2020;9(8): 2527. pmid:32764509
  67. 67. Sarboozi Hoseinabadi T, Kakhki S, Teimori G, Nayyeri S. Burnout and its influencing factors between frontline nurses and nurses from other wards during the outbreak of Coronavirus Disease -COVID-19- in Iran. Invest Educ Enferm. 2020;38(2): e03. pmid:33047546
  68. 68. García-Fernández L, Romero-Ferreiro V, López-Roldán PD, Padilla S, Calero-Sierra I, Monzó-García M, et al. Mental health impact of COVID-19 pandemic on Spanish healthcare workers. Psychol Med. 2020: 1–3. pmid:32456735
  69. 69. Skoda EM, Teufel M, Stang A, Jöckel KH, Junne F, Weismüller B, et al. Psychological burden of healthcare professionals in Germany during the acute phase of the COVID-19 pandemic: differences and similarities in the international context. J Public Health. 2020. Published online Aug 7. pmid:32766787
  70. 70. Huang L, Lei W, Xu F, Liu H, Yu L. Emotional responses and coping strategies in nurses and nursing students during Covid-19 outbreak: A comparative study. PLoS One. 2020;15(8): e0237303. pmid:32764825