Impact of COVID-19 pandemic on mental health: An international study

Background The COVID-19 pandemic triggered vast governmental lockdowns. The impact of these lockdowns on mental health is inadequately understood. On the one hand such drastic changes in daily routines could be detrimental to mental health. On the other hand, it might not be experienced negatively, especially because the entire population was affected. Methods The aim of this study was to determine mental health outcomes during pandemic induced lockdowns and to examine known predictors of mental health outcomes. We therefore surveyed n = 9,565 people from 78 countries and 18 languages. Outcomes assessed were stress, depression, affect, and wellbeing. Predictors included country, sociodemographic factors, lockdown characteristics, social factors, and psychological factors. Results Results indicated that on average about 10% of the sample was languishing from low levels of mental health and about 50% had only moderate mental health. Importantly, three consistent predictors of mental health emerged: social support, education level, and psychologically flexible (vs. rigid) responding. Poorer outcomes were most strongly predicted by a worsening of finances and not having access to basic supplies. Conclusions These results suggest that on whole, respondents were moderately mentally healthy at the time of a population-wide lockdown. The highest level of mental health difficulties were found in approximately 10% of the population. Findings suggest that public health initiatives should target people without social support and those whose finances worsen as a result of the lockdown. Interventions that promote psychological flexibility may mitigate the impact of the pandemic.


Introduction
The COVID-19 global pandemic caused by the severe acute respiratory syndrome coronavirus 2 (SARS-COV-2) virus triggered governmentally mandated lockdowns, social distancing, quarantines and other measures in the interest of public health. The mandated lockdowns abruptly and dramatically altered people's daily routines, work, travel, and leisure activities to a degree unexperienced by most people living outside of war zones. Simultaneously, the highly contagious, yet invisible virus transformed previously neutral situations to perceived potentially dangerous ones: social interaction, touching one's face, going to a concert, shaking someone's hand, and even hugging grandparents. Given these changes and looming threat, increases in anxiety and depression can be expected [1]. Indeed, common psychological reactions to previous quarantines include post-traumatic symptoms, confusion, and anger [2], though these data stem from quarantines of specific regions or a subgroup of exposed people, such as medical professionals. It therefore remains an empirical question whether such patterns are consistent when entire populations across the globe are simultaneously affected.
For most people, it stands to reason that governmentally mandated lockdowns decrease their activity levels and the number of stimuli experienced compared to pre-lockdown levels. The impact of reducing activities, stimuli and routines on the population is unknown, but various analogue situations can be used to make predictions, like death of a spouse [3]; hearing loss [4]; job loss [5]; long duration expeditions [6]; poor acculturation [7]; and even ageing when combined with loneliness [8]. Each of these situations is associated with increases in psychological distress. This reduction of stimulations may lead to boredom and reductions in reinforcement, which has been associated with depression [9]. The sum total of these literatures, and some evidence from country specific studies on COVID-19 suggests that for some people, the mental distress in the form of stress, depression, and negative affect are likely reactions to the lockdown; therefore, people's wellbeing is likely to suffer. Indeed, increased loneliness, social isolation, and living alone are associated with increased mortality [10]-the exact effect that mandated lockdown and social distancing rules aimed to counteract.
Alternately, the planned slowing down of daily routines can be beneficial. For example, vacations and weekends are highly sought-after-if not always achieved-periods of relaxation and stress reduction [11]. Likewise, some religious and spiritual traditions encourage simplicity, mindfulness, and solitude with the goal of increasing wellbeing [12]. It is therefore conceivable that for some people the lockdown could offer a reprieve from daily hassles and stress and even lead to increases in wellbeing. It is therefore equally important to identify protective factors that can buffer against the negative effects of the lockdown.
Although nearly all people around the globe have been subject to some form of lockdown measures to contain the COVID-19 response, variations exist with respect to how each person is confined, even within a single country. For instance, during the COVID-19 pandemic some people were allowed to go to work, whereas others were required to work exclusively from home. For various reasons, some people had difficulty obtaining some basic supplies. Further, some were thrust into the situation of taking care of others (e.g., children, due to closing of schools). Finally, some people lost income as a result of the lockdown, and this is a known risk-factor for poor mental health [13,14]. Finally, a lockdown may be experienced differently the longer it continues and potentially when in confined spaces [2]. All of these lockdown-specific features may have an impact on one's mental health, but to date it remains inadequately explored.
As the risk of the pandemic continues, it is important to understand to what degree the virus-induced uncertainty and the lockdown-induced changes in daily routines impact stress, depression, affect, and wellbeing. Towards this end, it is important to identify factors that can mitigate potential negative psychological effects of pandemics and lockdowns. Various social and psychological factors have been identified in other contexts that may also help build resilience in large-scale pandemics such as COVID-19. On the social level, one such candidate is social support, which has repeatedly been found to positively impact mental health and wellbeing [15][16][17][18]. Another social factor is the family climate and family functioning, which clearly impacts people's mental health [19,20]. Psychological factors such as mindfulness and psychologically flexible response styles (as opposed to rigid and avoidant response styles) are behavioral repertoires that have previously been shown to buffer the impact of stress and facilitate wellbeing [21][22][23][24].
Given the scope of the COVID-19 pandemic, it is crucial to better understand how a pandemic and associated lockdowns impact on mental health. Thus, the aim of this study was to determine mental health outcomes and to examine known predictors of outcomes to identify psychological processes and contextual factors that can be used in developing public health interventions. It can be assumed, but remains untested, that those with risks in social-demographic factors, living conditions, social factors and psychological factors have more severe reactions to the lockdown. We therefore tested whether outcomes of stress, depression, affect, and wellbeing were predicted by country of residence, social demographic characteristics, COVID-19 lockdown related predictors, social predictors, and psychological predictors.

Participants
The inclusion criteria were �18 years of age and ability to read one of the 18 languages (English, Greek, German, French, Spanish, Turkish, Dutch, Latvian, Italian, Portuguese, Finnish, Slovenian, Polish, Romanian, Hong Kong, Hungarian, Montenegrin, & Persian.). There were no exclusion criteria. People from all countries were eligible to participate.

Procedure
Ethics approval was obtained from the Cyprus National Bioethics Committee (ref.: EEBK EP 2020.01.60) followed by site approvals from different research teams involved in data collection. All participants provided written informed consent prior to completing the survey (computer-based, e.g., by clicking "yes").
A population based cross-sectional study was conducted in order to explore how people across the world reacted to the COVID-19. The anonymous online survey was distributed using a range of methods. Universities emailed the online survey to students and academic staff and also posted the survey link to their websites. In addition, and in order to broaden the sample to older age groups and to those with different socio-demographic characteristics, the survey was disseminated in local press (e.g., newspapers, newsletters, radio stations), in social media (e.g., Facebook, Twitter, etc.), in professional networks, local hospitals and health centers and professional groups' email lists (e.g., medical doctors, teachers, engineers, psychologists, government workers), and to social institutions in the countries (e.g., churches, schools, cities/townships, clubs, etc.).
Data were collected for two months between 07th April and 07th June 2020. The majority of countries where data were collected had declared a state of emergency for COVID-19 during this time.

Measures
Well validated and established measures were used to assess constructs. When measures did not already exist in a language, they were subject to forward and backward translation procedures. Well-validated measures of predictors and outcomes and items measuring COVID-19 related characteristics were selected after a consensus agreement among the members of this study.

Predictors
Country. Respondents' countries were coded and entered as predictors. Socio-demographic status. Participants responded to questions related to their sociodemographic characteristics including their age, gender, country of residence, marital status, employment status, educational level, whether they have children as well as their living situation.
Lockdown variables. Participants responded to questions related to lockdown including length of lockdown, whether they need to leave home for work, any change in their finances, whether they were able to obtain basic supplies, the amount of their living space confined in during the lockdown. They were also asked whether they, their partner, or a significant other was diagnosed with COVID-19.
Social factors. Social factors were measured using the Brief Assessment of Family Functioning Scale (BAFFS; [25]) and the Oslo Social Support Scale (OSSS; [26]). The BAFFS items are summed to produce a single score with higher scores indicating worse family functioning. The OSSS items are summed up and provide three levels types of social support: low (scored 3-8), moderate (scored 9-11) and high (scored [12][13][14]. Psychological factors. Psychological factors including mindfulness and psychological flexibility. Mindfulness was measured using the Cognitive Affective Mindfulness Scale (CAMS; [27]). The CAMS produces a single score with higher scores indicating better mindfulness qualities. Psychological flexibility (e.g., hold one's thoughts lightly, be accepting of one's experiences, engage in what is important to them despite challenging situations) was measured using the Psyflex scale [28]. The Psyflex produces a single score with higher scores indicating better psychological flexibility qualities.

Outcomes
Stress. Stress was measured using the Perceived Stress Scale (PSS; [29]). The PSS assesses an individual's appraisal of how stressful situations in their life are. Items ask about people's feelings and thoughts during the last month. A total score is produced, with higher scores indicating greater overall distress.
Depression. Depressive symptomatology was assessed using two items from the disengagement subscale of the Multidimensional State Boredom Scale (MSBS; [30]). These items assessed wanting to do pleasurable things but not finding anything appealing (i.e., boredom), as well as wasting time. Based on concepts of reinforcement deprivation (i.e., lack of access to or engagement with positive stimuli) that is known to contribute to depression, we added an item that measured how rewarding or pleasurable people found the activities that they were engaging in (i.e., reinforcement). Higher scores indicated higher depressive symptomatology.
Positive affect/ negative affect. The Positive And Negative Affect Scale (PANAS) was used to measure affect [31]. The original version of the questionnaire was used with five additional items: bored, confused, angry, frustrated and lonely. All items were scored on a 5-point Likert type scale, ranging from 1 = very little/not at all to 5 = extremely and summed up so that higher scores in the positive-related items indicating higher positive affect and higher scores in the negative-related items indicating higher negative affect. In order to capture additional dimensions of negative affect believed to be relevant to the COVID-19 lockdowns, we additionally added five items: bored, confused, angry, frustrated, lonely.
Wellbeing. Wellbeing was assessed using the Mental Health Continuum Short Form (MHC-SF; [32]); which assesses three aspects of wellbeing: emotional, psychological, and social. The MHC-SF produces a total score and scores for each of the three aspects of wellbeing. The MHC-SF can also be scored to produce categories of languishing (i.e., low levels of emotional, psychological, and social well-being), flourishing (i.e., high levels of emotional psychological and social well-being almost every day), and moderately mentally healthy (in between languishing and flourishing).

Statistical analysis
The mean and standard deviation was calculated for dependent variables that follow the normal distribution while the median and interquartile range (IQR) were computed for non-normally distributed data. Bivariable association between an outcome variable and each predictor was investigated with ANOVA test for categorical predictor and univariable linear regression for numerical predictor. Linear mixed-effect model with random effect for country was performed to consider simultaneously several predictors in the same model and to account for the variation in outcome variable between countries. Four separate linear mixed-effect models were used for each outcome variable, one for each set of socio-demographic, lockdown, social and psychosocial predictors and multicollinearity for each set of predictors was investigated with the variation inflation criterion (VIF). Standardized regression coefficients were computed as effect size indices to measure the strength of the association between predictor variables and outcome variables. The comparison between the country mean and overall mean for each outcome variable was estimated though a linear regression model with dependent variable the mean centering outcome and predictor the country. Cohen's d effect size of the standardize difference between country mean and the overall mean was computed as a measure of the magnitude of the difference between the two means.
The whole sample was used in linear mixed-effect models while for the comparison of country mean to the overall mean was used the sample from countries with sample size �100. The R packages lme4 and effect sizes were used for fitting the linear mixed effect model and to compute the standardized regression coefficients of the linear mixed effect models [33]. Significance test and confidence intervals were calculated at a significance level of 0.05. The following cut-off values were used for the evaluation of the effect sizes: 'tiny' �0.05, 'very small' from 0.05 to �0.10, 'small' from 0.10 to � 0.20, 'medium' from 0.20 to � 0.30, 'large' from 0.30 to � 0.40 and 'very large' > 0.40 [34].

Descriptive
Participants were n = 9,565 people from 78 countries. See supporting information for a participation flowchart (S1 Appendix). The countries with the largest samples were: Latvia  Table).

Outcome variables
The means, standard deviations, and where appropriate percentage of participants within categories of the five outcome variables can be seen in Table 1.

Predictor variables
Countries. A full list of countries can be found in the supporting information (S1 Table). Socio-demographic status. The mean age was 36.9 (13.3) years. A majority of participants were female (77.7%), approximately a fifth male (22.0%), and small minority identified as other (0.3%). More than half of the respondents were either in a relationship (25.7%) or married (36.1%), almost a third were single (30.8%), and the rest were either divorced (5%), widower (1.1%) or other (1.3%). Participants indicated that they lived: alone (14.6%), with both parents (20.8%), one parent (5.1%), with their own family including partner and children (54.1%), or with friends or roommates (5.5%). Less than half of respondents had children (40.8%). Approximately half of the participants were working full time (53.4%), almost a fifth were working part-time (17.5%), 23.2% were unemployed and a small minority were either on parental leave (2.2%) or retired (3.7%).
COVID-19 lockdown variables. At the time of responding, participants were in lockdown or self-isolation for a median of 5.0 (3.0 IQR) weeks. Most people indicated that they had not been infected with COVID-19 (88.0%), a small minority indicated they had been infected (1.4%) and the rest had symptoms but were unsure (10.6%). Similar patterns were seen with reported infection rates of partners (no: 92.2%, yes: 0.7%, unsure: 7.1%) and of people close to them (no: 86.0%; yes: 5.6%; unsure: 8.4%). With respect to leaving the house for work, almost half (47.7%) indicated that this never occurred, 7.7% indicated leaving only once, whereas an almost equal number indicated leaving a couple times per week (23.7%) or more than three times per week (21.0%). Nearly all participants indicated they were able to obtain all the basic supplies they needed (93.5%). Participants reported having a median inner living space of 90.0 square meters (80.0 IQR) and median outdoor space of 20.0 square meters (192.1 IQR). Finally, with respect to finances, more than half indicated that their financial situation remained about the same (57.9%), a minority indicated it improved (8.9%), and a third reported that their finances had gotten worse (33.3%).
Social and psychological predictors. Mean values of the other predictors (i.e., social predictors and psychological predictors) can be seen in Table 1.
Differences in reported levels of stress across countries were largely negligible, with the exception of two countries that reported higher levels of stress (Hong Kong (2.85, 95%CI, 2.22,    Depression. Results of multivariate analyses for the outcome of depression can be seen in Table 3. The strongest predictor of depression was social support, such that high (-1.30, 95% CI, -1.44, -1.16) and medium levels (-0.73, 95%CI, -0.85, -0.62) of social support were protective against depression (relative to low levels) with a very large and large effect sizes, respectively. The only other large effect size was for psychological flexibility, which also served in a protective manner (-0.20, 95%CI, -0.22, -0.19). Moderate effect sizes of predictors associated with less depression symptoms were also observed for higher education levels (see Table 3). Moderate effect sizes of predictors associated with more depression were worse family functioning (0.29, 95%CI, 0.27, 0.32) and not being able to obtain all basic supplies (0.49, 95%CI, 0.27, 0.70).
The amount of depression symptoms reported on average within countries was similar for most countries with the exception of one country with lower reported levels than average with a large effect size (Austria (-0.71, 95%CI, -0.95, -0.47)) and one with higher levels than average with a large effect size (USA (0.85, 95%CI, 0.58, 1.13)). See supporting information for information on each country (S2-S6 Tables).
Affect. Results of multivariate analyses for the outcome of affect can be seen in Table 4. With respect to positive affect, social support (high support vs low support (5.69, 95%CI, 5.23, 6.16) and psychological flexibility (0.77, 95%CI, 0.74, 0.81) were both predictors with very large effect sizes. Interestingly, those who left their house more than three times per week had higher levels of positive affect than those that did not leave their house for work (1.68, 95%CI, 1.18, 2.17), with a medium effect size. Higher education levels were associated with higher levels of positive affect with a medium to large effect size (see Table 4, PANAS-Positive).
The amount of positive affect reported on average within countries was similar for most countries with the exception of one country with lower reported levels than average with a large effect size (Finland (-2.96, 95%CI, -4.19, -1.73)) and one with higher reported levels than average with a large effect size (Portugal (2.96, 95%CI, 2.12, 3.80)). See supporting information for information on each country (S2-S6 Tables).
Wellbeing. Results of multivariate analyses for the outcome of wellbeing can be seen in Table 5. Once again, social support (high support vs low support (13.20,95%CI,12.39,14.01)) and psychological flexibility (1.42, 95%CI, 1.34, 1.49) were the predictors with the largest effect sizes (very large) on wellbeing. Higher education levels were associated with higher levels of wellbeing with a medium to large effect sizes (see Table 5). Medium negative effect sizes were noted for family functioning (-1.98, 95%CI, -2.12, -1.83) and inability to obtain all basic    The level of wellbeing reported on average within countries was similar for most countries with the exception of three countries with higher levels with large effect sizes (Austria (4.95, 95%CI, 3.55, 6.34), Finland (5.24, 95%CI, 3.10, 7.38), & Portugal (4.59, 95%CI, 3.12, 6.05)) and two countries with lower levels of wellbeing than average with large (Italy (-4.36, 95%CI, -11.06, 2.35)) and very large effect sizes (Hong Kong (-6.84, 95%CI, -8.02, -5.66)). See supporting information for information on each country (S2-S6 Tables).

Discussion
The COVID-19 is the largest pandemic in modern history. This study assessed nearly 10,000 participants across many countries to examine the impact of the pandemic and resultant governmental lockdown measures on mental health. During the height of the lockdown, the pandemic was experienced as at least moderately stressful for most people, and 11% reported the highest levels of stress. Symptoms of depression were also high, including 25% of the sample indicating that the things they did were not reinforcing, 33% reporting high levels of boredom, and nearly 50% indicating they wasted a lot of time. Consistent with symptoms of stress and depression, 10% of participants were psychologically languishing. These results suggest that there is a subgroup of people who are especially suffering and that in about 50% of the respondents' levels of mental health was only moderate. Previous studies have found that along with low levels, even moderate levels of mental health (which consists of only moderate levels of emotional, psychological, and social well-being) are associated with increased subsequent disability, productivity loss, and healthcare use [35][36][37]. Not everyone was suffering, however, as evidenced by the nearly 40% of participants who reported levels of mental health consistent with flourishing. The present results, while serious, do not point to more severe reactions observed in previous samples of selective quarantined individuals or groups [2]. Perhaps the   previously reported distress in these groups is prevented when an entire country or world is in lockdown so that the feeling emerges that "everyone is in it together". Importantly, a handful of predictors emerged that consistently predicted all outcomes: Social support, education level, finances, access to basic needs, and the ability to respond psychologically flexible. The consistency of results examining predictors is noteworthy, both in terms of the consistently strong predictors (e.g., social support, education, psychological flexibly, as well as loss of income and lack of access to necessities) and in terms of the other predictors that were either not predictive or only weakly so. All predictors were chosen based on theoretical ties to the outcomes, previous findings, and studies on quarantines [2].
A novel finding was that people who left their house three or more times per week reported more positive affect than those that left their house less often. It is possible that these people experienced more variation, which contributed to positive affect. It is also possible they experienced a greater sense of normality. Future studies are encouraged to further investigate possible mechanisms through which this result unfolds.
Overall, these patterns did not differ substantially between countries. Although some differences did emerge, they were mostly inconsistent across outcomes. Three countries fared worse on two outcomes each: Hong Kong (stress & wellbeing); Turkey (stress & negative affect); and Finland (lower positive affect and higher negative affect)-though participants in Finland also reported higher levels of wellbeing than average. Two countries had more favorable outcomes than the average levels across all countries: Portugal (lower stress and higher wellbeing) and Austria (lower depression and higher wellbeing). The differences observed are likely due to a combination of chance, sampling, nation specific responses to the COVID-19 pandemic, cultural differences, and other factors playing out in the countries (e.g., political unrest [38]). If replicated, future studies are encouraged to examine possible mechanisms of these outcomes.
This study provides valuable insights on several levels. First, it documents the mental health outcomes across a broad sample during the COVID-19 global pandemic. Second, it informs about the conditions and resilience factors (social support, education, and psychological flexibility) and risk factors (loss of income and inability to get basic supplies) that affect mental health outcomes. Third, these factors can be used in future public health responses are being made, including those that require large scale lockdowns or quarantines. That is, public health officials should direct resources to identifying and supporting people with poor social support, income loss, and potentially lower levels of education and provide a strategy to mitigate special risks in these subpopulations. The importance of social support needs to be made clear to the public and to the degree possible mechanisms that can contribute to social support should be supported. Further, psychological flexibility is a trainable set of skills that has repeatedly been shown to ameliorate suffering [22,39]; and can be widely distributed with modern technological intervention tools such as digital, internet, or virtual means [40]. We do not claim, however, that psychological flexibility is the only factor that can be used for interventions. Instead, it is a recognized transdiagnostic factor assessed in this study and one that is feasible to be targeted and modified by interventions and prevention [41][42][43]. This study is limited by several important factors. First, the results are based on cross sectional analysis and correlations. As such, causation cannot be inferred and any delayed impact of the pandemic and lockdown on peoples' mental health was not captured. Second, all results of this survey were obtained via self-report questionnaires, which can be subject to retrospective response bias. Third, although the sample was large and based on varied recruitment sources, it was not representative of the population and undersampled people who suffered most from the pandemic (i.e., front line health care professionals, people in intensive care, etc.) or people without internet access, etc. Finally, the country-specific incidence rates and lockdown measures differed across countries. These were not assessed, but future studies are encouraged to investigate how such factors impact mental health outcomes.
These limitations notwithstanding, based on nearly 10,000 international participants, this study found that approximately 10% of the population was languishing during or shortly after the lockdown period. These finding have implications for public health initiatives. First, officials are urged to attend to, find, and target people who have little social support and/ or whose finances have worsened as a result of the measures. Second, public health interventions are further urged to target psychological processes such as psychological flexibility in general to potentially help buffer other risk factors for mental health. Likewise, availability of social support and information about where to get support and remain connected are needed. These recommendations should become part of public health initiatives designed to promote mental health in general, and should equally be considered when lockdowns or physical distancing are prescribed during a pandemic.
Supporting information S1