Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The good, the bad, and the mixed: Experiences during COVID-19 among an online sample of adults

  • Devin J. Mills ,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing

    devin.mills@ttu.edu

    Affiliation Department of Community, Family, and Addiction Sciences, Texas Tech University, Lubbock, Texas, United States of America

  • Julia Petrovic,

    Roles Conceptualization, Writing – original draft

    Affiliation Department of Educational and Counselling Psychology, McGill University, Montreal, Canada

  • Jessica Mettler,

    Roles Conceptualization, Methodology, Writing – original draft

    Affiliation Department of Educational and Counselling Psychology, McGill University, Montreal, Canada

  • Chloe A. Hamza,

    Roles Supervision, Writing – review & editing

    Affiliation Department of Applied Psychology and Human Development, University of Toronto, Toronto, Canada

  • Nancy L. Heath

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Educational and Counselling Psychology, McGill University, Montreal, Canada

Abstract

Studies have outlined the negative consequences of the COVID-19 pandemic to psychological health. However, the potential within-individual diversity of experiences during COVID-19, and how such experiences relate to indices of psychological distress and COVID-19-specific stressors, remains to be explored. A large online sample of American MTurk Workers (N = 3,731; Mage = 39.54 years, SD = 13.12; 51.70% female) completed short assessments of psychological distress, COVID-19-specific stressors (e.g., wage loss, death), and seven items assessing negative and positive COVID-19 experiences. Latent profile analyses were used to identify underlying profiles of COVID-19 experiences. A four-profile solution was retained representing profiles that were: (1) predominantly positive (n = 839; 22.49%), (2) predominantly negative (n = 849; 22.76%), (3) moderately mixed (n = 1,748; 46.85%), and (4) high mixed (n = 295; 7.91%). The predominantly positive profile was associated with lower psychological distress, whereas both the predominantly negative and high mixed profiles were associated with higher psychological distress. Interestingly, specific COVID-19 stressful events were associated with the high mixed profile. The present study challenges the narrative that the impacts of COVID-19 have been unilaterally negative. Future directions for research are proposed.

Introduction

The COVID-19 pandemic, along with the unprecedented series of lockdowns that followed its onset, caused drastic disruptions to day-to-day life globally. A substantial proportion of students and employees experienced a sudden shift to remote work and lockdown measures abruptly halted social activities, leading to increased social isolation [1, 2]. Accordingly, to date, there are multiple studies which have focused on the negative impacts of the COVID-19 pandemic onset, with several highlighting aversive psychological impacts [35]. However, it has been suggested that an overemphasis on the negative consequences of COVID-19 may bring about expectancy effects [6] and the capacity for resilience in response to COVID-19 cannot be discounted in our investigations of the impact of the pandemic [7, 8]. Moreover, a balanced exploration into both negative and positive experiences during early months of the pandemic, their potential for co-occurrence, and whether they differ as a function of COVID-19-specific COVID-19 stressful events remains to be examined. Thus, the present study took a person-centered approach to examine the potential variability in COVID-19 experiences among a large and diverse sample of adults, and to investigate how differences in specific COVID-19-related stressors (i.e., loss of wages, COVID-19 diagnosis of self or loved one, death of loved one due to COVID-19) were associated with COVID-19 experiences.

Negative experiences during COVID-19

During the early months of COVID-19, numerous studies reported on the negative impacts and stressful events associated with the first series of global lockdowns. Here, we distinguish between psychological experiences during COVID-19 (e.g., feeling stressed, sad, or lonely) and COVID-19 stressful events (e.g., job loss, death). Heightened levels of mental health difficulties were commonly reported (e.g., distress, anxiety, depression) [4, 5, 9, 10]. However, emerging longitudinal research suggests these effects may be small, and there is likely considerable variability in the psychological experiences of COVID-19 [6]. Nevertheless, psychological harms, concern towards the health of vulnerable loved ones, as well as loss of leisure and health activities, were commonly reported during the early months of COVID-19 [2, 11].

Other studies have focused on the mental health disparities associated with COVID-19. For instance, two studies of individuals with eating disorders found that disordered eating behaviours were exacerbated in the first few weeks of the pandemic [12, 13]; these were among a number of studies to report that COVID-19 exacerbated the struggles of groups experiencing various difficulties prior to the onset of the pandemic. In another early pandemic study, Iob and colleagues [14] found that COVID-19 instigated an amplification of pre-existing inequalities among disadvantaged groups including ethnic minority groups, those experiencing socioeconomic disadvantages, and the unemployed. Furthermore, in a qualitative study of distress and coping in India during the first COVID-19 lockdown, disadvantaged groups with limited access to mobile phones, health messaging, or health care experienced extreme distress and despair, greater health needs, loss of income, and further social exclusion as a result of the pandemic [10]. Taken together, these findings suggest that COVID-19 may have worsened existing psychosocial and financial inequalities [5, 15].

Social isolation has been commonly reported as a primary cause of increased psychological distress among some individuals during COVID-19 [11]. One longitudinal study of university students revealed that individuals without pre-existing mental health concerns were more likely than individuals with pre-existing mental health concerns to experience declining mental health during the early months of the pandemic, which corresponded with increased social isolation among these students (whereas there was no change for students with pre-existing mental health concerns) [16]. Other contextual factors that have been found to be contributors to negative COVID-19 experiences among general population samples during the early months of the pandemic include economic fallout (e.g., wage loss), grief from having lost a loved one to COVID-19, trauma associated with surviving COVID-19, the inability to see relatives (especially older relatives), having to manage the impracticalities of working or schooling from home, the disruption of social and recreational activities, and frustration with the media or government [2, 17]. In short, much of the literature has focused on the negative consequences associated with COVID-19 events without accounting for the possibility of positive experiences emanating from COVID-19 events.

Positive COVID-19 experiences

Despite the numerous negative psychological experiences of the onset of COVID-19 on populations worldwide, preliminary findings have shed light on the possibility that the experiences of COVID-19 during its early months have not been unanimously negative [6, 18]. For example, a study by Pinkham and colleagues [19] of individuals with severe mental illness found that their affective experiences and psychotic symptoms remained stable throughout the early months of the pandemic, and that they actually experienced an increase in well-being during this timeframe. Additionally, a longitudinal study with over 50,000 UK adults found that across early pandemic months, individuals with pre-existing mental health conditions experienced significantly greater decreases in anxiety than individuals without pre-existing mental health conditions [20]. These findings suggest that in certain instances, the onset of COVID-19 brought about positive, rather than negative, psychological impact for some individuals.

A limited number of studies have explored positive experiences during the onset of the pandemic among more general populations. Indeed, research suggests that the shared experience of the pandemic may have strengthened social connectedness, since people reported feeling as though “we are all in this together” [6, 21, 22]. Even among disadvantaged groups who report a disproportionate degree of negative COVID-19 experiences, themes of resilience and healthy coping have emerged in reports of their experiences, which have included reports of social connectedness as well as finding sense and meaning in the pandemic [10]. Typically, these studies have been limited in the breadth of positive experiences examined.

To our knowledge, only four studies have specifically focused on the investigation of a broad range of positive experiences during early COVID-19 months among general community samples. The first was a cross-sectional online study by Stallard and colleagues [23] which investigated positive COVID-19 experiences reported by parents and caregivers (88.6% of the sample were mothers) in Portugal and the UK during the first lockdown. It was found that as many as 88.6% of participants identified positives arising from COVID-19 within an open-ended question. A second cross-sectional study by Williams and colleagues [18] conducted in Scotland during the first lockdown explored positive changes experienced during COVID-19, and the underlying sociodemographic predictors of such changes. Again, the majority of participants reported positive changes including having more quality time with their partner (53.3%), to be in nature (65.2%), do enjoyable activities (67.4%), and exercise (53.9%). Participants also reported being more appreciative of things usually taken for granted (82.6%). A third study by Schmiedeberg and Thönnissen [24] of German adults explored the extent to which individuals held positive and/or negative perceptions regarding COVID-19. Using two items, one for positive perception and one for negative perception, the authors found 61% agreed with positive perceptions towards COVID-19 (i.e., being able to see the positive sides of the pandemic), whereas only 26% agreed with negative perceptions (i.e., feeling strongly affected by the pandemic). Finally, Hampshire and colleagues [2] investigated positive and negative COVID-19 experiences during May 2020 among a large sample (N > 100,000) of participants aged 16 to 85 and older, as well as sociodemographic and neurological/psychiatric predictors of such experiences. Participants reported strong endorsement of a number of positive COVID-19 experiences (i.e., improved natural environment, enjoying the simpler things in life, spending less money, and a greater sense of community) as well as of a number of negative COVID-19 experiences (i.e., loss of leisure/health activities, and concern for health of loved ones, which was higher than concern about one’s own health). Furthermore, sociodemographic characteristics, work, environment, and social circumstances revealed robust associations with the nature and extent of self-reported positive and negative COVID-19 experiences.

Taken together, the studies outlined above highlight the importance of measuring multiple dimensions of both negative and positive COVID-19 experiences when quantifying the breadth of impacts of the onset of COVID-19. Yet, much of the available research presents a view of the effect of COVID-19 as all negative, and research that has assessed the positive outcomes of COVID-19 is limited. Hampshire and colleagues [2] assessed a comprehensive overview of both positive and negative experiences revealing a sufficient number of participants endorsed both positive and negative. This is due to past research primarily using variable-centered approaches, which help to reveal general associations among variables but fail to account for individual variability across a set of variables. As a result, researchers have yet to examine whether there are subgroups of individuals, based on the scores on both positive and negative indicators (e.g., someone who is strongly positive, but also somewhat negative). A person-centered analysis takes into account this heterogeneity.

The present study

The present study sought to explore the range of experiences during the COVID-19 pandemic among an online community sample of adults, as well as whether COVID-19-specific stressful events were related to such experiences. The first objective was thus to investigate the factor structure of a researcher-designed measure of negative and positive COVID-19 experiences and its convergent and divergent validity with psychological distress markers (i.e., stress, anxiety, depression). Given the paucity of work exploring the potential positives of COVID-19, developing this scale represents an important contribution to the emerging literature on the effects of COVID-19 on individuals. Based on previous literature, we hypothesized that two distinct factors would emerge: one for negative COVID-19 experiences and one for positive COVID-19 experiences. Furthermore, we anticipated that negative experiences during COVID-19 would be associated with greater stress, anxiety, and depression. Conversely, positive experiences related to COVID-19 were expected to be associated with less stress, anxiety, and depression. Given that many authors have suggested that impacts of COVID-19 will continue long after the pandemic has ended, [25], this scale can continue to be used to explore both positive and negative experiences resulting from the pandemic in the years to come. However, it is also expected that the measure may be easily adapted to assess positive and negative experiences to other global, national, or local crises (e.g., political unrest, natural disasters).

The second objective of this study was to use a person-centered approach to identify underlying profiles of COVID-19 experiences, taking into account the diversity of negative and positive experiences. Contrary to a variable-centered approach, the person-centered approach is expected to yield more information regarding the underlying relationship of both negative and positive COVID-19 experiences within individuals. Finally, the third objective sought to better understand the emergent profiles by comparing them in terms of differences in demographic information, psychological distress, and specific stressful events during COVID-19 (i.e., loss of wages, diagnosis of self or other, knowing someone who died from COVID-19). Given the inherently exploratory nature of this approach, no specific hypotheses were made for these last two objectives.

Methods

COVID-19 context

The first COVID-19 case in the United States was confirmed by the Centers for Disease Control and Prevention on January 21, 2020, and a Public Health Emergency was declared within two weeks on February 3, 2020. On March 12, 2020, financial markets were down nearly 10% in the United States with rising concerns of business closings. By late March, many states enacted stay-at-home orders, and employees began to be furloughed. Unemployment within the US jumped from less than 5% in February to nearly 15% by April. Although cases continued to rise in the United States, many state-mandated stay-at-home orders expired by the end of May. As of June 2020, the financial challenges were amplified by the rising health concerns as the confirmed COVID-19 case count in the United States exceeded 2 million with more than 100,000 deaths related to complications with COVID-19. This represents the context in which the present data was collected. Data for the present study are available online here: https://tinyurl.com/m54cfraf.

Participants and procedure

The Texas Tech University Review Board (IRB2019-920) approved the present study. Participants were provided information about the study prior to completing the online survey anonymously. As part of a larger study on the mental health and risky behaviors of workers on Amazon’s Mechanical Turk (MTURK), a short, five-minute survey was posted on MTURK to screen participants for future research. MTURK has been used extensively in social sciences with research demonstrating benefits including cost effectiveness, speed, and data quality [26, 27]. The survey was created in Qualtrics and posted on MTURK via the TurkPrime.com platform [28] which, in addition to being user friendly, offers additional services including blocking known problem workers and bots. Participants provided their informed consent following a review of the intended research goals and continued to the online survey.

The survey was open for a seven-day period from June 8, 2020 to June 14, 2020 and was only open to participants with ≥ 90% approval in at least 100 previous assignments on MTURK. Participants were paid $0.50. In total, 4,771 participants initiated the survey on MTURK. Participants were excluded for missing one or more attention item (n = 640), engaging in “straight lining” (n = 226), or submitting missing data (n = 174). The final sample included 3,731 participants (Mage = 39.54 years, SD = 13.12; 51.70% female) (see Table 1 for sample demographics).

thumbnail
Table 1. Sample demographics and descriptives statistics for mental health indices.

https://doi.org/10.1371/journal.pone.0269382.t001

Measures

Negative and positive experiences during COVID-19.

Seven items were created for the purposes of the present study based on previous exploratory, qualitative interviews with adults regarding their experiences during the early months of COVID-19. Items followed the prompt, “Relative to months before COVID-19…” and were rated on a 6-point scale ranging from Strongly Disagree (1) to Strongly Agree (6). The brevity of the scale was intentional as it reduces participant burden and would be scalable for future large-scale studies including continued COVID-19 research. Further, a briefer measure would make it more useful in clinical contexts. Table 2 presents these items and the item descriptives.

thumbnail
Table 2. Items descriptives and loadings from the exploratory (EFA) and confirmatory (CFA) factor analyses on the COVID-19 experience items.

https://doi.org/10.1371/journal.pone.0269382.t002

Demographics.

Basic demographics were collected including sex, age, race, level of education, and income. Due to the timing of data collection within the United States, it was possible that some individuals were experiencing complicated circumstances regarding their employment status; as a result, participants reported their employment prior to COVID-19.

Specific COVID-19 events.

Three Yes/No questions were asked regarding specific COVID-19 events: (1) Have you lost wages because of the COVID-19 pandemic?; (2) Have you or someone you know been diagnosed with the coronavirus (COVID-19)?; and (3) Has someone you know died due to complications with the coronavirus (COVID-19)?

Stress, depression, and anxiety.

Short forms of psychological distress measures were selected due to space restrictions. The Perceived Stress Scale (PSS) [29] was used to assess subjective experiences of stress during the past month. Items were rated on 5-point scale ranging from Never (0) to Very Often (4). The internal consistency of the PSS-4 was 0.81 in the present study. Two-item versions of the Patient Health Questionnaire (PHQ2) [30] and the General Anxiety Disorder scale (GAD2) [31] were used to assess depressive and anxiety symptoms, respectively. For both scales, participants rated the occurrence of symptoms over the past two weeks on a scale ranging from Not at all (0) to Nearly every day (3), with higher scores indicating greater levels of depression and anxiety. The correlation between the two PHQ2 items was 0.78, and between the two GAD2 items was 0.75. Sample descriptives are present in Table 1.

Data analysis

Data were cleaned and descriptive statistics computed in SPSS version 26 [32]. Mplus version 8 [33] was used evaluate the factor structure of the seven created items assessing negative and positive experiences related to COVID-19. After randomly splitting the sample in half, data from the first group (n = 1,888; Mage = 39.54 years, SD = 13.06; 51.70% female) were used within an exploratory factor analysis (EFA) with Promax rotation. Data from the second group (n = 1,843; Mage = 39.40, SD = 13.17; 50.19% female) were used in a confirmatory factor analysis (CFA) with robust maximum likelihood to further confirm the observed factor structure observed within the EFA. Several goodness-of-fit indices were used to assess the fit of the data to the resulting factor structure including the root mean square error of approximation (RMSEA; ≤ .05), comparative fit index (CFI; ≥ .90), Tucker-Lewis Index (TLI; ≥ .90), and standardized root mean squared residual (SRMR; ≤ .06) [34].

Subsequently, a series of latent profiles (LPAs) were conducted using the seven individual items with means and variances freely estimated [35]. All models were estimated with 5000 random start values, 1000 iterations, and the 200 best solutions were retained. Starting with a model with one profile, model with an increasing number of profiles were considered. Values for the Akaike Information Criterion (AIC), the Bayesian Information Criterion (BIC), and the Sample-Size-Adjusted BIC (SSABIC) graphed following each LPA in order to identify the point at which decreases in these information criteria begin to plateau (i.e., the “elbow”) [35, 36].

The adjusted Lo-Mendell-Rubin likelihood ratio test (aLRT) was conducted for models with 2 or more profiles, which tests whether the model with k profiles is preferred to one with to k– 1 profiles. A significant result suggests preference for the model with k profiles [37]. Although not used in the selection process [38, 39], entropy is commonly reported as it provides an assessment of the precision classification. Entropy values range from 0 (high uncertainty) to 1 (low uncertainty).

Results

Exploratory and confirmatory factor analysis

The resulting eigenvalues from the EFA with Promax rotation for the first two factors were 2.94 (Factor 1) and 1.49 (Factor 2) and accounted for 42.00% and 21.29% of the variance, respectively. The eigenvalues for the remaining factors were less than 0.80 and not considered. Loadings from the EFA are presented in Table 2. Factor 1 represented negative COVID-19 experiences (e.g., I have been more stressed), whereas Factor 2 represented positive COVID-19 experiences (e.g., I have felt happier). The two factors were modestly negatively correlated (r = -0.38). Results from CFA revealed a slightly below adequate fit of the data to this 2-factor model (χ2 (13) = 202.45, p < .001; RMSEA = 0.09 90%CI[0.08, 0.10]; CFI = 0.94; TLI = 0.91; SRMR = 0.04). After reviewing the modification indices, error terms were allowed to correlate between item 2 and item 5 and between item 5 and item 6, which improved fit to an acceptable level (χ2 (11) = 115.04, p < .001; RMSEA = 0.07 90%CI[0.06, 0.08]; CFI = 0.97; TLI = 0.94; SRMR = 0.04). Loadings from the CFA are presented in Table 2. The correlation between negative and positive COVID-19 experiences was -0.51, p < 0.001.

Data from the entire sample were used within a measurement model in which negative and positive COVID-19 experiences (as modelled in the CFA) were covaried with composite scores on the PSS4, PHQ2, and GAD2, thus providing estimates of the bivariate correlations between the two COVID-19 experiences and the three indices of psychological distress through the TECH4 function of Mplus. Data fit the model adequately (χ2(26) = 535.30, p < .001; RMSEA = 0.07 90% CI [0.06, 0.08]; CFI = 0.96; TLI = 0.93; SRMR = 0.03). Results largely supported expectations in that negative COVID-19 experiences were positively associated with scores on the PSS4 (r = 0.62, p < .001), PHQ2 (r = 0.62, p < .001), and GAD2 (r = 0.62, p < .001), whereas positive COVID-19 experiences would be negatively associated with scores on the PSS4 (r = -0.30, p < .001), PHQ2 (r = -0.17, p < .001), and GAD2 (r = -0.15, p < .001).

Latent profile analysis

Table 3 presents the model selection indices for each of the seven profiles. Values for the AIC, BIC, and SABIC were graphed in order to identify the point at which the decline in values plateaued (i.e., the “elbow”; see Fig 1). This was observed following the rise from four to five profiles suggesting a preference for the four-profile model. This was supported by the significant aLRT. Nonetheless, significant aLRTs also support both five- or six-profile models. As such, the five- and six-profile models were considered but found to result in largely uninterpretable profiles. Therefore, the four-profile model was selected.

thumbnail
Fig 1. Values of the Akaike Information Criterion (AIC), the Bayesian Information Criterion (BIC), and the Sample-Size-Adjusted BIC (SSABIC) across the seven competing latent profile analyses.

https://doi.org/10.1371/journal.pone.0269382.g001

thumbnail
Table 3. Model selection indices for latent profiles analyses.

https://doi.org/10.1371/journal.pone.0269382.t003

Fig 2 presents the means of the seven items across each of the four profiles. Profile 1 (n = 839; 22.49%) is the “Predominantly Positive” profile representing those who more strongly endorsed positive versus negative experiences related to COVID-19. Profile 2 (n = 1,748; 46.85%) is the “Moderately Mixed” profile representing those who moderately endorsed both positive and negative experiences related to COVID-19. Profile 3 (n = 849; 22.76%) is the “Predominantly Negative” profile representing those who more strongly endorsed negative experiences related to COVID-19. Profile 4 (n = 295; 7.91%) is the “High Mixed” profile representing those who strongly endorsed both positive and negative experiences related to COVID-19.

thumbnail
Fig 2. Means for the seven items across each of the four profiles.

https://doi.org/10.1371/journal.pone.0269382.g002

Table 4 presents demographics across the four profiles. Significant differences, albeit small based on Cramer’s V (see note in tables), were found across sex, race/ethnicity, employment prior to COVID-19, and annual income (p’s < 0.001). Bonferroni-adjusted post-hoc comparisons were conducted to further explore the differences in the proportions. Results revealed that males were slightly over-represented in the Moderate Mixed and High Mixed profiles, whereas females were over-represented in the predominantly negative profile. Differences in race were largely attributed to an over-representation of Hispanic/Latino and African American/Black in the High Mixed profile. Those who were either laid off or looking for work prior to COVID-19 were over-represented within the Moderate Mixed profile. Additionally, those who were retired, disabled, or otherwise unable to work prior to COVID-19 were over-represented in the predominately positive and predominately negative profile. Finally, high earners ($100,000 or more) were over-represented in the predominately positive profile, whereas, low earners (less than $29,999) were over-represented in the predominately negative profile. Below average ($30,000 to $49,999) and average ($50,000 to $99,999) earners were over-represented in the high mixed profile.

Table 5 presents differences in age and psychological distress. The High Mixed profile was associated with being younger and experiencing greater psychological distress.

thumbnail
Table 5. Differences in age and psychological distress across latent profiles.

https://doi.org/10.1371/journal.pone.0269382.t005

Finally, Table 6 presents the proportion of each profile endorsing specific COVID-19 events. Relative to the other groups, a greater proportion of those in the High Mixed group indicated a loss of wages, having been themselves or knowing someone else that was diagnosed with COVID-19, and knowing someone who died due to COVID-19 complications.

thumbnail
Table 6. Proportion of individuals endorsing specific COVID-19 experiences across the four latent profiles.

https://doi.org/10.1371/journal.pone.0269382.t006

Discussion

The present study is the first to investigate the within-individual co-occurrence of negative and positive experiences during the early months of the COVID-19 pandemic among an online, diverse community sample of adults. The first objective was to validate the researcher-designed measure used to assess negative and positive experiences in terms of its factor structure as well as its divergent and convergent validity with markers of psychological distress. The second objective was to identify underlying profiles of negative and positive COVID-19 experiences using a person-centered approach, which provides a more nuanced perspective than the more commonly variable-centered approach prior research has employed. Finally, the third objective sought to better understand these emergent profiles by exploring how they differed in terms of specific stressful events during COVID-19, psychological distress, and demographic information.

Over the past year, the leading narrative, both in research and in the media, on the psychological and mental health consequences of the COVID-19 pandemic has primarily focused on the negative impacts of the pandemic due to increased stress, anxiety, grief, and social isolation measures [5, 14, 15]. However, this narrative was not consistent with the experiences of more than three-quarters of the sample in the present study, who reported at least modest positive experiences during COVID-19. This finding is consistent with a growing body of literature suggesting that COVID-19 experiences may extend beyond negative experiences and include positive experiences as well. Moreover, the present study is the first to apply a person-centered approach to identify four unique profiles of experiences, extending the findings of previous studies that have largely focused on the frequency of negative and/or positive experiences without fully accounting for the individual variability of the COVID-19 experiences or exploring whether or not negative and positive experiences may co-occur within an individual. Furthermore, these studies have either had a non-diverse sample (e.g., primarily female) or have focused on further examining the correlates of negative and positive COVID-19 experiences independently rather than investigating these experiences from a person-centered lens approach. Thus, the present study is unique in exploring concurrent reports of negative and positive experiences in the early onset of the pandemic within a diverse community sample.

This study is also among the first to develop and validate a brief measure assessing the diversity of COVID-19 experiences. As hypothesized, results from an EFA and a CFA revealed a two-factor structure for COVID-19 experiences, with negative and positive experiences emerging as two distinct factors. Further validation of these factors with psychological distress constructs (i.e., stress, anxiety, and depression) suggests that these factors function differently from one another. Specifically, as expected, negative COVID experiences significantly and positively correlated with markers of psychological distress. Similarly, results also indicated that psychological distress constructs were significantly inversely associated with positive experiences, although these relationships were weaker than those with negative experiences. Future research should explore whether positive COVID-19 experiences are in fact associated with concurrent experiences of subjective well-being and vitality [40, 41].

The present findings are additionally consistent with previous literature on both COVID-19 experiences and the divergent relationship between negative and positive emotions indicating that positive experiences, whether COVID-19-specific or not, are weakly yet negatively associated with negative psychological constructs or responses to affective stimuli [42, 43]. This is also in line with positive psychology research on the dual continua of mental health and mental illness in which positive experiences have been found to function in a distinct and different way from negative experiences [44, 45]. Specifically, positive psychology research suggests that the presence of negative experiences (i.e., constructs associated with mental illness such as stress, anxiety, depression) does not inherently suggest an absence of positive experiences (i.e., constructs associated with mental health such as happiness, life satisfaction, wellbeing) and that the complex relationship and interaction between negative and positive experiences merits further investigation [44].

The present study’s profile analysis revealed an interesting and counterintuitive pattern whereby the majority of participants reported a mixed experience of either moderate levels of both negative and positive emotions (46.85%) or high levels of both negative and positive emotions (7.91%). This simultaneous reporting of positive and negative experiences that emerged in the LPA has not been previously documented in COVID-19 literature and challenges the cultural narrative that negative psychological experiences have been predominant during the COVID-19 pandemic [15]. Indeed, only 22.76% of the present sample reported predominantly negative experiences during the early onset of the pandemic. Thus, these findings highlight the importance of using a person-centered approach in investigating experiences during the COVID-19 pandemic and the need to consider both positive and negative experiences in tandem.

Moreover, having established the emergence of four distinct profiles of COVID-19 experiences, the present study sought to better understand these profiles through an investigation of contributing factors including demographics, psychological distress variables, and specific stressful events during COVID-19. To be clear, the small effect sizes, based on Cramer’s V, suggest a cautious interpretation. Nonetheless, some interesting patterns became apparent in the comparison of these profiles. First, participants who reported predominantly negative experiences during the onset of COVID-19 were significantly proportionately more likely to be female, retired, disabled or not working, as well as to report low income. This finding is in line with previous literature [10, 14, 45, 46] which has found that individuals who have reported more negative experiences in response to the onset of COVID-19 have tended to be those already in a position of psychosocial or financial disadvantage. Thus, although they may not have reported experiencing the greatest number of challenges, individuals reporting predominantly negative experiences during COVID-19 in the present study may have been in a greater position of vulnerability at the onset of the pandemic. However, surprisingly, participants who reported predominantly negative experiences during the onset of COVID-19 were not the ones who experienced the highest proportion of stressful events during the early onset of the pandemic.

Interestingly, individuals who reported high levels of both negative and positive COVID-19 experiences were also more likely to have experienced the highest proportion of adverse COVID-19 specific events. Specifically, they were more likely to report loss of wages, having received or knowing someone who received a diagnosis of COVID-19, or having lost someone due to COVID-19 complications. They were also the profile most likely to report symptoms of anxiety and depression and the second most likely to report stress. Thus, although the plethora of challenges caused by the pandemic may have brought about intense negative experiences for these individuals, results suggest that these individuals reported endorsing a high degree of positive experiences during the early months of the COVID-19 as well.

A possible explanation for this discrepancy could be that the high negative and positive experiences reported by individuals in this profile occurred sequentially rather than simultaneously. We hope that future research addresses the temporal order of both negative and positive experiences during COVID-19 as researchers begin to analyze their longitudinal data on the psychological impacts of the pandemic. In the present study, it may have been the case that individuals within the High Mixed profile had good resources to begin with, which may have enabled them to cope well with the high number of challenges that they encountered. This is tentatively supported by the fact that the individuals in this profile were significantly more likely to be working prior to the pandemic and to be reporting an annual income between $30,000 to $99,000.

Alternatively, it may be that the high negative and positive experiences reported during the pandemic occurred simultaneously for these individuals. Although seemingly counter-intuitive, this would be consistent with stress research showing that positive and negative emotions cannot only co-occur during chronic high stress periods but that positive emotions may be a critical part of the stress response in order to foster resilience [47]. Specifically, during periods of high and chronic stress, beyond the natural negative experiences resulting from an adverse situation, individuals may also report positive experiences as a result of trying to form a sense of personal meaning and growth out of the experience [23, 47, 48]. Nevertheless, future longitudinal research is needed in order to elucidate these findings.

In summary, the present study builds upon existing research in the UK in which similar reports of both negative and positive experiences specific to the pandemic were found also using a validated, researcher-designed measure [2]. This communality in finding distinct reports of both negative and positive experiences, despite the fact that the US and UK’s highly politicized national responses to the pandemic were arguably two of the most globally controversial [49], speaks to the underlying strength of this finding. Furthermore, most interestingly, these findings provide a unique contribution by using a person-centered approach to investigate the complexity and diversity of profiles of experiences during the pandemic. These findings document a strong pattern of mixed negative and positive experiences specific to COVID-19, which further strengthens the growing body of literature regarding the complexity of experiences and the surprising potential for resilience during the pandemic.

Limitations & future directions

The present study is not without limitations. For instance, while its cross-sectional design allowed for a detailed snapshot of individuals’ experiences during the early onset of the pandemic, longitudinal research is needed to elucidate the temporal order of negative and positive experiences during COVID-19, as well as to extend the current findings by considering the potential for adjustment and adaptation in response to stressful events [48, 50], such as the ongoing COVID-19 pandemic. Additionally, while the development and validation of a brief measure of negative and positive experiences during COVID-19 was a novel contribution to the field, further research is needed to potentially expand this measure by considering a broader range of experiences which have been highlighted in the growing body of literature [2, 18]. Similarly, this researcher-developed assessment was validated with self-report measures of psychological distress of which two assessed experiences during the past two weeks (PHQ-2; GAD-2) and one assessed experiences during the past month (PSS-4). As such, future research should seek to further validate this measure with more robust clinical assessments of psychological functioning. Finally, the use of MTURK has its own limitations. First, although the present study’s sample was more economically diverse than previous samples and included a more even sex distribution [2, 18, 23], the sample still suffers from being largely White or Caucasian, a common limitation of MTURK samples. Therefore, the generalizability of the present findings is limited, and research with more ethnically diverse samples is warranted. Second, as noted by one of our reviewers, there is concern within the field as to whether or not the sample characteristics are accurate. Indeed, this is a general limitation with any self-report data including data from university and/or community samples. Nonetheless, data was rigorously screened for completeness, inattention, and suspicious response patterns in order to maintain high data integrity.

Conclusions

Despite these limitations, the findings in the present study challenge the common narrative, both in research and media reports, that the impacts of COVID-19 have been predominantly negative. In fact, we found that the vast majority of individuals indicated that they had experienced positive experiences in the context of the pandemic. These findings highlight the need for the current discourse on COVID-19 experiences to move beyond a deficit and pathology-oriented model to a salutogenic and strengths-based approach that takes into account human resiliency in the context of the pandemic. In addition, the brief, validated assessment of diverse experiences during COVID-19 that was developed in the present study can henceforth be used, for both research and clinical purposes, to tap both negative and positive experiences simultaneously with a broad range of samples; assessing both gradients of negative and positive impacts of COVID-19 is necessary to ascertain a comprehensive understanding of an individual’s functioning during the pandemic. Furthermore, the emergence of four distinct profiles in the present study also highlights that individuals’ experiences during the early months of COVID-19 have not been unilaterally positive or negative, but rather, highly diverse and undeniably complex. These findings underscore the importance of taking into account the complexity of individuals’ responses to the pandemic in future efforts to quantify the wide range of COVID-19 experiences that may include factors from the area of positive psychology [51]. Lastly, by drawing on data related to psychological distress, COVID-19-specific events, and demographics, the current findings provide novel insights into which individuals have been most at-risk during the pandemic and can inform targeted prevention and intervention for resilience-building during and beyond COVID-19.

References

  1. 1. Sachser C, Olaru G, Pfeiffer E, Brähler E, Clemens V, Rassenhofer M, et al. The immediate impact of lockdown measures on mental health and couples’ relationships during the COVID-19 pandemic—results of a representative population survey in Germany. Soc Sci Med. 2021;278. pmid:33932692
  2. 2. Hampshire A, Hellyer P, Soreq E, Mehta MA, Ioannidis K, Trender W, et al. Dimensions and modulators of behavioural and mental-health change during the Covid-19 pandemic. medRxiv [Internet]. 2020 Jan 1; Available from: http://medrxiv.org/content/early/2020/08/04/2020.06.18.20134635.abstract
  3. 3. Emery RL, Johnson ST, Simone M, Loth KA, Berge JM, Neumark-Sztainer D. Understanding the impact of the COVID-19 pandemic on stress, mood, and substance use among young adults in the greater Minneapolis-St. Paul area: Findings from project EAT. Soc Sci Med [Internet]. 2021 May;276. Available from: pmid:33743209
  4. 4. Luo M, Guo L, Yu M, Jiang W, Wang H. The psychological and mental impact of coronavirus disease 2019 (COVID-19) on medical staff and general public—A systematic review and meta-analysis. Psychiatry Res [Internet]. 2020 Sep;291:113190. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0165178120310209 pmid:32563745
  5. 5. Salari N, Hosseinian-Far A, Jalali R, Vaisi-Raygani A, Rasoulpoor S, Mohammadi M, et al. Prevalence of stress, anxiety, depression among the general population during the COVID-19 pandemic: a systematic review and meta-analysis. Global Health [Internet]. 2020 Dec 6;16(1):57. Available from: https://globalizationandhealth.biomedcentral.com/articles/10.1186/s12992-020-00589-w pmid:32631403
  6. 6. Prati G, Mancini AD. The psychological impact of COVID-19 pandemic lockdowns: a review and meta-analysis of longitudinal studies and natural experiments. Psychol Med [Internet]. 2021 Jan 13;51(2):201–11. Available from: https://www.cambridge.org/core/product/identifier/S0033291721000015/type/journal_article pmid:33436130
  7. 7. Ran L, Wang W, Ai M, Kong Y, Chen J, Kuang L. Psychological resilience, depression, anxiety, and somatization symptoms in response to COVID-19: A study of the general population in China at the peak of its epidemic. Soc Sci Med [Internet]. 2020;262. Available from: pmid:32758794
  8. 8. Kimhi S, Marciano H, Eshel Y, Adini B. Resilience and demographic characteristics predicting distress during the COVID-19 crisis. Soc Sci Med [Internet]. 2020 Nov;265. Available from: pmid:33039732
  9. 9. Pan K-Y, Kok AAL, Eikelenboom M, Horsfall M, Jörg F, Luteijn RA, et al. The mental health impact of the COVID-19 pandemic on people with and without depressive, anxiety, or obsessive-compulsive disorders: a longitudinal study of three Dutch case-control cohorts. The Lancet Psychiatry [Internet]. 2021 Feb;8(2):121–9. Available from: https://linkinghub.elsevier.com/retrieve/pii/S2215036620304910 pmid:33306975
  10. 10. Mathias K, Rawat M, Philip S, Grills N. “We’ve got through hard times before”: acute mental distress and coping among disadvantaged groups during COVID-19 lockdown in North India—a qualitative study. Int J Equity Health [Internet]. 2020 Dec 17;19(1):224. Available from: https://equityhealthj.biomedcentral.com/articles/10.1186/s12939-020-01345-7 pmid:33334344
  11. 11. Brown S, Opitz M-C, Peebles AI, Sharpe H, Duffy F, Newman E. A qualitative exploration of the impact of COVID-19 on individuals with eating disorders in the UK. Appetite [Internet]. 2021 Jan;156:104977. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0195666320315993 pmid:32991945
  12. 12. Phillipou A, Meyer D, Neill E, Tan EJ, Toh WL, Van Rheenen TE, et al. Eating and exercise behaviors in eating disorders and the general population during the COVID-19 pandemic in Australia: Initial results from the COLLATE project. Int J Eat Disord [Internet]. 2020 Jul;53(7):1158–65. Available from: https://onlinelibrary.wiley.com/doi/10.1002/eat.23317 pmid:32476163
  13. 13. Weissman RS, Bauer S, Thomas JJ. Access to evidence-based care for eating disorders during the COVID-19 crisis. Int J Eat Disord [Internet]. 2020 May 27;53(5):639–46. Available from: https://onlinelibrary.wiley.com/doi/10.1002/eat.23279 pmid:32338400
  14. 14. Iob E, Steptoe A, Fancourt D. Abuse, self-harm and suicidal ideation in the UK during the COVID-19 pandemic. Br J Psychiatry [Internet]. 2020 Oct 13;217(4):543–6. Available from: https://www.cambridge.org/core/product/identifier/S0007125020001300/type/journal_article pmid:32654678
  15. 15. Wang C, Pan R, Wan X, Tan Y, Xu L, Ho CS, et al. Immediate Psychological Responses and Associated Factors during the Initial Stage of the 2019 Coronavirus Disease (COVID-19) Epidemic among the General Population in China. Int J Environ Res Public Health [Internet]. 2020 Mar 6;17(5):1729. Available from: https://www.mdpi.com/1660-4601/17/5/1729 pmid:32155789
  16. 16. Hamza CA, Ewing L, Heath NL, Goldstein AL. When social isolation is nothing new: A longitudinal study on psychological distress during COVID-19 among university students with and without preexisting mental health concerns. Can Psychol Can [Internet]. 2021 Feb;62(1):20–30. Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/cap0000255
  17. 17. Reger MA, Stanley IH, Joiner TE. Suicide Mortality and Coronavirus Disease 2019—A Perfect Storm? JAMA Psychiatry [Internet]. 2020 Nov 1;77(11):1093. Available from: https://jamanetwork.com/journals/jamapsychiatry/fullarticle/2764584 pmid:32275300
  18. 18. Williams L, Rollins L, Young D, Fleming L, Grealy M, Janssen X, et al. What have we learned about positive changes experienced during COVID-19 lockdown? Evidence of the social patterning of change. Ortega JA, editor. PLoS One [Internet]. 2021 Jan 5;16(1):e0244873. Available from: https://dx.plos.org/10.1371/journal.pone.0244873 pmid:33400700
  19. 19. Pinkham AE, Ackerman RA, Depp CA, Harvey PD, Moore RC. A Longitudinal Investigation of the Effects of the COVID-19 Pandemic on the Mental Health of Individuals with Pre-existing Severe Mental Illnesses. Psychiatry Res [Internet]. 2020 Dec;294:113493. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0165178120331541 pmid:33038789
  20. 20. Fancourt D, Steptoe A, Bu F. Trajectories of anxiety and depressive symptoms during enforced isolation due to COVID-19: longitudinal analyses of 36,520 adults in England. medRxiv [Internet]. 2020 Jan 1;2020.06.03.20120923. Available from: http://medrxiv.org/content/early/2020/11/03/2020.06.03.20120923.abstract
  21. 21. Tull MT, Edmonds KA, Scamaldo KM, Richmond JR, Rose JP, Gratz KL. Psychological Outcomes Associated with Stay-at-Home Orders and the Perceived Impact of COVID-19 on Daily Life. Psychiatry Res [Internet]. 2020 Jul;289:113098. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0165178120310854 pmid:32434092
  22. 22. Luchetti M, Lee JH, Aschwanden D, Sesker A, Strickhouser JE, Terracciano A, et al. The trajectory of loneliness in response to COVID-19. Am Psychol [Internet]. 2020 Oct;75(7):897–908. Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/amp0000690 pmid:32567879
  23. 23. Stallard P, Pereira AI, Barros L. Post-traumatic growth during the COVID-19 pandemic in carers of children in Portugal and the UK: cross-sectional online survey. BJPsych Open [Internet]. 2021 Jan 20;7(1):e37. Available from: https://www.cambridge.org/core/product/identifier/S2056472421000016/type/journal_article pmid:33468270
  24. 24. Schmiedeberg C, Thönnissen C. Positive and negative perceptions of the COVID-19 pandemic: Does personality play a role? Soc Sci Med. 2021;276(March). pmid:33799202
  25. 25. Fiorillo A, Gorwood P. The consequences of the COVID-19 pandemic on mental health and implications for clinical practice. Eur Psychiatry. 2020;63(1). pmid:32234102
  26. 26. Chandler J, Shapiro D. Conducting clinical research using crowdsourced convenience samples. Annu Rev Clin Psychol [Internet]. 2016 Mar 28;12(1):53–81. Available from: http://www.annualreviews.org/doi/10.1146/annurev-clinpsy-021815-093623 pmid:26772208
  27. 27. Mason W, Suri S. Conducting behavioral research on Amazon’s Mechanical Turk. Behav Res Methods. 2012 Mar;44(1):1–23. pmid:21717266
  28. 28. Litman L, Robinson J, Abberbock T. TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behav Res Methods. 2017;49(2):433–42. pmid:27071389
  29. 29. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983; pmid:6668417
  30. 30. Löwe B, Kroenke K, Gräfe K. Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosom Res. 2005 Feb;58(2):163–71. pmid:15820844
  31. 31. Donker T, van Straten A, Marks I, Cuijpers P. Quick and easy self-rating of Generalized Anxiety Disorder: Validity of the Dutch web-based GAD-7, GAD-2 and GAD-SI. Psychiatry Res. 2011;188(1):58–64. pmid:21339006
  32. 32. IBM Corp. IBM SPSS Statistics for Windows, Version 26.0. Released 2019. Armonk, NY: IBM Corp; 2019.
  33. 33. Muthén L, Muthén B. Mplus user’s guide (version 8.0). Mplus user’s guide. 2017.
  34. 34. Kline RB. Principles and practice of structural equation modeling. Fourth Edi. New York: The Guilford Press; 2016.
  35. 35. Diallo TMO, Morin AJS, Lu HZ. Impact of Misspecifications of the Latent Variance–Covariance and Residual Matrices on the Class Enumeration Accuracy of Growth Mixture Models. Struct Equ Model [Internet]. 2016;23(4):507–31. Available from:
  36. 36. Ferguson SL, Moore EWG, Hull DM. Finding latent groups in observed data: A primer on latent profile analysis in Mplus for applied researchers. Int J Behav Dev. 2020;44(5):458–68.
  37. 37. Lo Y, Mendell NR, Rubin DR. Testing the number of components in a normal mixture. Biometrika [Internet]. 2001 Oct 1;88(3):767–78. Available from: https://academic.oup.com/biomet/article-lookup/doi/10.1093/biomet/88.3.767
  38. 38. Tein J-Y, Coxe S, Cham H. Statistical Power to Detect the Correct Number of Classes in Latent Profile Analysis. Struct Equ Model A Multidiscip J [Internet]. 2013 Oct;20(4):640–57. Available from: http://www.mendeley.com/research/statistical-power-detect-correct-number-classes-latent-profile-analysis pmid:24489457
  39. 39. Nylund KL, Asparouhov T, Muthén BO. Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation Study. Struct Equ Model A Multidiscip J [Internet]. 2007;14(4):535–69. Available from: http://www.tandfonline.com/doi/abs/10.1080/10705510701575396
  40. 40. Diener E. Subjective well-being: The science of happiness and a proposal for a national index. Am Psychol. 2000;55(1):34–43. pmid:11392863
  41. 41. Ryan RM, Frederick C. On energy, personality, and health: subjective vitality as a dynamic reflection of well-being. J Pers. 1997;65(3):529–65. pmid:9327588
  42. 42. Watson D, Wiese D, Vaidya J, Tellegen A. The two general activation systems of affect: Structural findings, evolutionary considerations, and psychobiological evidence. J Pers Soc Psychol [Internet]. 1999;76(5):820–38. Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/0022-3514.76.5.820
  43. 43. Douglas Olsen G, Pracejus JW. Integration of Positive and Negative Affective Stimuli. J Consum Psychol [Internet]. 2004 Jan;14(4):374–84. Available from: http://doi.wiley.com/10.1207/s15327663jcp1404_7
  44. 44. Keyes CLM. Mental Illness and/or Mental Health? Investigating Axioms of the Complete State Model of Health. J Consult Clin Psychol [Internet]. 2005 Jun;73(3):539–48. Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/0022-006X.73.3.539 pmid:15982151
  45. 45. Westerhof GJ, Keyes CLM. Mental Illness and Mental Health: The Two Continua Model Across the Lifespan. J Adult Dev [Internet]. 2010 Jun 26;17(2):110–9. Available from: http://link.springer.com/10.1007/s10804-009-9082-y pmid:20502508
  46. 46. Burki T. The indirect impact of COVID-19 on women. Lancet Infect Dis [Internet]. 2020 Aug;20(8):904–5. Available from: https://linkinghub.elsevier.com/retrieve/pii/S1473309920305685 pmid:32738239
  47. 47. Folkman S. The case for positive emotions in the stress process. Anxiety, Stress Coping [Internet]. 2008 Jan 26;21(1):3–14. Available from: https://www.tandfonline.com/doi/full/10.1080/10615800701740457 pmid:18027121
  48. 48. Linley PA, Joseph S. The Human Capacity for Growth Through Adversity. Am Psychol [Internet]. 2005 Apr;60(3):262–4. Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/0003-066X.60.3.262b pmid:15796685
  49. 49. Yamey G, Wenham C. The U.S. and U.K. Were the Two Best Prepared Nations to Tackle a Pandemic—What Went Wrong? TIME [Internet]. 2020 Jul; https://time.com/5861697/us-uk-failed-coronavirus-response/
  50. 50. Makwana N. Disaster and its impact on mental health: A narrative review. J Fam Med Prim Care [Internet]. 2019;8(10):3090. Available from: http://www.jfmpc.com/text.asp?2019/8/10/3090/270033 pmid:31742125
  51. 51. Seligman MEP, Csikszentmihalyi M. Positive psychology: An introduction. Am Psychol. 2000;55(1):5–14. pmid:11392865