Due to the COVID- 19 outbreak in the Netherlands (March 2020) and the associated social distancing measures, families were enforced to stay at home as much as possible. Adolescents and their families may be particularly affected by this enforced proximity, as adolescents strive to become more independent. Yet, whether these measures impact emotional well-being in families with adolescents has not been examined. In this ecological momentary assessment study, we investigated if the COVID-19 pandemic affected positive and negative affect of parents and adolescents and parenting behaviors (warmth and criticism). Additionally, we examined possible explanations for the hypothesized changes in affect and parenting. To do so, we compared daily reports on affect and parenting that were gathered during two periods of 14 consecutive days, once before the COVID-19 pandemic (2018–2019) and once during the COVID-19 pandemic. Multilevel analyses showed that only parents’ negative affect increased as compared to the period before the pandemic, whereas this was not the case for adolescents’ negative affect, positive affect and parenting behaviors (from both the adolescent and parent perspective). In general, intolerance of uncertainty was linked to adolescents’ and parents’ negative affect and adolescents’ positive affect. However, Intolerance of uncertainty, nor any pandemic related characteristics (i.e. living surface, income, relatives with COVID-19, hours of working at home, helping children with school and contact with COVID-19 patients at work) were linked to the increase of parents’ negative affect during COVID-19. It can be concluded that on average, our sample (consisting of relatively healthy parents and adolescents) seems to deal fairly well with the circumstances. The substantial heterogeneity in the data however, also suggest that whether or not parents and adolescents experience (emotional) problems can vary from household to household. Implications for researchers, mental health care professionals and policy makers are discussed.
Citation: Janssen LHC, Kullberg M-LJ, Verkuil B, van Zwieten N, Wever MCM, van Houtum LAEM, et al. (2020) Does the COVID-19 pandemic impact parents’ and adolescents’ well-being? An EMA-study on daily affect and parenting. PLoS ONE 15(10): e0240962. https://doi.org/10.1371/journal.pone.0240962
Editor: Silvia Cimino, Sapienza - University of Roma, Italy, ITALY
Received: July 1, 2020; Accepted: October 6, 2020; Published: October 16, 2020
Copyright: © 2020 Janssen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying the results presented in the study are available (uploaded on 22th of September 2020) from the public repository Electronic Archiving System (EASY) of the Data Archiving and Networked Services (DANS) under the following link: https://doi.org/10.17026/dans-x7n-p9n9.
Funding: The study was supported by a personal research grant from the Netherlands Organization for Scientific Research awarded to Bernet Elzinga (VICI; Unravelling the Impact of Emotional Maltreatment on the Developing Brain 453-15-006). https://www.nwo.nl/. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: AIC, Akaike information criterion; B, Unstandardized beta; BIC, Bayesian information criterion; COVID-19, Coronavirus disease 2019; df, Degrees of freedom; EMA, Ecological momentary assessment; fMRI, Functional magnetic resonance imaging; ICC, Intra-class correlation coefficient; IU, Intolerance of uncertainty; IUS, Intolerance of uncertainty scale; K-SADS-PL, Kiddie-schedule for affective disorders and schizophrenia—present and lifetime version; LL, Log-likelihood; LUMC, Leiden university medical center; M, Mean; ML, Maximum likelihood; p, p-value; PANAS-C, Positive and negative affect schedule for children; PHQ-9, Patent health questionnaire; RE-PAIR, Relations and emotions in parent-adolescent interaction research; SD, Standard deviation; SE, Standard error; t, T-statistic
Since March 2020, the coronavirus disease 2019 (COVID-19) is referred to as a pandemic by the World Health Organization . To slow the spread of COVID-19, national governments have taken radical measures to minimize social interactions by closing public places, demanding people to keep physical distance and stay at home and—in some countries—by enforcing ‘full lockdown’. In the Netherlands, at March 15th 2020, measures of social distancing enforced all Dutch citizens to stay home and work remotely as much as possible, public spaces (e.g. schools, offices, parts of public transport, theatres) were closed and public gatherings were prohibited (see Fig 1 for a timeline). These measures of social distancing (a so-called ‘lockdown') created drastic changes in daily social life; distinct domains such as family life, school, and work suddenly coincided and families faced an unforeseen increase in hours spent together under the same roof. Adolescents and their families may be particularly affected by this enforced proximity, as adolescents strive to become independent and focus more on socializing and spending time with friends rather than with their families [2, 3]. To that end, this study aimed to investigate well-being of adolescents and their parents and parenting behaviors during the COVID-19 pandemic and explored daily difficulties and helpful activities during the COVID-19 pandemic linked to their well-being.
For some families, spending more time together during a lockdown may bring family members closer towards each other and foster a sense of well-being. However, several factors that are emblematic for the COVID-19 crisis, such as financial insecurity, concerns about own and others’ health, uncertainty about quarantine duration, lack of social and physical activities, and boredom have all frequently been shown to negatively affect a person’s mood and mental well-being [4–8]. Moreover, parents and adolescents may also experience stress because they are faced with more daily hassles (e.g. a suboptimal work or school environment) and additional tasks (e.g. parents homeschooling their children or caring for significant others). Previous studies have shown that the impact of these quarantine related factors on mental health outcomes (e.g. depressive symptoms, anxiety, and PTSD) can be wide-ranging, substantial and long-lasting (see review of Brooks et al. ). As a consequence, these confinements may also lead to more tension, irritability, family conflicts, and at worse, domestic violence or child abuse .
One of the key questions that have been raised by governmental agencies and health care workers is to what extent the COVID-19 pandemic and the associated distancing measures affect families’ well-being and parenting behaviors. In this study, Dutch adolescents and their parents filled in 14 days of ecological momentary assessments (EMA; ) twice, before the COVID-19 outbreak (2018–2019) and also during the COVID-19 pandemic (14–28 April 2020). In addition, we asked parents and adolescents about daily difficulties and helpful activities during the COVID-19 pandemic that possibly influenced their affect in positive and negative ways. This enabled us to investigate how and to what extent well-being and parenting behaviors in daily life were impacted by the COVID-19 pandemic and the related social distancing measures. Gaining more insight into these processes, our findings can contribute to formulating recommendations for policy makers and mental health professionals.
Positive and negative affect in daily life
Individuals’ affect states are not one-dimensional and static in nature, but can fluctuate from moment to moment in response to other individuals and external circumstances (e.g., ). Positive and negative affect reflect a persons’ momentary mood state. Both positive and negative affect have implications for health and well-being over time for adults and adolescents [13–18]. Positive affect predominantly generates action, motivation, social connectedness and cognitive flexibility, whereas negative affect might result in actions such as avoidance, attack, or expel [19, 20]. Using momentary assessments enabled us to identify the potential impact of the pandemic on parents’ and adolescents’ positive and negative affect in daily life without the potential bias of retrospective recall.
The COVID-19 pandemic and the related social measures might also impact parenting behaviors, such as the amount of expressed warmth and criticism. Parental warmth is typically considered as one of the primary dimensions of sensitive parenting behavior and can include acceptance, support, and positive involvement towards the child . Parental criticism can be defined as expressing negativity, disapproval, or dissatisfaction to a child . Psychological distress related to the COVID-19 pandemic may influence parenting behaviors, with parents being more emotionally withdrawn or critical and irritated, instead of being supportive, sensitive and encouraging to the child .
Previous studies have shown that especially positive mood of family members is closely related to warm family interactions, whereas negative mood is related to withdrawal from interactions [19, 24–26]. However, no prior studies have examined the effects of a situation comparable to the current COVID-19 pandemic on parenting. Therefore, in addition to its impact on affect, we also aimed to investigate the impact of the COVID-19 pandemic and its consequences on parental warmth and criticism in daily life. Since parenting is a dynamic process , we will examine day-to-day parental warmth and criticism. Furthermore, as perspectives from parents and adolescents on parenting might differ (e.g., ), we examined both the parent and adolescent perspective on parental warmth and criticism.
Intolerance of uncertainty
A crucial aspect of unforeseen stressful situations, such as the COVID-19 pandemic, is uncertainty. Uncertainty is one of the key determinants of experienced levels of stress [28–30]. Moreover, the ability to deal with uncertainty varies widely. While some people can tolerate uncertainty very well, others have difficulties tolerating uncertainty and try to avoid it at best [31–33]. Intolerance of uncertainty (IU) is described as a predisposition to negatively perceive and respond to uncertain information and situations, irrespective of its probability and outcomes [34, 35]. As the worldwide COVID-19 pandemic influenced daily life for all people, escaping from the accompanied uncertainty is deemed impossible. Consequently, parents and adolescents with higher levels of IU might experience greater distress under the current circumstances, which might in turn also impact their affect and parenting behaviors. No prior studies have investigated the relation between IU and daily affect and parenting behavior within the family context. This was pursued in the present study. In the light of the pandemic, it is also examined to what extent IU is related to a change in affect and parenting behaviors.
In the present study, we examined the impact of the COVID-19 pandemic on daily affect and parenting of both Dutch parents and adolescents. The aims were: (1) To explore parents’ and adolescents’ daily difficulties and helpful activities during the COVID-19 pandemic, (2) to examine and compare positive and negative affect of both parents and adolescents during 2 weeks of the COVID-19 pandemic and a similar 2-week period pre-pandemic (from now on referred to as baseline), (3) to examine and compare (perceived) parenting behaviors in terms of parental warmth and criticism towards the adolescent (as assessed by both the adolescent and the parent) during 2 weeks of the COVID-19 pandemic and a similar 2-week period pre-pandemic, (4) to examine whether parents’ and adolescents’ levels of IU at baseline are associated with affect and parenting behaviors in general, and (5) as well as with the hypothesized changes in affect and (perceived) parental warmth and criticism.
We expect an increase of negative affect and a decrease in positive affect for both parents and adolescents during the COVID-19 pandemic as compared to baseline. Regarding parenting behaviors, we expect lower levels of parental warmth and higher levels of parental criticism during the COVID-19 pandemic as compared to baseline, both from the perspective of parents and adolescents. With respect to IU, we expect that higher levels of IU predict higher levels of negative affect and lower levels of positive affect in parents and adolescents at both time points, as well as a greater increase in negative affect and decrease in positive affect during the COVID-19 pandemic compared to baseline.
The current study was based on baseline data of the ongoing Dutch multi-method two-generation RE-PAIR study: ‘Relations and Emotions in Parent-Adolescent Interaction Research’ and on the follow-up assessment ‘RE-PAIR during the COVID-19 pandemic’. In RE-PAIR, we examine the relation between parent-child interactions and adolescent mental well-being. The study design and in- and exclusion criteria of the baseline assessment can be found in S1 Text. The current study included data from adolescents without psychopathology and their parents (i.e., healthy control families).
Inclusion criteria for the adolescents to participate in the current study at baseline were: being aged between 11 and 17 years, living at home with at least one primary caregiver, going to high school or higher education, and a good command of the Dutch language. Adolescents were excluded if they had a current mental disorder, a life-time history of major depressive disorder or dysthymia, or a history of psychopathology in the past two years. Adolescent psychopathology was assessed at baseline during a face-to-face interview using the Structured Interview of the Kiddie-Schedule for Affective Disorders and Schizophrenia—Present and Lifetime Version (K-SADS-PL ). For parents, no in- or exclusion criteria were specified, except for a good command of the Dutch language. To participate in the follow-up during the COVID-19 pandemic the adolescent had to still live at home with at least one caregiver. Adolescents and parents were allowed to sign up individually.
From the 80 adolescents and 151 parents who were contacted for the follow-up assessment during the COVID-19 pandemic, 51 individuals (14 adolescents and 37 parents) did not respond to any of the attempts of contact from the researchers. Of the individuals who did respond, 76 (31 adolescents and 45 parents) were not willing to participate. Reasons were: being busy and having other priorities (i.e., work, school, taking care of children or parents). The remaining 104 participants gave consent to participate. Two participants did not start the EMA and one participant did not complete the measures and hence, the final sample of the current study included 101 participants, consisting of 34 adolescents and 67 parents. Descriptive statistics of the current sample are described in the result section and in Table 1.
Recruitment of the participants was done via social media, advertisements, and flyers, with a specific focus on the inclusion of both parents (i.e., mothers and fathers). The focus was on primary caregivers, so not only biological parents could participate, but also stepparents and guardians, as long as they played an important role in the upbringing of the adolescent. Interested families could sign-up for the study via the website or mail and received information letters. Approximately two weeks later families were contacted by phone by one of the researchers to provide them with more information and check the inclusion criteria. If all criteria were met, families could participate in the study. All participants signed informed consent (including consent to contact them to request to participate in follow-up research). In addition, for adolescents younger than 16 years of age, both parents with legal custody signed informed consent.
The families completed the EMA in the period between September 2018 and November 2019 with EMA not taking place during holidays and exam weeks of the adolescent. Instructions on the EMA were given face-to-face prior to the baseline assessment and researchers assisted with installing the Ethica app  on the smartphone of the adolescent and both parents. Each family member also received written instructions and their individual account information. For participation in the EMA, parents received €20,- and adolescents €10,-. In addition, four gift vouchers of €75,- were raffled based on compliance.
All families who participated at baseline were invited for the follow-up in April 2020. The follow-up assessment was announced in a newsletter followed by a personal e-mail, and reminders were sent to parents and adolescents who had not responded yet. Parents and adolescents who agreed to participate were sent an online questionnaire on demographic characteristics and general mental well-being. Thereafter, participants received written instructions on how to download and reinstall the Ethica app. EMA data collection took place one month into the lockdown, from April 14th to April 28th. For participation in the follow-up assessment, parents received €20,- and adolescents €10,- in gift vouchers. The current study focusses on the EMA data of the baseline assessment (2018–2019) and the follow-up assessment (2020).
The RE-PAIR study was approved by the Medical Ethics Committee of Leiden University Medical Center (LUMC) in Leiden, the Netherlands (NL62502.058.17) and the follow-up assessment ‘RE-PAIR during the COVID-19 pandemic’ was approved by the Psychology Research Ethics Committee of Leiden University in Leiden, the Netherlands (2020-03-30-B.M. Elzinga-V2-2334).
The EMA procedures and set-ups were almost entirely similar at baseline and during the COVID-19 pandemic and consisted of filling out questionnaires at four timepoints per day, for 14 consecutive days on parents’ and adolescents’ own smartphones using the mobile app Ethica (Ethica Data, 2019). At all timepoints participants completed questions about their affect and how they experienced contact with the last person they interacted with. Detailed information on the concepts in the questionnaires, triggering schedules, differences in set-up, number of items and completing time, and monitoring process can be found in S2 Text.
The overall response rate at baseline was 81.0%. Adolescents completed 74.2% of the EMA questionnaires at baseline (M = 41.56 completed, SD = 9.21, Min/Max = 12/54). Parents completed 84.1% of the EMA questionnaires at baseline (M = 47.12 completed, SD = 6.32, Min/Max = 29/56). The overall response rate during the COVID-19 pandemic was 72.1%. Adolescents completed 64.6% of the EMA questionnaires during the COVID-19 pandemic (M = 36.18 completed, SD = 13.71, Min/Max = 8/54). Parents completed 75.9% of the EMA questionnaires during the COVID-19 pandemic (M = 42.49 completed, SD = 9.17, Min/Max = 21/56). No participants were excluded based on EMA compliance.
Momentary affect states of parents and adolescents were assessed four times per day with a slightly adapted and shortened four-item version of the Positive and Negative Affect Schedule for Children (PANAS-C; [38, 39]). At each timepoint participants were asked “How do you feel at the moment?” followed by two positive affect states “Happy” and “Relaxed”, and two negative affect states “Sad” and “Irritated”. Each affect state was rated on a 7-point Likert scale, ranging from 1 (not at all) to 7 (very). A mean score of the positive affect state was calculated per moment to create a momentary PA scale and a mean score of the negative affect state was calculated per moment to create a momentary NA scale. A higher score represented higher levels of PA or NA.
In the last questionnaire of each day, adolescents were asked to indicate with whom they spoke during that day (i.e., mother, father, stepmother, stepfather), and if so, to rate each parent’s warmth and criticism by answering the questions “Throughout the day, how warm/loving was your parent towards you?” and “Throughout the day, how critical was your parent towards you?” on a 7-point Likert scale ranging from 1 (not at all) to 7 (very). If adolescents only reported on mother and stepfather for instance throughout the EMA, scores about stepfathers were recoded as father. This was the case for two adolescents during the baseline and three adolescents during the COVID-19 pandemic. One adolescent reported on four caregivers (i.e. biological parents and stepparents) during both periods and we included scores about biological parents because these were mostly rated.
In the questionnaire at the end of each day parents also had to indicate whether they spoke to their child (i.e., the participating adolescent) and if so, to rate their own behavior towards their child by answering the questions “How warm/loving were you towards your child?” and “How critical were you towards your child?” on a 7-point Likert scale ranging from 1 (not at all) to 7 (very). Both for adolescent and parent report, a higher score represented more warmth and more criticism.
Daily difficulties and helpful activities.
To assess the difficulties and helpful activities during the COVID-19 pandemic, at the end of each day, participants were asked to choose items from a list of potential activities. Parents and adolescents could select almost similar activities and it was possible to give multiple answers. The list of potential daily difficulties consisted of: boredom, fights/conflicts, work (for parents)/homework (for adolescents), irritations with family members, noise disturbance, loneliness, missing social contact with friends, worries about own health, worries about health of others, concerns about the coronavirus in general, coronavirus-related news items or ‘anything else, namely…’. The list of potential helpful activities consisted of: work (for parents)/homework (for adolescents), watching series/television, listening to music, gaming, social media, reading a book, sports, chilling, online contact with relatives or friends, being together with the family, card or board games, DIY or crafts, cooking/dining, ‘anything else, namely’. Based on the total number of observed responses a top 5 of daily difficulties and helpful activities was composed. Percentages were calculated by dividing the number of observed responses on one activity by the total of given answers.
Intolerance of uncertainty.
The 12-item version of the Intolerance of Uncertainty Scale (IUS; ) was used to assess IU of parents and adolescents. Participants completed this questionnaire online prior to baseline. The 12 items of the IUS (e.g., “Uncertainty makes me uneasy, anxious, or stressed.” or “I should be able to organize everything in advance.”) were answered on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). A higher sum score represents higher levels of intolerance of uncertainty. Both the original and the 12-item version of the IUS appear to have satisfactory concurrent, discriminant, and predictive validity . Internal consistency of the scale was good with a Cronbach’s alpha of .81 for adolescents and .83 for parents.
The Patient Health Questionnaire (PHQ-9; ) was used to screen for the presence of depressive symptoms during the past two weeks. Depressive symptoms were assessed at both timepoints. The items are based on nine DSM-IV criteria for depression and are scored as 0 (not at all) to 3 (nearly every day). The PHQ-9 has been validated for use in primary care. Sum scores range from 0 to 27 and a score above 10 is suggestive of the presence of depression . For parents, the Cronbach’s alpha at baseline was .79 and during the COVID-19 pandemic .73. For adolescents, Cronbach’s alpha at baseline was .53 and during the COVID-19 pandemic .76.
Strategy of analyses
Parents and adolescents reported repeatedly on positive affect, negative affect, parental warmth, and parental criticism at baseline and during the COVID-19 pandemic. These repeated measures (Level 1) were nested within individuals (Level 2). Given this nested structure of the data, multilevel modelling  was used for the main analyses. Models were specified in R Version 3.6.1 , using the multilevel version 2.6  package to test our hypotheses with maximum likelihood (ML) estimation. Level 2 predictors were grand-mean centered, following guidelines proposed by Hoffman  and Bolger and Laurenceau .
To evaluate within-person change in positive affect, negative affect, parental warmth, and parental criticism from baseline to the COVID-19 pandemic, a series of models were tested. Separate models were tested per outcome and per informant (adolescents and parents), resulting in a total of 8 models. Per model, several similar steps were taken. First, we specified an unconditional random intercept model with covariance structure (Model 1). For more information on the selection of covariance structure and results see S3 Text. Second, we added period as predictor (Model 2), which was scored 0 (baseline) and 1 (during the COVID-19 pandemic) to model change. For example, to model change in positive affect, we specified period as the predictor and positive affect as the outcome. The intercept of the model estimates is positive affect score at baseline and the slope of the model is the estimated change from baseline to during the COVID-19 pandemic. Fourth, we added a random effect (Model 3) indicating that the change from baseline to during the COVID-19 pandemic could vary between persons. Significant changes in model fit were tested with likelihood ratio tests (following guidelines of Hox ). Fifth, we examined whether the changes were predicted by IU by adding a main effect of IU (Model 4). In the models on parental warmth and parental criticism gender of parents was also added to the model as main effect to test for possible gender differences. In the final model (Model 5), we also added an interaction term of IU with period to test the possible moderating role of IU.
Since two parents of a same family could participate in the study, a third level (family) was specified in all models including parents (Model 1b). To not overcomplicate our models, we tested whether adding family level (Level 3) to Model 1 for parents improved the model fit based on the likelihood ratio tests. Only if these tests were significant, the third level remained in the model. Since adolescents could report on parenting of fathers and mothers, family was specified as extra level in the models concerning parental warmth and parental criticism reported by adolescents (Model 1b). For adolescents, answers on father and mother (Level 2) are nested within adolescents (Level 3). We tested whether adding parent level (Level 2) to Model 1 for adolescents improved the model fit based on the likelihood ratio tests. If these tests were significant, the second level remained in the model.
We used two-tailed tests with an α = 0.05. The analytic plan for this study was uploaded to Open Science Framework prior to the analyses (preregistered at April 27th, osf.io/34ycu).
In the current study, 67 Dutch parents (age range during the COVID-19 pandemic: 36.25–71.04 years) and 34 adolescents (age range during the COVID-19 pandemic: 14.66–19.01 years) participated. Participant characteristics can be found in Table 1. The sample reported little to none depressive symptoms as measured with the PHQ-9. PHQ-9 scores of adolescents ranged between 0–9 at baseline and between 0–16 during the COVID-19 pandemic. PHQ-9 scores of parents ranged between 0–16 at baseline and between 0–16 during the COVID-19 pandemic. Levels of depressive symptoms did not differ between the two periods for adolescents (t = 1.11, df = 33, p = .275) and parents (t = 1.24, df = 67, p = .221). Information on household composition of participating families can be found in S3 Text. Correlations between study variables (gender, age, affect, parenting behavior, and IU) can be found in S1 Table (parents) and S2 Table (adolescents).
Situational description of the families during the COVID-19 pandemic
Of all parents, 91% (n = 61) were currently employed, 6% (n = 4) were unemployed and 3% (n = 2) were unable to work or lost their job due to the COVID-19 pandemic. During the 14 days of EMA, 53.7% of the parents who were employed worked more from home, 7.5% worked less from home and 38.8% worked just as much from home as compared to the period before the COVID-19 pandemic. All parents indicated owning a house with a garden and having a living surface >100m2. Of our sample, 17.9% (n = 12) of the parents reported having COVID-19 related symptoms during the 14 days of EMA.
During the COVID-19 pandemic, the most reported daily difficulties across the 14 days of EMA for parents were (1) missing social contact with friends (14.6%), (2) concerns about the coronavirus in general (13.5%), (3) irritations with family members (12.8%), (4) worrying about health of others (8.3%), and (5) coronavirus-related news items (8.0%). It was also asked daily which activities were helpful during the day. The top 5 of helpful activities reported by parents was (1) being together with family (20.0%), (2) cooking/dining (14.4%), (3) watching television/series (9.9%), (4) work (7.4%), and (5) online contact with relatives or friends (6.2%).
Due to the COVID-19 pandemic all national final school exams were canceled and some high schoolers already graduated (or not) based on their prior school exams, 5 (21.7%) adolescents graduated promptly in March 2020 prior to the 14 days of EMA. Of our adolescent sample, one person reported having COVID-19 related symptoms during the 14 days of EMA.
For adolescents (n = 34) the top 5 daily difficulties was (1) boredom (22.9%), (2) missing social contact with friends (17.7%), (3) irritations with family members (13.1%), (4) homework (12.3%), and (5) worry about the health of others (6.4%). The top 5 helpful activities for adolescents were (1) chilling (12.9%), (2) watching television/series (11.4%), (3) online contact with relatives or friends (11.0%), (4) listening to music (10.8%), and (5) being together with the family (9.6%).
Affect during the COVID-19 pandemic versus baseline
Affect: Parent reports.
First, an unconditional means model of negative affect with the intercept only was built (referred to as ‘Model 1’- complete model results of parents can be found in S3 Table, model fit statistics of parents can be found in S4 Table). The intraclass correlation coefficient (ICC) was .31 on the person level, indicating that moderate concordance of negative affect across time points within persons existed. Next, family was added as level to the unconditional means model (Model 1b). The ICC of the family level was .11, which indicates that some concordance of negative affect existed within families. However, the model fit did not improve significantly (χ2(1) = 1.581, p = .209) and family level was therefore removed from the model.
Next, in Model 2, we tested change in negative affect from baseline to during the COVID-19 pandemic by adding period to the model. Parents reported more negative affect during COVID-19 pandemic as compared to the baseline (B = 0.096, SE = .025, df = 5982, t = 3.900, p < .001). Adding individual variance in Model 3 improved the model fit significantly (χ2(2) = 56.613, p < .001). In Model 4, we added IU which was significantly associated with negative affect (B = 0.022, SE = .010, df = 62, t = 2.075, p = .042) indicating that more IU was related to more negative affect (main effect). Lastly, we added IU as moderator in Model 5 and results of this final model are presented in Table 2. No moderating effect of IU was found (B = 0.002, SE = .007, df = 5752, t = 0.225, p = .822) and IU was no longer significantly associated with negative affect (B = 0.021, SE = .011, df = 62, t = 1.960, p = .054), but period remained significantly associated with negative affect. Results are shown in Fig 2.
For positive affect, the same steps were followed. Model 1 showed an ICC of .32 and adding family level (Model 1b) did not significantly improve the model fit (χ2(1) = 0.738, p = .390). Results of Model 2 showed that parents’ positive affect did not differ across the two periods (B = 0.012, SE = .028, df = 5986, t = 0.404, p = .686). Adding individual variance in Model 3 improved the model fit significantly (χ2(2) = 122.186, p < .001). In Model 4 IU was added as a main effect, but no significant association with positive affect was found. Lastly, IU was added as moderator in Model 5, but no moderating effect of IU was found (B = -0.008, SE = .009, df = 5756, t = -0.823, p = .411). Results of this final model are presented in Table 2.
Affect: Adolescent reports.
In Model 1, the ICC of negative affect on the person level was .32 (complete model results of adolescents can be found in S5 Table, model fit statistics of adolescents can be found in S6 Table). Results of Model 2 showed that there was no significant change in adolescent negative affect (B = 0.016, SE = .027, df = 2618, t = 0.595, p = .552). Adding individual variance in Model 3 improved the model fit significantly (χ2(2) = 39.759, p < .001). In Model 4, we added IU as a main effect which was significantly associated with negative affect (B = 0.030, SE = .011, df = 30, t = 2.737, p = .010) indicating that more IU was related to more negative affect. IU was added as moderator in Model 5 and IU remained significantly associated with negative affect, but no moderating effect of IU was found (B = -0.006, SE = .008, df = 2463, t = -0.803, p = .422). Results of this final model are presented in Table 3. Results are shown in Fig 2.
For positive affect in Model 1, the ICC on the person level was .33. No significant change in adolescent positive affect (B = 0.025, SE = .043, df = 2618, t = 0.574, p = .566) was found in Model 2. Adding individual variance in Model 3 improved the model fit significantly (χ2(2) = 103.798, p < .001). In Model 4, we added IU as main effect, which was significantly associated with positive affect (B = -0.044, SE = .015, df = 30, t = -2.917, p = .007), indicating that more IU was related to less positive affect. IU was added as moderator in Model 5, IU remained significantly associated with positive affect, but no moderating effect of IU was found (B = -0.003, SE = .017, df = 2463, t = -0.199, p = .842). Results of this final model are presented in Table 3.
Parenting: Parent reports.
In Model 1, the ICC of parental criticism on the person level was .39 (complete model results of parents can be found in S3 Table, model fit statistics of parents can be found in S4 Table). Adding family level (Model 1b) did significantly improve the model fit (χ2(1) = 5.430, p = .020) with an ICC of .20 at the family level and ‘family’ remained in the model. Results of Model 2 showed that no difference in parental criticism between baseline and during the COVID-19 pandemic was found (B = 0.126, SE = .064, df = 1530, t = 1.963, p = .050). Adding individual variance in Model 3 improved the model fit significantly (χ2(4) = 39.527, p < .001). In Model 4, we added IU and gender of the parent as main effects. Both were not significantly associated with parental criticism. IU was added as moderator in Model 5, but no moderating effect of IU was found (B = -0.013, SE = .014, df = 1466, t = -0.944, p = .346). Results of this final model are presented in Table 4.
For parental warmth in Model 1, the ICC on the person level was .46 and adding family level (Model 1b) did not significantly improve the model fit (χ2(1) = 0.761, p = .383). No significant change in parental warmth (B = 0.010, SE = .038, df = 1530, t = 0.255, p = .799) was found in Model 2. Adding individual variance in Model 3 improved the model fit significantly (χ2(2) = 22.499, p < .001). In Model 4, we added IU and gender of parent and both were not significantly associated with parental warmth. IU was added as moderator in Model 5, but no moderating effect of IU was found (B = 0.004, SE = .008, df = 1466, t = .489, p = .625). Results of this final model are presented in Table 4.
Parenting: Adolescent reports.
In Model 1, the ICC of parental criticism on the person level was .45 (complete model results of adolescents can be found in S5 Table, model fit statistics of adolescents can be found in S6 Table). Adding family level (Model 1b) did not significantly improve the model fit (χ2(1) = 2.925, p = .087). Results of Model 2 showed that the change in reports on parental criticism between baseline and during the COVID-19 pandemic was not significant (B = 0.036, SE = .062, df = 1350, t = 0.576, p = .565). Adding individual variance in Model 3 improved the model fit significantly (χ2(2) = 53.931, p < .001). In Model 4, we added IU and gender of parent as main effects. Gender of parent was significantly associated with reports on parental criticism (B = -0.121, SE = .058, df = 1268, t = -2.099, p = .036), indicating that adolescents reported more parental criticism of mothers than fathers. IU was not significantly associated with parental criticism. IU was added as moderator in Model 5, but no moderating effect of IU was found (B = 0.028, SE = .021, df = 1267, t = 0.083, p = .934). Results of this final model are presented in Table 5. Gender of parents remained significantly associated with parental criticism.
For parental warmth in Model 1, the ICC on the person level was .60 and adding family level (Model 1b) did significantly improve the model fit (χ2(1) = 25.314, p < .001) with an ICC of .05 at the family level and family remained in the model. No significant change in parental warmth (B = 0.026, SE = .051, df = 1317, t = 0.500, p = .617) was found in Model 2. Adding individual variance in Model 3 improved the model fit significantly (χ2(4) = 74.831, p < .001). In Model 4, we added IU and gender of parent and both were not significantly associated with parental warmth. IU was added as moderator in Model 5, but no moderating effect of IU was found (B = 0.002, SE = .021, df = 1267, t = 0.083, p = .934). Results of this final model are presented in Table 5.
Post hoc analyses on increase in parents’ negative affect during the COVID-19 pandemic.
As IU did not explain why parents reported more negative affect during COVID-19 pandemic as compared to the baseline, we did some post hoc analyses to examine whether characteristics related to the lockdown and the COVID-19 pandemic were associated with the increase of parents’ negative affect. Living surface, income, having suffered from COVID-19 symptoms, helping children with school at home, working from home, going to work, daily difficulties during the past two weeks of COVID-19, and working with COVID-19 patients were examined (see S7 and S8 Tables for description of the EMA items). None of these characteristics were related to the increase of parents’ negative affect during the COVID-19 pandemic as compared to the baseline (all p-values < .001).
In this study we (1) explored parents’ and adolescents’ daily difficulties and helpful activities during the COVID-19 pandemic (2) examined positive and negative affect of both parents and adolescents during 2 weeks of the COVID-19 pandemic and compared them to a 2-week baseline period pre-pandemic, (3) examined parenting behaviors (assessed by both the adolescent and the parent) and compared parental warmth and criticism towards the adolescent during 2 weeks of the COVID-19 pandemic and a 2-week baseline period, (4) examined whether parents’ and adolescents’ levels of IU at baseline are associated with affect and parenting in general, and (5) as well as with the hypothesized changes in affect and (perceived) parental warmth and criticism.
Subjective experience of the COVID-19 pandemic
Most importantly, both parents and adolescents were bothered by a lack of social contact with friends, by irritations with family members, and worried about the health of others. This might be a logical consequence of the lockdown and social distancing. Remarkably, adolescents struggled with boredom whereas this was not the case for parents. Parents worried about the coronavirus in general, while this did not bother adolescents that much. In response to social distancing, online contact with relatives or friends aided both parents and adolescents to cope with the situation. In addition, watching tv-shows was also mentioned as a helpful activity by parents and adolescents. Other activities that helped to cope with the situation varied across parents and adolescents. While parents reported to benefit from being together with family and cooking and dining, adolescents reported chilling and listening to music.
Previous studies have shown that quarantine and quarantine-related issues (i.e., financial insecurity, fear of infection, uncertainty about duration) in general have a negative influence on adult mood and mental well-being . Therefore, it was expected that the COVID-19 pandemic and lockdown would increase negative affect and decrease positive affect as compared with a period before the lockdown. Our results show that, indeed, parents’ negative affect increased as compared to the period before the lockdown. Important to note is that we collected data during 5th and 6th week of the lockdown in the Netherlands with only minor prospects of easing regulations. We also explored whether other pandemic-related characteristics (i.e. living surface, income, relatives with COVID-19, hours of working at home, helping children with school and contact with COVID-19 patients at work) were linked to the increase of negative affect in parents. This was not the case.
Our findings suggested however the presence of heterogeneity among individuals. All our models improved significantly when allowing the associations between period (2 weeks of the COVID-19 pandemic versus a similar 2-week baseline period) and affect and parenting behavior to vary across individuals, which is in line with the theoretical notion of differential susceptibility (e.g., ). Whether or not parents and adolescents experience (emotional) problems during lockdown can clearly vary from household to household, suggesting that in general families seem to be able to adapt to the circumstances, but that some families struggle. This is important to keep in mind for potential future measures of social distancing.
It was expected that the forced social distance during the COVID-19 pandemic and particularly the physical distance from friends and peers and the school closure would result in an increase of negative affect and decrease of positive affect in adolescents (see also Loades et al. ). Yet, in our study, no differences in adolescent reports on negative affect were found during the COVID-19 pandemic as compared to a baseline period. As for adults, the opportunities for adolescents of online social interaction might have buffered feelings of isolation or loneliness and bolstered mental well-being during the COVID-19 pandemic . Moreover, it should be noted that our sample is considered healthy on average, based on the PHQ-9 scores, and lived in relatively favorable circumstances (e.g., high socioeconomic status). Affect of adolescents with (subclinical) mental health issues (e.g. depressive or anxiety symptoms) or living under less fortune circumstances might be more influenced during the COVID-19 pandemic. Therefore, it is important to examine the effect of the COVID-19 pandemic in clinical samples to elucidate its effect on psychopathology. Moreover, it should be noted that our assessments were in the rather poignant phase of social lock down, when school closings may also have yielded relief for some adolescents. Even though individuals thrive to become independent during adolescence and start to explore the environment outside family household [2, 3] this period of enforced proximity did not seem to affect adolescents on the short-term. Potentially, the endurance of the lockdown may have more detrimental effects on adolescent well-being.
Not for parents nor for adolescents, a change in positive affect was found. Despite the increase of stress and uncertainty around the COVID-19 pandemic, disasters such as a pandemic also might increase the sense of social connectedness and morality . This sense of shared social identity and the feeling of ‘we are all in this together’ can be related to positive affect , which could explain why positive affect did not decrease in the present study. In families, as in our sample, no one was home alone, and one could still have online social interactions with others outside the household. To that end, ‘physical distancing’ might be a better term for the imposed social isolation or social distance, as was previously suggested in literature .
As mentioned before, the COVID-19 pandemic and the related lockdown may lead to more tension, irritability, and family conflicts or worse . Notably, parent’ affect and parenting behavior are interrelated and are both involved in giving comfort, expressing approval or expressing criticism [52, 53]. For instance, parents who worry more, express more criticism towards their adolescents, indicating that a negative affect promotes insensitive and in more extreme cases abusive parenting behavior, whereas positive affect strongly relates to supportive parenting [52, 53]. Regarding parenting behaviors, we therefore expected higher levels of parental criticism and lower levels of parental warmth during the COVID-19 pandemic as compared to baseline. We found, however, that parental warmth and criticism from both parent and adolescent perspective, did not differ between before and during the COVID-19 pandemic. Interestingly, even though negative affect of parents increased compared to the period before lockdown, this did not seem to affect parenting behavior (self-report and perceived by the adolescent). It should be noted that, in general, adolescents perceived their mothers as more critical compared with fathers, unrelated to measurement period. This might be due to the unique roles of mothers and fathers in caregiving and setting rules and boundaries [54, 55].
Intolerance of uncertainty (IU)
Results showed that IU was related to more negative affect in both parents and adolescents, independent of the period of assessment. Furthermore, in adolescents, IU was also linked to a decrease in positive affect, while for parents no link between IU and positive affect was found. It was expected that people with elevated IU levels might experience even greater distress under the COVID-19 circumstances as compared to baseline, however our results do not support this. IU is often described as a predisposition to negatively perceive and respond to uncertain information and situations, irrespective of its probability and outcomes [34, 35]. Apparently, it is negatively associated with affect in daily life, regardless of whether there are major threats and uncertainties, or more daily hassles. Future research could elucidate why IU may particularly dampen positive affect in adolescents and not in adults. Even though IU seems to relate to affect of parents and adolescents, it did not seem to spill over into parenting behaviors. These results give a first indication that IU also relates to more micro processes in daily life, for both adolescents and parents.
Strengths, limitations and remarks
Firstly, the intensive longitudinal study design with multiple assessments per day enabled us to gain more fine-grained insights in affect and parenting behaviors in daily life and to consider individual differences. Secondly, assessment during two periods, before and during the COVID-19 pandemic, allowed us to detect changes due to the COVID-19 pandemic. Next to the strengths, it should be acknowledged that the sample (67 parents and 34 adolescents) was relatively small. Second, it should be noted that the study sample consisted of overall healthy, well-functioning parents and adolescents. That is, adolescents were screened at baseline and were excluded if they had a current mental disorder, a history of psychopathology in the past two years, or a lifetime history of major depressive disorder or dysthymia. Moreover, the PHQ-9 scores of adolescents and parents indicated few depressive symptoms. Therefore, findings might not be applicable to adolescents and parents with (sub)clinical mental health problems or at-risk populations (e.g. refugees, low socioeconomic status), since these groups might be at increased risk of problems such as loneliness, negative affect or negative parenting practices during the COVID-19 pandemic. Lastly, it should be noted that information on long-term consequences of lockdown during the COVID-19 pandemic is lacking.
Prior research has suggested that the impact of stress can be altered by mindsets and appraisals of stressful events [10, 56, 57]. These factors could possibly explain the individual variations we found. For instance, people with low expectations of the course of events might adapt relatively well to new situations and, therefore, experience little emotional problems. Moreover, adaptive mindsets about stressful events might increase positive emotions and reduce negative health symptoms . Considering these factors in future studies might be useful to elucidate individual differences in risk and resilience.
In our study parents, but not adolescents, showed an increase of negative affect in a two-week period (14–28 April 2020) during the COVID-19 pandemic compared with a similar two-week baseline period pre-pandemic. Positive affect and parenting behaviors ‘warmth’ and ‘criticism’ did not change. It can be concluded that, on average, parents and adolescents in our sample seem to deal fairly well with the circumstances. Individuals and families differed however to what extent the COVID-19 pandemic influenced their affect and (perspective of) parenting behavior. Living surface, income, having suffered from COVID-19 symptoms, helping children with school at home, working from home, going to work, difficulties during COVID-19, and working with COVID-19 patients did not explain the increase of parental negative affect.
Policy makers and mental health professionals working to prepare for potential disease outbreaks should be aware that the experience of being quarantined might affect individuals differently. Each parent and adolescent could therefore benefit from a different coping strategy, as ‘one size does not fit all’. Providing easily accessible and safe ways to increase online contact for all ages and layers of society, recommending to search for distraction such as listening to music or watching television, and helping to accept the uncertain situation are for instance potential coping strategies. In this way, individuals can find ways that suit their own personal needs in order to benefit their well-being in times of a lockdown and social distancing measures.
S1 Text. Detailed information RE-PAIR study.
S2 Text. Detailed information on EMA: Concepts in the questionnaires, triggering schedules, differences in set-up, number of items and completing time, and monitoring process.
S3 Text. Information on household composition of participating families.
S4 Text. Detailed information on covariance structure.
S1 Table. Correlations between study variables for parents.
S2 Table. Correlations between study variables for adolescents.
S3 Table. Model results parents.
Table A: Model results on the relation between period and negative affect, and the moderating role of intolerance of uncertainty in parents. Table B: Model results on the relation between period and positive affect, and the moderating role of intolerance of uncertainty in parents. Table C: Model results on the relation between period and parental criticism, and the moderating role of intolerance of uncertainty in parents. Table D: Model results on the relation between period and parental warmth, and the moderating role of intolerance of uncertainty in parents.
S4 Table. Model fit statistics of all models of parents.
S5 Table. Model results adolescents.
Table A: Model results on the relation between period and negative affect, and the moderating role of intolerance of uncertainty in adolescents. Table B: Model results on the relation between period and positive affect, and the moderating role of intolerance of uncertainty in adolescents. Table C: Model results on the relation between period and parental criticism, and the moderating role of intolerance of uncertainty in adolescents. Table D: Model results on the relation between period and parental warmth, and the moderating role of intolerance of uncertainty in adolescents.
S6 Table. Model fit statistics of all models of adolescents.
S7 Table. Overview of EMA items used in the current study.
S8 Table. Overview of EMA items of the exit questionnaire used in the current study.
We are grateful to all the families that have invested their time by participating in this study. We furthermore thank Ethica data for offering their services (i.e., use of the Ethica app and platform) free of charge during the COVID-19 pandemic.
Organization WH. WHO announces COVID-19 outbreak a pandemic. 2020. http://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-announces-covid-19-outbreak-a-pandemic#:~:text=COVID-19 can be, growing number of countries.
Steinberg L, Silk J. Parenting adolescents. In: Bornstein MH, editor. Handbook of parenting: Children and parenting. Lawrence Erlbaum Associates Publishers; 2002. pp. 103–133.
- 3. Steinberg L. Cognitive and affective development in adolescence. Trends in Cognitive Sciences. 2005. pp. 69–74. pmid:15668099
- 4. Cava MA, Fay KE, Beanlands HJ, McCay EA, Wignall R. The experience of quarantine for individuals affected by SARS in Toronto. Public Health Nursing. 2005;22: 398–406. pmid:16229732
- 5. Hawryluck L, Gold WL, Robinson S, Pogorski S, Galea S, Styra R. SARS control and psychological effects of quarantine, Toronto, Canada. Emerging Infectious Diseases. 2004;10: 1206–1212. pmid:15324539
- 6. Liu X, Kakade M, Fuller CJ, Fan B, Fang Y, Kong J, et al. Depression after exposure to stressful events: Lessons learned from the severe acute respiratory syndrome epidemic. Comprehensive Psychiatry. 2012;53: 15–23. pmid:21489421
- 7. Sprang G, Silman M. Posttraumatic stress disorder in parents and youth after health-related disasters. Disaster Medicine and Public Health Preparedness. 2013;7: 105–110. pmid:24618142
- 8. Jeong H, Yim HW, Song YJ, Ki M, Min JA, Cho J, et al. Mental health status of people isolated due to Middle East Respiratory Syndrome. Epidemiology and health. 2016;38: e2016048. pmid:28196409
- 9. Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. The Lancet. Elsevier; 2020. pp. 912–920. pmid:32112714
- 10. Bavel JJV, Baicker K, Boggio PS, Capraro V, Cichocka A, Cikara M, et al. Using social and behavioural science to support COVID-19 pandemic response. Nature Human Behaviour. Nature Publishing Group; 2020. pp. 460–471. pmid:32355299
- 11. Stone AA, Shiffman S. Ecological momentary assessment (EMA) in behavioral medicine. Annals of Behavioral Medicine. 1994. pp. 199–202.
- 12. Kuppens P, Oravecz Z, Tuerlinckx F. Feelings change: Accounting for individual differences in the temporal dynamics of affect. Journal of Personality and Social Psychology. 2010;99: 1042–1060. pmid:20853980
- 13. Carstensen LL, Turan B, Scheibe S, Ram N, Ersner-Hershfield H, Samanez-Larkin GR, et al. Emotional experience improves with age: Evidence based on over 10 years of experience sampling. Psychology and Aging. 2011;26: 21–33. pmid:20973600
- 14. Eid M, Diener E. Intraindividual variability in affect: Reliability, validity, and personality correlates. Journal of personality and social psychology. 1999;76: 662.
- 15. Houben M, Van Den Noortgate W, Kuppens P. The relation between short-term emotion dynamics and psychological well-being: A meta-analysis. Psychological Bulletin. 2015;141: 901–930. pmid:25822133
Granic I, Dishion TJ, Hollenstein T. The family ecology of adolescence: A dynamic systems perspective on normative development. In: Berzonsky IGRA and M D, editor. Blackwell Handbook of Adolescence. Malden, MA: Blackwell; 2008. pp. 60–91. https://doi.org/10.1002/9780470756607.ch4
- 17. Wilson C, Budd B, Chernin R, King H, Leddy A, Maclennan F, et al. The role of meta-cognition and parenting in adolescent worry. Journal of Anxiety Disorders. 2011;25: 71–79. pmid:20828983
- 18. Maciejewski DF, van Lier PAC, Neumann A, Van der Giessen D, Branje SJT, Meeus WHJ, et al. The Development of Adolescent Generalized Anxiety and Depressive Symptoms in the Context of Adolescent Mood Variability and Parent-Adolescent Negative Interactions. Journal of Abnormal Child Psychology. 2014;42: 515–526. pmid:23982435
- 19. Bai S, Reynolds BM, Robles TF, Repetti RL. Daily links between school problems and youth perceptions of interactions with parents: A diary study of school-to-home spillover. Social Development. 2017;26: 813–830. pmid:29307958
- 20. Fredrickson BL. The role of positive emotions in positive psychology: The broaden-and-build theory of positive emotions. American Psychologist. 2001;56: 218–226. pmid:11315248
- 21. Epkins CC, Harper SL. Mothers’ and fathers’ parental warmth, hostility/rejection/neglect, and behavioral control: Specific and unique relations with parents’ depression versus anxiety symptoms. Parenting. 2016;16: 125–145.
- 22. Hickey EJ, Hartley SL, Papp L. Psychological well-being and parent-child relationship quality in relation to child autism: An actor-partner modeling approach. Family Process. 2020;59: 636–650. pmid:30844091
- 23. Pottie CG, Ingram KM. Daily stress, coping, and well-being in parents of children with autism: A multilevel modeling approach. Journal of Family Psychology. 2008;22: 855–864. pmid:19102606
- 24. Flook L. Gender differences in adolescents’ daily interpersonal events and well-being. Child Development. 2011;82: 454–461. pmid:21410907
- 25. Ramsey MA, Gentzler AL. An upward spiral: Bidirectional associations between positive affect and positive aspects of close relationships across the life span. Developmental Review. Academic Press; 2015. pp. 58–104.
- 26. Repetti R, Wang SW, Saxbe D. Bringing it all back home: How outside stressors shape families’ everyday lives. Current Directions in Psychological Science. 2009;18: 106–111.
- 27. Korelitz KE, Garber J. Congruence of parents’ and children’s perceptions of parenting: A meta-analysis. Journal of Youth and Adolescence. 2016;45: 1973–1995. pmid:27380467
- 28. Buhr K, Dugas MJ. Investigating the construct validity of intolerance of uncertainty and its unique relationship with worry. Journal of Anxiety Disorders. 2006;20: 222–236. pmid:16464706
- 29. Zlomke KR, Young JN. A retrospective examination of the role of parental anxious rearing behaviors in contributing to intolerance of uncertainty. Journal of Child and Family Studies. 2009;18: 670–679.
- 30. Meeten F, Dash SR, Scarlet ALS, Davey GCL. Investigating the effect of intolerance of uncertainty on catastrophic worrying and mood. Behaviour Research and Therapy. 2012;50: 690–698. pmid:22982084
- 31. Dugas MJ, Gagnon F, Ladouceur R, Freeston MH. Generalized anxiety disorder: A preliminary test of a conceptual model. Behaviour Research and Therapy. 1998;36: 215–226. pmid:9613027
- 32. Freeston MH, Rhéaume J, Letarte H, Dugas MJ, Ladouceur R. Why do people worry? Personality and individual differences. 1994;17: 791–802.
- 33. Rosen NO, Knäuper B. A little uncertainty goes a long way: State and trait differences in uncertainty interact to increase information seeking but also increase worry. Health Communication. 2009;24: 228–238. pmid:19415555
- 34. Ladouceur R, Blais F, Freeston MH, Dugas MJ. Problem solving and problem orientation in generalized anxiety disorder. Journal of Anxiety Disorders. 1998;12: 139–152. pmid:9560176
- 35. Ladouceur R, Gosselin P, Dugas MJ. Experimental manipulation of intolerance of uncertainty: A study of a theoretical model of worry. Behaviour Research and Therapy. 2000;38: 933–941. pmid:10957827
Reichart CG, Wals M, Hillegers M. Vertaling K-SADS. HC Rümke Groep, Utrecht. 2000.
Data E. No Title. 2019. https://ethicadata.com
- 38. Ebesutani C, Regan J, Smith A, Reise S, Higa-McMillan C, Chorpita BF. The 10-item Positive and Negative Affect Schedule for Children, Child and parent shortened versions: Application of item response theory for more efficient assessment. Journal of Psychopathology and Behavioral Assessment. 2012;34: 191–203.
- 39. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology. 1988;54: 1063–1070. pmid:3397865
- 40. Carleton RN, Norton MAAPJ, Asmundson GJG. Fearing the unknown: A short version of the Intolerance of Uncertainty Scale. Journal of Anxiety Disorders. 2007;21: 105–117. pmid:16647833
- 41. Khawaja NG, Yu LNH. A comparison of the 27-item and 12-item intolerance of uncertainty scales. Clinical Psychologist. 2010;14: 97–106.
- 42. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine. 2001;16: 606–613. pmid:11556941
- 43. Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): A meta-analysis. CMAJ. 2012;184: E191–E196. pmid:22184363
- 44. Hox J, Moerbeek M, Van de Schoot R. Multilevel analysis: Techniques and applications. 2010.
Team RC. R: A language and environment for statistical computing (Version 3.6.1)[Software package]. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from …; 2019.
- 46. Bliese P, Bliese MP. Package ‘multilevel.’ 2016.
Hoffman L. Longitudinal analysis: Modeling within-person fluctuation and change. Routledge; 2015.
Bolger N, Laurenceau J-P. Intensive longitudinal methods: An introduction to diary and experience sampling research. Guilford Press; 2013.
- 49. Pluess M, Belsky J. Differential susceptibility to parenting and quality child care. Developmental Psychology. 2010;46: 379–390. pmid:20210497
- 50. Loades ME, Chatburn E, Higson-Sweeney N, Reynolds S, Shafran R, Brigden A, et al. Rapid systematic review: The impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19. Journal of the American Academy of Child & Adolescent Psychiatry. 2020. pmid:32504808
- 51. Doré BP, Morris RR, Burr DA, Picard RW, Ochsner KN. Helping others regulate emotion predicts increased regulation of one’s own emotions and decreased symptoms of depression. Personality and Social Psychology Bulletin. 2017;43: 729–739. pmid:28903637
- 52. Dix T. The affective organization of parenting: Adaptive and maladaptative processes. Psychological Bulletin. 1991;110: 3–25. pmid:1891517
- 53. Rueger SY, Katz RL, Risser HJ, Lovejoy MC. Relations between parental affect and parenting behaviors: A meta-analytic review. Parenting. 2011. pp. 1–33.
Lamb M. E., Lewis C. Father-child relationships. Handbook of Father Involvement: Multidisciplinary perspective. 2013. https://books.google.co.uk/books?hl=en&lr=&id=Xx-abFyPtg8C&oi=fnd&pg=PA119&dq=Lamb,+M.+E.,+%26+Lewis,+C.+(2013).+Father-child+relationships.+Handbook+of+father+involvement:+Multidisciplinary+perspectives,+2,+119-135.&ots=3modiWSSmw&sig=3JBCo6uwZOoiaFwnL_V
- 55. Van Lissa CJ, Keizer R, Van Lier PAC, Meeus WHJ, Branje S. The role of fathers’ versus mothers’ parenting in emotion-regulation development from mid-late adolescence: Disentangling between-family differences from within-family effects. Developmental Psychology. 2019;55: 377–389. pmid:30570297
- 56. Jamieson JP, Crum AJ, Goyer JP, Marotta ME, Akinola M. Optimizing stress responses with reappraisal and mindset interventions: an integrated model. Anxiety, Stress and Coping. Routledge; 2018. pp. 245–261. pmid:29471669
- 57. Dienstbier RA. Arousal and physiological toughness: Implications for mental and physical health. Psychological Review. 1989;96: 84–100. pmid:2538855
- 58. Crum AJ, Akinola M, Martin A, Fath S. The role of stress mindset in shaping cognitive, emotional, and physiological responses to challenging and threatening stress. Anxiety, Stress and Coping. 2017;30: 379–395. pmid:28120622