Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Can We Increase Psychological Well-Being? The Effects of Interventions on Psychological Well-Being: A Meta-Analysis of Randomized Controlled Trials

  • Laura A. Weiss ,

    l.weiss@utwente.nl

    Affiliation Centre for eHealth and Well-being Research, Department of Psychology, Health and Technology, University of Twente, Enschede, The Netherlands

  • Gerben J. Westerhof,

    Affiliation Centre for eHealth and Well-being Research, Department of Psychology, Health and Technology, University of Twente, Enschede, The Netherlands

  • Ernst T. Bohlmeijer

    Affiliation Centre for eHealth and Well-being Research, Department of Psychology, Health and Technology, University of Twente, Enschede, The Netherlands

Can We Increase Psychological Well-Being? The Effects of Interventions on Psychological Well-Being: A Meta-Analysis of Randomized Controlled Trials

  • Laura A. Weiss, 
  • Gerben J. Westerhof, 
  • Ernst T. Bohlmeijer
PLOS
x

Abstract

Background

There is a rapidly growing interest in psychological well-being (PWB) as outcome of interventions. Ryff developed theory-based indicators of PWB that are consistent with a eudaimonic perspective of happiness. Numerous interventions have been developed with the aim to increase PWB. However, the effects on PWB measured as coherent outcome have not been examined across studies yet. This meta-analysis of randomized controlled trials of behavioral interventions aims to answer the question whether it is possible to enhance PWB.

Methods

A systematic literature search was performed in PsycINFO, Cochrane and Web of Science. To be included, studies had to be randomized controlled trials of behavioral interventions with psychological well-being as primary or secondary outcome measure, measured with either Ryff’s Psychological Well-Being Scales or the Mental Health Continuum—Short Form. The meta-analysis was performed using a random effects model. From the 2,298 articles found, 27 met the inclusion criteria. The included studies involved 3,579 participants.

Results

We found a moderate effect (Cohen’s d = 0.44; z = 5.62; p < .001). Heterogeneity between the studies was large (Q (26) = 134.12; p < .001; I2 = 80.62). At follow-up after two to ten months, a small but still significant effect size of 0.22 was found. There was no clear indication of publication bias. Interventions were more effective in clinical groups and when they were delivered individually. Effects were larger in studies of lower quality.

Conclusions

It appears to be possible to improve PWB with behavioral interventions. The results are promising for the further development and implementation of interventions to promote PWB. Delivering interventions face-to-face seems to be the most promising option. We recommend to keep including clinical groups in the research of psychological well-being. Heterogeneity is a limitation of the study and there is need for more high-quality studies.

Introduction

In the last years, the focus in mental healthcare and prevention has shifted from solely treating or preventing mental health complaints to enhancing positive aspects of mental health. A new goal in mental healthcare is the promotion of well-being [14]. However, there are currently many definitions of well-being [5]., with the two main concepts being subjective and psychological well-being.

Subjective well-being builds on a hedonic framework in which striving for positive experiences is central. It is usually measured as satisfaction with life in combination with a balance between positive and negative emotions [6]. The standards that people use to judge their subjective well-being were not theorized in this framework. By contrast, Carol Ryff introduced the concept psychological well-being with the intention to develop theory-based indicators of positive human functioning that were consistent with a eudaimonic perspective of happiness [7]. Another well-researched theory in the eudaimonic tradition is the self-determination theory that states that the fulfillment of basic psychological needs is essential to well-being and growth [8].

The variety of concepts and measures makes it difficult to compare studies [9]. It is therefore important to be precise in one’s definition of well-being. This paper focuses on the concept of psychological well-being according to Ryff’s definition [10]. Earlier meta-analyses have already examined subjective well-being [11, 12]. The latest meta-analysis has also included psychological well-being, but measured it in a very broad way with many different instruments [12]. We will conduct the first meta-analysis that exclusively examines psychological well-being as defined by Ryff.

Based on an extensive review of the literature of clinical, humanistic and life-span developmental psychology, as well as existential and utilitarian philosophy, Ryff [10] defined psychological well-being as a process of self-realization, consisting of six dimensions: autonomy, environmental mastery, personal growth, positive relations with others, purpose in life and self-acceptance. There is some discussion on the six-factor structure [13] and whether psychological and subjective well-being are two separate but related dimensions or one overarching construct [14].

Recently Ryff [15], reviewed over 350 empirical studies on psychological well-being that have been conducted in the past decades. Longitudinal studies show that high levels of psychological well-being are a protective factor against mental illnesses and psychopathology [1618] and that it is also related to biological markers of physical health, reduced risk for various diseases such as Alzheimer’s disease, and a longer life-duration [15]. This growing evidence of positive outcomes of psychological well-being makes it worthwhile to study whether we can improve it.

However, as existing studies show that psychological well-being is rather stable across time [19], an important question is whether it can indeed be promoted in interventions. Answering this question will provide more insight into the state or trait discussion whether characteristics of psychological well-being are more trait-like or state-like [20].

In recent years, there has been a rapid increase of studies on behavioral interventions that included psychological well-being as an outcome measure (e.g. [21, 22]). A central aim of interventions such as well-being therapy [23, 24], acceptance and commitment therapy [25], life-review therapy [26], and positive psychological interventions [27] is to enhance positive psychological functioning. Meta-analyses have shown that these interventions are successful in enhancing certain aspects of psychological well-being [11, 12, 28], but as mentioned, they measured psychological well-being with many different measurement instruments that do not all fit the definition of Ryff. To which extent interventions have an impact on psychological well-being as a coherent construct of positive psychological functioning is unclear. Also, only positive psychological interventions were included, thereby neglecting the increasing number of interventions that addressed psychological well-being in other disciplines.

Hence, we will take the next step in reviewing the evidence on psychological well-being by conducting a meta-analysis on the effects of different behavioral interventions on psychological well-being as a coherent construct across randomized controlled trials. We want to examine whether well-being can be changed as a function of behavioral interventions.

Methods

Eligibility criteria

Study eligibility criteria.

The research question and inclusion criteria were established before the meta-analysis was conducted. Psychological well-being had to be used as primary or secondary outcome measure. To examine it as coherent construct, it had to be measured either with Ryff’s Psychological Well-Being Scales (PWBS) [10] with all six dimensions of psychological well-being as study endpoints, or with the subscale ‘Psychological Well-Being’ of the Mental Health Continuum—Short Form (MHC-SF) [29, 30]. The MHC-SF also assesses psychological well-being with the six dimensions of Ryff’s model. If the MHC-SF was used, the data of the subscale psychological well-being had to be available. Research on the MHC-SF in different cultures has provided support for its psychometric properties and its three dimensional factor structure [31, 32]. The reliability and validity of the PWBS has been established in different versions and across various cultures (e.g. [33, 34]). Yet it has to be noted that the a priori six-factor structure is debated [13]. This problem appears to be exacerbated by the existence of multiple forms of the test, ranging from 18 to 120 items. There is also discussion whether the PWBS is able to discriminate between higher levels of well-being [35].

Only randomized controlled trials (RCTs) of behavioral interventions were included, excluding pharmacological interventions. We focused on all study populations, including both healthy and clinical populations of any age. Waiting list, no treatment, care-as-usual, placebo, or alternative treatment groups were included as comparators.

Report eligibility criteria.

To be included, an article had to be published in English-language peer-reviewed journals, excluding books, dissertations and conference proceedings. No publication date restriction was imposed. Data necessary to calculate the effect size had to be available in the article or upon request.

Search strategy and selection of studies

Information sources.

A systematic literature search was performed in the databases of the Cochrane Library, PsycINFO, and Web of Science. The last search was run on 13 April 2015. The first and second author developed the search with the help of an information specialist. The first author (LAW) and a trained student assistant (PDW) conducted the search. We screened the reference lists of included studies and of the meta-analyses of Sin and Lyubomirsky (11), Bolier et al. [12] and the review of Ryff [15] for additional potentially eligible studies. Finally, we invited four experts in the field to suggest additional studies that might meet the inclusion criteria.

Search.

Search terms were Ryff* or "mental health continuum" or "psychological well-being" or "psychological wellbeing" in all fields of the database, combined with one of the following terms in the title or abstract: intervention or therapy or treatment or random* or control* or trial or RCT. Search strings were adapted to the according database. No limitations were used.

Study selection.

Two data extractors (LAW and PDW) assessed the eligibility independently in a standardized manner. The retrieved records from the database search were screened by title and abstract. First, the extractors screened the first ten publications in PsycINFO together and discussed the results, and then both screened the next 100 studies in PsycINFO independently. They performed an interrater reliability check where Cohen’s kappa was 0.71, which is considered ‘good’ [36]. A consensus procedure for disagreement between them was established and disagreements were resolved by consensus. The remainder of the records were screened by the two researchers independently. After the titles and abstracts were screened for possible inclusion, full articles were assessed for eligibility.

Data collection

Data items.

Information was extracted from each included study on (1) study sample; (2) outcome measure (Ryff’s PWBS or MHC-SF) with number of items; (3) type of intervention; (4) number of sessions and treatment duration in weeks; (5) control group; (6) total sample size; (7) mean age of the sample with standard deviation or range; and (8) quality assessment.

Data collection process.

LAW extracted the data from the included studies with a data extraction sheet, PDW checked the extracted data. Disagreements were resolved by discussion. We contacted 14 authors through e-mail for additional data. Seven authors responded and provided the unpublished data. In one case, data was obtained via the author of an earlier meta-analysis where the study was included. One author had lost the data due to a hard drive failure. For the remaining five articles, the authors did not respond. All in all, six studies could not be included due to missing data.

Quality assessment

Quality was assessed with eight criteria, partly based on the criteria of the Cochrane collaboration [37] tailored for the included studies. (1) Was the randomization adequately described? (2) Were drop-out and reasons for drop-out properly described? (3) In case of drop-out, was an intention-to-treat analysis performed? (4) Were the professionals who delivered the intervention adequately qualified? (5) Was a power analysis carried out or were a total of at least 128 participants included (i.e., could the trial detect a moderate change according to a power analysis with Cohen’s d = .50, alpha = .05, power (1-beta) = .80)? (6) Was the treatment integrity checked? (7) Were the outcome measures at baseline assessed and study groups comparable? In the case of differences between groups, were adjustments made to correct for baseline imbalance? (8) Were inclusion/exclusion criteria described?

Each criterion was scored with 0 or 1. As certain criteria were not applicable to some studies, the percentage of items scored 1 across all applicable criteria was calculated. We classified study quality as lower (<40% quality index), intermediate (41–75%) or higher (>75%). For details, see Table in S1 Table. We included quality as a moderator in the moderator analysis, as we hypothesized that the effect size may differ between studies depending on the quality of the studies.

Data analysis

All analyses were completed with the program Comprehensive Meta-Analysis (CMA, version 2.2.064).

We used the random effects model and a 95% confidence interval with two-tailed tests.

Summary measures.

We expected considerable heterogeneity due to diverse intervention types and populations. Therefore, the meta-analysis was performed using a random effects model. If possible, outcomes from an intention-to-treat analysis were used. Samples for completers only were used when intention-to-treat samples were not provided. The primary outcome statistic was the standardized difference in means. For each study, between-group effect sizes were computed, using Cohen’s d. When Ryff’s PWBS were used, the six dimensions were joined in one outcome measure. Standard deviations were reconstructed from p-values or t- statistics when necessary. Lipsey’s rules for interpretation were used: small effect sizes range from 0 to 0.32, medium effect sizes range from 0.33 to 0.55 and large effect sizes are 0.56 or higher [38].

Heterogeneity.

To evaluate between-study variability, we tested for heterogeneity with the chi-squared test Cochran’s Q and I2 statistics, which quantifies the amount of variation in results across studies, beyond the expected chance. The heterogeneity analysis was performed with a random effect model, a 95% confidence interval and a two-tailed test.

Moderators.

Moderator analyses were conducted with the following moderators and categories: (1) target group: clinical (psychopathological or health problems) or non-clinical; (2) age of target group: adolescence/young adulthood (≤ 25 years), adulthood (26–55 years) or later life (≥55); (3) intervention type: self-help, individual face-to-face, or group face-to-face; (2) number of sessions: less (≤ 8 studies) or more (> 8 sessions); (5) instrument: PWBS or MHC-SF; (6) control group: not active (no treatment, waiting list, or care-as-usual) or active (placebo or alternative treatment); (7) quality: lower (<40%), intermediate (41% -75%) or higher quality (≥75%).

Publication bias.

The risk of publication bias was estimated using a funnel plot, the Egger’s test and a trim and fill analysis.

Follow-up assessment.

When available, between-group effect sizes (Cohen’s d) were computed for follow-up differences in psychological well-being.

Results

Study selection

Fig 1 summarizes the database hits, (reasons for) exclusion and final inclusion in a flow diagram. We found 2631 records from Web of Science (1151), the Cochrane Library (1026), and PsycINFO (454), and Reference lists searches added four studies and expert consultation two studies. After adjusting for duplicates, 2298 studies remained and were screened for title and abstract. Of these, 2150 were discarded as the studies did not meet the inclusion criteria. The full texts of the remaining 148 studies were assessed for eligibility. 121 studies did not meet the inclusion criteria. Finally, a total of 27 studies met the inclusion criteria and were included in the meta-analysis.

Study characteristics

The main characteristics of the studies are presented in Table 1. All 27 studies were RCTs published in peer-reviewed English journals. The studies were published between 1998 and 2014. The included studies involved 3579 participants. Sample size varied between 20 and 376 participants. Whereas 14 studies were conducted among non-clinical populations (e.g. employees, students), 13 studies used a clinical sample. The vast majority of the clinical samples had psychological disorders, mostly affective disorders. Only two studies used a population with physical complaints (i.e., hearing impairment [39] and chronic pain [40]). The mean age varied between 11 and 79 years. While 4 studies used adolescents or young adults, 18 studies examined adults, and 5 studies had a sample of older people. Interventions included well-being therapy, life review, positive psychology interventions, acceptance and commitment therapy, mindfulness interventions and identity interventions. Seven interventions were self-help (web-based or book), 6 were individually administered and 14 group-based. The duration of the interventions varied between 4 and 52 weeks. Whereas 15 studies had between four [41] and eight sessions, 10 studies had between 8 and 48 sessions [42]. Sixteen studies used the PWBS as outcome measure, 11 studies the MHC-SF. Six different versions of the PWBS were used, varying between 14 and 84 items. The control conditions included 16 non-active control groups (no intervention, waiting list, care-as-usual) and 13 active control groups (placebos such as relaxation sessions or alternative established interventions such as cognitive behavioral therapy). Nine studies were qualified as having a lower quality, 8 as intermediate and 10 as higher quality studies. Whereas 16 studies declared no conflict of interest [21, 22, 24, 39, 4151], the other 11 studies did not mention whether there was a conflict of interest.

thumbnail
Table 1. Main characteristics of studies included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0158092.t001

Results data analysis

Post-test effects.

The random effect model showed that the behavioral interventions had a moderate effect on psychological well-being (Cohen’s d = 0.44; z = 5.62; p < .001). The 95% confidence interval was between 0.29 and 0.59, with a standard error of 0.08. The forest plot in Fig 2 displays the post-test effects.

thumbnail
Fig 2. Forest plot for post-test effects of behavioral interventions on psychological well-being.

https://doi.org/10.1371/journal.pone.0158092.g002

Heterogeneity.

Effect sizes of studies ranged from 0.05 to 2.11. A heterogeneity analysis revealed significant heterogeneity (Q (26) = 134.12; p < .001). Heterogeneity was high (I2 = 80.62). Therefore, moderator analyses were performed.

Moderators.

Table 2 presents the findings of the moderator analyses. A systematic finding is that for 15 out of 17 categories, significant effects were found. No significant effects were found for age of target group, number of sessions, measurement instrument and control group. However, the strength of the effects differed for target group, intervention type and study quality. Interventions in clinical groups showed larger effects than those in non-clinical groups. Individual face-to-face interventions had stronger effects than self-help or group interventions. Studies of lower quality had higher effect sizes than studies of intermediate or higher quality. In a post-hoc analysis, we assessed whether the three significant moderating variables were interrelated among each other. There was no relation between target group and intervention type (χ2 = 1.1; df = 1; p = 0.587). Target group and study quality were related (χ2 = 9.4; df = 2; p = 0.009). Studies with clinical target groups had higher quality. The higher effects for clinical groups can thus not be attributed to a lower quality of studies. There was a significant relation between intervention type and quality of the study (χ2 = 14.1; df = 4; p = 0.007). Individual face-to-face interventions were more often assessed in studies with lower quality. Due to this contamination, it remains uncertain whether the intervention type or the quality of the study caused the higher effect sizes.

Publication bias.

There is no clear indication of publication bias. Visual inspection of the funnel plot suggested no evidence of publication bias, as the distribution is symmetrical. Egger’s regression intercept also suggests that there is no publication bias (intercept = 1.53; t = 1.31; df = 25; p = 0.20). Duval and Tweedie’s trim and fill analysis indicated that no studies needed to be filled or trimmed, which suggests that the effect size was not affected by publication bias.

Follow-up effects.

Twelve studies [21, 22, 40, 42, 44, 45, 4951, 55, 57, 61] examined follow-up effects after at least 2 months up to 10 months. Nine of these 12 studies examined the follow-up at 6 months. The random effect model showed small but significant effects for psychological well-being, compared with a control group (Cohen’s d = 0.22; z = 4,9; p<0.001). The 95% confidence interval was between 0.13 and 0.31, with a standard error of 0.045. Heterogeneity was low (Q (11) = 11.45; p<0.41; I2 = 3.89).

Discussion and Conclusion

Psychological well-being is increasingly used as an outcome in studies on behavioral interventions, besides measures of psychological complaints and psychopathological symptoms. Several studies reported evidence that psychological well-being can indeed be promoted through behavioral interventions. This is the first meta-analysis to assess their overall effect. A moderate effect size of 0.44 was found across studies for psychological well-being, with no indication for publication bias. Significant effects were found across the categories of the moderator variables, illustrating the systematic nature of the effects. In the follow-up assessment, the effect size was still significant, but small (0.22). This result has to be interpreted with caution as only 12 studies could be included in this analysis. It is important that future studies make use of follow-up measures to gain more insight in the longitudinal development of the effects of interventions on psychological well-being.

This study explicitly focused on psychological well-being as an integrated construct that builds on several psychological theories of the twentieth century. The effect size of psychological well-being is somewhat lower than the standardized mean difference of .61 that was reported in a meta-analysis by Sin and Lyubomirsky (11) and somewhat higher than the effect of .20 for psychological well-being in a meta-analysis by Bolier et al. [12]. These differences may be related to the fact that the first meta-analyses focused on subjective well-being whereas the second one included 10 different measures of psychological well-being in addition to the PWBS and MHC-SF, for example hope, mastery and purpose in life. This might demonstrate the importance of good definitions of well-being as different results may be obtained with instruments derived from different traditions. Furthermore, both previous meta-analyses focused on specific positive psychological interventions, whereas our study included a number of different therapeutic interventions. Because the interventions varied considerably, a reliable subgroup analysis was not possible. When sufficient studies will be published in the future, later meta-analyses could address differences between interventions, for example comparing positive psychological interventions, well-being therapy, acceptance and commitment therapy, and life review therapy. Despite the relatively high levels of stability of psychological well-being across time [19], these results show that it is possible to improve psychological well-being. Consequently, it might have more state-like characteristics, as a trait would be very hard to change, especially in a short period of time.

The heterogeneity was large with effects ranging from 0.05 [41] to 2.11 [52]. Although the statistical power is sufficient for the study in total, it is low for the moderator analyses [63]. Therefore, it is even more remarkable that we did find three significant moderators out of seven possible moderators. Effects were larger for clinical groups and in individual interventions. Interestingly, these moderators were also found significant in the meta-analyses of Sin and Lyubomirsky [11] and Bolier et al. [12]. The promotion of psychological well-being seem to be best suited for individuals who suffer from psychological or somatic complaints. One possible explanation is that clinical populations have more impaired levels of psychological well-being at the beginning of the intervention, indicating that there is more room for improvement. This finding is relevant because psychological well-being can be seen as an important component of recovery [64]. Higher levels of psychological well-being are associated with better physical health [15] and buffer against future disorders [16, 65], suggesting that people with higher levels are potentially more resilient [66, 67]. Furthermore, a personal approach with face-to-face contact appears to work better compared to self-help and group interventions. Yet interventions targeted at the general population or using self-help or group interventions showed smaller, but still significant effects. When such interventions have a large enough reach, they might also bring substantive public health gains [12].

For an interpretation of the results, it is important to be aware of possible limitations of the meta-analysis. First, one third of the studies had lower quality, whereas these studies also showed larger effects. However, the quality might have been underestimated, as it was scored conservatively: not reporting on the randomization procedures for example was rated as absence. Lower quality might also be attributed to the fact that new interventions were tested with pilot studies with a small number of participants. The larger effects of studies with lower quality might also contaminated with the finding that individual face-to-face interventions had higher effects. Future research needs RCTs with better quality, such as a larger number of participants based on a priori power analyses and longer follow-ups. Second, there are some limitations due to the search strategy. There was not sufficient data for six studies which met the inclusion criteria, limiting the completeness of the meta-analysis. The search strategy also may have been imperfect, as additional information sources revealed another six studies which were not found with the database search. Still, this possible limitation has been compensated by asking experts in the field and searching through reference lists of relevant articles and meta-analyses. We also excluded grey literature articles that were not peer-reviewed, which might have led to biased results. However, we did not find any indication of a publication bias. Another limitation is that the meta-analysis included highly heterogeneous studies; different outcomes may be due to factors such as different patient populations, protocol characteristics, and enrollment procedures [68, 69].

A broader point of discussion concerns the fact that the scales rely on self-reports. Self-reported well-being measures correlate with social desirability [70]. It would therefore be interesting to find new ways of measurements to assess aspects of psychological functioning in a more objective way, for example using biological markers or automatic behavioral analyses. Until the reliability and validity of such methods have been proven, the possible self-reporting biases should be kept in mind when interpreting results of meta-analyses such as the current one.

Despite the limitations, we conclude that psychological well-being can be significantly improved to a moderate extent. This is important evidence for the development and implementation of interventions and policies in the field of mental health promotion. Improvement of psychological well-being is especially successful in clinical populations. Based on this meta-analysis, individual face-to-face interventions can be considered as valuable option when developing interventions for an improved psychological well-being. There is a need for higher quality studies in this emerging field to be able to further underpin the promising results of this meta-analysis.

Acknowledgments

We want to thank Sanne Lamers and Linda Bolier for giving us an introduction to the program Central Meta-Analysis. We are grateful to Mirjam Irene Maas who made a start with her thesis and Pauline de With for helping with the data-search and other tasks that came up.

Author Contributions

Conceived and designed the experiments: LAW GJW ETB. Performed the experiments: LAW. Analyzed the data: LAW GJW. Wrote the paper: LAW GJW ETB.

References

  1. 1. Seligman ME, Csikszentmihalyi M. Positive psychology: An introduction: American Psychological Association; 2000.
  2. 2. Barry MM, Jenkins R. Implementing Mental Health Promotion. Oxford: Churchill Livingstone, Elsevier; 2007.
  3. 3. Keyes CLM. Promoting and protecting mental health as flourishing: A complementary strategy for improving national mental health Am Psychol 2007;62:95–108. pmid:17324035
  4. 4. World Health Organization. Promoting mental health: Concepts, emerging evidence, practice. Geneva: WHO, 2005.
  5. 5. Dodge R, Daly AP, Huyton J, Sanders LD. The challenge of defining wellbeing. International Journal of Wellbeing. 2012;2(3).
  6. 6. Diener E. Subjective well-being. Psychol Bull. 1984;95:542–74. pmid:6399758
  7. 7. Ryff CD, Singer B. Psychological well-being: Meaning, measurement, and implications for psychotherapy research. Psychother Psychosom. 1996;65(1):14–23. pmid:8838692
  8. 8. Ryan R, Deci E. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66. pmid:11148302
  9. 9. Hone L, Jarden A, Schofield G. An evaluation of positive psychology intervention effectiveness trials using the re-aim framework: A practice-friendly review. The Journal of Positive Psychology. 2015;10(4):303–22.
  10. 10. Ryff CD. Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Pers Soc Psychol. 1989;57(6):1069.
  11. 11. Sin N, Lyubomirsky S. Enhancing well-being and alleviating depressive symptoms with positive psychology interventions: a practice-friendly meta-analysis. J Clin Psychol. 2009;65:467–87. pmid:19301241
  12. 12. Bolier L, Haverman M, Westerhof G, Riper H, Smit F, Bohlmeijer E. Positive psychology interventions: a meta-analysis of randomized controlled studies. BMC Public Health. 2013;13(1):119.
  13. 13. Abbott RA, Ploubidis GB, Huppert FA, Kuh D, Wadsworth ME, Croudace TJ. Psychometric evaluation and predictive validity of Ryff's psychological well-being items in a UK birth cohort sample of women. Health and quality of life outcomes. 2006;4(1):1.
  14. 14. Disabato DJ, Goodman FR, Kashdan TB, Short JL, Jarden A. Different Types of Well-Being? A Cross-Cultural Examination of Hedonic and Eudaimonic Well-Being. 2015.
  15. 15. Ryff CD. Psychological well-being revisited: Advances in the science and practice of eudaimonia. Psychotherapy and Psychosomatics. 2014;83(1):10–28. 2013-41405-003. pmid:24281296
  16. 16. Lamers SM, Westerhof GJ, Glas CA, Bohlmeijer ET. The bidirectional relation between positive mental health and psychopathology in a longitudinal representative panel study. J Posit Psychol. 2015:1–8.
  17. 17. Keyes CL, Dhingra SS, Simoes EJ. Change in level of positive mental health as a predictor of future risk of mental illness. Am J Public Health. 2010;100(12):2366. pmid:20966364
  18. 18. Wood AM, Joseph S. The absence of positive psychological (eudemonic) well-being as a risk factor for depression: A ten year cohort study. J Affect Disord. 2010;122(3):213–7. pmid:19706357
  19. 19. Lamers SM, Glas CA, Westerhof GJ, Bohlmeijer ET. Longitudinal evaluation of the mental health continuum-short form (MHC-SF). European journal of psychological assessment. 2012.
  20. 20. Schimmack U, Krause P, Wagner GG, Schupp J. Stability and change of well being: An experimentally enhanced latent state-trait-error analysis. Social Indicators Research. 2010;95(1):19–31.
  21. 21. Fledderus M, Bohlmeijer ET, Smit F, Westerhof GJ. Mental health promotion as a new goal in public mental health care: a randomized controlled trial of an intervention enhancing psychological flexibility. Am J Public Health. 2010;100(12):2372. Epub 2010/10/23. pmid:20966360.
  22. 22. Korte J, Bohlmeijer ET, Cappeliez P, Smit F, Westerhof GJ. Life review therapy for older adults with moderate depressive symptomatology: a pragmatic randomized controlled trial. Psychol Med. 2012;42(6):1163. pmid:21995889
  23. 23. Fava GA, Rafanelli C, Cazzaro M, Conti S, Grandi S. Well-being therapy. A novel psychotherapeutic approach for residual symptoms of affective disorders. Psychol Med. 1998a;28(2):475–80. WOS:000073744100023.
  24. 24. Fava GA, Ruini C, Rafanelli C, Finos L, Salmaso L, Mangelli L, et al. Well-being therapy of generalized anxiety disorder. Psychother Psychosom. 2005;74(1):26–30. Epub 2005/01/04. pmid:15627853.
  25. 25. Hayes SC, Levin ME, Plumb-Vilardaga J, Villatte JL, Pistorello J. Acceptance and Commitment Therapy and Contextual Behavioral Science: Examining the Progress of a Distinctive Model of Behavioral and Cognitive Therapy. Behav Ther. 2013;44(2):180–98. pmid:23611068
  26. 26. Westerhof GJ, Bohlmeijer E, Webster JD. Reminiscence and mental health: A review of recent progress in theory, research and interventions. Agein Soc. 2010;30(04):697–721.
  27. 27. Lee Duckworth A, Steen TA, Seligman ME. Positive psychology in clinical practice. Annu Rev Clin Psychol. 2005;1:629–51. pmid:17716102
  28. 28. Bohlmeijer E, Roemer M, Cuijpers P, Smit F. The effects of reminiscence on psychological well-being in older adults: a meta-analysis. Aging Ment Health. 2007;11:291–300. pmid:17558580
  29. 29. Keyes CL, Wissing M, Potgieter JP, Temane M, Kruger A, van Rooy S. Evaluation of the mental health continuum—short form (MHC—SF) in setswana‐speaking South Africans. Clin Psychol Psychother. 2008;15(3):181–92. pmid:19115439
  30. 30. Keyes CL. The mental health continuum: From languishing to flourishing in life. J Health Soc Behav. 2002:207–22. pmid:12096700
  31. 31. Lamers S, Westerhof GJ, Bohlmeijer ET, ten Klooster PM, Keyes CL. Evaluating the psychometric properties of the mental health continuum‐short form (MHC‐SF). J Clin Psychol. 2011;67(1):99–110. pmid:20973032
  32. 32. Joshanloo M, Wissing MP, Khumalo IP, Lamers SM. Measurement invariance of the Mental Health Continuum-Short Form (MHC-SF) across three cultural groups. Pers Indiv Differ. 2013;55(7):755–9.
  33. 33. Ryff CD, Keyes CLM. The structure of psychological well-being revisited. J Pers Soc Psychol. 1995;69(4):719. pmid:7473027
  34. 34. Cheng ST, Chan AC. Measuring psychological well-being in the Chinese. Pers Indiv Differ. 2005;38(6):1307–16.
  35. 35. Abbott RA, Ploubidis GB, Huppert FA, Kuh D, Croudace TJ. An evaluation of the precision of measurement of Ryff’s Psychological Well-Being Scales in a population sample. Social Indicators Research. 2010;97(3):357–73. pmid:20543875
  36. 36. Altman DG. Practical statistics for medical research: CRC press; 1990.
  37. 37. Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj. 2011;343:d5928. pmid:22008217
  38. 38. Lipsey MW. Design sensitivity: Statistical power for experimental research. In: Bickman L, Rog DJ, editors. The SAGE handbook of applied social research methods. 2. Thousand Oaks: Sage Publications; 1990. p. 44–76.
  39. 39. Hickson L, Worrall L, Scarinci N. A Randomized Controlled Trial Evaluating the Active Communication Education Program for Older People with Hearing Impairment. Ear Hear 2007;8(2):212–30.
  40. 40. Trompetter HR, Bohlmeijer ET, Veehof MM, Schreurs KM. Internet-based guided self-help intervention for chronic pain based on Acceptance and Commitment Therapy: A randomized controlled trial. J Behav Med. 2014;38(1):66–80. pmid:24923259
  41. 41. Ruini C, Belaise C, Brombin C, Caffo E, Fava GA. Well-being therapy in school settings: a pilot study. Psychother Psychosom. 2006;75(6):331–6. Epub 2006/10/21. pmid:17053333.
  42. 42. Borness C, Proudfoot J, Crawford J, Valenzuela M. Putting brain training to the test in the workplace: a randomized, blinded, multisite, active-controlled trial. PloS One. 2013;8(3):e59982. pmid:23555855
  43. 43. Addley K, Boyd S, Kerr R, McQuillan P, Houdmont J, McCrory M. The impact of two workplace-based health risk appraisal interventions on employee lifestyle parameters, mental health and work ability: results of a randomized controlled trial. Health Educ Res. 2014;29 (2):247–58. pmid:24399261
  44. 44. Bolier L, Haverman M, Kramer J, Westerhof GJ, Riper H, Walburg JA, et al. An internet-based intervention to promote mental fitness for mildly depressed adults: randomized controlled trial. J Med Internet Res. 2013;15(9).
  45. 45. Bolier L, Ketelaar SM, Nieuwenhuijsen K, Smeets O, Gärtner FR, Sluiter JK. Workplace mental health promotion online to enhance well-being of nurses and allied health professionals: A cluster-randomized controlled trial. Internet Interv. 2014;1(4):196–204.
  46. 46. Fava GA, Rafanelli C, Cazzaro M, Conti S, Grandi S. Well-being therapy. A novel psychotherapeutic approach for residual symptoms of affective disorders. Psychol Med. 1998;28(02):475–80.
  47. 47. Fledderus M, Bohlmeijer E. T., Pieterse M. E., & Schreurs K. M. G.. Acceptance and commitment therapy as guided self-help for psychological distress and positive mental health: a randomized controlled trial. Psychol Med. 2012;42(3):485–95. pmid:21740624
  48. 48. Pots WT, Meulenbeek PA, Veehof MM, Klungers J, Bohlmeijer ET. The Efficacy of Mindfulness-Based Cognitive Therapy as a Public Mental Health Intervention for Adults with Mild to Moderate Depressive Symptomatology: A Randomized Controlled Trial. PloS One 2014;9(10):e109789. pmid:25333885
  49. 49. Ruini C, Ottolini F, Tomba E, Belaise C, Albieri E, Visani D, et al. School intervention for promoting psychological well-being in adolescence. J Behav Ther Exp Psychiatry. 2009;40(4):522–32. Epub 2009/08/18. pmid:19683703.
  50. 50. Stein KF, Corte C, Chen DGD, Nuliyalu U, Wing J. A Randomized Clinical Trial of an Identity Intervention Programme for Women with Eating Disorders. Eur Eat Disord Rev. 2013;21(2):130–42. pmid:23015537
  51. 51. Tomba E, Belaise C, Ottolini F, Ruini C, Bravi A, Albieri E, et al. Differential effects of well-being promoting and anxiety-management strategies in a non-clinical school setting. J Anxiety Disord. 2010;24(3):326–33. Epub 2010/02/26. pmid:20181456.
  52. 52. Afonso RM, Bueno B, Loureiro MJ, Pereira H. Reminiscence, psychological well-being, and ego integrity in Portuguese elderly people. Educ Geront. 2011;37(12):1063–80.
  53. 53. Bonthuys A. The effect of the Lifeplan® programme on the psychological well-being of a rural community in South Africa. J Psychol Afr. 2011;21(3):421–8.
  54. 54. Green LS, Oades LG, Grant AM. Cognitive-behavioral, solution-focused life coaching: Enhancing goal striving, well-being, and hope. J Posit Psychol. 2006;1(3):142–9.
  55. 55. Goldstein ED. Sacred moments: implications on well-being and stress. J Clin Psychol. 2007;63(10):1001–19. Epub 2007/09/11. pmid:17828765.
  56. 56. Josefsson T, Lindwall M, Broberg AG. The Effects of a Short-term Mindfulness Based Intervention on Self-reported Mindfulness, Decentering, Executive Attention, Psychological Health, and Coping Style: Examining Unique Mindfulness Effects and Mediators. Mindfulness. 2014;5(1):18–35. WOS:000339617700003.
  57. 57. Lamers SM, Bohlmeijer ET, Korte J, Westerhof GJ. The efficacy of life-review as online-guided self-help for adults: A randomized trial. J Gerontol B Psychol Sci Soc Sc. 2014:gbu030.
  58. 58. Lee WK, Bang HJ. The effects of mindfulness-based group intervention on the mental health of middle-aged Korean women in community. Stress Health. 2010;26(4):341–8.
  59. 59. Meca A, Eichas K, Quintana S, Maximin BM, Ritchie RA, Madrazo VL, et al. Reducing identity distress: Results of an identity intervention for emerging adults. Identity. 2014;14(4):312–31.
  60. 60. Meléndez Moral JC, Ruiz LC, Mayordomo T, Galán AS. Effects of a reminiscence program among institutionalized elderly adults. Psicothema. 2013;25(3):319–23. pmid:23910745
  61. 61. Page KM, Vella-Brodrick DA. The working for wellness program: RCT of an employee well-being intervention. J Happiness Stud. 2013;14(3):1007–31.
  62. 62. Spence GB, Grant AM. Professional and peer life coaching and the enhancement of goal striving and well-being: An exploratory study. J Posit Psychol. 2007;2(3):185–94.
  63. 63. Cafri G, Kromrey JD, Brannick MT. A meta-meta-analysis: Empirical review of statistical power, type I error rates, effect sizes, and model selection of meta-analyses published in psychology. Multivariate Behav Res/. 2010;45(2):239–70.
  64. 64. Fava G. The concept of recovery in affective disorders. Psychother Psychosom. 1996;65(1):2–13. pmid:8838691
  65. 65. Grant F, Guille C, Sen S. Well-being and the risk of depression under stress. PloS One. 2013;8(7):e67395. pmid:23840872
  66. 66. Ryff CD, Love GD, Essex MJ, Singer B. Resilience in adulthood and later life. Handbook of aging and mental health: Springer; 1998. p. 69–96.
  67. 67. Fava GA, Tomba E. Increasing Psychological Well‐Being and Resilience by Psychotherapeutic Methods. Eur J Pers. 2009;77(6):1903–34.
  68. 68. Jane-Wit D, Horwitz RI, Concato J. Variation in results from randomized, controlled trials: stochastic or systematic? Journal of clinical epidemiology. 2010;63(1):56–63. Epub 2009/09/11. pmid:19740624.
  69. 69. Fava GA, Guidi J, Rafanelli C, Sonino N. The Clinical Inadequacy of Evidence-Based Medicine and the Need for a Conceptual Framework Based on Clinical Judgment. Psychother Psychosom. 2015;84(1):1–3. pmid:25547189
  70. 70. Migdal L, MacDonald DA. Clarifying the relation between spirituality and well-being. The Journal of nervous and mental disease. 2013;201(4):274–80. pmid:23538971