Figures
Abstract
Subclinical psychotic experiences at the level of the general population are common, forming an extended psychosis phenotype with clinical psychosis. Persistence of subclinical experiences is associated with transition to later mental disorder. Increased daily life stress reactivity is considered an endophenotype for psychotic disorders. We examined, in a longitudinal framework, whether baseline momentary assessment markers of stress reactivity would predict persistence of subclinical psychotic experiences over time. In a general population sample of female twins (N = 566), the Experience Sampling Method (ESM; repetitive random sampling of momentary emotions, psychotic experiences and context) was used to assess (emotional and psychotic) daily life stress reactivity. Persistence of subclinical psychotic experiences was based on the Community Assessment of Psychic Experiences (CAPE), assessed three times over 14 months post-baseline. It was investigated whether baseline daily life emotional and psychotic stress reactivity predicted persistence of psychotic experiences over time. Higher levels of emotional stress reactivity (a decrease in positive and an increase in negative affect in response to stress), and increased psychotic reactivity to daily stress was found in individuals with persistent psychotic experiences over time compared to individuals with transient psychotic experiences. The results suggest that markers of daily life stress reactivity may predict “macro-level” persistence of normally transient expression of psychotic liability over time. Linking daily life markers of altered reactivity in terms of emotions and psychotic experiences to longitudinal persistence of psychotic experiences, associated with increased risk of transition to overt mental disorder, may contribute to earlier and more accurate diagnosis of risk.
Citation: Collip D, Wigman JTW, Myin-Germeys I, Jacobs N, Derom C, Thiery E, et al. (2013) From Epidemiology to Daily Life: Linking Daily Life Stress Reactivity to Persistence of Psychotic Experiences in a Longitudinal General Population Study. PLoS ONE 8(4): e62688. https://doi.org/10.1371/journal.pone.0062688
Editor: Peter W. Halligan, University of Cardiff, United Kingdom
Received: October 3, 2012; Accepted: March 24, 2013; Published: April 23, 2013
Copyright: © 2013 Collip et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by the Netherlands Organisation for scientific Research; the Fund for Scientific Research, Flanders and Twins, a nonprofit association for scientific research in multiple births (Belgium) (to the East Flanders Prospective Survey). DC was supported by a Kootstra talent fellowship (Maastricht University). MW was supported by the Netherlands Organisation for Scientific Research (VENI grant nr. 916.76.147) and by ZON-MW (grant nr. 171001002). IM-G was supported by a 006NARSAD Young Investigator Award and by the Netherlands Organisation for Scientific Research (VIDI grant nr. 917.76.341). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Psychiatric research is complementing its previous focus on categorical, heterogeneous disease entities with dimensional approaches towards psychopathology. For example, there is evidence that subclinical psychotic experiences at the level of the general population are common, and represent an extended psychosis phenotype outside the boundaries of clinical disorder [1]. Psychotic experiences may be considered truly dimensional, extending across most mental disorders including common mental disorder [2], in which they impact negatively on course and outcome, as well as occasioning a more “schizophrenia-like” risk factor profile [3]. In fact, the majority of individuals who report psychotic experiences present with other mental disorders, particularly depression or anxiety disorders [3], [4]. In the general population, psychotic experiences predict later psychotic and, to a lesser extent, affective disorders [5], even when not considered clinically relevant [6] and particularly when persistent [7], [8].
High levels and persistence of psychotic experiences is influenced by both environmental and genetic factors [9], [10]. One hypothesis is that persistence of subclinical psychotic experiences reflects the behavioral expression of stress sensitization [11], [12]. Sensitization refers to the phenomenon that the response to an environmental risk factor increases in intensity with repeated exposure to this risk factor. Eventually, this may lead to a lasting change in response amplitude [11], [12]. It is hypothesized that indicators of early behavioral sensitization precedes persistence of psychotic symptoms.
Earlier work has shown that markers of (behavioral) sensitization can be identified at the level of everyday life experience. For example, in patients with clinical psychotic disorder [13] and in their siblings [14], increased stress reactivity, in the form of both emotional and psychotic reactivity to daily hassles, has been reported. Given that daily life stress reactivity is considered a marker of sensitization, and that the process of sensitization is thought to mediate the expression of psychosis, it is attractive to hypothesize, in a longitudinal framework, that baseline daily reactivity to stress (assessed with momentary assessment technology in daily life) predicts persistence of subclinical psychotic experiences, which can be considered a measure of psychometric psychosis risk. Linking daily life markers of stress reactivity to longitudinal persistence of psychotic experiences and increased risk of transition to overt mental disorder allows for earlier and more accurate diagnosis of risk and might moreover have important implications for (very)early intervention and risk reduction [15].
In a longitudinal study of young adult female twins from the general population, we examined the following questions:
- Do individuals with stable high levels (i.e. persistence) of subclinical psychotic experiences over time (macro-level) at baseline show increased emotional stress reactivity in daily life (micro-level) compared to those with stable low levels of psychosis?
- Do individuals with stable high levels (i.e. persistence) of subclinical psychotic experiences over time (macro-level) at baseline show increased psychotic stress reactivity in daily life (micro-level) compared to those with stable low levels of psychosis?
We hypothesized that stable high levels (i.e. persistence) of subclinical psychotic experiences would be associated with increased emotional and psychotic reactivity to stress in daily life at baseline.
Methods
Sample
This study forms part of a general population twin study that investigates gene – environment interactions in vulnerability for mental disorders, as described previously [16], [17]. Given that genetic effects on psychopathology are likely sex-specific to a degree, only women were included in the original study, meaning that the current analyses pertain to women only. Participants (twins) were recruited from the East-Flanders Prospective Twin Survey, a population-based survey that has prospectively recorded all multiple births in the province of East Flanders since 1964 [16], [17]. Originally, the sample included 621 subjects (575 twins and 46 of their non-twin sisters). The 46 non-twin sisters were excluded, as well as three subjects with missing zygosity and six subjects who participated without their twin. Thirty-seven individuals did not participate in the ESM study or were excluded because they had missing or too few valid ESM self reports. The final sample thus consisted of 529 subjects (323 individuals were monozygotic, and 206 were dizygotic twins), with mean age 27.2 years (SD 7.4; range 18–46). Participants were interviewed five times (T0–T4) at approximately 3- to 4-monthly intervals. Participants were white and of Belgian origin. Sixty-two percent had a higher education, 36% had followed higher secondary school, and 2% had finished primary school only and the majority was employed (62%) and in a relationship (76%). There were five measurement points, including a baseline (T0) and four follow-up measurements (T1–T4). The average number of days between T0 and T1 was 132, 91 between T1 and T2, 116 between T2 and T3, and 91 between T3 and T4. Baseline measurements were carried out at individuals' homes, and follow-up measurements were collected using questionnaires and telephone interviews. All interviews were performed by trained research psychologists or graduate psychological assistants. The study was approved by the ethics committee of the Maastricht University Medical Centre and all participants provided written informed consent after receiving complete description of the study.
Instruments
The positive item scale of the Community Assessment of Psychic Experiences (CAPE) (20 self-reported items) was used to assess subclinical psychotic experiences [18]. The CAPE is based on the Peters Delusions Inventory (PDI), modified to also include hallucinatory experiences [19]. Each item in the CAPE rates two aspects of subclinical psychotic experiences: (i) frequency and (ii) associated distress, both rated on a four-point scale of never/not distressed (1); sometimes/a bit distressed (2); often/quite distressed (3); nearly always/very distressed (4). The CAPE was assessed at T0, T2, and T4. The frequency items showed good internal consistency (Cronbach's alpha >0.96 at all three measurements). Standardized sum scores of the positive items subscale were used as indicators for the growth model.
The Structured Clinical Interview for DSM-IV Axis I disorders (SCID) was administered at T0 (and T4). To measure baseline psychotic symptoms, the sum score of the subscales delusions (consisting of 15 items) and hallucinations (consisting of eight items) of the SCID was used.
Trajectories
In a previous paper, growth mixture modeling was used to identify two different developmental trajectories of the CAPE items, assessed at the three time points of the Flanders twin study [20]. These developmental trajectories represent different courses of subclinical psychotic experiences over time. Two differential subgroups were found: a larger group (N = 467; 88% of the current sample; in original sample N = 496) with a persistently low (subclinical) expression of psychosis (referred to as Low group) and a smaller group (N = 62; 12% of the current sample; in original sample N = 70) with a persistently high (subclinical) expression of psychosis (referred to as Persistent group). These two groups can be interpreted as representing different levels of vulnerability for psychosis, since they were differentially associated with psychopathology, risk factors for psychosis and functioning (for more details see Wigman et al., 2011) [20].
Experience Sampling Method (ESM)
The Experience Sampling Method (ESM) is a random time-sampling self-assessment technique that has been shown to be feasible, valid, and reliable in general and patient populations [21], [22]. ESM data were collected at baseline (T0). Subjects received a digital wristwatch that emitted a signal ten times a day on five consecutive days, at unpredictable moments between 7:30 a.m. and 10:30 p.m. After each ‘beep’, subjects completed ESM self-assessment forms concerning current context, thoughts, emotions, and psychotic experiences. Subjects were instructed to complete their reports immediately after the beep, thus minimizing memory distortions. Reports were considered valid when subjects responded within 15 minutes after the beep, as determined by comparing the actual beep time with the reported time of completion. For inclusion in the analyses, participants had to have provided valid responses to at least one-third of the emitted beeps [23].
ESM measures
Event stress.
Event stress was conceptualized in terms of subjective appraisals of events and minor disturbances that continually occur in the natural flow of daily life. After each beep, participants were asked to report the most important event that had happened between the current and the previous report and then to rate this event on a 7-point, bipolar Likert scale (−3 = very unpleasant, 0 = neutral, 3 = very pleasant). For the current analyses, all positive responses were recoded as 0, and the negative responses were recoded so that high scores reflect more unpleasant and potentially stressful events (0 = neutral, 3 = very unpleasant) [24].
Activity stress.
For activity-related stress, participants rated their current activity on three self-report items scored on 7 point Likert scales, namely “I am not skilled to do this activity”, “I would rather do something else” and “This activity requires effort”. The mean of these items represented the activity-related stress scale (alpha = .50).
Social stress.
Social stress was measured by asking subjects whether they were alone at the time of the beep. If not alone, they were asked whether they liked the company they were in at that moment. This was rated on a 7-point Likert scale. The scale was reversed so that higher scores represent higher disliking of being in that company.
Paranoid ideation.
Paranoid ideation was assessed with the ESM item “I feel suspicious” rated on a 7-point Likert scales (1 = not at all to 7 = very) [25].
Negative affect.
Negative affect (NA) was assessed as the mean score on 5 ESM items, rated on 7-point Likert scales (1 = not at all to 7 = very): “I feel insecure”, “I feel lonely”, “I feel anxious”, “I feel down” and “I feel guilty” (alpha = 0.73) [26].
Positive affect.
Positive affect (PA) was assessed as the mean score on 4 ESM items, rated on 7-point Likert scales (1 = not at all to 7 = very): “I feel happy”, “I feel cheerful”, “I feel relaxed” and “I feel satisfied” (alpha = 0.86) [26].
Statistical analyses
Main Analyses.
Momentary ESM data were analysed using multilevel linear regression techniques, which take the hierarchical structure of the data (repeated measurements clustered in persons) into account. In addition, the sample consisted of twin pairs, resulting in a further level of clustering. Thus, in the current study, repeated momentary measurements (level 1) were clustered within subjects (level 2), some of whom were members of the same twin pair (level 3). Data were analyzed using the XTMIXED multilevel random regression routine in STATA 11.0 [27], providing non-standardized regression coefficients of the predictors in the multilevel model (b-values). When significant interactions were found, stratified effect sizes were calculated in order to clarify group differences, using the STATA LINCOM command to calculate the appropriate linear combinations from the model containing the interaction.
Descriptives.
ANOVAs (for continuous variables) and Chi-square (for categorical variables) tests were conducted to investigate group differences in demographic characteristics and ESM variables.
Emotional stress reactivity.
To investigate whether stress (activity, event, social) elicited differential emotional reactions in the two groups, two multilevel analysis was conducted with (a) NA and (b) PA as the dependent variables and group (low versus persistent), (event, social, activity) stress and their interaction as the independent variables [26].
Psychotic stress reactivity.
To investigate whether stress (activity, event, social) elicited differential psychotic reactions in the two groups, a multilevel analysis was conducted with paranoid ideation as the dependent variable and group (low versus persistent), (event, social, activity) stress and their interaction as the independent variables [28].
Results
Sample characteristics
The final sample included 529 participants, of whom 62 (12%) were in the persistent group and 467 (88% of the sample) in the low psychosis group, who completed a total of 21270 valid ESM observations (mean = 38.40, SD = 6.56). The groups did not differ in mean number of ESM reports (low group: mean (SD) = 37.05 (6.92); persistent group: 36.58 (5.87); F = 0.26, p = 0.61). The two groups did not differ in age (F(1, 525) = 0.55, p = 0.46, marital status (χ2 (1) = 0.06, p = 0.80, and educational level (χ2 (3) = 1.29, p = 0.73). Group differences on ESM variables are summarized in Table 1.
Emotional stress reactivity
Multilevel linear regression analysis revealed significant interactions between group and all three stressors in the models predicting NA (event: b = .09; 95%CI .05, .12, p<0.001; χ2 (1) = 21.54; activity: b = .06; 95%CI .04, .08, p = 0.000; χ2 (1) = 42.4; p = 0.0000; social: b = .05; 95%CI .03, .07, p<0.001; χ2 (1) = 21.49; p<0.001). For all stressors, stratified analyses showed a significantly greater increase in NA following stress in the Persistent group compared to the Low group (Figure 1).
Multilevel linear regression analysis revealed a significant interaction between group and activity stress in the model predicting PA (b = −.04; 95%CI −.07, −.01, p = 0.02; χ2 (1) = 5.08), however not in the models with event stress and social stress predicting PA (event: b = −.02; 95%CI −.11, .007, p = 0.62; χ2 (1) = 0.25; social: b = −.03; 95%CI −.07, .01, p = 0.10; χ2 (1) = 2.65). For activity stress, stratified analyses showed a significantly stronger decrease in PA following stress in the Persistent compared to the Low group (Figure 1).
Psychotic reactivity
Multilevel analyses revealed a significant interaction between activity stress and group in the model of momentary paranoid ideation (b = .04; 95%CI .02, .06, p<0.001; χ2 (1) = 13.83). The Persistence group (b = .07; 95%CI .06, .09, p<0.001) reported significantly more momentary paranoid ideation when experiencing stressful activities compared to the Low group (b = .04; 95%CI .03, .04, p<0.001) (see Figure 2).
No significant interaction was apparent between group and event stress in the model of momentary paranoid ideation (b = .02; 95%CI −.02, .06, p = 0.33; χ2 (1) = 0.95). Similarly, there was no significant interaction between group status and social stress in the model of momentary paranoid ideation (b = .00; 95%CI −.02, .03, p = 0.70; χ2 (1) = 0.15).
Sensitivity analyses – baseline psychopathology
Additional analyses were carried out, investigating whether baseline psychosis psychopathology influenced the results. All analyses were repeated with both exclusion of participants who reported delusions or hallucinations at baseline (low group n = 419 and persistent group n = 46 remained in the analyses) and controlling for baseline psychosis CAPE scores. Apart from some small effect size alterations, all results remained comparable (data not shown, available upon request).
Discussion
The current study shows that sensitivity to daily life stress is associated with stable high levels of psychotic experiences over time. Although a causal relationship cannot be established, more stress reactivity may predict more persistence of psychosis over time. Thus, sensitivity at the micro-level is associated with persistence of psychotic experiences at the macro-level. More specifically, higher levels of emotional sensitivity (i.e. less expression of positive and more expression of negative affect in response to stress), and psychotic reactivity to daily stress were found in individuals with persistent subclinical psychotic experiences compared to individuals with persistently low levels of psychotic experiences.
Individuals with persistent subclinical psychotic experiences were more emotionally responsive to all types of daily stressors (event, social and activity stress). This was more consistently found in models of NA reactivity compared to PA reactivity. Earlier ESM studies have found increased emotional stress reactivity in patients with psychotic disorders [13]. The current results extend these findings further to the subclinical expression of liability to psychosis at the level of the general population, i.e. before individuals develop any need for care. Higher levels of reactivity to stress in individuals with persistent psychotic experiences possibly may reflect early signs of sensitization. Thus, sensitization may be the mechanism underlying increased liability to develop, first, incidental and, second, persistent psychotic experiences, which in turn may be predictive of development of psychotic disorder [5]. The results suggest that the persistence of normally transient expression of psychotic experiences at macro-level may be traced back to baseline micro-level stress reactivity in daily life (Figure 3).
The findings indicate that individuals who are more responsive to stress are more likely to pertain to a group of individuals with persistently high levels of psychotic experiences. One important factor underlying these findings may be type and amount of coping. Thus, individuals who are liable to develop psychosis are more likely to (i) be more sensitive to stress [29] and to (ii) display dysfunctional coping [30],[31]. Given that coping is modifiable using the principles of cognitive behavioral therapy, future work may examine the relevance of coping in the earliest trajectories of psychosis expression [32]. Following from this, an important implication of our findings is the potential for (very) early recognition of risk and, possibly, risk reduction [15]. Strategies like these could bring about increased awareness of an individual's tendency of experiencing daily hassles unusually stressful, with the possibility of risk reduction preventing further progression of sensitization and a vicious cycle of increasing psychopathology.
An innovative aspect of the study is that it introduces a multilevel approach, linking different levels of manifestation of psychosis liability, namely “micro-level” daily life interactions and “macro-level” psycho(patho)logical experiences. This may represent an important step forward in complementing the current, diagnosis-oriented approach in psychiatry. Moreover, the results are in line with earlier propositions that liability to develop psychosis is distributed in the general population [1], and furthermore suggest that increased liability is reflected in part in heightened sensitivity in the form of emotional and psychotic response to environmental change. Taken together, the results suggest that epidemiology could significantly benefit from a stronger focus on daily life.
The results of the current study should be interpreted in the light of its strengths and limitations. First, use of ESM booklets instead of electronic devices means that the exact timing of participants' self-reports cannot be established with 100% certainty [33]. However, results of a study comparing self-reported and electronically monitored collection times, with the same intensive, semi-random time-sampling protocol used in the current study, indicated that self-reported collection times corresponded well with the electronic time-stamps [34]. Another comparative study concluded that paper and electronic diaries yield similar results [35]. Since both the ESM data collection and the first assessment of the CAPE were carried out at the same baseline measurement point, our data cannot be interpreted as showing that emotional/psychotic reactivity really “predicts” persistence. Rather, from the temporal perspective of the statistical model with baseline ESM data as dependent variable, we showed that those with stable high levels of psychotic experiences tended to be more emotionally and psychotically reactive to stress than those with stable low levels of psychotic experiences. The distinction between the groups is based on non-presence versus presence and/or persistence of presence of high levels of psychotic experiences. It cannot be ruled out that persistence of psychotic experiences was already present before the onset of the study, meaning that causality from daily life interactions to symptom persistence cannot be directly inferred. More prospective research is needed to unravel this causal chain over time. Moreover, it should be mentioned that in this sample we could only identify two developmental trajectories of psychotic symptoms; more dynamic developmental trajectories (i.e. increasing and/or decreasing), that were identified in earlier studies were not present. This may be due to the age range of the current sample, which was older than samples in earlier studies. Therefore, dynamic changes in psychotic symptoms may already have been stabilized. It should moreover be mentioned, that only one ESM item was used to measure subclinical daily life psychotic experiences. However, as this study constitutes a general population study, ESM items were chosen to capture subclinical psychotic phenomena with enough momentary variation. The ESM item referring to paranoia was the only ESM item on psychotic phenomena that was included in the study. The current study also had some specific strengths. In particular, the repeated sampling of daily experiences and interactions over 5 days takes into account daily variation of psychological phenomena, providing an ecologically valid picture of a person's psychological functioning. Multiple measures per person were complemented by a relatively large number of participants. Use of multilevel modeling allowed assessment of within-person associations between stress and subjective experiences in real time and real-life contexts. Such intensive sampling offers the possibility to detect subtle deviation of emotional or psychotic reactivity at the micro-level that might easily be missed when testing at the macro-level and that may be especially important in the subclinical ranges of the extended psychosis continuum, when the very first expression of (liability for) psychosis may become manifest. The approach of the current study offers an exciting angle to link different levels of manifestation of psychosis liability; future research should focus on replication of the findings and on their extension to other ranges of the extended psychosis continuum.
Author Contributions
Responsible for trial design and contributed to data collection: ET NJ JvO CD. Contributed to interpretation of the analyses: MW IM-G. Conducted statistical analyses and were involved in data interpretation: DC JW. Performed the experiments: NJ JvO CD ET. Analyzed the data: DC JW MW JvO. Contributed reagents/materials/analysis tools: MW JvO. Wrote the paper: DC JW MW NJ JvO CD ET IM-G.
References
- 1. van Os J, Linscott RJ, Myin-Germeys I, Delespaul P, Krabbendam L (2009) A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness-persistence-impairment model of psychotic disorder. Psychol Med 39: 179–195.
- 2. Van Os J, Hanssen M, Bijl R, Ravelli A (2000) Straus (1969) revisited: A psychosis continuum in the general population? Schizophr Res 45: 11–20.
- 3. Wigman JTW, van Nierop M, Vollebergh WAM, Lieb R, Beesdo-Baum K, et al. (2012) Evidence That Psychotic Symptoms Are Prevalent in Disorders of Anxiety and Depression, Impacting on Illness Onset, Risk, and Severity – Implications for Diagnosis and Ultra–High Risk Research. Schizophr Bull 38: 247–257.
- 4. Yung AR, Buckby JA, Cotton SM, Cosgrave EM, Killackey EJ, et al. (2006) Psychotic-like experiences in nonpsychotic help-seekers: associations with distress, depression, and disability. Schizophr Bull 32: 352–359.
- 5. Kaymaz N, Drukker M, Lieb R, Wittchen HU, Werbeloff N, et al. (2012) Do subthreshold psychotic experiences predict clinical outcomes in unselected non-help-seeking population-based samples? A systematic review and meta-analysis, enriched with new results. Psychol Med 1: 1–15.
- 6. van Nierop M, van Os J, Gunther N, Myin-Germeys I, de Graaf R, et al. (2012) Phenotypically continuous with clinical psychosis, discontinuous in need for care: evidence for an extended psychosis phenotype. Schizophr Bull 38: 231–238.
- 7. Cougnard A, Marcelis M, Myin-Germeys I, De Graaf R, Vollebergh W, et al. (2007) Does normal developmental expression of psychosis combine with environmental risk to cause persistence of psychosis? A psychosis proneness-persistence model. Psychol Med 37: 513–527.
- 8. Dominguez MD, Wichers M, Lieb R, Wittchen HU, van Os J (2011) Evidence that onset of clinical psychosis is an outcome of progressively more persistent subclinical psychotic experiences: an 8-year cohort study. Schizophr Bull 37: 84–93.
- 9. Wigman J, van Winkel R, Raaijmakers Q, Ormel J, Verhulst F, et al. (2011) Evidence for a persistent, environment-dependent and deteriorating subtype of subclinical psychotic experiences: a 6-year longitudinal general population study. Psychol Med 1: 1–13.
- 10. Mackie C, Castellanos-Ryan N, Conrod P (2011) Developmental trajectories of psychotic-like experiences across adolescence: impact of victimization and substance use. Psychol Med 41: 47–58.
- 11. Collip D, Myin-Germeys I, Van Os J (2008) Does the concept of “sensitization” provide a plausible mechanism for the putative link between the environment and schizophrenia? Schizophr Bull 34: 220–225.
- 12. Yuii K, Suzuki M, Kurachi M (2007) Stress sensitization in schizophrenia. New York Academy of Sciences 1113: 276–290.
- 13. Myin-Germeys I, van Os J (2007) Stress-reactivity in psychosis: evidence for an affective pathway to psychosis. Clin Psychol Rev 27: 409–424.
- 14. Lataster T, Collip D, Lardinois M, van Os J, Myin-Germeys I (2010) Evidence for a familial correlation between increased reactivity to stress and positive psychotic symptoms. Acta Psychiatr Scand 122: 395–404.
- 15. McGorry PD, McFarlane C, Patton GC, Bell R, Hibbert ME, et al. (1995) The prevalence of prodromal features of schizophrenia in adolescence: a preliminary survey. Acta Psychiatr Scand 92: 241–249.
- 16. Jacobs N, Rijsdijk F, Derom C, Vlietinck R, Delespaul P, et al. (2006) Genes making one feel blue in the flow of daily life: a momentary assessment study of gene-stress interaction. Psychosom Med 68: 201–206.
- 17. Derom CA, Vlietinck RF, Thiery EW, Leroy FOG, Fryns JP, et al. (2006) The east flanders prospective twin survey (EFPTS). Twin research and human genetics 9: 733–738.
- 18. Konings M, Bak M, Hanssen M, van Os J, Krabbendam L (2006) Validity and reliability of the CAPE: a self-report instrument for the measurement of psychotic experiences in the general population. Acta Psychiatr Scand 114: 55–61.
- 19. Peters ER, Joseph SA, Garety PA (1999) Measurement of delusional ideation in the normal population: introducing the PDI (Peters, et al. Delusions Inventory). Schizophr Bull 25: 553–576.
- 20. Wigman JTW, van Winkel R, Jacobs N, Wichers M, Derom C, et al. (2011) A twin study of genetic and environmental determinants of abnormal persistence of psychotic experiences in young adulthood. Am J Med Genet B Neuropsychiatr Genet. 156B(5): 546–52.
- 21. Csikszentmihalyi M, Larson R (1987) Validity and reliability of the Experience-Sampling Method. Journal of Nervous and Mental Disease 175: 526–536.
- 22.
Myin-Germeys I, Oorschot M, Collip D, Lataster J, Delespaul P, et al.. (2009) Experience sampling research in psychopathology: opening the black box of daily life. Psychol Med: 1–15.
- 23. Delespaul P, deVries M, van Os J (2002) Determinants of occurrence and recovery from hallucinations in daily life. Social Psychiatry and Psychiatric Epidemiology 37: 97–104.
- 24. Jacobs N, Myin-Germeys I, Derom C, Delespaul P, van Os J, et al. (2007) A momentary assessment study of the relationship between affective and adrenocortical stress responses in daily life. Biol Psychology 74: 60–66.
- 25. Simons CJ, Wichers M, Derom C, Thiery E, Myin-Germeys I, et al. (2009) Subtle gene-environment interactions driving paranoia in daily life. Genes Brain Behav 8: 5–12.
- 26. Myin-Germeys I, van Os J, Schwartz JE, Stone AA, Delespaul PA (2001) Emotional reactivity to daily life stress in psychosis. Arch Gen Psychiatry 58: 1137–1144.
- 27.
StataCorp (2009) STATA/SE statistical software, release 11. Texas: College Station.
- 28. Myin-Germeys I, Delespaul P, van Os J (2005) Behavioural sensitization to daily life stress in psychosis. Psychol Med 35: 733–741.
- 29. Collip D, Nicolson N, Lardinois M, Lataster T, van Os J, et al. (2011) Daily cortisol, stress reactivity and psychotic experiences in individuals at above average genetic risk for psychosis. Psychol Med 41: 2305–2315.
- 30. Phillips LJ, Francey SM, Edwards J, McMurray N (2009) Strategies used by psychotic individuals to cope with life stress and symptoms of illness: a systematic review. Anxiety, Stress, & Coping 22: 371–410.
- 31. Lin A, Wigman J, Nelson B, Vollebergh W, van Os J, et al. (2011) The relationship between coping and subclinical psychotic experiences in adolescents from the general population–a longitudinal study. Psychol Med 41: 2535–2546.
- 32. Sarin F, Wallin L, Widerlöv B (2011) Cognitive behavior therapy for schizophrenia: A meta-analytical review of randomized controlled trials. Nordic Journal of Psychiatry 65: 162–174.
- 33. Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR (2002) Patient non-compliance with paper diaries. Bmj 324: 1193–1194.
- 34. Jacobs N, Nicolson NA, Derom C, Delespaul P, van Os J, et al. (2005) Electronic monitoring of salivary cortisol sampling compliance in daily life. Life Sci 76: 2431–2443.
- 35. Green AS, Rafaeli E, Bolger N, Shrout PE, Reis HT (2006) Paper or plastic? Data equivalence in paper and electronic diaries. Psychol Methods 11: 87–105.