https://orcid.org/0000-0001-7091-2249
Figures
Abstract
Background
There is increasing interest in studying psychotic symptoms in non-clinical populations, with the Community Assessment of Psychic Experiences-Positive scale (CAPE-P15) being one of the self-screening questionnaires used most commonly for this purpose. Further research is needed to evaluate the ability of the scale to accurately identify and classify positive psychotic experiences (PE) in the general population.
Aim
To provide psychometric evidence about the accuracy of the CAPE-P15 for detecting PE in a sample of Chilean adolescents from the general population and classifying them according to their PE severity levels.
Method
We administered the CAPE-P15 to a general sample of 1594 students aged 12 to 19. Based on Item Response Theory (IRT), we tested the accuracy of the instrument using two main parameters: difficulty and discrimination power of the 15 items.
Results
We found that the scale provides very accurate information about PE, particularly for high PE levels. The items with the highest capability to determine the presence of the latent trait were those assessing perceptual anomalies (auditory and visual hallucinations), bizarre experiences (a double has taken the place of others; being controlled by external forces), and persecutory ideation (conspiracy against me).
Conclusions
The CAPE-P15 is an accurate and suitable tool to screen PE and to accurately classify and differentiate PE levels in adolescents from the general population. Further research is needed to better understand how maladaptive psychological mechanisms influence relationships between PE and suicidal ideation (SI) in the general population.
Citation: Núñez D, Godoy MI, Gaete J, Faúndez MJ, Campos S, Fresno A, et al. (2021) The Community Assessment of Psychic Experiences-Positive scale (CAPE-P15) accurately classifies and differentiates psychotic experience levels in adolescents from the general population. PLoS ONE 16(8): e0256686. https://doi.org/10.1371/journal.pone.0256686
Editor: Christine Mohr, University of Lausanne, SWITZERLAND
Received: November 5, 2020; Accepted: August 12, 2021; Published: August 26, 2021
Copyright: © 2021 Núñez et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting information files.
Funding: This work was supported by: Fondo de Innovación y Competitividad [FIC_40.001.103-0] ANID – Millennium Science Initiative Program [NCS17_035]. https://www.imhay.org/ Programa de Investigación Asociativa (PIA) en Ciencias Cognitivas, Facultad de Psicología, Universidad de Talca [RU-158-2019]. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Timely detection of psychotic experiences (PE) has been recommended for mental health prevention [1], particularly among adolescents and youths [2]. However, the current capability to identify psychotic manifestations in clinical and general populations is sub-optimal [3]. For instance, 50–62% of patients with psychotic symptoms are not identified in the first contact with mental healthcare services [4], and only 5.2% of cases of emerging first-episode psychosis are detected in secondary mental health services [5]. PE are associated with a wide range of psychiatric symptoms [6,7] and negative outcomes, including poor functioning [8–10], increased use of mental health services and psychotropic medication [11,12], poor treatment response [13,14], and suicidal behavior [15,16]. Consequently, PE are potential markers to identify individuals at risk for psychopathology beyond psychotic spectrum disorders [17,18]. Using short self-report questionnaires could enhance the detection of these individuals [19,20] in the context of stratified programs or sequential testing methods [21,22]. However, the evidence about psychometric properties of available brief measures is still insufficient [22,23].
Over the last years, the focus of psychosis research has increasingly shifted to non-clinical populations [24], as authors have argued that systematic and standardized screening for PE could be feasible in community and educational settings [25–27]. One of the most frequently used screening tools is the Community Assessment of Psychic Experiences (CAPE) [28], which was created following the theoretical framework of the extended subclinical psychosis phenotype [24]. The original version (CAPE-42) [29] has good discriminant validity and good test-retest reliability [19,30]. A shorter version comprises 15 items assessing persecutory ideation (PI), bizarre experiences (BE), and perceptual anomalies (PA) (CAPE-P15) [31]. Evidence for this three-factor structure has been reported in prior studies [32,33], but we also found a strong general factor in a bifactor model among adolescents [34], a finding that requires additional research [33]. The scale has shown good validity and reliability in university students [32]. Additionally, in college students, it has adequate construct and concurrent validity, internal consistency, test-retest reliability, and measurement invariance across sex [35].
The CAPE-P15 scale can help to identify at-risk populations and the screening methodology may consider several approaches. For example, Bukenaite et al. [3], computing the average of all items, identified a cut-off of 1.47 for both frequency and distress scales as suitable for detecting ultra-high risk for psychosis, supporting the CAPE-P15 as a valid and reliable instrument to sensitively and specifically detect positive individuals in adolescent outpatients. Alternatively, it would be possible to establish several risk groups according to the severity of the latent traits using scores derived from Item Response Theory analysis. No previous studies have used the latter approach to assess the accuracy of the CAPE in educational settings, where higher thresholds will probably be needed to reduce false positives [20]. In line with literature suggesting authors to evaluate the psychometric properties of screening tools for assessing PE [30] and encouraging them to detect PE in both adolescence [6] and population-based samples [22,26,36], we seek to provide new psychometric evidence about the CAPE-P15 in adolescent school students in Chile. First, we tested its internal structure by conducting confirmatory analyses. Second, we assessed its accuracy in classifying PE levels using Item Response Theory (IRT) [37], and tested which items better discriminate the latent trait. Furthermore, we assessed the instrument’s discriminant validity by examining associations between PE and symptoms (depression and anxiety), suicidal ideation (SI), and some maladaptive psychological mechanisms (defeat, entrapment, and rumination) probably influencing the experience of psychotic symptoms [38,39] and underlying the links between PE and SI in psychosis [40,41].
Materials and methods
Participants
We conducted a cross-sectional study with 1599 adolescents recruited between April and September 2019 in 11 public secondary public schools in Chile. The inclusion criteria were that the students and their parents voluntarily agreed to participate in the study and signed written and informed consent. We excluded five individuals who wrongly defined their ages (out of the age range of 12–19 years). We performed the analyses with a final sample of 1594 adolescents (mean age = 15.56 SD = 1.35, women = 47.4%).
Measures
Psychotic experiences.
We used the CAPE-P15, a 15-item self-report questionnaire [31]. In the current version, responses to items range from 1 (never) to 5 (very often). The scale assesses three domains: paranoid ideation (PI, 5 items), bizarre experiences (BE, 7 items), and perceptual anomalies (PA, 3 items). Scores can range from 15 to 75. Higher scores indicate higher severity of PE. All items are averaged for an overall measure of the trait being assessed. We did not address the degree of distress associated with positive symptoms.
Depressive symptoms.
We used the Patient Health Questionnaire-9 (PHQ-9) [42], a 9-itemself-report questionnaire with responses ranging from 0 (not at all) to 3 (nearly every day). Total scores can range from 0 to 27. Scores of 0–4 indicate no depressive symptoms, 5–9 mild severe depressive symptoms, 10–14 moderate depressive symptoms, 15–19 moderately-severe depressive symptoms, and 20–27 severe depressive symptoms [42]. In outpatient adolescents, its positive predictive value was 77% [43]. In Chilean adolescents, Borghero et al. [44] observed the following values: internal consistency = .78; sensitivity = 86.2%, specificity = 82.9%). In our sample, Cronbach’s alpha (α) was 0.90, and McDonald’s Omega Coefficient (ω) was 0.81.
Anxiety symptoms.
We used the Generalized Anxiety Disorder 7-item scale (GAD-7) [45], a 7-item self-report questionnaire with possible responses ranging from 0 (not at all) to 3 (nearly every day). Total scores can range from 0 to 21 points. Cutoff scores of5, 10, and 15 respectively represent mild, moderate, and severe levels of anxiety [45]. For scores ≥ 11, the scale has shown good predictive value (>99%) and negative value (.83) in adolescents. For scores ≥ 17, it was associated with a positive value of.266 and a negative predictive value of >99% [46]. In adolescents from Chile, internal consistency (α) reached.86. In our sample, Cronbach’s α was 0.90 and McDonald’s ω was 0.86.
Suicidal ideation (SI).
We used seven items of the Columbia Suicide Severity Rating Scale (C-SSRS) [47], adapted for use as a self-report questionnaire [48]. The severity of SI was rated on a 7-point ordinal scale in which 1 = wish to be dead, 2 = nonspecific active suicidal thoughts, 3 = thoughts about how to commit suicide, 4 = suicidal thoughts and intentions, 5 = suicidal thought with a detailed plan, 6 = intentions to conduct plan, 7 = prior behaviors or planning acts to commit suicide. Scores over 3 points represent an elevated risk of suicidal ideation. The frequency of SI was addressed by asking participants when these thoughts happened: ever in life (SIL) and/or during the last month (SIM). We only reported the former (SIL) because there were few reports of SIM. In our sample, α was 0.90 and ω was 0.81.
Defeat and entrapment.
We used the Short Defeat and Entrapment Scale (SDES) [49]. It comprises eight items with a 5-point response scale ranging from 1 (never) to 5 (very often). Four items assess defeat, defined as the perception of a failed struggle, feelings of powerlessness, and a sense of losing social status or missing personal goals [50]. Four items assess entrapment, defined as the feelings of being threatened or involved in a stressful, unpleasant state or situation which one cannot escape because of internal or external circumstances [51]. Total scores for each scale range from 4 to 20. The scale has shown good reliability (α values from 0.85 to 0.88 (Defeat scale) and from 0.65 to.083 (Entrapment scale) [52]. In our sample, the α and ω values for the Defeat scale were 0.93 and 0.89 respectively, while for the Entrapment scale they were 0.86 and 0.84.
Rumination.
We used four items extracted from the Ruminative Response Scale (RRS) [53]. The items assess rumination on a 5-point response scale ranging from 1 (never) to 5 (very often). Total scores range from 4 to 20. In our sample, internal consistency was good (α = 0.87; ω = 0.85).
Procedure
We invited 11 public schools to participate in the study and all of them agreed to do so after meetings were held with their administration teams. After securing each school’s approval and once written and informed consent was obtained from both the adolescents and their caregivers, the participants completed online questionnaires, administered in school computer laboratories. Ethical approval was obtained from the Bioethics Committee of the University of Talca (40.001.103–0; 11/07/2020).
Data analysis
Descriptive statistics.
The descriptive statistics of the participants are reported with percentages and their confidence interval (CI 95%). We used means and standard deviation to describe depressive and anxiety symptoms, suicidal ideation, defeat, entrapment, and rumination. The items of the CAPE-P15 were described by mean, standard deviation, median, skewness and kurtosis parameters, and the quartiles 1 and 3. The two latter parameters are presented in intervals [Q1-Q3], as a robust measure of dispersion. Also, we reported the frequencies of each response category, ranging from 1 (never) to 5 (very often).
Internal consistency.
We tested the dimensionality of the CAPE through confirmatory factor analysis (CFA) with weighted least squares (WLS) adjusted over a polychoric matrix, a robust estimator for item ordinals. We used several goodness-of-fit indices which were evaluated when the adjustment was at least acceptable, as described in Table 3. Additionally, we assessed the reliability of the instrument through the omega coefficient (ω). Reliability values of 0.65 or more were regarded as acceptable [54].
IRT model.
We used Item Response Theory (IRT) [55] to provide evidence on the capability of the CAPE-P15 and to differentiate participants according to the severity level of their PE. We used two main parameters: discrimination power and difficulty of each item. Moreover, we assessed the accuracy of the scale by computing the item and the test information functions. We categorized the answers as follows: 0 = "never"; 1 = "rarely"; and 2 = "occasionally", "often", or "very often". To assess item discrimination capability, we computed alpha values, which represent the degree to which the answer categories differentiate between the trait levels and it remains constant for all the thresholds of the categories of the same item. To estimate item difficulty, we used beta parameters (β1 and β2). β1 represents the latent trait that is needed for the adolescent to pass the threshold from answering 0 (never) to 1 (rarely). In other words, it refers to the minimum value of the trait needed to obtain a probability higher than 0.5 of answering option 1. β2 represents the threshold for passing from answer category 1 (rarely) to 2 (at least occasionally) (we interpreted these parameters according to Baker et al. [56]).
To evaluate the measurement accuracy of each item in different levels of the latent construct, we tested the trait range θ using the Item Information Function (IFF). Higher information values indicate higher precision of the elements for a certain range of theta.
To assess the overall test and how well it estimates PE severity, we computed the Test Information Function (TIF), which combines the information of all items. Higher information values indicate greater scale precision.
Relationship of PE with other variables.
To evaluate associations between PE and other variables, we divided the latent variable estimated by the graded response model into three groups (Low ≤ -1 SD; Medium = between -1 and 1 SD; and High ≥ 1 SD). Then, we compared PE scores to those of depressive and anxiety symptoms, suicidal ideation, rumination, defeat, and entrapment. For each comparison, we used the median and non-parametric statistic tests for independent groups (Kruskall-Wallis and U Mann-Whitney).
We performed all statistical analyses in R 4.2.0. For the factor analysis, we used the lavaan library, and for the graduated response model, we used the mirt library.
Results
Descriptive statistics
Table 1 describes the sociodemographic and clinical characteristics of the participants. Table 2 shows the descriptive scores of the items of the CAPE-P15. We observed asymmetric responses (bias to the left) and a high degree of kurtosis, meaning that the data is concentrated close to the mean. Overall, most participants tend to choose the category "never", except for items 1 and 2, which exhibit greater variability.
Internal consistency and dimensionality
The fit indices of the CAPE-P15 are good (Table 3). The unidimensional structure of the CAPE (Estimator 1 Factor = 1 general factor reflecting an average score of all items) was corroborated. The hierarchical structure (Estimator Model 2 = 1 general factor plus three correlated factors) was also corroborated. The RMESA index was acceptable for both structures but slightly better for the hierarchical structure (S1 Fig). Thus, the data support the existence of a general PE latent factor, but at the same time, it is possible to differentiate three specific PE dimensions which may have different clinical meanings.
Additionally, the scale has good internal reliability (α = 0.94; ω = 0.81).
IRT model
Discrimination and difficulty parameters.
Table 4 shows parameters α, β1, and β2. Alpha values vary between 1.05 (moderate) and 2.44 (very high). According to Baker et al. [56], all items have acceptable discrimination capability and properly represent PE as the latent trait in the present sample. We observed moderate values for items BE1 (electronic devices can influence your thoughts) and PA3 (visual hallucinations), high values for items assessing paranoid ideation (PI1, PI2, and PI5) and auditory hallucinations (PA1), and very high values for items assessing paranoid ideation (PI3 and PI4), bizarre experiences (BE2, BE3, BE4, BE5, BE6, BE7), and auditory hallucinations (PA2).
Concerning the difficulty parameters β1 and β2, we observed clear differences in PE severity. The means of these two parameters were.36 for β1 (range = -.73–1.36) and 1.5 for β2 (range = -.23–2.35). Item PI2 showed the lowest latent trait (β1 = 1.73; β2 = -.23). Therefore, a person located close to the mean of the latent trait (within a region without diagnostic value) will be highly likely to give a positive answer. By contrast, the items with the higher thresholds were BE7 (β1 = 1.36; β2 = 2.21), PA2 (β1 = 1.27; β2 = 2.25), and PA3 (β1 = 1.08; β2 = 2.35), which means that a positive response to them represents a high PE level.
Item information function.
As depicted in Fig 1, item PI2 provides information at lower psychotic levels. Moreover, item BE1 provides information throughout all ranges of the latent variable, and therefore it appears not to discriminate it properly in this population. By contrast, items BE7, PA2, and PA3 provide the most information at high levels of PE.
X-axis represents the severity of PE.
Test information function.
Fig 2 represents the Test Information Function (TIF), which is equivalent to the combined value of the information functions of the fifteen items (continuous line), and the distribution of the measurement error (discontinuous line). We observe that the test provides information throughout the entire course of the latent variable, being more precise between -1SD and 2.5 SD.
The solid line represents the TIF, which is equivalent to the combined value of the information functions of the fifteen items of the CAPE-P15. The dotted line represents the standard error.
Relationship between PE and other variables.
Three groups were defined: Low ≤ -0.93 SD; Medium = between -0.93 and 0.93 SD; and High ≥ 0.93 SD. We observe significant differences among groups in all variables (Fig 3; S1 Table). Also, higher values for the PE category are associated with higher scores for depressive symptoms, anxiety symptoms, suicidal ideation, rumination, defeat, and entrapment.
Discussion
To the best of our knowledge, this is the first study examining the accuracy of the CAPE-P15 for differentiating participants according to their PE severity levels in a large sample of adolescent school students aged 12 to 19. We analyzed the difficulty and the discrimination power of each item as well as the accuracy with which the scale provides information about the latent trait. The capability of the items to discriminate PE ranged from moderate to very high. The item information function analysis yielded a high ability for the items to differentiate severity levels of PE. The test information function analysis showed that the scale provides very accurate information about PE, particularly for high PE levels. Our findings support prior research showing that the CAPE-P15 is a suitable tool for screening PE in the general population [31,35] and provide new evidence on the accuracy of each item in classifying and differentiating PE levels in school-age adolescents. These results, owing to the inclusion of PE as a meaningful domain [1], are relevant in the context of the increasing interest in conducting research on psychosis in general populations [24] and the well-recognized need to detect individuals at risk for mental health problems.
The suitability of the CAPE-P15 for screening PE in the general population is additionally supported by its reliability, which was good in the present study. Our results mirror previous research showing satisfactory reliability in secondary students [34], university and college students [32,35], primary care [57], and mental health services [3]. Our findings on the internal structure of the CAPE-P15 revealed acceptable fit values for both the unidimensional and the hierarchical models, with a slightly better fit for the latter. This is consistent with prior research suggesting the usage of a mean total score [3,35]. However, given prior evidence supporting a three-factor structure [32–34], combining general and specific dimensions of PE could be informative for diagnostic purposes [58]. Additionally, using subtypes of PE is currently recommended [24], for instance, considering their potential specific role in the formation of psychopathology (e.g. suspiciousness strongly associated with vulnerability to psychosis; ideas of reference more strongly linked to development of affective disorders [59]).
Regarding the general functioning of the scale, we observed a floor effect, meaning that most of the participants obtained low PE scores. The scale is productive within a small range of the variable, particularly in moderate-high and very high areas, which is to be expected for clinical scales administered to a general population. Most items showed a high discriminative capability [56], especially those assessing delusional experiences of being controlled by external forces (BE6) and thought control/broadcasting (items BE2, BE3, BE4, and BE5). The item "Have you ever felt as if some people are not what they seem to be?" (PI2) reached the highest mean value, indicating that it is the most frequent PE in our sample, which mirrors other findings [35]. Although its discriminative ability (the capability to differentiate between levels of the latent trait) was high, it showed the lowest capability to determine the presence of PE within the higher levels of the trait. By contrast, this capability was very high for the items with lower mean values, which assessed perceptual anomalies (auditory, PA1 and PA2; visual hallucinations, PA3), bizarre experiences (BE7 = a double has taken the place of a family member, friend or acquaintance; BE6 = being controlled by external forces), and persecutory ideation (PI4 = conspiracy against me). Thus, as expected, we observed a general pattern where the more weakly a symptom was experienced by participants the higher was its capability to determine the presence of the latent trait within the higher severity levels. This supports prior research showing that questionnaires assessing PE provide limited and less reliable information at lower trait levels [60].
According to both severity and peak information, the items can be categorized into three groups with different levels of PE. Group 1 (low presence) encompasses paranoid ideation (PI2); group 2 (intermediate presence) includes items from PI (PI1, PI3, and PI5) and bizarre experiences (BE1, BE3, BE4, and BE5); and group 3 (high presence) comprises items from PI (PI4), BE (BE2, BE6, and BE7), and perceptual anomalies (PA1, PA2, and PA3). Concerning item BE1 (“Have you ever felt as if electrical devices such as computers can influence the way you think?”), we observed an unclear pattern: whereas the difficulty parameter β2 shows a high capability to differentiate the latent trait, the item information function does not support this assertion. Results reported by Kelleher et al. [61] and ours, though using different item wording for similar content (“Have you ever had messages sent just to you through TV or radio?” vs. “Have you ever felt as if electrical devices such as computers can influence the way you think?”), showed the poorest predictive capability. Regarding item 6, one potential explanation for this result may be related to the generalized use of social media or internet activity in the present day. Currently, the item wording probably does not capture the psychopathological nature of this phenomenon. However, this is assertion needs further research.
Our results support prior research showing that visual and auditory hallucinations, when assessed with the Prodromal Questionnaire-Brief Child Version (PQ-BC) [62], discriminate the latent trait in a sample of children aged 9 to 10 years [60]. Moreover, our findings are also in accordance with Phalen et al. [63], who, in help-seeking adolescents and college participants, observed that these two dimensions were the most informative of PE when assessed using three psychosis screening tools: the Prime Screen [64], the Prodromal Questionnaire-Brief (PQ-B) [62], and the Youth Psychosis at Risk Questionnaire-Brief (YPARQ-B) [65]. Our results also mirror the findings reported by Kelleher et al. [61], who found that these symptoms plus paranoid delusional experiences and feelings of being controlled by external forces were highly specific and sensitive for detecting PE in adolescents. However, because different questionnaires and age ranges were used, direct comparisons should be interpreted with caution. Importantly, our most informative seven items belong to our Group 3, comprising PE domains previously reported as being strongly associated with distress, depression, and poor functioning [66]. Further research examining whether specific items are differentially associated with psychological difficulties and with different psychopathological outcomes is needed and strongly encouraged nowadays [24,59,67].
Finally, we observed significant between-group differences reflecting strong positive associations between the intensity of PE and emotional distress measured via emotional (depressive and anxiety) symptoms, suicidal ideation, and maladaptive psychological factors or cognitive distortions previously associated with depression and suicide (defeat, entrapment, and rumination) [40,41]. This indicates good discriminant validity and is in line with prior research showing that, in young people from the general population, PE can be regarded as risk markers for a wide range of non-psychotic symptoms [6,68], emotional distress, and suicidal ideation [9,69–72]. Additionally, our findings revealing associations between PE and cognitive distortions support prior research conducted in the light of cognitive models of psychosis [73,74]. For instance, rumination has been associated with negative symptoms [75] and has been found to act as a predictor of persecutory delusional and hallucinatory experiences [38,76]. Nevertheless, it is not clear whether ruminative processing is a reaction to psychotic symptoms or a true precursor [39]. Moreover, entrapment has been suggested to mediate the association between the severity of positive symptoms (particularly suspiciousness) and suicidal ideation in schizophrenia patients [41]. As reported by Valmaggia et al. [77], defeat and entrapment contribute to the onset of psychopathology in people at risk for psychosis, probably triggering paranoid appraisals in social contexts. This association could be mediated by attenuated psychotic symptoms, which deserves further research. However, testing the impact and specific mechanisms underlying associations between PE, psychiatric symptoms, suicidal ideation, and cognitive distortions is beyond the scope of the present study. Future research examining these issues could provide new insights to improve preventive interventions aimed at enhancing protective coping strategies in those at risk for mental health problems.
This study has some limitations. First, given our cross-sectional design, we cannot establish causal relationships among variables. Second, we recruited participants from public schools. Therefore, adolescents from higher socioeconomic status backgrounds, usually attending private schools, could be underrepresented. Third, despite the adequate validity of the CAPE-P15 for assessing PE and the adequate sensitivity and specificity of self-report measures for identifying PE in adolescents, using a self-report questionnaire might over-estimate the prevalence of these experiences [10]. However, the endorsement rates of PE were similar to those of recent studies conducted with relatively similar-aged samples [6,35]. Fourth, we assessed rumination using a limited set of items, and probably failed to capture some specific aspects of this construct. Fifth, because we did not address the distress associated with PE, we cannot draw conclusions regarding the clinical relevance of PE in our sample. Sixth, we did not use exclusion criteria for participation in the study. Finally, because the IRT model used assumes one-dimensionality, we did not compute between-group comparisons to assess associations between subtypes of PE and other variables. A hierarchical latent IRT model considering a hierarchical structure should be tested if feasible.
Conclusions
Based on item response theory, our results demonstrate that the CAPE-P15 is a reliable and useful tool for screening PE in adolescents from the general population and for accurately classifying them according to their differential levels of PE.
Supporting information
S1 Fig. Unidimensional and hierarchical models.
A) General factor mode. B) Hierarchical model.
https://doi.org/10.1371/journal.pone.0256686.s001
(TIF)
S1 Table. Relationship between PE and other variables.
https://doi.org/10.1371/journal.pone.0256686.s002
(XLSX)
Acknowledgments
The authors would like to acknowledge the important role of all participants, both students and professionals, who supported the project.
References
- 1. Bhavsar V, Dorrington S, Morgan C, Hatch SL, McGuire P, Fusar-Poli P et al. Psychotic experiences, psychiatric comorbidity and mental health need in the general population: a cross-sectional and cohort study in Southeast London. Psychological Medicine.2019; 1–11 pmid:31713511
- 2. Arango C, Díaz-Caneja C, McGorry P, Rapoport J, et al. Preventive strategies for mental health. Lancet Psychiatry.2018; 5: 591–604. pmid:29773478
- 3. Bukenaite A, Stochl J, Mossaheb N, Schäfer M et al. Usefulness of the CAPE-P15 for detecting people at ultra-high risk for psychosis: Psychometric properties and cut-off values. Schizophrenia Research. 2017;189: 69–74. pmid:28254243
- 4. Boonstra N, Wunderink L, Sytema S, Wiersma D. Improving detection of first-episode psychosis by mental health-care services using a self-report questionnaire. Early Intervention in Psychiatry. 2009; 3: 289–295. pmid:22642732
- 5. Fusar-PoliMcGorry PD, Jane J. Improving outcomes of first-episode psychosis: an overview World Psychiatry. 2017; 16: 251–265. pmid:28941089
- 6. Isaksson J, Vadlin S, Olofsdotter S, Aslund C et al. Psychotic-like experiences during early adolescence predict symptoms of depression, anxiety, and conduct problems three years later: A community-based study. Schizophrenia Research.2020; 215: 190–196. pmid:31677809
- 7. Peters E, Ward T, Jackson M, Woodruff P, Morgan C, McGuire P, et al. Clinical relevance of appraisals of persistent psychotic experiences in people with and without a need for care: an experimental study. The Lancet Psychiatry.2017; 4: 927–936. pmid:29179936
- 8. Asher L, Zammint S, Sullivan S, Dorrington S et al. The relationship between psychotic symptoms and social functioning in a non-clinical population of 12 year olds. Schizophrenia Research.2013; 150: 404–409. pmid:24021878
- 9. Kelleher I, Wigman JTW, Harley M, O’Hanblon E. Psychotic experiences in the population: Association with functioning and mental distress. Schizophrenia Research. 2015;165: 9–14. pmid:25868930
- 10. Zammit S, Kounali D, Cannon M, David A, Gunnell D et al. 2013. Psychotic experiences and psychotic disorders at age 18 in relation to psychotic experiences at age 12 in a longitudinal population-based cohort study. Am J Psychiatry. 2013; 170:742–750. pmid:23639948
- 11. Bhavsar V, Maccabe J, Hatch S, Hotopf M, Boydell J, & McGuire P. Subclinical psychotic experiences and subsequent contact with mental health services. Bjpsych Open. 2017; 3(2): 64–70. pmid:28357132
- 12. Rimvall M, van Os J, Verhult F, Wolf R et al. Mental health service use and psychopharmacological treatment following psychotic experiences in preadolescence. AJP in Advance. 2019. pmid:32098486
- 13. Pérez J, Russo D, Ctochl J, Clarke J et al. Common mental disorder including psychotic experiences: Trailblazing a new recovery pathway within the Improving Access to Psychological Therapies programme in England. Early Intervention in Psychiatry. 2017:1–8. pmid:28509391
- 14. Wigman J, van Os J, Abidi L, Huibers M., Roelofs J, Arntz A et al. Subclinical psychotic experiences and bipolar spectrum features in depression: association with outcome of psychotherapy. Psychological Medicine. 2014; 44(2): 325–336. pmid:23651602
- 15. Bromet E, Nock M, Saha S, Lim C, Aguilar-Gaxiola S, Al-Hamzawi A et al. Association between psychotic experiences and subsequent suicidal thoughts and behaviors. JAMA Psychiatry. 2017; 74(11): 1136. pmid:28854302
- 16. Yates K, Lång U, Cederlöf M, Boland F, Taylor P, Cannon M et al. Association of psychotic experiences with subsequent risk of suicidal ideation, suicide attempts, and suicide deaths. JAMA Psychiatry. 2019; 76 (2): 180. pmid:30484818
- 17. Healy C, Gordon A, Coughlan H, Clarke M, Kelleher I, & Cannon M. Do childhood psychotic experiences improve the prediction of adolescent psychopathology? A longitudinal population‐based study. Early Intervention in Psychiatry. 2018; 13(5): 1245–1251. pmid:30488567
- 18. Healy C, Cannon M. We Need to Talk About Prevention. Am J Psychiatry. 2020;177: 4.
- 19. Addington J, Stowkowy J, Weiser M. Screening tools for clinical high risk for psychosis. Early Intervention in Psychiatry. 2014; 9(5): 345–356. pmid:25345316
- 20. Kline E, Schiffman J. Psychosis risk screening: A systematic review. Schizophrenia Research. 2014; 158: 11–18. pmid:25034762
- 21. Calkins M, Moore T, Satterthwaite T, Wolf D et al. Persistence of psychosis spectrum symptoms in the Philadelphia Neurodevelopmental Cohort: a prospective two-year follow-up. World Psychiatry.2017; 16: 62–76. pmid:28127907
- 22. Kennedy L, Johnson KA, Cheng J, Woodberry KA. A public health perspective on screening for psychosis within general practice clinics. Front. Psychiatry. 2020; 10:1025. pmid:32082199
- 23. Gutteridge T, Lang C, Turner A, Jacobs B et al. Criterion validity of the Psychotic-Like Experiences Questionnaire for Children (PLEQ-C). Schizophrenia Research. 2020. pmid:32278538
- 24. Unterrasner L. Subtypes of Psychotic-Like Experiences and Their Significance for Mental Health. Psychosis—Biopsychosocial and Relational Perspectives.2018. http://dx.doi.org/10.5772/intechopen.78691.
- 25. Howie C, Poter C, Shannon C, Davidson G, Mulholland C. Screening for the at-risk mental state in educational settings: A systematic review. Early Intervention in Psychiatry. 2019: 1–12.
- 26. Schiffman J, Stephan Sh, Hong L, Reeves G. School-based approaches to reducing the duration of untreated psychosis. Child Adolesc Psychiatric Clin N Am. 2015; 24: 335–351.http://dx.doi.org/10.1016/j.chc.2014.11.004. pmid:25773328
- 27. Soneson E, Childs-Fegredo J, Anderson J, Stochl J, et al. Acceptability of screening for mental health difficulties in primary schools: a survey of UK parents. BMC Public Health. 2018;18: 1404. pmid:30577830
- 28. Lee K, Chan K, Chang W, Lee E. A systematic review on definitions and assessments of psychotic-like experiences. Early Intervention in Psychiatry. 2016; 10: 3–16 pmid:25772746
- 29. Stefanis NC, Hanssen M, Smirnis NC, Avramopoulos DA, Evdokimodis DK, Stefanis CN, et al. Evidence that three dimensions of psychosis have a distribution in the general population. Psychol. Med. 2002;32: 347–358. pmid:11866327
- 30. Mark W, Toulopoulou T. Psychometric properties of “Community Assessment of Psychic Experiences”: Review and meta-analyses. Schizophrenia Bulletin. 2016; 42(1): 34–44. pmid:26150674
- 31. Capra C, Kavanagh D, Hides L, & Scott J. Brief screening for psychosis-like experiences. Schizophrenia Research. 2013; 149(1–3): 104–107. pmid:23830544
- 32. Capra C, Kavanagh D, Hides L, Scott J. Current CAPE-15: a measure of recent psychotic-like experiences and associated distress. Early Intervention in Psychiatry. 2015; 11(5): 411–417. pmid:25962504
- 33. Therman S, Ziermans T. Confirmatory factor analysis of psychotic-like experiences in a general population sample. Psychiatry Research, 2016; 235: 197–199. pmid:26738980
- 34. Núñez D, Arias V, Vogel E, Gómez L. Internal structure of the community assessment of psychic experiences—positive (CAPE-P15) scale: evidence for a general factor. Schizophrenia Research.2015; 165: 236–242. pmid:25935814
- 35. Sun M, Wang D, Jing L. Xi Ch, et al. Psychometric properties of the 15-item positive subscale of the community assessment of psychic experiences. Schizophrenia Research. 2020. pmid:32522467
- 36. Kline E, Thompson E, Demro C, Bussell K et al. Longitudinal validation of psychosis risk screening tools. Schizophrenia Research.2015; 165: 116–122. pmid:25975827
- 37.
Embretson SE, Reise SP. Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum; 2000.
- 38. Hartley S, Haddock G, Vasconselos e Sa D, Emsley R. An experience sampling study of worry and rumination in psychosis. Psychological Medicine.2014; 44: 1605–1614. pmid:23953654
- 39. Hartley S, Bucci S, Morrison A. Rumination and psychosis: an experimental, analogue study of the role of perseverative thought processes in voice-hearing. Psychosis. 2017.
- 40. Johnson J, Gooding P, Tarrier N. Suicide risk in schizophrenia: Explanatory models and clinical implications, The Schematic Appraisal Model of Suicide (SAMS). Psychology and Psychotherapy: Theory, Research and Practice. 2008; 81: 55–77.
- 41. Taylor P, Gooding P, Wood A, Johnson J et al. Defeat and entrapment in schizophrenia: The relationship with suicidal ideation and positive psychotic symptoms. Psychiatry Research. 2010;178: 244–248. pmid:20472304
- 42. Johnson J, Harris E, Spitzer R, Williams J. The patient health questionnaire for adolescents: validation of an instrument for the assessment of mental disorders among adolescent primary care patients. J Adolesc Health Off Publ Soc Adolesc Med. 2002; 30(3): 196–204. pmid:11869927
- 43. Sinclair-McBride K, Morelli N, Gusman M. PHQ-9 administration in outpatient adolescent psychiatry services. Psychiatr Serv. 2018; 69(7): 837–838. pmid:29962317
- 44. Borghero F, Martínez V, Zitko P, Vöhringer P et al. Tamizaje de episodio depresivo en adolescentes. Validación del instrumento PHQ-9. Rev Med Chile. 2018; 146: 479–486.
- 45. Spitzer R, Kroenke K, Williams J, Löwe B. A brief measure for assessing generalized anxiety disorder. Arch Intern Med. 2006; 166:1092–1097. pmid:16717171
- 46. Mossman S, Luft M. Schroeder H, Varney S et al. The Generalized Anxiety Disorder 7-item (GAD-7) scale in adolescents with generalized anxiety disorder: signal detection and validation. Ann Clin Psychiatry. 2018; 29(4): 227–234A.
- 47. Posner K, Brown G., Stanley B, Brent D, Yershova K, Oquendo M et al. The Columbia–suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am. J. Psychiatry. 2011;168: 1266–77. pmid:22193671
- 48. Núñez D, Arias V, Méndez-Bustos P, & Fresno A. Is a brief self-report version of the Columbia severity scale useful for screening suicidal ideation in Chilean adolescents? Comprehensive Psychiatry. 2019; 88: 39–48. pmid:30471550
- 49. Griffiths A, Wood A, Maltby J, Taylor P et al. The development of the Short Defeat and Entrapment Scale (SDES). Psychological Assessment. 2015; 27(4): 1182–1194. pmid:25894711
- 50.
Gilbert P. Varieties of submissive behavior as forms of social defense: their evolution and role in depression. In: Sloman L, Gilbert P, editors. Subordination and defeat: an evolutionary approach to mood disorders and their therapy. Mahwah: Erlbaum; 2000. p. 3–45.
- 51. Gilbert P, Allan S. The role of defeat and entrapment (arrested flight) in depression: an exploration of an evolutionary view. PsycholMed.1998;28:585–98. pmid:9626715
- 52. Höller I, Teismann T, Cwik JC, Glaesmer H et al. Short defeat and entrapment scale: A psychometric investigation in three German samples. Comprehensive Psychiatry. 2020; 98: 152160. pmid:32036078
- 53. Treynor W. Gonzalez R, Nolen-Hoeskema S. Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research. 2003; 27(3): 247–259.
- 54.
McDonald RP. Test theory: A unified treatment. Mahwah: Lawrence Erlbaum Associates, Inc.; 1999.
- 55. Samejima F. Estimation of ability using a response pattern of graded scores. Psychometrika Monograph. 1969; 17.
- 56.
Baker F. The basic of item response theory: College Park: ERIC clearinghouse on assessment and evaluation. University of Maryland; 2001.
- 57. Knight C, Stochl J, Sonsson E, Russo D, Jones P, Perez J. Revisiting CAPE-P15 cut-off values to increase sensitivity for detecting psychotic experiences in primary care. Schizophrenia Research. 2020; 216: 507–510. pmid:31813808
- 58. Reininghaus U, Priebe S, Bentall R. Testing the psychopathology of psychosis: evidence for a general psychosis dimension. Schizophr. Bull. 2013; 39(4): 884–895. pmid:22258881
- 59. Unterrassner L, Wyss T, Wotruba D, Haker H & Rössler W. The intricate relationship between psychotic-like experiences and associated subclinical symptoms in healthy individuals. Frontiers in Psychology. 2017; 8. pmid:28936192
- 60. Karcher N, Perino M, Barch D. An item response theory analysis of the Prodromal Questionnaire-Brief Child Version: Developing a Screening Form that informs understanding of self-reported psychotic-like experiences in childhood. Journal of Abnormal Psychology. 2020; 129(3): 293–304 ISSN: 0021-843X http://dx.doi.org/10.1037/abn0000502. pmid:32105123
- 61. Kelleher I, Harley M, Murtach A, Cannon M. Are screening instruments valid for psychotic-like experiences? A validation study of screening questions for psychotic-like experiences using in-depth clinical interview. Schizophrenia Bulletin. 2011; 37(2): 362–369. pmid:19542527
- 62. Loewy R. L., Pearson R., Vinogradov S., Bearden C. E., & Cannon T. D. (2011). Psychosis risk screening with the Prodromal Questionnaire—Brief version (PQ-B). Schizophrenia Research, 129;42–46. http://dx.doi.org/10.1016/j.schres.2011.03.029. pmid:21511440
- 63. Phalen P, Rakhshan Rouhakhtar P, Millman Z, Thompson E. Validity of a two-item screen for early psychosis. Psychiatry Research. 2018; 270: 861–868. pmid:30551336
- 64. Miller T.J., Cicchetti D., Markovich P.J., McGlashan T.H., Woods S.W. The SIPS screen: a brief self-report screen to detect the schizophrenia prodrome. Schizophr. Res. 2004; 70(1),78.
- 65. Ord L., Myles-Worsley M., Blailes F., Ngiralmau H. Screening for prodromal adolescents in an isolated high-risk population. Schizophr. Res. 2004;71(2–3), 507–508. pmid:15474922
- 66. Yung A, Nelson B, Bajer K, Buckby JA, et al. Psychotic-like experiences in a community sample of adolescents: Implications for the continuum model of psychosis and prediction of schizophrenia. Australian and New Zealand Journal of Psychiatry.2009; 43:118–128.
- 67. Unterrasner L, Wyss T, Wotruba D, Ajdacic-Gross V. Psychotic-like experiences at the healthy end of the psychosis continuum. Front. Psychol. 2017a; 8:775. pmid:28555120
- 68. Healy C, Brannigan R, Dooley N, Coughlan H, Clarke M, Kelleher I, et al. Childhood and adolescent psychotic experiences and risk of mental disorder: a systematic review and meta-analysis. Psychological Medicine. 2019; 49(10): 1589–1599. pmid:31088578
- 69. DeVylder J, Jahn D, Doherty T, Wilson C, Wilcox H, Schiffman J, et al. Social and psychological contributions to the co-occurrence of sub-threshold psychotic experiences and suicidal behavior. Social Psychiatry and Psychiatric Epidemiology. 2015; 50(12): 1819–1830. pmid:26493307
- 70. Kelleher I, Connor D, Clarke MC, Devlin N, Harley M, Cannon M. Prevalence of psychotic symptoms in childhood and adolescence: a systematic review and meta analysis of population-based studies. Psychol. Med. 2012; 9: 1–7. pmid:22225730
- 71. Kelleher I, Cederlöf M, Lichtenstein P. Psychotic experiences as a predictor of the natural course of, suicidal ideation: a Swedish cohort study. Schizophrenia Research. 2014; 153: S11. pmid:24890071
- 72. Fonseca-Pedrero E, Ortuño-Sierra J, Muñiz J, Bobes J. Latent profile analysis of psychosis liability in a community derived sample of adolescents: Links with mental health difficulties, suicidal ideation, bipolar-like experiences and psychotic-like experiences. Early Intervention in Psychiatry.2018; 1–10.
- 73. Freeman D, Garety P, Kuipers E, Fowler D et al. A cognitive model of persecutory delusions. British Journal of Clinical Psychology. 2002; 41: 331–347.
- 74. Garety PA, Kuipers E, Fowler D, Freeman D, Bebbington PE. A cognitive model of the positive symptoms of psychosis. Psychol Med. 2001; 31(2): 189–95. pmid:11232907.
- 75. Halari R, Premkumar P, Farquharson L, Fannon D, Kuipers E, Kumari V. Rumination and Negative Symptoms in Schizophrenia. The Journal of Nervous and Mental Disease. 2009;197(9):703–706. pmid:19752652
- 76. Vorontsova N, Garety P, & Freeman D. Cognitive factors maintaining persecutory delusions in psychosis: The contribution of depression. Journal of Abnormal Psychology. 2013;122(4): 1121–1131. pmid:24364615
- 77. Valmaggia L, Day F, Garety P, Freeman D et al. Social defeat predicts paranoid appraisals in people at high risk for psychosis. Schizophrenia Research. 2015; 168(1–2): 16–22. pmid:26276306