Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Columbia suicide severity rating scale screen scores in adults with Chiari malformation Type 1

  • Richard Labuda ,

    Contributed equally to this work with: Richard Labuda, Emme Nolan, Emily P. Rabinowitz, Douglas L. Delahanty, Petra M. Klinge, Philip A. Allen

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Writing – original draft, Writing – review & editing

    * director@conquerchiari.org

    Affiliation Conquer Chiari, Wexford, Pennsylvania, United States of America

  • Emme Nolan ,

    Contributed equally to this work with: Richard Labuda, Emme Nolan, Emily P. Rabinowitz, Douglas L. Delahanty, Petra M. Klinge, Philip A. Allen

    Roles Data curation, Writing – review & editing

    Affiliation Department of Psychology, University of Akron, Akron, Ohio, United States of America

  • Emily P. Rabinowitz ,

    Contributed equally to this work with: Richard Labuda, Emme Nolan, Emily P. Rabinowitz, Douglas L. Delahanty, Petra M. Klinge, Philip A. Allen

    Roles Writing – review & editing

    Affiliation Department of Psychological Sciences, Kent State University, Kent, Ohio, United States of America

  • Douglas L. Delahanty ,

    Contributed equally to this work with: Richard Labuda, Emme Nolan, Emily P. Rabinowitz, Douglas L. Delahanty, Petra M. Klinge, Philip A. Allen

    Roles Writing – review & editing

    Affiliation Department of Psychological Sciences, Kent State University, Kent, Ohio, United States of America

  • Petra M. Klinge ,

    Contributed equally to this work with: Richard Labuda, Emme Nolan, Emily P. Rabinowitz, Douglas L. Delahanty, Petra M. Klinge, Philip A. Allen

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of Neurosurgery, Warren Alpert Medical School of Brown University, Rhode Island Hospital, Providence, Rhode Island, United States of America

  • Philip A. Allen

    Contributed equally to this work with: Richard Labuda, Emme Nolan, Emily P. Rabinowitz, Douglas L. Delahanty, Petra M. Klinge, Philip A. Allen

    Roles Conceptualization, Formal analysis, Funding acquisition, Supervision, Writing – review & editing

    Affiliation Department of Psychology, University of Akron, Akron, Ohio, United States of America

Abstract

Adult Chiari malformation Type 1 is a neurological condition characterized by high levels of chronic pain, disability, and psychological distress, yet self-harming behaviors have not previously been studied in this patient group. The purpose of this study was to determine the prevalence of elevated suicide risk scores among adults with Chiari malformation Type I using the Columbia Suicide Severity Rating Scale – Screen and examine the association between risk scores and pain, disability, and psychological distress. A web-based, anonymous survey was administered comprised of validated scales and demographic questions. Suicide risk (Columbia Screen score) was dichotomized as Low or High-Risk and both crude and adjusted odds ratios were calculated to determine statistical associations with pain, disability, and psychological measures. Overall, 44% of 372 respondents scored in the High-Risk group. Logistic regression showed that depression at the moderate level or above (Adjusted Odd Ratio (AOR) = 4.27, 95% CI = 2.58–7.05, p < .0001), age younger than 30 years (AOR = 3.10, 95% CI = 1.67–5.78, p = .0003), and severe or complete neck related disability (AOR = 2.02, 95% CI = 1.22–3.33, p = .0056) were significant predictors of High-Risk scoring. This study is the first to examine suicidal ideation and risk in the adult CMI population. Clinicians should be aware that suicidal ideation is a serious morbidity in this patient population.

Introduction

Symptomatic, adult Chiari Malformation Type I (CMI) is a neurological condition characterized by high levels of chronic pain, disability, and depression, yet self-harming and suicidal behaviors have not yet been studied in this patient group [13]. Clinically, CMI involves herniation of the cerebellar tonsils through the foramen magnum at the bottom of the skull resulting in direct compression of neural tissue and disruption of the natural flow of cerebrospinal fluid across the cranio-vertebral junction [4,5]. Common symptoms include headaches (acute Valsava induced and chronic migraine type), neck pain, shoulder pain, balance issues, depression, anxiety, cognitive impairment, and trouble sleeping [69]. For reasons that have not yet been elucidated, close to 80% of adult CMI patients are female [10]. A subset of patients (~54%) [6] undergo neurosurgery to create more room around the compressed tissue and restore the natural flow of cerebrospinal fluid [5]. However, this procedure has limited long-term outcomes, and patients are often left with residual physical, psychological, and functional issues [1,2,11]. Although it has not been previously studied, both surgical and non-surgical CMI patients could be at elevated risk of self-harming and suicidal behaviors due to high levels of chronic pain, disability, and depression [13,1214].

Specifically, it has been shown that 80% of adult CMI women have moderate-complete neck related disability as measured by the Neck Disability Index (NDI) [2]. In addition, pain levels reported by CMI patients on the Short Form McGill Pain Questionnaire 2 (SF-MPQ-2) are comparable to what is found in other chronic pain conditions [3]. Interestingly, both the disability and pain findings are independent of surgical status [2,3]. Meanwhile, Meeker et al. [15] found that more than 90% of adult CMI patients struggle with one or more aspects of daily living. Psychologically, Garcia et al. [1] found that 44% of adult CMI patients suffer from moderate-severe depression and 60% from moderate-severe anxiety (Depression, Anxiety and Stress Scale – 21, DASS-21), again independent of surgical status. Finally, a large survey found that 78% of patients still employed found it difficult to work due to CMI, and of those not employed 79% said it was due to CMI [6].

Both chronic pain and depression have been well demonstrated as major risk factors for self-harmful behaviors up to and including suicide [12,13]. In addition, a nationally representative survey of nearly 200,000 subjects found that people with functional disabilities were significantly more likely to report suicidal ideation, planning, and attempts than the general population [14].

The Columbia Suicide Severity Rating Scale – Screening Version (C-SSRS Screen) is a shortened version of the widely used Columbia-Suicide Severity Rating Scale [16]. Bjureberg et al. [16] evaluated the utility of the C-SSRS Screen in predicting 7-day, one month, and one year completed suicide in more than 18,000 consecutive psychiatric emergency room patients and found the C-SSRS Screen score was significantly associated with higher odds of completed suicide at all three time points.

The purpose of this cross-sectional study was to quantify the suicide risk among a relatively large sample (N = 372) of CMI adults (65% post-surgical) using the C-SSRS Screen administered through a web-based anonymous survey, and further to examine the relationship between the level of risk with pain, disability, and psychological distress.

We hypothesized that CMI adults would exhibit high levels of suicide risk and that pain, disability, and psychological distress would be significant, independent predictors of the C-SSRS Screen scores.

Materials and methods

The research was approved by the Institutional Review Board at The University of Akron (#2022065), and all participants provided written, electronic informed consent. A web-based, anonymous survey was constructed using Qualtrics (Provo, UT: Qualtrics; 2022). The survey consisted of demographic and Chiari history questions, plus eight validated scales to assess suicide risk, pain, disability, and mental health.

Given the nature of the study, the participant debrief included instructions on how to contact the National Suicide Prevention Lifeline as well as a web link for additional resources. While the study of suicidal ideation and behaviors raises valid ethical concerns, Gould et al. found in a large, randomized control trial of high school students that screening did not increase distress levels, ideation, or attempts [17]. In a review of the literature, Dazzi et al. also found no evidence that screening increased ideation [18].

Subjects

Adults diagnosed with CMI were recruited to participate in a web-based study on the “Psychological Impact of Chiari” using a large patient organization’s (Conquer Chiari) website, email list, and social media platforms. Respondents under 18 years at the time of the survey, those without a physician diagnosis of CMI (self-reported), and those who did not complete all the scales were excluded from this analysis (the C-SSRS Screen was presented last in the survey). Between 9/6/2022–12/12/2022, 520 people responded at least in part to the survey. Out of these, 372 (71.5%) met the inclusion criteria and completed all survey elements.

C-SSRS screen

The C-SSRS Screen, which was designed to be administered without training by anyone,evaluates suicide risk based on five progressive, previous month ideation focused questions and one behavior history question [16]. The responses are then categorized as No, Low, Medium, or High-Risk, with good internal reliability (Cronbach’s α = 0.89) [19]. Bjureberg et al. [16] found using an area under the curve analysis that the optimal cut-off to predict suicide in the subsequent week, month, and year was ideation with methods, which equates to the Medium Risk category.

Additional survey measures

The UCLA Loneliness Scale is a 20-item assessment which uses a 4-point scale (1 = never to 4 = always, with certain items reverse scored) to measure feelings of loneliness and social isolation (Cronbach’s α = 0.89–0.94) [20]. The DASS-21 is a widely used instrument comprised of depression, anxiety, and stress subscales with 7 questions each scored on a Likert scale (Cronbach’s alpha = 0.91) [21,22]. The NDI is the most widely used, validated instrument for assessing neck-related disability and consists of ten questions covering daily activities like personal care and work [23]. Each item is rated from 0 (no disability) to 5 (complete disability), with total scores doubled to represent a percentage disability (Cronbach’s α = 0.86) [24]. The SF-MPQ-2 assesses pain across four domains: continuous, intermittent, neuropathic, and affective [25]. Respondents rate 22 items on an 11-point Likert scale (0 = none to 10 = worst). The scale shows high reliability for subscales (Cronbach’s α = 0.73–0.89) and total scores (α = 0.91–0.94). The Impact of Events Scale-Revised (IES-R) measures trauma-related psychological distress using 22 items and a 5-point Likert scale (0 = not at all to 4 = extremely, Cronbach’s α = 0.79–0.95) [26]. The Pain Catastrophizing Scale (PCS) assesses negative thinking about pain through 13 items on a 5-point Likert scale (0 = not at all to 4 = all the time, Cronbach’s α = 0.92) [27].

Given the time period during which the study took place, a COVID Impact Scale was included to account for potential confounding effects of the pandemic. The Coronavirus Impact Scale (CIS) measures how much the pandemic changed the respondent’s life in terms of daily routine, access to food, mental health, etc. The instrument uses a 4-point Likert scale (0 = No change to 4 = Severe, Cronbach’s α = 0.90–0.96) [28].

Demographics and surgical history

The survey also included questions on gender, age, and Chiari surgical history. Race and ethnicity data were not collected to ensure anonymity. In our previous experience with similar surveys, respondents were overwhelmingly white and non-Hispanic, therefore we did not want to risk exposing the identity of any minority respondents.

Statistical analysis

The dependent variable was the C-SSRS Screen score dichotomized as Low-Risk (None-Low) or High-Risk (Medium-High) (note the terms Low and High-Risk as used throughout this paper mean based on the C-SSRS Screen score, not a clinical diagnosis). Independent variables included Age, Gender, Chiari Surgical History, Loneliness (UCLA), Pain (SF-MPQ-2 Total), Depression (DASS-21 subscale), Anxiety (DASS-21 subscale), Neck Related Disability (NDI), Impact of Events (IES Revised), Pain Catastrophizing (PCS), and COVID Impact (CIS).

Means and standard deviations were computed for the continuous variables, and frequency and percentages for the categorical variables. Student’s t-tests and chi-square tests were used to compare subjects who scored at High-Risk vs Low-Risk across all independent variables.

The continuous independent variables were then categorized using either published cut-off points (Loneliness, Depression, Anxiety, Neck Related Disability, Post Traumatic Stress Disorder (PTSD based on IES), Pain Catastrophizing) [21,23,27,29,30] or quartiles (Pain, COVID Impact) if no categorical interpretation was available in the literature. Age was categorized by decade up to 50 years. The categorical variables were then used to calculate crude Cochran-Mantel-Haenszel odds ratio estimates and 95% confidence intervals of scoring at High-Risk.

Two logistic regression models were constructed with High-Risk as the outcome variable. The first model (Continuous) utilized the scale values in their continuous form to identify significant predictors while adjusting for confounding. To assist with interpretation, a second logistic model (Binary) was constructed based on the results of the first model (which variables to include) and the crude odds ratios (the lowest categorical level with a significant OR relative to the reference level was set as a dichotomization point). The second model used Age dichotomized at 30 years, Depression dichotomized at moderate, and Neck Disability dichotomized at severe as the input variables To account for potential collinearity, a linear regression model was used with the C-SSRS risk score as the output variable and the input variables in continuous form where applicable was constructed to determine the variance inflation factor (VIF) of each input variable. P-values below.05 (two-tailed) were considered significant.

All statistical analyses were performed using SAS (Version 9.4. Cary, NC: SAS Institute; 2022) and Microsoft Excel for Microsoft 365 (Version 2201. Redmond, WA: Microsoft Corp.; 2022).

Results

The average age of the study sample was 43 years and 92.7% were female. Sixty-five percent had undergone Chiari surgery. Overall, 162 (43.5%) participants were in the High-Risk group based on the CSSRS-Screen (Table 1). The High-Risk group was 5 years younger on average than the Low-Risk group (p = .0005) but the differences in gender and Chiari surgical history were not significant. The High-Risk group scored significantly higher on every scale measure, with all but Loneliness (p = .0046) maintaining significance even after correcting for multiple observations (p < .0045).

thumbnail
Table 1. Demographic, functional, and psychological distress measures of adult CMI patients scoring at high (N = 162) and low (N = 210) risk on the C-SSRS screen.

https://doi.org/10.1371/journal.pone.0334599.t001

Categorizing the variables (Table 2) demonstrated that the odds of scoring at High-Risk for suicide decreased significantly with older age, with participants aged 30 years and older having less than half the odds of being High-Risk as those aged 18–29. Participants with moderate Depression were more than three times as likely to be in the High-Risk group as those who scored in the normal range (OR = 3.50, 95% CI = 1.79–6.86), while participants who scored as extremely severe in Depression were more than six times as likely to be High-Risk (OR = 6.56, 95% CI = 3.60–11.94). Severe Neck Disability was significantly associated with High-Risk status (OR = 4.71, 95% CI = 1.62–13.73), as was Pain at every quartile above the first. Participants with IES-R scores suggestive of PTSD were twice as likely to be in the High-Risk group (OR = 2.38, 95% CI = 1.56–3.64), while those meeting the cut-off for Pain Catastrophizing were three times as likely to be in the High-Risk group (OR = 3.2, 95% CI = 2.08–4.93).

thumbnail
Table 2. Univariate odds ratio analysis for scoring at high-risk on C-SSRS screen among adults with CMI (N = 372).

https://doi.org/10.1371/journal.pone.0334599.t002

The collinearity check showed all VIF < 3, indicating collinearity among the input variables would not influence the regression models. The first regression model (Continuous) demonstrated good concordance (c = .76), with Age, Depression, and Neck Disability as the only significant predictors (p < .05) when controlling for all other variables (Table 3). The second logistic regression model (Binary) also demonstrated good concordance (c = .73), with Depression at the moderate level or above having the highest adjusted odds ratio of being in the High-Risk group (AOR = 4.27, 95% CI = 2.58–7.05). In addition, those under the age of 30 years had three times the odds of being in the High-Risk group (AOR = 3.10, 95% CI = 1.67–5.78), and those with severe or complete Neck Related Disability had twice the odds of being in the High-Risk group (AOR = 2.02, 95% CI = 1.22–3.33).

thumbnail
Table 3. Logistic regression models with continuous and selected binary factors for C-SSRS screen high-risk score among adults with CMI (N = 371).

https://doi.org/10.1371/journal.pone.0334599.t003

Discussion

This cross-sectional study found that 44% of adults with CMI were at an elevated risk of suicide as defined by the CSSRS-Screen. In addition, being under the age of 30, having moderate or higher depression (DASS-21), or severe to complete neck related disability (NDI) significantly increased the odds of being classified as High-Risk for suicide. However, gender and history of Chiari surgery were not related to suicide risk.

Suicide risk has not been previously studied in the CMI population. However adult CMI patients exhibit several factors linked to increased risk of suicidal behavior, including high levels of depression, chronic pain, and disability [13,1214]. In a review of the epidemiology of suicide, Bachmann [12] noted, “Depression is the leading cause of death by suicide worldwide…half of all completed suicides are related to depressive and other mood disorders.” In a separate review, Lepine and Briley [31] found that the mortality risk for suicide among depressed patients is more than twenty times greater than the general population. Our study found that depression (at the moderate or higher level on the DASS-21) was a strong, independent predictor of being classified in the High-Risk group.

Chronic pain is also a major risk factor for suicidal behaviors [13,32]. In a review, Tang and Crane [13] found that relative to controls the risk of death is double for chronic pain patients and the lifetime prevalence of suicidal ideation is around 20%. Calati et al. [32] found in a meta-analysis that individuals with any type of pain were significantly more likely to experience death wish, suicidal ideation, planning, attempts, and completions. They concluded that physical pain is a consistent risk factor for suicidal thoughts and behaviors. While our study showed that on average participants in the High-Risk group reported pain scores that were 23.5% higher than the Low-Risk group (p < .0001), pain was not an independent, significant predictor in the regression models.

In a secondary analysis of data collected through the 2020 Nations Survey on Drug Use and Health, Marlow et al. [14] found that people with disabilities were more than twice as likely to report suicidal ideation, planning, and attempts. Our study found similar results, with participants who reported severe to complete neck related disability being twice as likely to be in the High-Risk group. While these categories represent high levels of disability, they are common among adult CMI patients. Specifically, 31% of the study sample were classified as such, and in a separate study of 474 adult females with CMI, Labuda et al. [2] found that 44% reported severe to complete neck related disability.

The present study also found that older participants had significantly lower odds of scoring High-Risk compared to younger participants. This is counter to global, general population suicide rates where older adults (age 65+) are the most at risk age group, especially men [33]. This could be due in part to the composition of the study group, with only 4% of participants being 65 years or older and with no men in this category. A post-hoc analysis demonstrated a weak but significant negative correlation between age and both depression (r = −.13, p = .0149) and anxiety (r = −.18, p = .0007). However, this seems unlikely to provide a full explanation of this result, especially since all three variables were included in the regression modeling. Further study may be warranted to elucidate the nature of the association.

CMI patients often seek care from a number of providers during the course of their diagnosis and clinical care, including neurosurgeons, neurologists, and pain specialists. However, based on our experience, screening for depression and/or suicide risk is not routinely performed for CMI patients. The results of our survey suggest that suicidal ideation rates are unusually high in both surgically treated and untreated Chiari patients, and that the CSSRS-Screen may be a useful tool to identify those at risk. Our data further supports the importance of a study of suicide risk and its clinical and health implications in the CM1 patient population.

The present study has two main limitations. First, the cross-sectional design precludes any conclusions regarding causality. While several predictor variables showed strong statistical associations with an elevated risk score on the C-SSRS Screen, the precise nature of the associations cannot be definitively determined and requires additional research.

Second, because participants were recruited through a patient organization’s website and social media, the study sample may include selection bias which could affect the accuracy of the point estimates and potential generalizability. Specifically, it is possible that the study sample may include subjects with more severe symptoms and/or worse outcomes than the general Chiari population. The surgical rate – which can be used as a crude surrogate for disease severity in the group – was 65% in the study sample compared to 54% in a much larger sample [6]. However, previous research and this study’s results indicate that suicide risk scores, neck related disability, and depression are all comparable among surgical and non-surgical patients [1,2], suggesting that the impact of a surgically skewed bias would be minimal. While clinic-based studies of suicide risk would be valuable, the logistics of performing a comparable study to the present one would be challenging. First, not many clinical centers have the patient flow for a study this size, but more importantly it is our experience that most surgical CMI patients are only followed clinically for 12 months after surgery. Therefore, a clinic-based sample would only be looking at a small window of time in the patient experience and would not be representative of the general CMI population.

It is worth noting that the potential effects of delivering the C-SSRS screen anonymously through the web are not known. However, it should be emphasized that the Screen was designed using plain language and intended for use by anyone without any training. It seems reasonable that the anonymous, remote format may actually result in more accurate responses than in-person assessments, since the respondents are not concerned with the potential consequences of their answers, and thus more willing to disclose any ideation or previous suicide attempts. Finally, it is important to note that the study data was collected leading up to the holiday season which could have biased the C-SSRS Screen scores. However, 92.2% of the responses were collected prior to 10/31, so the magnitude of any such bias is likely minimal.

Conclusion

Forty-four percent of adults with CM1 surveyed were at an elevated risk of suicidal behavior as measured by the C-SSRS Screen, independent of surgical treatment. Age under 30 years, depression at the moderate level or worse as scored on the DASS-21, and severe to complete neck related disability significantly increased the odds of scoring at higher risk. This study is the first to examine suicidal ideation and risk in the adult CMI population.

Acknowledgments

The authors would like to acknowledge and thank Dorothy Loth, MS, of Northeastern University for performing the Qualtrics programming.

References

  1. 1. Garcia MA, Allen PA, Li X, Houston JR, Loth F, Labuda R, et al. An examination of pain, disability, and the psychological correlates of Chiari Malformation pre- and post-surgical correction. Disabil Health J. 2019;12(4):649–56. pmid:31147250
  2. 2. Labuda R, Loth D, Loth F, Allen PA. Pain and Depression Account for More Than One Half of the Neck Disability Variance Among Adult Women with Chiari I. World Neurosurg. 2023;171:e478–85. pmid:36526226
  3. 3. Tokar DM, Kaut KP, Allen PA. Revisiting the factor structure of the Short-Form McGill Pain Questionnaire-2 (SF-MPQ-2): Evidence for a bifactor model in individuals with Chiari malformation. PLoS One. 2023;18(10):e0287208. pmid:37797067
  4. 4. Labuda R, Loth F, Slavin K. National Institutes of Health Chiari Research Conference: state of the research and new directions. Neurol Res. 2011;33(3):227–31. pmid:21513642
  5. 5. Milhorat TH, Chou MW, Trinidad EM, Kula RW, Mandell M, Wolpert C, et al. Chiari I malformation redefined: clinical and radiographic findings for 364 symptomatic patients. Neurosurgery. 1999;44(5):1005–17. pmid:10232534
  6. 6. Chiari1000 Results: Conquer Chiari. 2019. https://chiari1000results.info/
  7. 7. Mueller D, Oro’ JJ. Prospective analysis of self-perceived quality of life before and after posterior fossa decompression in 112 patients with Chiari malformation with or without syringomyelia. Neurosurg Focus. 2005;18(2):ECP2. pmid:15715455
  8. 8. He Y, Zhang M, Huang C, Qin X, Zhang Z, Wang Y, et al. Prevalence and treatment of typical and atypical headaches in patients with Chiari I malformation: A meta-analysis and literature review. Cephalalgia. 2023;43(1):3331024221131356. pmid:36694433
  9. 9. Allen PA, Delahanty D, Kaut KP, Li X, Garcia M, Houston JR, et al. Chiari 1000 Registry Project: assessment of surgical outcome on self-focused attention, pain, and delayed recall. Psychol Med. 2018;48(10):1634–43. pmid:29048273
  10. 10. Wilkinson DA, Johnson K, Garton HJL, Muraszko KM, Maher CO. Trends in surgical treatment of Chiari malformation Type I in the United States. J Neurosurg Pediatr. 2017;19(2):208–16. pmid:27834622
  11. 11. Klekamp J. Surgical treatment of Chiari I malformation--analysis of intraoperative findings, complications, and outcome for 371 foramen magnum decompressions. Neurosurgery. 2012;71(2):365–80; discussion 380. pmid:22569058
  12. 12. Bachmann S. Epidemiology of Suicide and the Psychiatric Perspective. Int J Environ Res Public Health. 2018;15(7):1425. pmid:29986446
  13. 13. Tang NKY, Crane C. Suicidality in chronic pain: a review of the prevalence, risk factors and psychological links. Psychol Med. 2006;36(5):575–86. pmid:16420727
  14. 14. Marlow NM, Xie Z, Tanner R, Jo A, Kirby AV. Association Between Disability and Suicide-Related Outcomes Among U.S. Adults. Am J Prev Med. 2021;61(6):852–62. pmid:34465506
  15. 15. Meeker J, Amerine J, Kropp D, Chyatte M, Fischbein R. The impact of Chiari malformation on daily activities: A report from the national Conquer Chiari Patient Registry database. Disabil Health J. 2015;8(4):521–6. pmid:25753308
  16. 16. Bjureberg J, Dahlin M, Carlborg A, Edberg H, Haglund A, Runeson B. Columbia-Suicide Severity Rating Scale Screen Version: initial screening for suicide risk in a psychiatric emergency department. Psychol Med. 2021;52(16):1–9. pmid:33766155
  17. 17. Gould MS, Marrocco FA, Kleinman M, Thomas JG, Mostkoff K, Cote J, et al. Evaluating iatrogenic risk of youth suicide screening programs: a randomized controlled trial. JAMA. 2005;293(13):1635–43. pmid:15811983
  18. 18. Dazzi T, Gribble R, Wessely S, Fear NT. Does asking about suicide and related behaviours induce suicidal ideation? What is the evidence?. Psychol Med. 2014;44(16):3361–3. pmid:24998511
  19. 19. Mokros Ł, Rawska-Kabacińska A, Świtaj P, Wieczorek Ł, Jabłońska A, Anczewska M. Adaptation and validation of the Columbia-Suicide Severity Rating Scale (C-SSRS) - screen version. Psychiatr Pol. 2024;59(2):281–98. pmid:38852178
  20. 20. Russell DW. UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure. J Pers Assess. 1996;66(1):20–40. pmid:8576833
  21. 21. Lovibond SH, Lovibond PF. Manual for the Depression, Anxiety, Stress Scale. Sydney: Psychology Foundation. 1995.
  22. 22. Sinclair SJ, Siefert CJ, Slavin-Mulford JM, Stein MB, Renna M, Blais MA. Psychometric evaluation and normative data for the depression, anxiety, and stress scales-21 (DASS-21) in a nonclinical sample of U.S. adults. Eval Health Prof. 2012;35(3):259–79. pmid:22008979
  23. 23. Vernon H. The Neck Disability Index: state-of-the-art, 1991-2008. J Manipulative Physiol Ther. 2008;31(7):491–502. pmid:18803999
  24. 24. McCarthy MJH, Grevitt MP, Silcocks P, Hobbs G. The reliability of the Vernon and Mior neck disability index, and its validity compared with the short form-36 health survey questionnaire. Eur Spine J. 2007;16(12):2111–7. pmid:17922152
  25. 25. Dworkin RH, Turk DC, Revicki DA, Harding G, Coyne KS, Peirce-Sandner S, et al. Development and initial validation of an expanded and revised version of the Short-form McGill Pain Questionnaire (SF-MPQ-2). Pain. 2009;144(1–2):35–42. pmid:19356853
  26. 26. Chang S, Kim W-H, Jung Y-E, Roh D, Kim D, Chae J-H, et al. Clinical Utility of Impact of Event Scale-Revised for Diagnostic and Statistical Manual of Mental Disorders-Fifth Edition Posttraumatic Stress Disorder. Psychiatry Investig. 2024;21(8):870–6. pmid:39086162
  27. 27. Wheeler CHB, Williams AC de C, Morley SJ. Meta-analysis of the psychometric properties of the Pain Catastrophizing Scale and associations with participant characteristics. Pain. 2019;160(9):1946–53. pmid:30694929
  28. 28. Stoddard J, Reynolds E, Paris R, Haller SP, Johnson SB, Zik J, et al. The Coronavirus Impact Scale: Construction, Validation, and Comparisons in Diverse Clinical Samples. JAACAP Open. 2023;1(1):48–59. pmid:37359142
  29. 29. Creamer M, Bell R, Failla S. Psychometric properties of the Impact of Event Scale - Revised. Behav Res Ther. 2003;41(12):1489–96. pmid:14705607
  30. 30. Deckx L, van den Akker M, Buntinx F. Risk factors for loneliness in patients with cancer: a systematic literature review and meta-analysis. Eur J Oncol Nurs. 2014;18(5):466–77. pmid:24993076
  31. 31. Lépine J-P, Briley M. The increasing burden of depression. Neuropsychiatr Dis Treat. 2011;7(Suppl 1):3–7. pmid:21750622
  32. 32. Calati R, Laglaoui Bakhiyi C, Artero S, Ilgen M, Courtet P. The impact of physical pain on suicidal thoughts and behaviors: Meta-analyses. J Psychiatr Res. 2015;71:16–32. pmid:26522868
  33. 33. Cho H, Kim S, Son Y, Jang W, Kim HJ, Lee H, et al. Method-specific suicide mortality rates among older adults in 47 countries and territories, 1996-2021, with projections to 2050: a global time series and modelling study. Lancet Healthy Longev. 2025;6(7):100719. pmid:40659027