Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Assessment of psychological pain in suicidal veterans

  • Christopher Reist ,

    Contributed equally to this work with: Christopher Reist, Steven Mee, Ken Fujimoto, Vivek Rajani, William E. Bunney, Blynn G. Bunney

    Affiliations VA Long Beach Healthcare System, Long Beach, California, United States of America, Department of Psychiatry, University of California Irvine, Irvine, California, United States of America

  • Steven Mee ,

    Contributed equally to this work with: Christopher Reist, Steven Mee, Ken Fujimoto, Vivek Rajani, William E. Bunney, Blynn G. Bunney

    Affiliation Applied Innovative Psychiatry, Los Alamitos, California, United States of America

  • Ken Fujimoto ,

    Contributed equally to this work with: Christopher Reist, Steven Mee, Ken Fujimoto, Vivek Rajani, William E. Bunney, Blynn G. Bunney

    Affiliation Loyola University, Chicago, IIlinois, United States of America

  • Vivek Rajani ,

    Contributed equally to this work with: Christopher Reist, Steven Mee, Ken Fujimoto, Vivek Rajani, William E. Bunney, Blynn G. Bunney

    Affiliation VA Long Beach Healthcare System, Long Beach, California, United States of America

  • William E. Bunney ,

    Contributed equally to this work with: Christopher Reist, Steven Mee, Ken Fujimoto, Vivek Rajani, William E. Bunney, Blynn G. Bunney

    Affiliation Department of Psychiatry, University of California Irvine, Irvine, California, United States of America

  • Blynn G. Bunney

    Contributed equally to this work with: Christopher Reist, Steven Mee, Ken Fujimoto, Vivek Rajani, William E. Bunney, Blynn G. Bunney

    bgbunney@uci.edu

    Affiliation Department of Psychiatry, University of California Irvine, Irvine, California, United States of America

Abstract

Psychological pain is a relatively understudied and potentially important construct in the evaluation of suicidal risk. Psychological pain also referred to as ‘mental pain’ or ‘psychache’ can be defined as an adverse emotional reaction to a severe trauma (e.g., the loss of a child) or may be associated with an illness such as depression. When psychological pain levels reach intolerable levels, some individuals may view suicide as the only and final means of escape. To better understand psychological pain, we previously developed and validated a brief self-rating 10-item scale, Mee-Bunney Psychological Pain Assessment Scale [MBP] in depressed patients and non-psychiatric controls. Our results showed a significant increase in psychological pain in the depressed patients compared to controls. We also observed a significant linear correlation between psychological pain and suicidality in the depressed patient cohort. The current investigation extends our study of psychological pain to a diagnostically heterogeneous population of 57 US Veterans enrolled in a suicide prevention program. In addition to the MBP, we administered the Columbia Suicide Severity Rating Scale (C-SSRS), Beck Depression Inventory (BDI-II), Beck Hopelessness Scale (BHS), and the Barratt Impulsiveness Scale (BIS-11). Suicidal patients scoring above a predetermined threshold for high psychological pain also had significantly elevated scores on all the other assessments. Among all of the evaluations, psychological pain accounted for the most shared variance for suicidality (C-SSRS). Stepwise regression analyses showed that impulsiveness (BIS) and psychological pain (MBP) contributed more to suicidality than any of the other combined assessments. We followed patients for 15 months and identified a subgroup (24/57) with serious suicide events. Within this subgroup, 29% (7/24) had a serious suicidal event (determined by the lethality subscale of the C-SSRS), including one completed suicide. Our results build upon our earlier findings and recent literature supporting psychological pain as a potentially important construct. Systematically evaluating psychological pain along with additional measures of suicidality could improve risk assessment and more effectively guide clinical resource allocation toward prevention.

Introduction

Suicide is a serious public health problem and one of the leading causes of death worldwide accounting for an estimated 800,000 deaths annually according to recent statistics from the World Health Organization [1]. In the United States alone more than 42,000 individuals die by suicide every year [2] and rates are increasing [3]. Military suicide rates, normally lower than the general US population, have surpassed that of the civilian population [4] and almost doubled for some military services [5].

Psychological pain is a relatively understudied and potentially important construct for the assessment of suicidal risk. Also referred to as ‘mental pain’ or ‘psychache’, psychological pain can be defined as an emotionally-based aversive feeling that at its extreme can be experienced as torment that may result from a severe emotional trauma (such as the loss of a child) or may be associated with an illness such as depression [5]. Schneidman [6] reviewed hundreds of notes left by completed suicides, and was the first to report a common overarching theme (“I can’t stand the ‘mental pain’ any longer”) suggesting that when psychological pain reaches unbearable levels, individuals view death as a final and only means of escape [7].

A review of ‘mental pain’ in mood disorder patients and studies in clinically heterogeneous patient populations found a significant correlation between high levels of psychological pain and suicidality, independent of psychiatric diagnoses [8]. It is likely that psychological pain alone is only one of many contributing factors. For example, depression, hopelessness and impulsiveness are factors known to increase suicide risk [912].

In our original study, we developed and validated a brief 10-item self-rating scale, the Mee-Bunney Psychological Pain Assessment Scale [MBP] [5]. The MBP is a self-report instrument designed for use in diverse clinical settings and can be easily administered by clinicians in a variety of settings. Items are rated on a 5-point Likert Scale and include categories such as chronicity (past 3 months), current psychological pain levels, intensity, tolerance (“how much psychological pain can you tolerate before it becomes unbearable?” and risk (“Do you feel the only way to make the psychological pain stop is to die?). We administered the MBP to 73 major depressive episode (MDE) patients and 96 non-psychiatric controls and showed significantly higher levels of psychological pain in the MDE patients. Further, we demonstrated a significant linear correlation between psychological pain and suicidality. Known groups, content and convergent validity and internal reliability for psychological pain (MBP) were also demonstrated in this study. Convergent validity showed that while the MBP and BDI were related (i.e., scores on these measures converged), the variance in scores was distinct in terms of suicidality. Known groups validity was established by demonstrating that after removing partial contributions of the rating scales, significant group differences remained between MDE patients and controls.

In the current study, we assessed psychological pain in a diagnostically heterogeneous population of suicidal VA patients enrolled in a suicide prevention program. In addition to the MBP, we evaluated depression [(Beck Depression Inventory-BDI-II), impulsiveness (Barratt Impulsiveness Scale-BIS II), hopelessness (Beck Hopelessness Scale-BHS) and suicidality (Columbia Suicide Severity Rating Scale (C-SSRS)]. To explore the relationship between psychological pain and future suicidal behavior we followed patients for 15 months and recorded suicide events. Serious suicide events (SSEs) were identified using the lethality/medical damage subscale of the C-SSRS. Due in part to a potential association with high psychological pain and suicidality [68] we hypothesized that the suicidal subjects would score higher on the MBP than major depressive episode (MDE) patients from our previous study [5].

Methods

Informed Consent: This study was approved by the Veteran’s Affairs Long Beach Healthcare System. All subjects provided written signed consents.

Subjects: Suicidal patients: A total of 57 psychiatric patients (23 outpatients and 34 inpatients) from the Veterans Affairs Long Beach Healthcare System (LBVAHS) meeting criteria were consecutively enrolled in the study. [The sample size was determined using data from our earlier study showing sufficient power for N≥50 [5]]. Patients were referred to the LBVAHS Suicide Prevention Program (SPP) for recent (within 3 months) suicidal ideation and/or behavior. The SPP is a team of clinicians who identify and monitor US Veterans who have previously attempted suicide or who are at risk for suicide.

Inclusion criteria: Males and females between 18–75 years of age receiving treatment at LBVAHS for suicidality.

Exclusion criteria: Acute substance intoxication, inability to fluently read and comprehend the English language and/or other conditions that would prevent an individual’s ability to comprehend and meaningfully complete the assessment instruments. Of those approached to participate, 1 patient was excluded due to lack of English fluency.

Table 1 provides demographics for the 57 suicidal patients. All 57 patients completed the assessments. Psychiatric diagnoses including post-traumatic stress disorder (PTSD), major depressive disorder (MDD), bipolar disorder (BPD), history of substance abuse as well as schizophrenia spectrum. Forty patients had co-occurring disorders.

Assessments

Initial visit: All subjects underwent structured diagnostic interviews with the Mini International Neuropsychiatric Interview Version 5.0.0 [(MINI) for DSM-IV and ICD-10 psychiatric disorders] administered by trained clinicians at in- or outpatient settings. Although not a fully comprehensive DSM-IV diagnostic instrument, the MINI provides reliable assessment of mood and anxiety disorders as well as substance abuse/dependence. It has demonstrated high concordance with the SCID for major depression and represents a reduced time burden for the participant [13]. We administered five scales to all patients: 1) Mee-Bunney Psychological Pain Assessment Scale (MBP) [5]; 2) Columbia-Suicide Severity Rating Scale, Baseline version (C-SSRS), to establish the severity and frequency of suicidal ideation [14]; 3) Beck Depression Inventory-II (BDI-II) [15], 4) Beck Hopelessness Scale (BHS) [16]; 5) Barratt Impulsiveness Scale (BIS-11) [17].

Mee-Bunney Psychological Pain Scale (MBP): a 10-item self-report measure allowing for rapid assessment of psychological pain in a general clinical setting using a 5-point Likert scale. The MBP measures frequency (“never” to “always”), intensity (“none” to “high”) and past (prior 3 months) and current psychological pain. Additionally, two items address risk to stop the pain, including dying. We used a pre-determined threshold from our original study (i.e., MBP ≥ 32 representing 0.5 standard deviations above the mean for MDE patients) as a cutoff for high psychological pain[5]. The Cronbach’s alpha (a measure of internal consistency for the MBP) was 0.86 for this study.

Columbia-Suicide Severity Rating Scale, Baseline version (C-SSRS): a standardized structured interview scale to assess suicidal ideation and behavior at the initial visit over the past month and historically.

BDI-II: a 21-item self-report measure of depression symptom severity obtained from answer choices on a four-point Likert scale to groups of statements. The BDI-II is revised from a previous version (BDI: Diagnostic and Statistical Manual-DSM-IV) to factor changes in diagnoses. The Cronbach’s alpha was .95 for this study

BHS: a 20-item self-report inventory designed to measure three aspects of hopelessness: feelings about the future, loss of motivation, and expectations. It has demonstrated construct validity and reliability with a Cronbach’s alpha = .95 for this study.

BIS-11 is a questionnaire designed to assess the personality/behavioral construct of impulsiveness. It includes 30 items that are scored to yield six first-order factors (attention, motor, self-control, cognitive complexity, perseverance, and cognitive instability impulsiveness) and three second-order factors (attentional, motor, and non-planning impulsiveness). The Cronbach’s alpha for this study is .87

15-month follow-up: Patients were tracked using electronic medical records within the VA system. Information included provider progress notes related to outpatient (including emergency room visits) and/or inpatient treatments. Data was carefully screened for information relevant to suicidal ideation or behavior. The comprehensive review included screening medical records from the Long Beach VA as well as from additional VA facilities. 56/57 patients continued care at a VA facility for the 15-month follow-up. One patient completed suicide. We evaluated seriousness of suicidal events using the lethality/medical subscale of the C-SSRS [14].

To determine whether suicidal patients in this study scored higher for psychological pain than major depressive episode patients (N = 73) from our previous study [5], we compared MBP scores between the two groups.

Statistical analysis

We utilized multiple regression analysis, with predictors entered into the model in blocks to examine relationships between the various scales and suicidality. As a starting point, a single predictor was included in the model to establish the baseline contribution of that predictor with respect to suicidality as measured by the C-SSRS. We then built on that model by entering the MBP, which served as the second block of predictors. Doing so, we assessed the additional amount of variance that MBP explained in suicidality on top of each of the other predictors. We could not run a model including all predictors (i.e., BIS, BHS, BDI and MBP) due to the small sample size. Group differences between patients and controls were examined by two-tailed t-tests. As multiple statistical significance tests were performed, the Type I error rate for all analyses was set at .01.

To determine whether suicidal patients rated higher for psychological pain on the MBP compared to patients with a major depressive episode from our earlier study [5] we performed a two-tailed t-test post-hoc to assess the difference in means between the two groups.

Results

Inpatients versus outpatients

There were no significant differences between inpatients or outpatients on any of the rating scales although there was a trend towards a difference in depression (BDI) (Table 2).

thumbnail
Table 2. Comparison of test scores of in- versus outpatientsa.

https://doi.org/10.1371/journal.pone.0177974.t002

Psychological pain (MBP): 24/57 (42.1%) suicidal patients scored above a pre-determined threshold [5] for high psychological pain (MBP ≥ 32). (MeanMBP suicidal = 30.14 ± 7.43; MeanMBP controls = 12.7 ±4.5, p>.001).(Fig 1).

thumbnail
Fig 1. Cumulative distribution graph of MBP scores for suicidal patients (N = 57).

Suicidal patients were ranked according to MBP scores from highest to lowest.

https://doi.org/10.1371/journal.pone.0177974.g001

Beck Depression Inventory (BDI-II): Overall depression scores were elevated (BDI mean = 13.2 ± 7.82. (BDI ranges: 0–9 minimal depression; 10–18 mild depression, 19–29 moderate depression, 30–63 severe depression).

Beck Hopelessness Scale (BHS): MeanBHS = 10.11 ± 6.90, considered to be moderate in intensity (Range: 0–3: none or minimal; 4–8: mild; 9–14: moderate may not be in immediate danger but needs monitoring; 15+: severe, definite suicide risk.

Barratt Impulsiveness Scale (BIS): Impulsiveness was elevated in suicidal patients (BIS mean = 74.12 ± 12.40). [Control scores are in the range of 50 to 60 [18]].

Regression of C-SSRS on MBP, BIS, BDI and BHS

To determine the relationships between measured psychiatric constructs and suicidality, C-SSRS scores were independently regressed on each predictor in seven separate analyses. Based on the linear regression (Table 3), psychological pain (MBP) accounted for the largest proportion of variance in the C-SSRS, followed by overall impulsiveness level (BIS total score), depression (BDI), and hopelessness (BHS). Impulsiveness (BIS) and psychological pain (MBP) contributed more to suicidality than any of the other combined assessments. The additional variance in suicidality (C-SSRS) contributed by the MBP on top of what impulsiveness (BIS) explains alone is 10%. The additional variance contributed by depression (BDI) and hopelessness (BHS) did not reach statistical significance.

thumbnail
Table 3. Simple linear regression of psychological pain (MBP), impulsiveness (BIS), depression (BDI) and hopelessness (BHS) on suicidality (C-SSRS).

https://doi.org/10.1371/journal.pone.0177974.t003

Differentiation of patients scoring above and below the MBP threshold

In our previous study we used a predetermined threshold of MBP ≥ 32 representing 0.5 SD above the mean for depressed MDE patients as a cutoff for high psychological pain [5]. As illustrated in Table 4, patients ranking above threshold also scored significantly higher on the other assessments (C-SSRS, BDI, BHS, BIS) suggesting that these patients were more suicidal, depressed, hopeless and impulsive than patients with lower scores.

thumbnail
Table 4. Two-tailed ‘t’ tests showing significant differences in test scores between high and low scoring patients on the MBPa.

https://doi.org/10.1371/journal.pone.0177974.t004

Incidence of serious suicide events (SSEs) at a 15-month follow-up

At a 15-month follow-up we recorded 9 SSEs, including one completed suicide (S1 Table). Two additional patients made what were determined to be non-serious gestures. Seven of the nine patients rated above-threshold for high psychological pain while two patients making suicide gestures scored in mid-range. The SSE patient with the highest score (MBP = 42) overdosed on drugs within 36 days of assessment and had to be intubated, requiring hospitalization in the ICU. Another patient scoring above threshold (MBP = 39) had an interrupted suicide attempt throat slitting (within 2.5 months of assessment). The patient who completed suicide had dropped out of the VA program and had an above threshold score (MBP = 33). Two other SSE patients had high but slightly below-threshold scores of 30 and 31, respectively. There were no other suicide events.

Logistic regression did not identify any baseline variables that predicted future SSEs. This is likely a consequence of the small number of subjects having a serious suicide event combined with a relatively low variability in scale scores. Examination of MBP scores categorically (MBP <32; MBP ≥ 32) did however suggest a relationship with future SSEs (Chi-squared = 5.58, df = 1, p = .018) but did not reach significance since we are using a Type 1 error rate of 0.1.

MBP scores in suicidal vs major depressive episode (MDE) patients

We compared MBP scores from suicidal patients and the cohort of MDE patients from our earlier study[5]. A post-hoc t-test showed no significant difference in means between the groups: (mean MBPsuicide.30.14 ± 7.82,) and MDE (mean MBPMDE 28.7 ± 6.4); t = -1.21, p = .23).

Discussion

The primary focus of this study was to evaluate psychological pain in a US veteran population of suicidal patients with a recent (within 3 months) history of suicidality. Using the MBP scale we identified a subgroup (24/57) of patients meeting criteria for high psychological pain. These patients also scored significantly higher for depression (BDI), hopelessness (BHS), impulsiveness (BIS) and suicidality (C-SSRS) compared to patients with lower MBP scores suggesting that suicidal patients with high psychological pain may represent a more severely ill subgroup. Our findings expand on our original research in which we showed a significant linear correlation between psychological pain and suicidality in major depressive episode (MDE) patients [5].

The MBP had the highest predictive value for suicidality (as measured by the C-SSRS) than depression (BDI), hopelessness (BHS) and impulsiveness (BIS) in suicidal patients. These results are compatible with our findings in MDE subjects and are supported by a comprehensive review in which mental pain was found to be a stronger factor of vulnerability to suicidal ideation than depression [8].

Despite the growing number of investigations on psychological pain, the link between high levels of psychological pain and suicidality has not been firmly established. Within our suicidal cohort, less than half (42%) scored above threshold on the MBP. This may be due to the potentially transient nature of psychological pain where intense pain levels fluctuate [19] and as reported, may rapidly (within days) decrease [9].

Based in part on Shneidman’s hypothesis that unbearable psychological pain is a motivating factor for suicide [6], we expected that suicidal patients would have a significantly higher mean score on the MBP than MDE patients from our previous study [5]. However, a post-hoc analysis revealed no significant difference between the depressed and suicidal patients although we observed a trend for higher psychological pain in the suicidal group.

Inpatients versus outpatients

No significant differences were found between in and outpatients on any of the evaluations although there was a non-significant trend for an increase in depression in the hospitalized patients.

Our data suggest that the weeks to months following high psychological pain could represent an increased period of vulnerability for a serious attempt. These results are consistent with previous studies showing a marked increase in suicides following discharge from psychiatric hospitals [2023]. We identified 9/57 (15.8%) patients with serious suicide events including one completed suicide. All 9 patients had high (n = 7) or near high threshold (n = 2) psychological pain. The one completed suicide scored above threshold on the MBP. Two additional patients with low to mid-range scores on the MBP made non-serious suicide gestures. These data, although preliminary, suggest the potential importance of assessing psychological pain in high-risk populations to help target individuals for additional interventions.

Research is needed to identify the factors that contribute to the transition from suicidal ideation to an SSE. Our research suggests that high levels of pain may help facilitate the transition and perhaps, as suggested by Meerwijk et al., [19, 24] when tolerance to pain falls below a critical level, the risk for suicidality increases. When combined with depression, hopelessness and impulsiveness the risk may be further elevated [912, 25]. Our observation that lethality of the attempts were associated with high scores for psychological pain may be due in part to the MBP test items capturing additional aspects of suicidality including tolerance to psychological pain and reporting that dying was an option to make the mental pain stop. However, studies in larger populations are needed.

Comprehensive data collected on military personnel support recent social stressors (within 90 days of the event) as a contributing factor to suicidality. The Department of Defense Suicide Event Report (DoDSER)[26] identified major social stressors (e.g., failed intimate relationships, financial problems and administrative/legal issues) as probable contributors to completed suicides. Only one of the SSE patients in our study reported a social stressor (breakup with spouse) at the time of admission into the study. Possibly relevant is that this patient completed suicide by overdose and rated psychological pain on the MBP above threshold. Future studies could help define the interaction of psychosocial stressors and psychological pain as they relate to suicide risk.

There are several limitations to our study. Medication could not be controlled or ethically withheld and our patients represented a diagnostically heterogeneous suicidal population including MDD, BPD, and PTSD, some with co-morbidity for substance abuse. Finally, we included both in and outpatient subjects in analyses.

Conclusions

A subset of patients with an increased vulnerability for experiencing high levels of psychological pain may represent a novel pathophysiological subtype of psychiatric disease with an increased risk for suicidality. Rather than solely focusing on the singular presence of suicidality, for example, proactively assessing underlying sub-constructs of suicide such as psychological pain, impulsiveness and hopelessness carries the potential for improving the identification of high-risk individuals.

Although many of the tests for suicidality including the Beck Hopelessness Scale (BHS), Beck Depression Scale (BDI) and Suicide Intent Scale (SIS)] have increased sensitivity for suicidality, they may not be as accurate for suicide prediction [27]. The addition of assessment tools such as the MBP to measure psychological pain may help further delineate a high-risk subpopulation for increased clinical interventions. Since a high proportion of suicides occur within close temporal proximity to clinician visits [28] and discharge from psychiatric hospitalization [20, 29], assessment with a combination of measures may improve risk evaluation during this important period.

Supporting information

S1 Table. Clinical descriptors of patients with serious suicidal events (15 month follow-up).

https://doi.org/10.1371/journal.pone.0177974.s001

(DOCX)

Author Contributions

  1. Conceptualization: CR SM BB WEB.
  2. Data curation: KF CR.
  3. Formal analysis: KF.
  4. Investigation: VR CR.
  5. Methodology: KF CR SM BB WEB.
  6. Project administration: CR.
  7. Resources: VR CR.
  8. Software: KF.
  9. Supervision: CR.
  10. Validation: KF CR SM BB WEB.
  11. Visualization: BB CR SM WEB.
  12. Writing – original draft: BB CR SM WEB.
  13. Writing – review & editing: BB CR SM WEB.

References

  1. 1. WHO. World Health Organization: Suicide Data2017. Available from: http://www.who.int/mediacentre/factsheets/fs398/en/.
  2. 2. CDC. FastStats Centers for Disease Control2015. Available from: http://www.cdc.gov/nchs/fastats/suicide.htm.
  3. 3. Curtin SC WM, Hedegaard H. Increase in Suicide in the United States, 1999–2014. NCHS data brief, no 241 [Internet]. 2016 March 30, 2017. Available from: https://www.cdc.gov/nchs/products/databriefs/db241.htm.
  4. 4. Ursano RJ, Colpe LJ, Heeringa SG, Kessler RC, Schoenbaum M, Stein MB, et al. The Army study to assess risk and resilience in servicemembers (Army STARRS). Psychiatry. 2014;77(2):107–19. PubMed Central PMCID: PMCPMC4075436. pmid:24865195
  5. 5. Mee S, Bunney BG, Bunney WE, Hetrick W, Potkin SG, Reist C. Assessment of psychological pain in major depressive episodes. J Psychiatr Res. 2011;45(11):1504–10. pmid:21831397
  6. 6. Shneidman ES. Suicide as psychache. J Nerv Ment Dis. 1993;181(3):145–7. pmid:8445372
  7. 7. Leenaars AA. Lives and deaths: Biographical notes on selections from the works of Edwin S. Shneidman. Suicide Life Threat Behav. 2010;40(5):476–91. pmid:21034210
  8. 8. Verrocchio MC, Carrozzino D, Marchetti D, Andreasson K, Fulcheri M, Bech P. Mental Pain and Suicide: A Systematic Review of the Literature. Front Psychiatry. 2016;7:108. PubMed Central PMCID: PMCPMC4913233. pmid:27378956
  9. 9. Caceda R, Durand D, Cortes E, Prendes-Alvarez S, Moskovciak T, Harvey PD, et al. Impulsive choice and psychological pain in acutely suicidal depressed patients. Psychosom Med. 2014;76(6):445–51. pmid:24988311
  10. 10. Swann AC, Dougherty DM, Pazzaglia PJ, Pham M, Steinberg JL, Moeller FG. Increased impulsivity associated with severity of suicide attempt history in patients with bipolar disorder. Am J Psychiatry. 2005;162(9):1680–7. pmid:16135628
  11. 11. Rimkeviciene J, O'Gorman J, De Leo D. Impulsive suicide attempts: a systematic literature review of definitions, characteristics and risk factors. J Affect Disord. 2015;171:93–104. pmid:25299440
  12. 12. Doihara C, Kawanishi C, Ohyama N, Yamada T, Nakagawa M, Iwamoto Y, et al. Trait impulsivity in suicide attempters: preliminary study. Psychiatry Clin Neurosci. 2012;66(6):529–32. pmid:22989319
  13. 13. Jones JE, Hermann BP, Barry JJ, Gilliam F, Kanner AM, Meador KJ. Clinical assessment of Axis I psychiatric morbidity in chronic epilepsy: a multicenter investigation. J Neuropsychiatry Clin Neurosci. 2005;17(2):172–9. pmid:15939970
  14. 14. Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168(12):1266–77. PubMed Central PMCID: PMCPMC3893686. pmid:22193671
  15. 15. Beck AT, Steer, R.A., Brown, G.K. Beck Depression Inventory-II. San Antonio: Harcourt Brace; 1996.
  16. 16. Beck AT, Weissman A, Lester D, Trexler L. The measurement of pessimism: the hopelessness scale. J Consult Clin Psychol. 1974;42(6):861–5. pmid:4436473
  17. 17. Patton JH, Stanford MS, Barratt ES. Factor structure of the Barratt impulsiveness scale. J Clin Psychol. 1995;51(6):768–74. pmid:8778124
  18. 18. Swann AC, Bjork JM, Moeller FG, Dougherty DM. Two models of impulsivity: relationship to personality traits and psychopathology. Biol Psychiatry. 2002;51(12):988–94. pmid:12062883
  19. 19. Meerwijk EL, Ford JM, Weiss SJ. Suicidal crises because of diminishing tolerance to psychological pain. Brain Imaging Behav. 2013;7(3):245–7. pmid:23640703
  20. 20. Olfson M, Wall M, Wang S, Crystal S, Liu SM, Gerhard T, et al. Short-term Suicide Risk After Psychiatric Hospital Discharge. JAMA Psychiatry. 2016;73(11):1119–26. pmid:27654151
  21. 21. Large M, Sharma S, Cannon E, Ryan C, Nielssen O. Risk factors for suicide within a year of discharge from psychiatric hospital: a systematic meta-analysis. Aust N Z J Psychiatry. 2011;45(8):619–28. pmid:21740345
  22. 22. Luxton DD, Trofimovich L, Clark LL. Suicide risk among US Service members after psychiatric hospitalization, 2001–2011. Psychiatr Serv. 2013;64(7):626–9. pmid:23677509
  23. 23. Meehan J, Kapur N, Hunt IM, Turnbull P, Robinson J, Bickley H, et al. Suicide in mental health in-patients and within 3 months of discharge. National clinical survey. Br J Psychiatry. 2006;188:129–34. pmid:16449699
  24. 24. Meerwijk EL, Ford JM, Weiss SJ. Resting-state EEG delta power is associated with psychological pain in adults with a history of depression. Biol Psychol. 2015;105:106–14. PubMed Central PMCID: PMCPMC4336814. pmid:25600291
  25. 25. Trakhtenbrot R, Gvion Y, Levi-Belz Y, Horesh N, Fischel T, Weiser M, et al. Predictive value of psychological characteristics and suicide history on medical lethality of suicide attempts: A follow-up study of hospitalized patients. J Affect Disord. 2016;199:73–80. pmid:27085659
  26. 26. DoDSER. Department of Defense Suicide Event Report Calendar Year 2014 Annual Report2016 November 3, 2015. Available from: http://www.dspo.mil/Portals/113/Documents/CY 2014 DoDSER Annual Report—Final.pdf.
  27. 27. Bolton JM, Gunnell D, Turecki G. Suicide risk assessment and intervention in people with mental illness. BMJ. 2015;351:h4978. pmid:26552947
  28. 28. Luoma JB, Martin CE, Pearson JL. Contact with mental health and primary care providers before suicide: a review of the evidence. Am J Psychiatry. 2002;159(6):909–16. pmid:12042175
  29. 29. Kessler RC, Warner CH, Ivany C, Petukhova MV, Rose S, Bromet EJ, et al. Predicting suicides after psychiatric hospitalization in US Army soldiers: the Army Study To Assess Risk and Resilience in Service members (Army STARRS). JAMA Psychiatry. 2015;72(1):49–57. PubMed Central PMCID: PMCPMC4286426. pmid:25390793