Figures
Abstract
Background
The association between temperament characteristics and mood disorders has gained much attention in recent years. The Temperament Evaluation of Memphis, Pisa, Paris and San Diego-autoquestionnaire version (TEMPS-A) is a self-rating scale measuring 5 affective temperament dimensions. In this study, we aimed to clarify whether each affective temperament of TEMPS-A is a differentiating factor between major depressive disorder (MDD), bipolar I disorder (BD-I), and bipolar II disorder (BD-II), and analyzed the utility of TEMPS-A in their differential diagnosis in a clinical setting.
Methods
A total of 346 patients (MDD, n = 176; BD-II, n = 112; BD-I, n = 58) filled out TEMPS-A. To assess the patients’ mood state at the time of temperament assessment, Patient Health Questionnaire-9 (PHQ-9) and Young Mania Rating Scale (YMRS) were also conducted.
Results
Multivariate logistic regression analysis demonstrated that cyclothymic and anxious temperament scores were significant factors differentiating the diagnosis of BD-I and BD-II from the diagnosis of MDD, and hyperthymic temperament score was a specific factor for the differential diagnosis of BD-I versus the diagnosis of BD-II.
Citation: Morishita C, Kameyama R, Toda H, Masuya J, Ichiki M, Kusumi I, et al. (2020) Utility of TEMPS-A in differentiation between major depressive disorder, bipolar I disorder, and bipolar II disorder. PLoS ONE 15(5): e0232459. https://doi.org/10.1371/journal.pone.0232459
Editor: Kenji Hashimoto, Chiba Daigaku, JAPAN
Received: January 28, 2020; Accepted: April 15, 2020; Published: May 22, 2020
Copyright: © 2020 Morishita et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be shared publicly because of Ethics Committee restriction. All relevant data are within the paper. Data are available from the Internal Review Board of the Department of Psychiatry, Tokyo Medical University (Japan)(contact via email: seisinka@tokyo-med.ac.jp) for researchers who meet the criteria for access to confidential data.
Funding: This work was supported in part by a Grant-in-Aid for Scientific Research (no. 16K10194, to T. Inoue) from the Japanese Ministry of Education, Culture, Sports, Science and Technology, Research and Development Grants for Comprehensive Research for Persons with Disabilities from Japan Agency for Medical Research and Development, and a grant from SENSHIN Medical Research Foundation.
Competing interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: Jiro Masuya has received personal compensation from Otsuka Pharmaceutical, Eli Lilly, Astellas, and Meiji Yasuda Mental Health Foundation, and grants from Pfizer. Masahiko Ichiki has received personal compensation from Otsuka Pharmaceutical, Pfizer, Eli Lilly, Mitsubishi Tanabe Pharma, Mochida Pharmaceutical, Meiji Seika Pharma, Janssen Pharmaceutical, Takeda Pharmaceutical, MSD, Dainippon Sumitomo Pharma, and Eisai; grants from Otsuka Pharmaceutical, Eli Lilly, Eisai, Shionogi, Takeda Pharmaceutical, MSD, and Pfizer; and is a member of the advisory board of Meiji Seika Pharma. Ichiro Kusumi has received personal compensation from Astellas, Chugai Pharmaceutical, Daiichi Sankyo, Dainippon Sumitomo Pharma, Eisai, Eli Lilly, Janssen Pharmaceutical, Kyowa Hakko Kirin, Meiji Seika Pharma, MSD, Nippon Chemiphar, Novartis Pharma, Ono Pharmaceutical, Otsuka Pharmaceutical, Pfizer, Mitsubishi Tanabe Pharma, Shionogi, and Yoshitomiyakuhin; has received research/grant support from AbbVie GK, Asahi Kasei Pharma, Astellas, Boehringer Ingelheim, Chugai Pharmaceutical, Daiichi Sankyo, Dainippon Sumitomo Pharma, Eisai, Eli Lilly, GlaxoSmithKline, Kyowa Hakko Kirin, Meiji Seika Pharma, MSD, Novartis Pharma, Ono Pharmaceutical, Otsuka Pharmaceutical, Pfizer, Takeda Pharmaceutical, Tanabe Mitsubishi Pharma, Shionogi, and Yoshitomiyakuhin; and is a member of the advisory board of Dainippon Sumitomo Pharma and Tanabe Mitsubishi Pharma. Takeshi Inoue has received personal compensation from Mochida Pharmaceutical, Takeda Pharmaceutical, Eli Lilly, Janssen Pharmaceutical, MSD, Taisho Toyama Pharmaceutical, Yoshitomiyakuhin, and Daiichi Sankyo; grants from Shionogi, Astellas, Tsumura, and Eisai; grants and personal fees from Otsuka Pharmaceutical, Dainippon Sumitomo Pharma, Mitsubishi Tanabe Pharma, Kyowa Pharmaceutical Industry, Pfizer, Novartis Pharma, and Meiji Seika Pharma; and is a member of the advisory boards of Pfizer, Novartis Pharma, and Mitsubishi Tanabe Pharma. All other authors declare that they have no actual or potential conflicts of interest associated with this study. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Differentiating between major depressive disorder (MDD), bipolar I disorder (BD-I), and bipolar II disorder (BD-II) in the early stages of disease is clinically important [1, 2], because clinicians should take different treatment approaches for the 3 disorders and inappropriate treatment can be associated with poor prognoses. For example, clinicians should not provide antidepressant monotherapy to patients with BD, particularly those with BD-I, according to many treatment guidelines for mood disorders [3, 4], and inappropriate treatment of BD and an extended duration of untreated BD may increase the risk of mood instabilities and suicide attempts [1, 2]. However, this distinction often requires a large amount of time and effort for clinicians, owing to various reasons. One reason is that in two-thirds of patients, the onset of BD is a major depressive episode [5]. Another reason is the lack of patient self-awareness of prior or future manic or hypomanic episodes [6].
In recent years, the association between mood disorders and temperament characteristics has gathered much attention. The Temperament Evaluation of Memphis, Pisa, Paris and San Diego-autoquestionnaire version (TEMPS-A) is a 110-item true-false self-reported questionnaire that quantitatively assesses 5 domains of affective temperament, i.e., depressive, hyperthymic, cyclothymic, irritable, and anxious temperaments [7]. Vazquez et al. showed the association between some affective temperaments on TEMPS-A and a suicidal risk in both psychiatric and general population samples [8]. The association between some affective temperaments on TEMPS-A and treatment resistance in MDD and BD patients has also been studied [9–11]. Moreover, Goto et al. suggested that cyclothymic and hyperthymic temperaments were associated with bipolarity, and also investigated the association between treatments and remission rates in patients with bipolarity [12]. Furthermore, several studies have shown the possibility of the usefulness of TEMPS-A to differentiate between MDD and BD [13–18]. However, most previous studies had limitations, such as a small sample size or that the data were not analyzed by multivariate analyses, including current mental status as an independent variable, although mood state is known to influence the self-evaluation of affective temperament [19]. Moreover, Solmi et al. [20] performed a meta-analysis and found that patients with a diagnosis of BD had significantly higher cyclothymic, hyperthymic, and irritable temperament scores compared with patients with a diagnosis of MDD. To our knowledge, this is the only study to date that performed a meta-analysis to assess the association between affective temperament scores on TEMPS-A and the diagnosis of mood disorders; however, the subjects included were of various mental states, and the possible effects of their mental states were ignored in the meta-analysis.
On the other hand, our previous studies demonstrated that cyclothymic and anxious temperaments were factors differentiating MDD and BD patients from healthy subjects [9, 10]. The data of our studies were analyzed by multivariate logistic regression analyses to take into account several relevant factors, such as depression severity, but we did not include manic or hypomanic symptoms in the analyses. Moreover, we did not compare the characteristics of TEMPS-A between MDD patients and BD patients, or between BD-I patients and BD-II patients. Takeshima and Oka [11] demonstrated that cyclothymic and hyperthymic temperaments are independent differentiating factors of BD in their comparison between MDD and BD patients. The data of their study were analyzed by multivariate logistic regression analysis, including the severity of depressive symptoms as an independent variable, but they ignored manic symptoms at the time of temperament assessment, and they did not consider BD-I and BD-II separately.
There have been few studies in which the severity of mood symptoms and the effects of other temperaments were taken into account in the comparison between MDD and BD. In other words, in previous studies, the effects of relevant factors were not considered. Moreover, no study to date has performed multivariate analysis to identify affective temperaments as differentiating factors of BD-I compared with BD-II. For these reasons, it has not yet been clarified whether TEMPS-A is useful for the differential diagnosis of mood disorders. Therefore, we hypothesized that each subscale of affective temperaments assessed by TEMPS-A is a differentiating factor of the diagnosis of MDD, BD-I, and BD-II.
The aim of this study was to test this hypothesis, and to clarify whether TEMPS-A is useful for a differential diagnosis in a clinical setting.
Subjects and methods
Subjects
Subjects were 157 outpatients and 189 inpatients (MDD, n = 176; BD-II, n = 112; BD-I, n = 58). Approximately 70 or more subjects for each disorder group were required for our analyses, because we planned to conduct multivariate logistic regression analyses including 7 factors as independent variables. Patient diagnoses were performed by psychiatric specialists who were responsible for the treatment of these patients, according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-Ⅳ-TR). The outpatients were those who received treatment at the Department of Psychiatry of either Hokkaido University Hospital or Self-Defense Forces Sapporo Hospital, both in Sapporo, National Defense Medical College Hospital in Tokorozawa, or Self-Defense Forces Central Hospital in Tokyo, between April 2012 and April 2013. The inpatients were those who received treatment at the Department of Psychiatry, Hokkaido University Hospital, between January 2010 and December 2017. The inclusion criteria of the patients were as follows: (1) a principal diagnosis of MDD, BD-I, or BD-II according to the DSM-Ⅳ-TR criteria; (2) 20 years of age or older; (3) the ability to complete the self-reported questionnaires; and (4) the ability to provide written informed consent. The exclusion criteria were as follows: (1) having serious physical or mental symptoms that hinder the completion of the self-reported questionnaires; (2) having organic mental disorders or a previous history of them; (3) meeting the diagnostic criteria of substance-use disorders; and (4) having a diagnosis of axis II according to the DSM-Ⅳ-TR criteria. Patients meeting the eligibility criteria were informed about our research by their doctors in charge, and those who gave written consent were included in the study. The sample might not be a nationally representative sample, as the sample was limited to a convenience sample, and consisted of only patients who received treatment at general or university hospitals in specific parts of Japan. In other words, the sample did not include patients who received treatment at psychiatric hospitals or clinics. The present study was performed in accordance with the Declaration of Helsinki, and was approved by the ethics committees of National Defense Medical College, Hokkaido University Hospital, and Tokyo Medical University. The approval number is SH4098.
Table 1 presents the demographic data, Patient Health Questionnaire-9 (PHQ-9) and Young Mania Rating Scale (YMRS) scores, and TEMPS-A subscores of the subjects.
Measures and procedures
The patients completed the Japanese standardized version of the TEMPS-A. The validity and reliability of TEMPS-A for psychiatric disorders, particularly for mood disorders, was suggested by Akiskal et al. [7], and the validity and reliability of the Japanese version was also shown by Matsumoto et al. [14]. In the analyses, True was scored as 2 and False was scored as 1, and final values were obtained by dividing the total points of each affective temperament subscale by the number of question items measuring each subscale.
The inpatients filled out the TEMPS-A at the time of hospital discharge, after their symptoms were improved by adequate treatment. The outpatients filled out the TEMPS-A at some point in their continuous visits, but not at their first visit. In other words, they completed it after they received treatment for months or years.
To assess the severity of depressive symptoms, patients were also asked to complete the Japanese version of PHQ-9 at the same time as completing the TEMPS-A. The PHQ-9 is a self-reported questionnaire consisting of 9 items on a 4-point Likert scale, used as an index of depressive symptom severity and as a screening test for major depressive episodes. The Japanese version of the PHQ-9 was used in this study. Some studies suggested that the PHQ-9 yields an index of depressive symptom severity and has diagnostic validity, and also validates the Japanese version of the PHQ-9 [21–23]. Additionally, to assess manic symptoms, evaluation using the Young Mania Rating Scale (YMRS) was performed by psychiatrists. The YMRS is an assessment sheet consisting of 11 items, which are each rated on a 0–4 scale. The rating of severity is based on both the subjective statements of patients and objective observation by clinicians. The construct validity and reliability of YMRS was demonstrated by Young et al. [24]. Demographic features, such as age, sex, duration of education, employment, and marital status were also analyzed. Data were anonymized and sent to our research group.
Statistical analyses
Continuous variables were compared using analysis of variance, and categorical variables were compared by the Kruskal-Wallis test. Post-hoc analyses were performed by the Bonferroni test. Multivariate logistic regression analyses using the backward stepwise method were performed to identify factors of the distinction of MDD, BD-I, and BD-II. Then, receiver operating characteristic (ROC) curves were used to assess the performances. Moreover, multivariate logistic regression analyses using the forced entry method were performed to confirm the reproducibility of the results.
Statistical analyses were performed using SPSS 24.0J for Windows (SPSS Inc., Chicago, IL, USA). A p-value of less than 0.05 was considered to indicate a statistically significant difference.
Results
Demographic and clinical characteristics and TEMPS-A subscale scores (Table 1)
YMRS scores were higher in the BD-I and BD-II groups than in the MDD group, although a statistically significant difference between the BD-I and BD-II groups was not detected. Differences of age, sex, education years, employment status, marital status, and PHQ-9 scores were not statistically significant among the 3 disease groups.
Three-group comparisons of MDD, BD-I, and BD-II demonstrated statistically significant differences in cyclothymic and hyperthymic temperaments, but we did not find statistically significant differences in depressive, irritable, or anxious temperaments among the 3 groups. Substantially higher cyclothymic temperament scores were found in the BD-I and BD-II groups than in the MDD group, and substantially higher hyperthymic temperament scores were found in the BD-I group than in the MDD and BD-II groups.
Analysis of differentiating factors of the diagnosis of MDD, BD-I, and BD-II
Taking into account the results shown in Table 1, multivariate logistic regression analysis was conducted for the severity of mood symptoms and TEMPS-A subscores, to identify independent differentiating factors of the diagnosis of mood disorders.
In Table 2, we summarized the results of backward stepwise multivariate logistic regression analysis performed to identify independent differentiating factors of the diagnosis of BD-I versus the diagnosis of MDD. Among the PHQ-9 scores, YMRS scores, and 5 TEMPS-A subscale scores, cyclothymic and anxious temperament scores on the TEMPS-A as well as YMRS scores were significant independent differentiating factors of the diagnosis of BD-I versus the diagnosis of MDD, whereas PHQ-9 scores and depressive, hyperthymic, and irritable temperament scores on the TEMPS-A were not considered as significant differentiating factors of the diagnosis of BD-I.
Table 3 demonstrates the results of stepwise multivariate logistic regression analysis conducted to identify variables distinguishing BD-II from MDD. Cyclothymic and anxious temperament scores were identified as significant independent differentiating factors of the diagnosis of BD-II versus the diagnosis of MDD, whereas the other variables were not considered as significant differentiating factors of the diagnosis of BD-II.
As shown in Table 4, stepwise multivariate logistic regression analysis of the diagnosis of BD-I compared with the diagnosis of BD-II demonstrated that only hyperthymic temperament score was a significant independent differentiating factor correlating with the diagnosis of BD-I.
We also conducted the multivariate logistic regression analyses using the forced entry method, including PHQ-9 and YMRS scores, and TEMPS-A subscores as independent variables, to confirm the robustness of our results. The results are shown in S1–S3 Tables. S1 and S2 Tables show that only cyclothymic temperament score is a significant differentiating factor of the diagnosis of BD-I and BD-II from the diagnosis of MDD. S3 Table demonstrates that hyperthymic temperament score is a specific factor for the differential diagnosis of BD-I versus the diagnosis of BD-II.
Discussion
The principle findings of our study are as follows. Cyclothymic temperament and anxious temperament may differentiate the diagnosis of BD-I and BD-II compared with MDD, and hyperthymic temperament may differentiate the diagnosis of BD-I compared with BD-II. These findings supported the hypothesis that some affective temperaments assessed by TEMPS-A can be used as differentiating factors of the diagnosis of MDD, BD-I, and BD-II. Affective temperament is a concept proposed by Akiskal and his colleagues. They described that temperaments are more than just forme frustes of mood disorders and temperamental dysregulation is present in the subclinical stages, before patients experience mood episodes [25, 26]. Based on their descriptions and our present results, our findings may indicate that clinicians should keep in mind the possibility that MDD patients with high cyclothymic and low anxious scores on TEMPS-A may subsequently have manic/hypomanic episodes, and BD-II patients with a high hyperthymic temperament score may have manic episodes. We believe that this diagnostic conversion should be kept in mind clinically, although we should verify the role of affective temperaments prospectively.
The periods of the illness of the subjects were various. As shown in S4 Table, approximately 30% of the patients in each disease group were in remission. From a perspective of the impact of affective symptoms on the questionnaire answers [19], it is preferable that all subjects are in euthymic state when answering the questionnaires. However, we aimed to verify whether TEMPS-A was useful for the differential diagnosis of mood disorders in real-world clinical settings, and therefore, we included patients with various symptom severity. Moreover, we performed multivariate logistic regression analyses including the severity of mood symptoms and 5 affective temperaments as independent variables, considering the impact of them on TEMPS-A.
This is the first report to our knowledge that used multivariate analysis to show that affective temperament is a statistically significant differentiating factor of mood disorders, considering BD-I and BD-II separately, and taking into account manic and depressive symptoms as well as the 5 affective temperaments. On the other hand, Di Florio et al. compared patients with MDD and BD, taking into account depressive symptoms and hypomanic symptoms at the time of temperament assessment, but found no significant differences in all the subscales of the short version of the TEMPS-A [27]. A possible interpretation of this discrepancy is that, in the study by Di Florio et al., the MDD group included only the subjects diagnosed with recurrent MDD with hypomanic features, because recurrent major depressive episodes is a predictor of bipolarity [18]. The utilization of the short version of the TEMPS-A may also explain the difference between the results of their studies and ours, as the short version of the TEMPS-A (39 items) shows only weak or moderate correlation with the full version of the TEMPS-A (109/110 items) [28].
We conducted multivariate logistic regression analyses using the forced entry method as well as the backward stepwise selection method, and confirmed the robustness of the results of the original analysis of BD-I versus BD-II, although the fit index of this model might not be accepted. On the other hand, we obtained partially different results using the forced entry method from the original results. In the forced entry method, only cyclothymic temperament score was a significant differentiating factor of the diagnosis of BD-I and BD-II from the diagnosis of MDD, and anxious temperament and YMRS scores were not significant differentiating factors of BD-I and BD-II versus MDD. The reason for this discrepancy might be that, although we attempted to construct the best model by taking into account mood symptoms and other affective temperaments, there is still a possibility that the effects of the excluded variables in the backward stepwise selection method were adjusted inadequately. We should hence confirm the reproducibility of our original results using larger samples in the future.
In addition, this study has several limitations. First, the design of our study was cross-sectional. Therefore, patients with MDD in this study may subsequently have a manic/hypomanic episode, leading to changes in their diagnoses. We should hence conduct follow-up observations to confirm their diagnoses. Secondly, all of the subjects included in the present study were patients treated in general or university hospitals, and consequently, there may be sampling biases.
In conclusion, the present study identified cyclothymic and anxious temperaments as differentiating factors of the diagnosis of BD compared with MDD, and hyperthymic temperament as a differentiating factor of BD-I compared with BD-II. These results indicate that evaluating affective temperaments with TEMPS-A in patients with mood disorders may be useful for distinguishing between MDD, BD-I, and BD-II.
Supporting information
S1 Table. Multivariate logistic regression analysis of the diagnosis of MDD and BD-I by the forced entry method.
https://doi.org/10.1371/journal.pone.0232459.s001
(DOCX)
S2 Table. Multivariate logistic regression analysis of the diagnosis of MDD and BD-II by the forced entry method.
https://doi.org/10.1371/journal.pone.0232459.s002
(DOCX)
S3 Table. Multivariate logistic regression analysis of the diagnosis of BD-II and BD-I using the forced entry method.
https://doi.org/10.1371/journal.pone.0232459.s003
(DOCX)
S4 Table. Depressive symptoms assessed by the PHQ-9 and manic symptoms assessed by the YMRS in the subjects.
https://doi.org/10.1371/journal.pone.0232459.s004
(DOCX)
References
- 1. Altamura AC, Dell'Osso B, Berlin HA, Buoli M, Bassetti R, Mundo E. Duration of untreated illness and suicide in bipolar disorder: a naturalistic study. Eur Arch Psychiatry Clin Neurosci. 2010;260(5):385–91. pmid:19911248.
- 2. Drancourt N, Etain B, Lajnef M, Henry C, Raust A, Cochet B, et al. Duration of untreated bipolar disorder: missed opportunities on the long road to optimal treatment. Acta Psychiatr Scand. 2013;127(2):136–44. pmid:22901015.
- 3. Kanba S, Kato T, Terao T, Yamada K, Committee for Treatment Guidelines of Mood Disorders JSoMD. Guideline for treatment of bipolar disorder by the Japanese Society of Mood Disorders, 2012. Psychiatry Clin Neurosci. 2013;67(5):285–300. pmid:23773266.
- 4. Yatham LN, Kennedy SH, Parikh SV, Schaffer A, Bond DJ, Frey BN, et al. Canadian Network for Mood and Anxiety Treatments (CANMAT) and International Society for Bipolar Disorders (ISBD) 2018 guidelines for the management of patients with bipolar disorder. Bipolar Disord. 2018;20(2):97–170. pmid:29536616; PubMed Central PMCID: PMC5947163.
- 5. Daban C, Colom F, Sanchez-Moreno J, Garcia-Amador M, Vieta E. Clinical correlates of first-episode polarity in bipolar disorder. Compr Psychiatry. 2006;47(6):433–7. pmid:17067865.
- 6. Hirschfeld RM, Lewis L, Vornik LA. Perceptions and impact of bipolar disorder: how far have we really come? Results of the national depressive and manic-depressive association 2000 survey of individuals with bipolar disorder. J Clin Psychiatry. 2003;64(2):161–74. pmid:12633125.
- 7. Akiskal HS, Akiskal KK, Haykal RF, Manning JS, Connor PD. TEMPS-A: progress towards validation of a self-rated clinical version of the Temperament Evaluation of the Memphis, Pisa, Paris, and San Diego Autoquestionnaire. J Affect Disord. 2005;85(1–2):3–16. pmid:15780671.
- 8. Vazquez GH, Gonda X, Lolich M, Tondo L, Baldessarini RJ. Suicidal risk and affective temperaments, evaluated with the TEMPS-A scale: A systematic review. Harv Rev Psychiatry. 2018;26(1):8–18. pmid:29303918.
- 9. Toda H, Inoue T, Tsunoda T, Nakai Y, Tanichi M, Tanaka T, et al. The structural equation analysis of childhood abuse, adult stressful life events, and temperaments in major depressive disorders and their influence on refractoriness. Neuropsychiatr Dis Treat. 2015;11:2079–90. PubMed Central PMCID: PMC4540121. pmid:26316754
- 10. Toda H, Inoue T, Tanichi M, Saito T, Nakagawa S, Masuya J, et al. Affective temperaments play an important role in the relationship between child abuse and the diagnosis of bipolar disorder. Psychiatry Res. 2018;262:13–9. pmid:29407563.
- 11. Takeshima M, Oka T. Comparative analysis of affective temperament in patients with difficult-to-treat and easy-to-treat major depression and bipolar disorder: Possible application in clinical settings. Compr Psychiatry. 2016;66:71–8. pmid:26995239.
- 12. Goto S, Terao T, Hoaki N, Wang Y. Cyclothymic and hyperthymic temperaments may predict bipolarity in major depressive disorder: a supportive evidence for bipolar II1/2 and IV. J Affect Disord. 2011;129(1–3):34–8. pmid:20699193.
- 13. Mendlowicz MV, Akiskal HS, Kelsoe JR, Rapaport MH, Jean-Louis G, Gillin JC. Temperament in the clinical differentiation of depressed bipolar and unipolar major depressive patients. J Affect Disord. 2005;84(2–3):219–23. pmid:15708419.
- 14. Matsumoto S, Akiyama T, Tsuda H, Miyake Y, Kawamura Y, Noda T, et al. Reliability and validity of TEMPS-A in a Japanese non-clinical population: application to unipolar and bipolar depressives. J Affect Disord. 2005;85(1–2):85–92. pmid:15780679.
- 15. Nowakowska C, Strong CM, Santosa CM, Wang PW, Ketter TA. Temperamental commonalities and differences in euthymic mood disorder patients, creative controls, and healthy controls. J Affect Disord. 2005;85(1–2):207–15. pmid:15780691.
- 16. Evans L, Akiskal HS, Keck PE, Jr., McElroy SL, Sadovnick AD, Remick RA, et al. Familiality of temperament in bipolar disorder: support for a genetic spectrum. J Affect Disord. 2005;85(1–2):153–68. pmid:15780686.
- 17. Mazzarini L, Pacchiarotti I, Colom F, Sani G, Kotzalidis GD, Rosa AR, et al. Predominant polarity and temperament in bipolar and unipolar affective disorders. J Affect Disord. 2009;119(1–3):28–33. pmid:19346002.
- 18. Takeshima M, Oka T. A comprehensive analysis of features that suggest bipolarity in patients with a major depressive episode: which is the best combination to predict soft bipolarity diagnosis? J Affect Disord. 2013;147(1–3):150–5. pmid:23158958.
- 19. Baba H, Kohno K, Inoue T, Nakai Y, Toyomaki A, Suzuki T, et al. The effects of mental state on assessment of bipolar temperament. J Affect Disord. 2014;161:1–3. pmid:24751299.
- 20. Solmi M, Zaninotto L, Toffanin T, Veronese N, Lin K, Stubbs B, et al. A comparative meta-analysis of TEMPS scores across mood disorder patients, their first-degree relatives, healthy controls, and other psychiatric disorders. J Affect Disord. 2016;196:32–46. pmid:26897455.
- 21. Muramatsu K, Miyaoka H, Kamijima K, Muramatsu Y, Yoshida M, Otsubo T, et al. The patient health questionnaire, Japanese version: validity according to the mini-international neuropsychiatric interview-plus. Psychol Rep. 2007;101(3 Pt 1):952–60. pmid:18232454.
- 22. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA. 1999;282(18):1737–44. pmid:10568646.
- 23. Muramatsu K, Miyaoka H, Kamijima K, Muramatsu Y, Tanaka Y, Hosaka M, et al. Performance of the Japanese version of the Patient Health Questionnaire-9 (J-PHQ-9) for depression in primary care. Gen Hosp Psychiatry. 2018;52:64–9. pmid:29698880.
- 24. Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978;133:429–35. pmid:728692.
- 25. Akiskal HS, Mallya G. Criteria for the "soft" bipolar spectrum: treatment implications. Psychopharmacol Bull. 1987;23(1):68–73. pmid:3602332.
- 26. Akiskal HS, Maser JD, Zeller PJ, Endicott J, Coryell W, Keller M, et al. Switching from 'unipolar' to bipolar II. An 11-year prospective study of clinical and temperamental predictors in 559 patients. Arch Gen Psychiatry. 1995;52(2):114–23. pmid:7848047.
- 27. Di Florio A, Hamshere M, Forty L, Green EK, Grozeva D, Jones I, et al. Affective temperaments across the bipolar-unipolar spectrum: examination of the TEMPS-A in 927 patients and controls. J Affect Disord. 2010;123(1–3):42–51. pmid:19883944.
- 28. Nakato Y, Inoue T, Nakagawa S, Kitaichi Y, Kameyama R, Wakatsuki Y, et al. Confirmation of the factorial structure of the Japanese short version of the TEMPS-A in psychiatric patients and general adults. Neuropsychiatr Dis Treat. 2016;12:2173–9. PubMed Central PMCID: PMC5003593. pmid:27601911