Figures
Abstract
The purpose of this study was to develop the Glasgow Antipsychotic Side effects Scale for Clozapine Japanese version (GASS-C-J) and examine its reliability to assess clozapine-related side effects. We developed the GASS-C-J using forward and backward translation. Semantic equivalence of the GASS-C-J to the GASS-C was confirmed by the original author. We then administered the GASS-C-J twice to 109 patients on clozapine treatment at two psychiatric hospitals in Japan. We assessed the internal consistency and test-retest reliability of the GASS-C-J using Cronbach’s alpha and weighted kappa coefficient, respectively. We also examined if discrepancies in each GASS-C-J item score between the first and second rating were correlated with items of the Brief Evaluation of Psychosis Symptom Domains (BE-PSD). The Cronbach’s alpha coefficient of the GASS-C-J at the first and second rating was 0.78 (95% CI: 0.72 to 0.84) and 0.82 (95% CI: 0.76 to 0.88), respectively. The weighted kappa coefficient of individual and total GASS-C-J item scores ranged from 0.45 to 0.88. Some symptom domains were correlated with discrepancies in specific items of the GASS-C-J: psychotic symptoms and nausea/vomiting (rs = 0.27), thirst (rs = 0.31), and appetite/weight gain (rs = 0.27); disorganized thinking and urinary incontinence (rs = 0.26); depression/anxiety and myoclonus (rs = 0.25), hypersalivation (rs = -0.27), and blurred vision (rs = -0.22). These findings demonstrate that the GASS-C-J can be used in clinical and research settings as a reliable scale to assess clozapine-related side effects.
Citation: Kitagawa K, So R, Nomura N, Mizuno Y, Misawa F, Kodama M, et al. (2020) Reliability of the Glasgow Antipsychotic Side-effects Scale for Clozapine Japanese version (GASS-C-J). PLoS ONE 15(6): e0234864. https://doi.org/10.1371/journal.pone.0234864
Editor: Kazutaka Ikeda, Tokyo Metropolitan Institute of Medical Science, JAPAN
Received: April 19, 2020; Accepted: June 3, 2020; Published: June 18, 2020
Copyright: © 2020 Kitagawa et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be shared publicly because we did not obtain informed consent on data sharing from the participants. Data are available from the Institutional Review Board of Okayama Psychiatric Medical Center (contact via r-oota@popmc.jp) for researchers who meet the criteria for access to confidential data.
Funding: This research was supported by a grant from Kobayashi Magobe Memorial Medical Foundation to RS and Inokashira Hospital to NN. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: Mr. Kitagawa has received research grants from Japan Society for the Promotion of Science (JSPS); personal fees from Meiji Seika Pharma, Novartis Pharma, Otsuka, and Sumitomo Dainippon Pharma; and manuscript fees from Iyaku-journal, Japanese Society of Hospital Pharmacists (JSHP), Japanese Society of Psychiatric Pharmacy (JSPP), Jiho, Nanzando, and Seiwa-shoten. Dr. So has received Health and Labor Sciences Research Grant; the research grant from the Mental Health Okamoto Memorial Foundation; personal fees from CureApp, Igaku-shoin, Kagaku-hyoronsha, Medical Review, and Otsuka. Dr. Nomura has received the Inokashira Hospital grant for psychiatry research. Dr. Mizuno is supported by fellowship grants from the Japan Society for the Promotion of Science, Astellas Foundation for Research on Metabolic Disorders, Japanese Society of Clinical Neuropsychopharmacology, and Mochida Memorial Foundation for Medical and Pharmaceutical Research; manuscript fees from Sumitomo Dainippon Pharma; and consultant fees from Bracket and MedAvante-ProPhase. Dr. Misawa has received speaker’s honoraria from Sumitomo Dainippon Pharma, Eli Lilly, Janssen, Novartis, Otsuka, and Pfizer. Dr. Kodama has no conflicts of interest. Dr. Uchida has received grants from Eisai, Meiji Seika Pharma Otsuka, and Sumitomo Dainippon Pharma; speaker’s honoraria from Eisai, Meiji Seika Pharma, Otsuka, and Sumitomo Dainippon Pharma; and advisory panel payments from Sumitomo Dainippon Pharma. Dr. Mimura has received speaker’s honoraria from Byer Pharmaceutical, Daiichi Sankyo, Sumitomo Dainippon Pharma, Eisai, Eli Lilly, Fujifilm RI Pharma, Hisamitsu, Janssen, Kyowa, Mochida, MSD, Mylan EPD, Nihon Medi-Physics, Nippon Chemipher, Novartis Pharma, Ono, Otsuka, Pfizer, Santen, Shire, Takeda, Tsumura, and Yoshitomiyakuhin; grants from Daiichi Sankyo, Eisai, Mitsubishi Tanabe Pharma, Pfizer, Shionogi, Takeda, and Tsumura. Dr. Takeuchi has received research grants from Japan Society for the Promotion of Science (JSPS), Japan Agency for Medical Research and Development (AMED), SENSHIN Medical Research Foundation, and Novartis Pharma; fellowship grants from Astellas Foundation for Research on Metabolic Disorders, the Canadian Institutes of Health Research (CIHR), Centre for Addiction and Mental Health (CAMH) Foundation, and the Japanese Society of Clinical Neuropsychopharmacology (JSCNP); speaker’s fees from Kyowa, Janssen, Meiji Seika Pharma, Mochida, Otsuka, Sumitomo Dainippon Pharma, and Yoshitomiyakuhin; and manuscript fees from Sumitomo Dainippon Pharma. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Clozapine is shown to be superior to other antipsychotics for efficacy [1–5] and is the only licensed medication for treatment-resistant schizophrenia [6,7]. Given that discontinuing clozapine or switching from clozapine to another antipsychotic has been reported to worsen psychiatric symptoms [8–10], it is critically important to continue clozapine for treatment-resistant schizophrenia where possible.
However, patients frequently withdraw from treatment of clozapine for various reasons [11–15]. Among them, side effects are the most common reasons for discontinuation of clozapine [16] which suggests that early detection and management of clozapine-associated side effects is vital in enabling continued treatment. To this point, using a checklist to both systematically and efficiently assess side effects is expected to be a useful strategy.
The Glasgow Antipsychotic Side-effects Scale (GASS) [17] is used as a scale for evaluating common side effects of antipsychotic drugs. However, since clozapine has a unique side effect profile such as myoclonus, hypersalivation, and frequent urination, the GASS is considered insufficient to detect clozapine-related side effects comprehensively. To effectively screen for clozapine-associated side effects, the Glasgow Antipsychotic Side effects Scale for Clozapine (GASS-C) was developed based on the GASS [18]. The GASS-C is a simple but comprehensive scale that can be completed by patients in approximately five minutes, which can then be used in the clinic to discuss unpleasant side effects and guide clinical decision making. Having access to the GASS-C is expected to be particularly important in Japan where clozapine is extremely underutilized [19] and many psychiatrists still lack experience in managing clozapine-related side effects. To address this clinically relevant issue, in the present study, we aimed to develop the GASS-C Japanese version (GASS-C-J) and examine its reliability.
Methods
Study design and subjects
We assessed the reliability of the GASS-C-J using data from a cross-sectional study aiming to investigate the relationship between plasma concentrations of clozapine and its side effects in Japanese patients with treatment-resistant schizophrenia. The study was carried out in Yamanashi Prefectural Kita Hospital and Okayama Psychiatric Medical Center, Japan. The institutional review boards at both hospitals approved the study protocol.
Individuals who met the following criteria were included in the study: (1) aged 20 years or older; (2) diagnosed with schizophrenia according to International Statistical Classification of Diseases and Related Health Problems, 10th Revision (ICD-10) [20]; (3) being treatment-resistant defined as an insufficient response to at least two adequate antipsychotic trials (i.e., treatment with chlorpromazine equivalent doses of ≥600 mg/day for ≥4 weeks, and at least one trial using an atypical antipsychotic) or treatment-intolerant (i.e. not being able to tolerate atypical antipsychotics due to side effects); (4) receiving outpatient or inpatient treatment at either hospital between September 2018 and February 2019; and (5) being capable of participating in the study judged by their attending physician. After complete explanation regarding the study, the participants provided written informed consent.
Study instruments
Development of GASS-C Japanese version (GASS-C-J).
The GASS-C is a self-rated questionnaire designed to elicit the subjectively unpleasant side effects of clozapine during the past week. The GASS-C is composed of 16 questions with the following four responses: “0 –Never”; “1 –Once”; “2 –A few times”; and “3 –Every day”. A total score of the GASS-C is calculated by adding all item scores, ranging from 0 to 48. According to the original GASS-C [18], the total GASS-C score is interpreted as follows: “0–16 = absent/mild side effects”; “17–32 = moderate side effects”; and “33–48 = severe side effects”.
Three authors (N.N., F.M., and H.T.) independently translated the original English version of the GASS-C into Japanese with permission from the original author, Dr. Hynes, and integrated the three Japanese versions into one. Any disagreement was resolved through discussion. Another author (Y.M.), a Japanese/English bilingual speaker, performed the backward translation. The semantic equivalence of the backward translated scale and the original GASS-C was confirmed by Dr. Hynes.
Brief evaluation of psychosis symptom domains (BE-PSD).
The BE-PSD is a clinician-rated rating scale, designed to capture the five symptom domains of psychosis: (1) psychotic symptoms; (2) disorganized thinking; (3) negative symptoms; (4) excitement/mania; and (5) depression/anxiety [21]. The severity of each symptom domain is scored based on the frequency of symptoms and their impact on behavior during the past week or interview, with scores ranging from 0 (absent) to 6 (very severe). The sum of the five symptom scores, ranging from 0 to 30, is used as a measure of overall symptom severity. In this study, we explored whether severity of specific symptom domains as assessed by the BE-PSD affects the test-retest reliability of the GASS-C-J.
Study procedures
Subjects were asked to complete the GASS-C-J twice with an interval of 14 days or less. The BE-PSD was evaluated by the attending physician when the informed consent was obtained.
Statistical analyses
The internal consistency of the GASS-C-J was evaluated using Cronbach’s alpha coefficient at the first and second test rating. The test-retest reliability of the total and individual item scores of the GASS-C-J were assessed using weighted kappa coefficient. Cases with missing data and those where prescriptions changed between the first and second rating were excluded from the analyses. Correlations between the discrepancies in individual GASS-C-J item scores between the first and second rating, and BE-PSD symptom domain scores were analyzed using Spearman’s correlation coefficient. All statistical analyses were conducted using R version 3.6.0 (R Core Team, 2017).
Results
Participants
A total of 151 patients met the eligibility criteria. Of these, 109 patients were included in the study and 42 patients refused to participate. Demographic and clinical characteristics of the included patients are shown in Table 1. The internal consistency of the GASS-C-J was examined using data from the all patients. The test-retest reliability of the GASS-C-J was examined in 99 patients. Ten patients were excluded from the analysis due to change in their clozapine dose between the two ratings.
Reliability of the GASS-C-J
The Cronbach’s alpha coefficient of the GASS-C-J at the first and second rating was 0.78 (95% CI: 0.72 to 0.84) and 0.82 (95% CI: 0.76 to 0.88), respectively. The test-retest reliability of the total GASS-C-J score was evaluated by calculating the weighted kappa coefficient of individual and total GASS-C-J item scores ranged from 0.45 to 0.88 (Table 2).
Relationship between symptom severity of the BE-PSD and test-retest reliability of the GASS-C-J
The correlations between the test-retest discrepancy in each GASS-C-J item score and each BE-PSD item score are shown in Table 3. The following correlations were significant: psychotic symptoms and nausea/vomiting (rs = 0.27), thirst (rs = 0.31), and appetite/weight gain (rs = 0.27); and disorganized thinking and urinary incontinence (rs = 0.26); depression/anxiety and myoclonus (rs = 0.25), hypersalivation (rs = -0.27), and blurry vision (rs = -0.22).
Discussion
We developed the GASS-C-J by forward and backward translation, and assessed its reliability with more than 109 patients receiving clozapine treatment. To our knowledge, the GASS-C-J is the first self-administered scale available in Japanese to assess clozapine-related side effects. With regard to internal consistency, the Cronbach’α coefficient was approximately 0.8 for both the first and second evaluations. Although there is no clear consensus regarding the interpretation of the α coefficient, a value of ≥0.8 is generally regarded as high [22]. The weighted kappa coefficient for test-retest reliability also indicated “moderate agreement” to “almost perfect” agreement for all items in this study, in light of the criteria proposed by Landis and Koch [23]. These findings indicate that the GASS-C-J is a reliable scale to assess side effects associated with clozapine.
It should be noted that the reliability of patient-reported outcomes evaluated by self-rating scales including the GASS-C-J could be influenced by symptoms of schizophrenia [24]. For example, Takeuchi et al. reported that disorganization and cognitive dysfunction had an impact on the discrepancies in the scores of the Subjective Well-being under Neuroleptics Scale–Short form in patients with schizophrenia [24]. We also found that discrepancies in some GASS-C-J items between the two ratings were correlated with some symptom domains. In particular, discrepancies in nausea/vomiting (Q9), thirst (Q14), appetite/weight gain (Q15) showed positive correlations with psychotic symptoms, and discrepancy in myoclonus (Q5) was associated with depressive/anxiety symptoms. On the other hand, disorganized thinking was not associated with discrepancies in any of the GASS-C-J items except for incontinence (Q12). These findings suggest that self-ratings of subjective side effects (such as nausea) become more variable with a greater degree of psychotic symptoms, while fluctuation in neurological side effects (such as myoclonus) are predicted by depression/anxiety symptoms.
There are several limitations to be noted in the present study. First, the sample size was slightly smaller than that recommended by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) standard [25] to evaluate test-retest reliability of 16 items of the GASS-C-J, which is 112 (7 times the number of items). Second, we did not include any other scales to assess clozapine-related side effects and therefore were not able to evaluate the concurrent validity of the GASS-C-J. Third, the sensitivity to change of the GASS-C-J was not examined in this study. Fourth, the correlation analysis between discrepancies in the GASS-C-J item scores and psychopathology as assessed by the BE-PSD was not hypothesis driven, and we did not control for multiple analyses. Lastly, because the current study only included patients receiving a stable dose of clozapine, the reliability of the GASS-C-J cannot be guaranteed for patients during the early stage of clozapine treatment, in which patients more frequently experience side effects [26]. On the other hand, since the present study included both inpatients and outpatients, the findings are likely applicable to a wide range of patients taking clozapine.
In conclusion, the GASS-C-J demonstrated high internal consistency and good test-retest reliability, indicating the potential to be widely used in both clinical and research settings. The use of the GASS-C-J will enable physicians to elicit clozapine-associated side effects both efficiently and comprehensively, which is expected to improve timely management of these side effects and enhance adherence to clozapine treatment.
Acknowledgments
The authors would like to thank Dr. Caroline Hynes for approving the development of the GASS-C-J and Ms. Kimiko Takaoka for managing the data.
References
- 1. Azorin JM, Spiegel R, Remington G, Vanelle JM, Péré JJ, Giguere M, et al. A double-blind comparative study of clozapine and risperidone in the management of severe chronic schizophrenia. Am J Psychiatry. 2001 Aug;158(8):1305–13. pmid:11481167
- 2. Chakos M, Lieberman J, Hoffman E, Bradford D, Sheitman B. Effectiveness of second-generation antipsychotics in patients with treatment-resistant schizophrenia: a review and meta-analysis of randomized trials. Am J Psychiatry. 2001 Apr;158(4):518–26. pmid:11282684
- 3. Lewis SW, Barnes TRE, Davies L, Murray RM, Dunn G, Hayhurst KP, et al. Randomized controlled trial of effect of prescription of clozapine versus other second-generation antipsychotic drugs in resistant schizophrenia. Schizophr Bull. 2006 Oct;32(4):715–23. pmid:16540702
- 4. McEvoy JP, Lieberman JA, Stroup TS, Davis SM, Meltzer HY, Rosenheck RA, et al. Effectiveness of clozapine versus olanzapine, quetiapine, and risperidone in patients with chronic schizophrenia who did not respond to prior atypical antipsychotic treatment. Am J Psychiatry. 2006 Apr;163(4):600–10. pmid:16585434
- 5. Souza JS, Kayo M, Tassell I, Martins CB, Elkis H. Efficacy of olanzapine in comparison with clozapine for treatment-resistant schizophrenia: evidence from a systematic review and meta-analyses. CNS Spectr. 2013 Apr;18(2):82–9. pmid:23253621
- 6. Kane J, Honigfeld G, Singer J, Meltzer H. Clozapine for the treatment-resistant schizophrenic. A double-blind comparison with chlorpromazine. Arch Gen Psychiatry. 1988 Sep;45(9):789–96. pmid:3046553
- 7. Warnez S, Alessi-Severini S. Clozapine: a review of clinical practice guidelines and prescribing trends. BMC Psychiatry. 2014 Apr;14:102. pmid:24708834
- 8. Lin C-C, Chiu H-J, Chen J-Y, Liou Y-J, Wang Y-C, Chen T-T, et al. Switching from clozapine to zotepine in patients with schizophrenia: a 12-week prospective, randomized, rater blind, and parallel study. J Clin Psychopharmacol. 2013 Apr;33(2):211–4. pmid:23422395
- 9. Mustafa FA. Schizophrenia past clozapine: what works? J Clin Psychopharmacol. 2013 Feb;33(1):63–8. pmid:23277242
- 10. Still DJ, Dorson PG, Crismon ML, Pousson C. Effects of switching inpatients with treatment-resistant schizophrenia from clozapine to risperidone. Psychiatr Serv Wash DC. 1996 Dec;47(12):1382–4.
- 11. Grohmann R, Rüther E, Sassim N, Schmidt LG. Adverse effects of clozapine. Psychopharmacology (Berl). 1989;99 Suppl:S101–104.
- 12. Leppig M, Bosch B, Naber D, Hippius H. Clozapine in the treatment of 121 out-patients. Psychopharmacology (Berl). 1989;99 Suppl:S77–79.
- 13. Naber D, Holzbach R, Perro C, Hippius H. Clinical management of clozapine patients in relation to efficacy and side-effects. Br J Psychiatry Suppl. 1992 May;(17):54–9. pmid:1358128
- 14. Naber D, Leppig M, Grohmann R, Hippius H. Efficacy and adverse effects of clozapine in the treatment of schizophrenia and tardive dyskinesia—a retrospective study of 387 patients. Psychopharmacology (Berl). 1989;99 Suppl:S73–76.
- 15. Young CR, Bowers MB, Mazure CM. Management of the adverse effects of clozapine. Schizophr Bull. 1998;24(3):381–90. pmid:9718630
- 16. Legge SE, Hamshere M, Hayes RD, Downs J, O’Donovan MC, Owen MJ, et al. Reasons for discontinuing clozapine: A cohort study of patients commencing treatment. Schizophr Res. 2016 Jul;174(1–3):113–9. pmid:27211516
- 17. Waddell L, Taylor M. A new self-rating scale for detecting atypical or second-generation antipsychotic side effects. J Psychopharmacol Oxf Engl. 2008 May;22(3):238–43.
- 18. Hynes C, Keating D, McWilliams S, Madigan K, Kinsella A, Maidment I, et al. Glasgow Antipsychotic Side-effects Scale for Clozapine—Development and validation of a clozapine-specific side-effects scale. Schizophr Res. 2015 Oct;168(1–2):505–13. pmid:26276305
- 19. Bachmann CJ, Aagaard L, Bernardo M, Brandt L, Cartabia M, Clavenna A, et al. International trends in clozapine use: a study in 17 countries. Acta Psychiatr Scand. 2017;136(1):37–51. pmid:28502099
- 20.
World Health Organization. The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines. Geneva: World Health Organization; 1992.
- 21. Takeuchi H, Fervaha G, Lee J, Agid O, Remington G. A preliminary examination of the validity and reliability of a new brief rating scale for symptom domains of psychosis: Brief Evaluation of Psychosis Symptom Domains (BE-PSD). J Psychiatr Res. 2016;80:87–92. pmid:27318892
- 22. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011 Jun 27;2:53–5. pmid:28029643
- 23. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–74. pmid:843571
- 24. Takeuchi H, Fervaha G, Remington G. Reliability of a patient-reported outcome measure in schizophrenia: Results from back-to-back self-ratings. Psychiatry Res. 2016 Oct;244:415–9. pmid:27543916
- 25. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010 May;19(4):539–49. pmid:20169472
- 26. Marinkovic D, Timotijevic I, Babinski T, Totic S, Paunovic VR. The side-effects of clozapine: a four year follow-up study. Prog Neuropsychopharmacol Biol Psychiatry. 1994 May;18(3):537–44. pmid:8078987