Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Reliability of the Glasgow Antipsychotic Side-effects Scale for Clozapine Japanese version (GASS-C-J)

  • Kohei Kitagawa ,

    Contributed equally to this work with: Kohei Kitagawa, Ryuhei So, Nobuyuki Nomura

    Roles Conceptualization, Data curation, Investigation, Methodology, Writing – original draft

    Affiliation Department of Neuropsychiatry, Okayama Psychiatric Medical Center, Okayama, Japan

  • Ryuhei So ,

    Contributed equally to this work with: Kohei Kitagawa, Ryuhei So, Nobuyuki Nomura

    Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Neuropsychiatry, Okayama Psychiatric Medical Center, Okayama, Japan

  • Nobuyuki Nomura ,

    Contributed equally to this work with: Kohei Kitagawa, Ryuhei So, Nobuyuki Nomura

    Roles Conceptualization, Data curation, Investigation, Methodology, Writing – review & editing

    Affiliations Department of Neuropsychiatry, Yamanashi Prefectural Kita Hospital, Yamanashi, Japan, Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan

  • Yuya Mizuno,

    Roles Conceptualization, Writing – review & editing

    Affiliations Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan, Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, Kings College London, London, United Kingdom

  • Fuminari Misawa,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Department of Neuropsychiatry, Yamanashi Prefectural Kita Hospital, Yamanashi, Japan

  • Masafumi Kodama,

    Roles Supervision

    Affiliation Department of Neuropsychiatry, Okayama Psychiatric Medical Center, Okayama, Japan

  • Hiroyuki Uchida,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan

  • Masaru Mimura,

    Roles Supervision

    Affiliation Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan

  • Hiroyoshi Takeuchi

    Roles Conceptualization, Methodology, Project administration, Writing – original draft, Writing – review & editing

    hirotak@dk9.so-net.ne.jp

    Affiliations Department of Neuropsychiatry, Yamanashi Prefectural Kita Hospital, Yamanashi, Japan, Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan

Abstract

The purpose of this study was to develop the Glasgow Antipsychotic Side effects Scale for Clozapine Japanese version (GASS-C-J) and examine its reliability to assess clozapine-related side effects. We developed the GASS-C-J using forward and backward translation. Semantic equivalence of the GASS-C-J to the GASS-C was confirmed by the original author. We then administered the GASS-C-J twice to 109 patients on clozapine treatment at two psychiatric hospitals in Japan. We assessed the internal consistency and test-retest reliability of the GASS-C-J using Cronbach’s alpha and weighted kappa coefficient, respectively. We also examined if discrepancies in each GASS-C-J item score between the first and second rating were correlated with items of the Brief Evaluation of Psychosis Symptom Domains (BE-PSD). The Cronbach’s alpha coefficient of the GASS-C-J at the first and second rating was 0.78 (95% CI: 0.72 to 0.84) and 0.82 (95% CI: 0.76 to 0.88), respectively. The weighted kappa coefficient of individual and total GASS-C-J item scores ranged from 0.45 to 0.88. Some symptom domains were correlated with discrepancies in specific items of the GASS-C-J: psychotic symptoms and nausea/vomiting (rs = 0.27), thirst (rs = 0.31), and appetite/weight gain (rs = 0.27); disorganized thinking and urinary incontinence (rs = 0.26); depression/anxiety and myoclonus (rs = 0.25), hypersalivation (rs = -0.27), and blurred vision (rs = -0.22). These findings demonstrate that the GASS-C-J can be used in clinical and research settings as a reliable scale to assess clozapine-related side effects.

Introduction

Clozapine is shown to be superior to other antipsychotics for efficacy [15] and is the only licensed medication for treatment-resistant schizophrenia [6,7]. Given that discontinuing clozapine or switching from clozapine to another antipsychotic has been reported to worsen psychiatric symptoms [810], it is critically important to continue clozapine for treatment-resistant schizophrenia where possible.

However, patients frequently withdraw from treatment of clozapine for various reasons [1115]. Among them, side effects are the most common reasons for discontinuation of clozapine [16] which suggests that early detection and management of clozapine-associated side effects is vital in enabling continued treatment. To this point, using a checklist to both systematically and efficiently assess side effects is expected to be a useful strategy.

The Glasgow Antipsychotic Side-effects Scale (GASS) [17] is used as a scale for evaluating common side effects of antipsychotic drugs. However, since clozapine has a unique side effect profile such as myoclonus, hypersalivation, and frequent urination, the GASS is considered insufficient to detect clozapine-related side effects comprehensively. To effectively screen for clozapine-associated side effects, the Glasgow Antipsychotic Side effects Scale for Clozapine (GASS-C) was developed based on the GASS [18]. The GASS-C is a simple but comprehensive scale that can be completed by patients in approximately five minutes, which can then be used in the clinic to discuss unpleasant side effects and guide clinical decision making. Having access to the GASS-C is expected to be particularly important in Japan where clozapine is extremely underutilized [19] and many psychiatrists still lack experience in managing clozapine-related side effects. To address this clinically relevant issue, in the present study, we aimed to develop the GASS-C Japanese version (GASS-C-J) and examine its reliability.

Methods

Study design and subjects

We assessed the reliability of the GASS-C-J using data from a cross-sectional study aiming to investigate the relationship between plasma concentrations of clozapine and its side effects in Japanese patients with treatment-resistant schizophrenia. The study was carried out in Yamanashi Prefectural Kita Hospital and Okayama Psychiatric Medical Center, Japan. The institutional review boards at both hospitals approved the study protocol.

Individuals who met the following criteria were included in the study: (1) aged 20 years or older; (2) diagnosed with schizophrenia according to International Statistical Classification of Diseases and Related Health Problems, 10th Revision (ICD-10) [20]; (3) being treatment-resistant defined as an insufficient response to at least two adequate antipsychotic trials (i.e., treatment with chlorpromazine equivalent doses of ≥600 mg/day for ≥4 weeks, and at least one trial using an atypical antipsychotic) or treatment-intolerant (i.e. not being able to tolerate atypical antipsychotics due to side effects); (4) receiving outpatient or inpatient treatment at either hospital between September 2018 and February 2019; and (5) being capable of participating in the study judged by their attending physician. After complete explanation regarding the study, the participants provided written informed consent.

Study instruments

Development of GASS-C Japanese version (GASS-C-J).

The GASS-C is a self-rated questionnaire designed to elicit the subjectively unpleasant side effects of clozapine during the past week. The GASS-C is composed of 16 questions with the following four responses: “0 –Never”; “1 –Once”; “2 –A few times”; and “3 –Every day”. A total score of the GASS-C is calculated by adding all item scores, ranging from 0 to 48. According to the original GASS-C [18], the total GASS-C score is interpreted as follows: “0–16 = absent/mild side effects”; “17–32 = moderate side effects”; and “33–48 = severe side effects”.

Three authors (N.N., F.M., and H.T.) independently translated the original English version of the GASS-C into Japanese with permission from the original author, Dr. Hynes, and integrated the three Japanese versions into one. Any disagreement was resolved through discussion. Another author (Y.M.), a Japanese/English bilingual speaker, performed the backward translation. The semantic equivalence of the backward translated scale and the original GASS-C was confirmed by Dr. Hynes.

Brief evaluation of psychosis symptom domains (BE-PSD).

The BE-PSD is a clinician-rated rating scale, designed to capture the five symptom domains of psychosis: (1) psychotic symptoms; (2) disorganized thinking; (3) negative symptoms; (4) excitement/mania; and (5) depression/anxiety [21]. The severity of each symptom domain is scored based on the frequency of symptoms and their impact on behavior during the past week or interview, with scores ranging from 0 (absent) to 6 (very severe). The sum of the five symptom scores, ranging from 0 to 30, is used as a measure of overall symptom severity. In this study, we explored whether severity of specific symptom domains as assessed by the BE-PSD affects the test-retest reliability of the GASS-C-J.

Study procedures

Subjects were asked to complete the GASS-C-J twice with an interval of 14 days or less. The BE-PSD was evaluated by the attending physician when the informed consent was obtained.

Statistical analyses

The internal consistency of the GASS-C-J was evaluated using Cronbach’s alpha coefficient at the first and second test rating. The test-retest reliability of the total and individual item scores of the GASS-C-J were assessed using weighted kappa coefficient. Cases with missing data and those where prescriptions changed between the first and second rating were excluded from the analyses. Correlations between the discrepancies in individual GASS-C-J item scores between the first and second rating, and BE-PSD symptom domain scores were analyzed using Spearman’s correlation coefficient. All statistical analyses were conducted using R version 3.6.0 (R Core Team, 2017).

Results

Participants

A total of 151 patients met the eligibility criteria. Of these, 109 patients were included in the study and 42 patients refused to participate. Demographic and clinical characteristics of the included patients are shown in Table 1. The internal consistency of the GASS-C-J was examined using data from the all patients. The test-retest reliability of the GASS-C-J was examined in 99 patients. Ten patients were excluded from the analysis due to change in their clozapine dose between the two ratings.

thumbnail
Table 1. Demographic and clinical characteristics of patients (N = 109).

https://doi.org/10.1371/journal.pone.0234864.t001

Reliability of the GASS-C-J

The Cronbach’s alpha coefficient of the GASS-C-J at the first and second rating was 0.78 (95% CI: 0.72 to 0.84) and 0.82 (95% CI: 0.76 to 0.88), respectively. The test-retest reliability of the total GASS-C-J score was evaluated by calculating the weighted kappa coefficient of individual and total GASS-C-J item scores ranged from 0.45 to 0.88 (Table 2).

thumbnail
Table 2. Test-retest reliability of the GASS-C-J.

https://doi.org/10.1371/journal.pone.0234864.t002

Relationship between symptom severity of the BE-PSD and test-retest reliability of the GASS-C-J

The correlations between the test-retest discrepancy in each GASS-C-J item score and each BE-PSD item score are shown in Table 3. The following correlations were significant: psychotic symptoms and nausea/vomiting (rs = 0.27), thirst (rs = 0.31), and appetite/weight gain (rs = 0.27); and disorganized thinking and urinary incontinence (rs = 0.26); depression/anxiety and myoclonus (rs = 0.25), hypersalivation (rs = -0.27), and blurry vision (rs = -0.22).

thumbnail
Table 3. Correlations between symptom severity of the BE-PSD and discrepancy in each item score of the GASS-C-J.

https://doi.org/10.1371/journal.pone.0234864.t003

Discussion

We developed the GASS-C-J by forward and backward translation, and assessed its reliability with more than 109 patients receiving clozapine treatment. To our knowledge, the GASS-C-J is the first self-administered scale available in Japanese to assess clozapine-related side effects. With regard to internal consistency, the Cronbach’α coefficient was approximately 0.8 for both the first and second evaluations. Although there is no clear consensus regarding the interpretation of the α coefficient, a value of ≥0.8 is generally regarded as high [22]. The weighted kappa coefficient for test-retest reliability also indicated “moderate agreement” to “almost perfect” agreement for all items in this study, in light of the criteria proposed by Landis and Koch [23]. These findings indicate that the GASS-C-J is a reliable scale to assess side effects associated with clozapine.

It should be noted that the reliability of patient-reported outcomes evaluated by self-rating scales including the GASS-C-J could be influenced by symptoms of schizophrenia [24]. For example, Takeuchi et al. reported that disorganization and cognitive dysfunction had an impact on the discrepancies in the scores of the Subjective Well-being under Neuroleptics Scale–Short form in patients with schizophrenia [24]. We also found that discrepancies in some GASS-C-J items between the two ratings were correlated with some symptom domains. In particular, discrepancies in nausea/vomiting (Q9), thirst (Q14), appetite/weight gain (Q15) showed positive correlations with psychotic symptoms, and discrepancy in myoclonus (Q5) was associated with depressive/anxiety symptoms. On the other hand, disorganized thinking was not associated with discrepancies in any of the GASS-C-J items except for incontinence (Q12). These findings suggest that self-ratings of subjective side effects (such as nausea) become more variable with a greater degree of psychotic symptoms, while fluctuation in neurological side effects (such as myoclonus) are predicted by depression/anxiety symptoms.

There are several limitations to be noted in the present study. First, the sample size was slightly smaller than that recommended by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) standard [25] to evaluate test-retest reliability of 16 items of the GASS-C-J, which is 112 (7 times the number of items). Second, we did not include any other scales to assess clozapine-related side effects and therefore were not able to evaluate the concurrent validity of the GASS-C-J. Third, the sensitivity to change of the GASS-C-J was not examined in this study. Fourth, the correlation analysis between discrepancies in the GASS-C-J item scores and psychopathology as assessed by the BE-PSD was not hypothesis driven, and we did not control for multiple analyses. Lastly, because the current study only included patients receiving a stable dose of clozapine, the reliability of the GASS-C-J cannot be guaranteed for patients during the early stage of clozapine treatment, in which patients more frequently experience side effects [26]. On the other hand, since the present study included both inpatients and outpatients, the findings are likely applicable to a wide range of patients taking clozapine.

In conclusion, the GASS-C-J demonstrated high internal consistency and good test-retest reliability, indicating the potential to be widely used in both clinical and research settings. The use of the GASS-C-J will enable physicians to elicit clozapine-associated side effects both efficiently and comprehensively, which is expected to improve timely management of these side effects and enhance adherence to clozapine treatment.

Acknowledgments

The authors would like to thank Dr. Caroline Hynes for approving the development of the GASS-C-J and Ms. Kimiko Takaoka for managing the data.

References

  1. 1. Azorin JM, Spiegel R, Remington G, Vanelle JM, Péré JJ, Giguere M, et al. A double-blind comparative study of clozapine and risperidone in the management of severe chronic schizophrenia. Am J Psychiatry. 2001 Aug;158(8):1305–13. pmid:11481167
  2. 2. Chakos M, Lieberman J, Hoffman E, Bradford D, Sheitman B. Effectiveness of second-generation antipsychotics in patients with treatment-resistant schizophrenia: a review and meta-analysis of randomized trials. Am J Psychiatry. 2001 Apr;158(4):518–26. pmid:11282684
  3. 3. Lewis SW, Barnes TRE, Davies L, Murray RM, Dunn G, Hayhurst KP, et al. Randomized controlled trial of effect of prescription of clozapine versus other second-generation antipsychotic drugs in resistant schizophrenia. Schizophr Bull. 2006 Oct;32(4):715–23. pmid:16540702
  4. 4. McEvoy JP, Lieberman JA, Stroup TS, Davis SM, Meltzer HY, Rosenheck RA, et al. Effectiveness of clozapine versus olanzapine, quetiapine, and risperidone in patients with chronic schizophrenia who did not respond to prior atypical antipsychotic treatment. Am J Psychiatry. 2006 Apr;163(4):600–10. pmid:16585434
  5. 5. Souza JS, Kayo M, Tassell I, Martins CB, Elkis H. Efficacy of olanzapine in comparison with clozapine for treatment-resistant schizophrenia: evidence from a systematic review and meta-analyses. CNS Spectr. 2013 Apr;18(2):82–9. pmid:23253621
  6. 6. Kane J, Honigfeld G, Singer J, Meltzer H. Clozapine for the treatment-resistant schizophrenic. A double-blind comparison with chlorpromazine. Arch Gen Psychiatry. 1988 Sep;45(9):789–96. pmid:3046553
  7. 7. Warnez S, Alessi-Severini S. Clozapine: a review of clinical practice guidelines and prescribing trends. BMC Psychiatry. 2014 Apr;14:102. pmid:24708834
  8. 8. Lin C-C, Chiu H-J, Chen J-Y, Liou Y-J, Wang Y-C, Chen T-T, et al. Switching from clozapine to zotepine in patients with schizophrenia: a 12-week prospective, randomized, rater blind, and parallel study. J Clin Psychopharmacol. 2013 Apr;33(2):211–4. pmid:23422395
  9. 9. Mustafa FA. Schizophrenia past clozapine: what works? J Clin Psychopharmacol. 2013 Feb;33(1):63–8. pmid:23277242
  10. 10. Still DJ, Dorson PG, Crismon ML, Pousson C. Effects of switching inpatients with treatment-resistant schizophrenia from clozapine to risperidone. Psychiatr Serv Wash DC. 1996 Dec;47(12):1382–4.
  11. 11. Grohmann R, Rüther E, Sassim N, Schmidt LG. Adverse effects of clozapine. Psychopharmacology (Berl). 1989;99 Suppl:S101–104.
  12. 12. Leppig M, Bosch B, Naber D, Hippius H. Clozapine in the treatment of 121 out-patients. Psychopharmacology (Berl). 1989;99 Suppl:S77–79.
  13. 13. Naber D, Holzbach R, Perro C, Hippius H. Clinical management of clozapine patients in relation to efficacy and side-effects. Br J Psychiatry Suppl. 1992 May;(17):54–9. pmid:1358128
  14. 14. Naber D, Leppig M, Grohmann R, Hippius H. Efficacy and adverse effects of clozapine in the treatment of schizophrenia and tardive dyskinesia—a retrospective study of 387 patients. Psychopharmacology (Berl). 1989;99 Suppl:S73–76.
  15. 15. Young CR, Bowers MB, Mazure CM. Management of the adverse effects of clozapine. Schizophr Bull. 1998;24(3):381–90. pmid:9718630
  16. 16. Legge SE, Hamshere M, Hayes RD, Downs J, O’Donovan MC, Owen MJ, et al. Reasons for discontinuing clozapine: A cohort study of patients commencing treatment. Schizophr Res. 2016 Jul;174(1–3):113–9. pmid:27211516
  17. 17. Waddell L, Taylor M. A new self-rating scale for detecting atypical or second-generation antipsychotic side effects. J Psychopharmacol Oxf Engl. 2008 May;22(3):238–43.
  18. 18. Hynes C, Keating D, McWilliams S, Madigan K, Kinsella A, Maidment I, et al. Glasgow Antipsychotic Side-effects Scale for Clozapine—Development and validation of a clozapine-specific side-effects scale. Schizophr Res. 2015 Oct;168(1–2):505–13. pmid:26276305
  19. 19. Bachmann CJ, Aagaard L, Bernardo M, Brandt L, Cartabia M, Clavenna A, et al. International trends in clozapine use: a study in 17 countries. Acta Psychiatr Scand. 2017;136(1):37–51. pmid:28502099
  20. 20. World Health Organization. The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines. Geneva: World Health Organization; 1992.
  21. 21. Takeuchi H, Fervaha G, Lee J, Agid O, Remington G. A preliminary examination of the validity and reliability of a new brief rating scale for symptom domains of psychosis: Brief Evaluation of Psychosis Symptom Domains (BE-PSD). J Psychiatr Res. 2016;80:87–92. pmid:27318892
  22. 22. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011 Jun 27;2:53–5. pmid:28029643
  23. 23. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–74. pmid:843571
  24. 24. Takeuchi H, Fervaha G, Remington G. Reliability of a patient-reported outcome measure in schizophrenia: Results from back-to-back self-ratings. Psychiatry Res. 2016 Oct;244:415–9. pmid:27543916
  25. 25. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010 May;19(4):539–49. pmid:20169472
  26. 26. Marinkovic D, Timotijevic I, Babinski T, Totic S, Paunovic VR. The side-effects of clozapine: a four year follow-up study. Prog Neuropsychopharmacol Biol Psychiatry. 1994 May;18(3):537–44. pmid:8078987