Figures
Abstract
One major obstacle to advancing research and treatment for major psychiatric disorders is their substantial within-diagnosis heterogeneity in patient lifetime trajectories. Adapted research methods such as cluster analysis to define subgroups of patients are currently used. However few studies have included service delivery descriptors in cluster analysis to investigate the determinants of heterogeneity in long-term trajectories. The aim of this study was to test whether patterns of service delivery could help in defining subgroups in terms of trajectories and clinical profiles in schizophrenia, bipolar disorder or major depressive disorder patients. Hierarchical Agglomerative Clustering (HAC) algorithms were used on a sample extracted from a Quebec government (Canada) transactional database to group and classify patients according to their interactions with the service delivery system. The resulting clusters were analyzed using statistical tools to characterize service trajectories. We observed three distinct trajectories that were not specific to any one of the three lifetime psychiatric diagnoses. Clusters were particularly affected by varying rates of clinician changes across the trajectory and changes of diagnoses. Results suggest that incorporating service delivery characteristics in future longitudinal studies of heterogeneity might be useful as a complement to studies that solely examine patients’ clinical features. The inclusion of service delivery elements may also be a useful tool for acquiring knowledge to adapt services to patients’ needs in public mental health and mental health economics research.
Citation: Nicoletta V, Ruiz A, Bélanger V, Paccalet T, Isabelle M, Maziade M (2025) Analyzing service descriptors and patients’ clinical characteristics may help understand heterogeneity in long-term trajectory of patients with schizophrenia, bipolar and major depressive disorder. PLOS Ment Health 2(5): e0000327. https://doi.org/10.1371/journal.pmen.0000327
Editor: Karli Montague-Cardoso, PLOS: Public Library of Science, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
Received: December 3, 2024; Accepted: April 17, 2025; Published: May 14, 2025
Copyright: © 2025 Nicoletta et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data used in this research were provided by the Commission d'accès à l'information du Québec (CAI), the official governmental registry in the province of Quebec. Any request to access the data must be submitted directly to the CAI through its website https://www.cai.gouv.qc.ca/.
Funding: AR was supported by the Natural Sciences and Engineering Research Council of Canada (NSERC), Discovery Grants Program, Grant 2020-07055. MM was supported by the Fonds de recherche du Québec – Programme intersectoriel AUDACE, Grant 2019-AUDC-263506. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Schizophrenia (SZ), bipolar disorder (BD) and major depressive disorder (MDD) together affect more than 4% of the population, or about 35 million people in the G7 countries [1]. The majority of patients affected by SZ, BD or MDD follow a chronic course, mainly because treatments remain largely symptomatic [2,3]. One major obstacle to advancing research is the substantial within-diagnosis heterogeneity in trajectory profiles for major psychiatric disorders. Adapted research methods must be sought to advance knowledge about the sources of this heterogeneity and then improve treatment and service delivery. The relevance of longitudinal trajectory studies is also underscored by the reduced quality of life and productivity of patients, with economic costs that amount to hundreds of billions of dollars annually in Europe and North America [4–6].
Over the past decades, several heterogeneity studies have investigated the longitudinal course of major psychiatric disorders such as SZ, BD, and MDD. These studies are difficult to compare due to differences in methods and variables used. Many informative studies have examined governmental population-based data registries in different countries [7,8] suggesting that the degree of concordance between research diagnoses and clinician diagnoses is satisfactory [9–11].
Relatedly, several studies have raised concerns about the stability of diagnoses over time [12,13], an important issue that has not often been considered in cross-sectional studies and in studies of the course of major psychiatric disorders. Indeed, the heterogeneity of the long-term course of psychiatric disorders includes changes in diagnosis and symptom intensity that make it difficult to interpret for disease management and service delivery modalities. BD would show more diagnostic instability [14–16] than SZ [17–21].
The impact of changes in diagnosis over the course of a patient’s illness is poorly understood. From a clinical perspective, diagnosis changes over time may imply treatment modifications or clarifications for the patient and family, and even possible forensic implications.
From a research perspective, it can be inferred that diagnosis changes over time, if not accounted for in trajectory research, are likely to introduce biases in sampling and outcome interpretation. Finally, most trajectory studies have examined only one disorder, and very few have simultaneously examined the clinical trajectories of patients with SZ, BD, and MDD.
Four conclusions can be drawn from previous trajectory studies [7,19–23]. First, most have focused solely on demographic and disease characteristics such as gender, severity, age of onset, or cognitive changes [24,25]. Second, heterogeneity has been observed among patients with respect to their long-term course [7,26–28]. Third, greater severity in the early years of illness would predict a worse long-term course [26]. Fourth, as mentioned above, the few studies that have examined the degree of diagnostic change suggest a higher diagnostic instability in BD than in SZ or MDD [14–16].
Although some studies have attempted to examine heterogeneity in patients’ long-term trajectories by considering the three major lifetime psychiatric diagnoses [29–33], only a few have utilized clustering analysis to do so [34–36]. To our knowledge, no studies have explicitly incorporated service delivery descriptors in the analysis. Our objective was to assess the heterogeneity in the long-term trajectories of SZ, BD and MDD, by performing a cluster analysis on several service use descriptors and subsequently validating the obtained clusters using patients’ clinical characteristics. Our hypothesis was that service delivery patterns would contribute to interpretable heterogeneous subgroups of patient trajectories.
Methods
We implemented a two-stage analysis process. In the first step, we extracted for each subject the number and type of patient contacts with health professionals from a government database containing health records for the entire population of Quebec City in the province of Quebec, Canada, from 2002 to 2014. The Quebec province offers a public universal health care system to its population. We then computed, for each subject, a set of service descriptors including the frequency of consultations, hospitalizations, change of professional, and diagnosis changes, and applied a cluster analysis to group individual trajectories into homogeneous groups. In a second step, analysis were performed on the resulting clusters to examine potential differences among the clusters in terms of patients’ clinical characteristics.
Ethical approval
Data used in this research were provided by the Régie de l’assurance maladie du Québec (RAMQ), which is the Quebec government’s mandatory health insurance office. The RAMQ manages transactions related to the use of medical services and reimburses health care professionals in the province of Quebec, Canada. The access to anonymized and confidential RAMQ’s data was authorised by the Commission d’accès à l’information du Québec (Quebec Information Access Commission, CAI), the official governmental registry in the province of Quebec, under request Ref. 111031-S. Since the dataset provided by RAMQ was anonymized, individuals’ consents were not obtained. We are prohibited from sharing the data with any repository or publication. Conversely, anyone interested should address an information access request directly to the RAMQ’s (acces@ramq.gouv.qc.ca).
Dataset
We had access to an anonymized RAMQ dataset containing all care services provided to individuals at all health centers in the Quebec City region between 2002 and 2014. This health administrative region covers more than 18,600 km2 and is populated by nearly 730,000 people from urban and semi-rural areas. We processed a dataset of 98 million observations corresponding to all patient transactions during the aforesaid period. Each record/transaction described a patient’s contact with the health care system and included the date and location of the contact, the anonymized identification number of the patient and the health care professional, and the associated principal diagnosis describing the encounter according to the diagnostic codes from the Ninth Revision of the International Statistical Classification of Diseases and Related Health Problems (ICD-09, see S12 Table) [37]. From this data set, we identified patients who met the following criteria: (1) received at least one ICD diagnosis of MDD, BD, or SZ; (2) received at least a diagnosis of MDD, BD, or SZ between the ages of 15 and 34 years; and (3) experienced a first contact with the system (considered here as a first episode) between 2002 and 2014. A total of 6,968 patients (3,752 men and 3,216 women) met these criteria.
Service trajectories
For each patient, we extracted the records related to psychiatric services (consultations and hospitalizations). These contacts with services are hereafter referred to as “visits”. The chronological sequence of visits forms the patient’s service trajectory. We defined the span of the service trajectory as the interval between the patient’s first and last visits. To avoid the potential bias that individuals with sporadic visits might intrude into our sample, we excluded patients with less than five years of follow-up, resulting in a final sample of 2,333 individuals. Fig 1 illustrates the step-by-step process of patient exclusion, whereas Table 1 provides descriptive characteristics of the final sample.
The final sample includes 2,333 individuals.
Diagnostic methods and predominant diagnosis along the trajectory
As reported in several previous studies of governmental health database [11,38,39], diagnoses were ICD diagnoses made by the clinicians across the trajectory of the patient.
A significant proportion of patients had changes of diagnosis given by the clinician over the course of the trajectory (see S1 Table). For this reason, a “predominant diagnosis” was necessary to obtain an equivalent of a lifetime diagnosis for each patient. We defined the predominant diagnosis as the diagnosis most frequently given by the clinician, i.e., the same diagnosis had to be present in at least 50% of the visits. If no diagnosis reached a frequency of at least 50% of the visits, the predominant (lifetime) diagnosis was considered uncertain, and the patient was excluded from further analyses.
Measurements
The measures were related to the services provided and the disease characteristics of the patients. The five measures that assessed how patients interact with the care delivery system longitudinally (thus characterizing their service trajectories) were: 1. visit frequency, defined as the number of visits divided by the length of the trajectory; 2. median time between consecutive visits; 3. number of diagnosis changes, defined as the number of different diagnoses at two consecutive visits along the patient’s trajectory; 4. percentage of visits with a diagnosis change, defined as the number of diagnosis changes divided by the number of visits in the trajectory; 5. number of physician changes, defined as the number of times the diagnosis was made by different physicians. Patient disease characteristics were: 1. the patient’s sex; 2. the age at onset of illness (defined as the first contact with the health care system); 3. the predominant diagnosis along the trajectory; 4. the first diagnosis made at the first visit; and 5. the number of hospitalizations assumed if the patient had a series of visits within seven days or less.
Statistical methods
First, we performed a cluster analysis on the patients’ service descriptors to identify subgroups of service trajectories [40]. We used the R statistical software (https://www.r-project.org/), which includes the k-means and hierarchical agglomerative clustering (HAC) methods. The k-means clustering is faster than the HAC, but it requires that the number of clusters be predetermined. Given the paucity of prior literature on our objective, we chose to test the number of clusters (or trajectories) that best fit our data, so we chose the HAC method. For the purposes of the analysis, the five measures of provider system characteristics were normalized to the [0,1] interval. Correlation tests between these measures resulted in low values of the R coefficient (less than |0.39| in all cases). The HAC algorithm first computes the distance between patients using the Euclidean distance; then it groups patients using a specific linkage function. Three linkage methods – Single, Complete, and Ward’s linkage – were evaluated, yielding agglomerative coefficient values of 97.03, 99.17, and 99.99, respectively. These results indicate a marginally higher clustering cohesion for the Ward’s linkage method. The correlation coefficients matrix and kernel density estimate for the five cluster variables are provided as supplementary material figures S1 Fig and S2 Fig. To select the appropriate number of classes, we first relied on visual inspection of the dendrogram, after which the Dunn index was calculated. A higher Dunn index was considered to indicate better clustering.
Second, the service trajectories within each class were analyzed to identify their common features, and descriptive statistics were computed to characterize the service trajectory subtype that fits each class.
Finally, regression analyses and ANOVAs tests using the clusters as dependent variables were performed to confirm the differences between the subtypes of trajectories identified by the cluster analysis (see subsection External validation of the clusters).
Results and validation
Service trajectory subtypes
A cluster analysis was applied to the service delivery descriptors of 2,333 individuals with a predominant diagnosis of MDD, BD, or SZ. The cluster analysis used the five measures that define patients’ interactions with the service provider: frequency of visits, median time between consecutive visits, number of diagnosis changes, percentage of visits with a diagnosis change, and number of times the diagnosis was made by different clinicians. The structure of classes or trajectory subtypes that best fit the data was based on the Dunn index, which yielded values of.007,.008,.008,.008, and.002 for structures with 2, 3, 4, 5, and 6 classes, respectively. The three-class structure was chosen on the principle that increasing the number of classes would not improve the Dunn Index value. The dendrogram is shown in Fig 2.
Graphical representation of the three classes (Type 1, Type 2, and Type 3) as a dendrogram. Each of the 2333 patients is represented by a black dot at the bottom of the image and connected by vertical lines to the most similar patient. Groups of patients connected by shorter vertical lines are less distant and therefore similar. The three selected classes are highlighted.
The description of the patients populating the three service trajectories or classes is given in Table 2.
The mean values of service indicators for the patients in each class, as well as their associated 95% confidence intervals, are given in Table 3.
The most populous class that we labelled Stable diagnosis trajectory, comprised 54% (N = 1258) of all patients. The majority of patients in this class (676 patients; 53.7%) had a predominant diagnosis of SZ, whereas 378 and 204 patients (30% and 16.3%) had a predominant diagnosis of MDP and BD, respectively. Patients had approximately one visit every three months (median time 102 days; CI = 85–120), mostly with psychiatrists (67%; CI = 65–69) and mostly with the same physician (percentage of visits with change of physician 22%; CI = 21–23). Finally, this class was characterized by a low number of changes in diagnosis (0.9; CI = 0.8-1) that occurred at a low frequency across all visits (1.9%; CI = 1.7-2.1), hence the name of the class.
A second class, labelled Unstable diagnosis with high care consumption trajectory, contained a smaller number of patients (N = 293; 13%). As in class 1, the majority of patients (N = 227; 77%) had a predominant diagnosis of SZ, and the remaining 23% (N = 66) had a diagnosis of MDD or BD. Individuals in this class had approximately one visit per week, but multiple same-day visits were also observed, suggesting that contacts likely occurred during hospitalizations. Most visits were seen by specialists (91%; CI = 89–93), with a low frequency of change of specialist (percentage of visits with change of physician 25%; CI = 23–27). On average, these individuals had the highest absolute mean number of changes in diagnosis (10.4; CI = 9.3-11.5), but an intermediate frequency of changes in diagnosis when the number of visits was considered (8.1%; CI = 7.1-8.1).
Finally, class 3 labelled Intermediate unstable diagnosis with low consumption of care trajectory included 782 patients (34%) mostly affected by mood disorders (N = 636; 81%), whereas 19% (N = 146) had a lifetime diagnosis of schizophrenia. For these patients, visits were fewer (16; CI = 15–17) and more distant in time (about one visit per year) and were less likely to be with a specialist (42% of visits; CI = 40–45%) or with the same physician (percentage of visits with a change of physician 38%; CI = 36–39).
External validation of the clusters
We conducted a bootstrapping-based stability analysis to assess the robustness of our clustering results based on the method reported in [41]. The procedure involved the following steps: 1. We generated 1,000 resampled datasets through bootstrapping; 2. For each resampled dataset, we applied the same clustering methodology (i.e., hierarchical clustering with Ward’s linkage) to produce the corresponding partitions; 3. To determine a stable partitioning, we employed a majority voting rule, where clusters were assigned based on the most frequently occurring assignments across resamples; 4. We compared the stable partitioning to the original clustering results using the Rand Index [41], which yielded a value of 70.79. This score indicates a strong level of agreement, suggesting that the clustering structure is relatively stable and reproducible.
To further validate the distinction between the three classes, we performed pairwise ANOVAs. One-way ANOVAs were performed with class as the independent variable, resulting in 3 comparisons: Class 1 vs. Class 2, Class 1 vs. Class 3, and Class 2 vs. Class 3. Table 4 reports the R2 values for each ANOVA, quantifying how much variability in the dependent variable is explained by the independent variable.
Finally, to test whether the three obtained classes were mainly determined by the service delivery descriptors, the patients’ clinical characteristics and service delivery descriptors were entered as independent variables in a multinomial logistic regression model where the three clusters or classes were used as dependent variables (see Table 5). The results indicated that patients’ characteristics such as sex, and predominant diagnosis did not significantly predict the three clusters.
Discussion
Our study through cluster analysis revealed three distinct classes of longitudinal service delivery trajectories. The results suggest that these classes apply to patients receiving either a diagnosis of SZ, BD or MDD and that the patients in each class longitudinally use psychiatric resources according to three distinct patterns. The study also supports the relevance of our method for future studies investigating heterogeneity in patients’ long-term trajectories and possibly within-diagnosis heterogeneity.
It is noteworthy that the first trajectory characterizing the largest number of patients featured stable diagnoses, with a low rate of clinician changes and included the majority (around 65%) of the schizophrenia patients. In contrast, the BD patients were more represented in the two other trajectories, showing higher percentages of both diagnoses and doctors changes. Interestingly, these results align with previous studies suggesting that BD diagnosis showed less stability over time than the SZ diagnosis [14–21]. Finally, the second trajectory characterized by unstable diagnosis and a high care consumption that might be associated with hospitalizations, contains only a few of the MDD patients.
The issue of the longitudinal stability of the diagnoses made by the clinicians has received limited attention so far [42]. Our longitudinal analysis suggested that instability of diagnoses and frequent doctor changes across life would be key variables distinguishing subgroups of service trajectories. We believe that these variables should be addressed in future studies since our results showed that 47% of the patients in our sample would fall into the two classes characterized by medium or high rates of diagnosis changes. Furthermore, we found that there was an association between a higher rate of diagnosis changes and a higher rate of physician changes across a patient’s trajectory. However, our study could not distinguish which of the two factors would be causal. In other words, would more demanding or relationally difficult patients provoke more clinician changes or would the changes in clinicians due to the mode of care delivery lead to increased diagnosis changes? Focussing on the determinants and timing of clinician changes is certainly important for future investigations, and previous studies [14–21,43] have already reported trends in diagnosis changes. As regards the practitioner and the patient, our findings also call to mind the potential disadvantages of discontinuities in care for the patient care and for cost efficiency, as well as consequences for patient or family perceptions of illness, and even forensic implications since the nature of diagnosis of a psychiatric disorder has an influence in the court of law. Meanwhile, there would generally be advantages, in the management of delivery of psychiatric care, of paying more attention to the rate of practitioner changes for these patients who in a large proportion have a chronic course.
Two other results of our analysis may have general implications for health care planners/managers and clinicians. First, MDD episodes may often be the start of a trajectory toward a lifetime predominant diagnosis of either MDD, BD or SZ. In particular, 1014 of the 2333 patients in our sample received a first diagnosis of MDD, but MDD seems to be the predominant diagnosis for only 759 of them. Second, the three trajectories show significant differences in the way patients with same diagnosis would longitudinally interact with the care delivery system. A logical consequence would be that diagnosis in the first episodes of illness might not be the best indicator for planning the provision of personalized mental health services.
Our study has both strengths and limitations. Several limitations merit cautions in the interpretation of the results. A first one to consider is that we analyzed longitudinal data collected from 2002 to 2014 and the possibility of a cohort effect might be kept in mind when interpreting the results, although there is no evidence of such an operative cohort effect in Quebec’s universal health care system. Second, whereas the stability of the cluster structure was confirmed by a statistical bootstrapping, we did not practice an out-of-sample validation. Third, our data could not allow us to determine the extent to which the patients themselves initiated their interactions with the care delivery system or vice-versa. In other words, it is for instance possible that some patients’ lower compliance placed them on the unstable diagnostic trajectory associated with low service use. Fourth, the type and number of clinical variables defining disease specificity or severity may also limit the interpretation. Fifth, the use of clinician diagnosis in governmental database must be kept in mind regarding potential differences with research diagnoses [11]. Sixth, the non-availability of the pharmacological history could have given valuable information that might have influenced the results.
Several strengths of our study should also be highlighted. First, this study is, to the best of our knowledge, the first to examine long-term psychiatric patient trajectories that incorporate service delivery descriptors. Our findings suggest that the latter may contribute to the distinction among subgroups of trajectories. Second, governmental database studies imply diagnoses made by clinicians. The use of ICD diagnoses renders our results readily useful for non-scientist clinical practitioners and furthermore, may allow other research groups to reproduce our results in governmental databases from other countries, paving the way for testing their own service descriptors. Third, the results of the cluster analysis align with those produced by classical regression models, thereby supporting the validity of the service trajectory classes produced by the clustering analytical methods. Fourth, the cluster analysis conducted in our study may present an advantage over other data-driven approaches that require thorough modeling among model variables.
Conclusion
Schizophrenia (SZ), bipolar disorder (BD), and major depressive disorder (MDD) exhibit intra-diagnostic heterogeneity in their clinical courses, which poses significant challenges for the planning of appropriate service delivery to these patients. This paper presents a clustering-based method that integrates service delivery and patient clinical descriptors to study the long-term trajectories of patients affected by SZ, BD, or MDD. Applied to a sample of 2,333 patients, the method identified three distinct classes or groups of patients that interact differently with the service provider in terms of the number and the frequency of the visits and demonstrated varying levels of diagnostic instability. These results suggest that analyzing service delivery features may be valuable for gaining further insights into a patient’s long-term clinical heterogeneity. Incorporating the pharmacological history into such studies would undoubtedly provide additional benefits.
Supporting information
S1 Table. Frequency of diagnosis changes among Major Depressive Disorder (MDD), Bipolar Disorder (BD), and Schizophrenia (SZ) over the total diagnosis changes.
https://doi.org/10.1371/journal.pmen.0000327.s001
(DOCX)
S2 Table. Demographic and clinical characteristics of female patients (N = 1068) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s002
(DOCX)
S3 Table. Average values and confidence intervals at 95% for the service trajectories measures of female patients (N = 1068) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s003
(DOCX)
S4 Table. Demographic and clinical characteristics of male patients (N = 1265) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s004
(DOCX)
S5 Table. Average values and confidence intervals at 95% for the service trajectories measures of male patients and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s005
(DOCX)
S6 Table. Demographic and clinical characteristics of patients with a predominant diagnosis of Schizophrenia (N = 1049) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s006
(DOCX)
S7 Table. Average values and confidence intervals at 95% for service trajectories measures of patients with a predominant diagnosis of Schizophrenia (N = 1049) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s007
(DOCX)
S8 Table. Demographic and clinical characteristics of patients with a predominant diagnosis of Bipolar disorder (N = 1049) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s008
(DOCX)
S9 Table. Average values and confidence intervals at 95% for service trajectories measures of patients with a predominant diagnosis of Bipolar disorder (N = 525) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s009
(DOCX)
S10 Table. Demographic and clinical characteristics of patients with a predominant diagnosis of Major Depressive Disorder (N = 759) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s010
(DOCX)
S11 Table. Average values and confidence intervals at 95% for service trajectories measures of patients with a predominant diagnosis of Major Depressive Disorder (N = 759)) and each service trajectory class.
https://doi.org/10.1371/journal.pmen.0000327.s011
(DOCX)
S12 Table. ICD-09 diagnostic codes used to classify our patients in the three disorder categories.
https://doi.org/10.1371/journal.pmen.0000327.s012
(DOCX)
S1 Fig. Correlation matrix.
Correlation coefficients of the five clustering variables are reported and shaded in blue for positive correlation and in red for negative correlation. A more intense color corresponds to a stronger correlation.
https://doi.org/10.1371/journal.pmen.0000327.s013
(DOCX)
S2 Fig. Distribution densities.
For each clustering variable, kernel density estimates are proposed: a) visit frequency; b) median time between consecutive visits; c) number of diagnosis changes; d) percentage of visits with a diagnosis change; e) number of physician changes.
https://doi.org/10.1371/journal.pmen.0000327.s014
(DOCX)
Acknowledgments
We thank the valuable support of the Service de l’intelligence des données et du développement de solutions informationnelles, CIUSSS Capitale-Nationale.
References
- 1. Maziade M. At Risk for Serious Mental Illness - Screening Children of Patients with Mood Disorders or Schizophrenia. N Engl J Med. 2017;376(10):910–2. pmid:28273009
- 2. Kilçiksiz CM, Öngür D. Double-Dissociation Studies in Psychiatric Research: A Scoping Review. Harv Rev Psychiatry. 2019;27(6):336–41. pmid:31714464
- 3. Maziade M, Silverstein SM. The place of the retina in psychiatry: uniting neurobiological and neurodevelopmental research with clinical research in psychiatric disorders. Schizophr Res. 2020.
- 4. Cloutier M, Aigbogun MS, Guerin A, Nitulescu R, Ramanakumar AV, Kamat SA, et al. The Economic Burden of Schizophrenia in the United States in 2013. J Clin Psychiatry. 2016;77(6):764–71. pmid:27135986
- 5. Greenberg PE, Fournier A-A, Sisitsky T, Pike CT, Kessler RC. The economic burden of adults with major depressive disorder in the United States (2005 and 2010). J Clin Psychiatry. 2015;76(2):155–62. pmid:25742202
- 6. Wykes T, Haro JM, Belli SR, Obradors-Tarragó C, Arango C, Ayuso-Mateos JL, et al. Mental health research priorities for Europe. Lancet Psychiatry. 2015;2(11):1036–42. pmid:26404415
- 7. Musliner KL, Munk-Olsen T, Laursen TM, Eaton WW, Zandi PP, Mortensen PB. Heterogeneity in 10-Year Course Trajectories of Moderate to Severe Major Depressive Disorder: A Danish National Register-Based Study. JAMA Psychiatry. 2016;73(4):346–53. pmid:26934026
- 8. Rabinowitz J, Haim R, Reichenberg A, Weiser M, Kaplan Z, Davidson M, et al. Association between functioning in adolescence prior to first admission for schizophrenia and affective disorders and patterns of hospitalizations thereafter. Schizophr Res. 2005;73(2–3):185–91. pmid:15653261
- 9. de la Vega D, Piña A, Peralta FJ, Kelly SA, Giner L. A Review on the General Stability of Mood Disorder Diagnoses Along the Lifetime. Curr Psychiatry Rep. 2018;20(4):29. pmid:29607445
- 10. Zimmerman M. A Review of 20 Years of Research on Overdiagnosis and Underdiagnosis in the Rhode Island Methods to Improve Diagnostic Assessment and Services (MIDAS) Project. Can J Psychiatry. 2016;61(2):71–9. pmid:27253697
- 11. Davis KAS, Sudlow CLM, Hotopf M. Can mental health diagnoses in administrative data be used for research? A systematic review of the accuracy of routinely collected diagnoses. BMC Psychiatry. 2016;16:263. pmid:27455845
- 12. Cegla-Schvartzman FB, Ovejero S, López-Castroman J, Baca-García E. Diagnostic Stability in Bipolar Disorder: A Narrative Review. Harv Rev Psychiatry. 2019;27(1):3–14. pmid:30358663
- 13. Woo YS, Shim IH, Wang H-R, Song HR, Jun T-Y, Bahk W-M. A diagnosis of bipolar spectrum disorder predicts diagnostic conversion from unipolar depression to bipolar disorder: a 5-year retrospective study. J Affect Disord. 2015;174:83–8. pmid:25486276
- 14. Baca-Garcia E, Perez-Rodriguez MM, Basurte-Villamor I, López-Castromán J, Fernandez del Moral AL, Jimenez-Arriero MA, et al. Diagnostic stability and evolution of bipolar disorder in clinical practice: a prospective cohort study. Acta Psychiatr Scand. 2007;115(6):473–80. pmid:17498159
- 15. Hirschfeld RM. Differential diagnosis of bipolar disorder and major depressive disorder. J Affect Disord. 2014;169 Suppl 1:S12-6. pmid:25533909
- 16. Østergaard SD, Straszek S, Petrides G, Skadhede S, Jensen SOW, Munk-Jørgensen P, et al. Risk factors for conversion from unipolar psychotic depression to bipolar disorder. Bipolar Disord. 2014;16(2):180–9. pmid:24215495
- 17. Fusar-Poli P, Cappucciati M, Rutigliano G, Heslin M, Stahl D, Brittenden Z, et al. Diagnostic Stability of ICD/DSM First Episode Psychosis Diagnoses: Meta-analysis. Schizophr Bull. 2016;42(6):1395–406. pmid:26980142
- 18. Ratheesh A, Davey C, Hetrick S, Alvarez-Jimenez M, Voutier C, Bechdolf A, et al. A systematic review and meta-analysis of prospective transition from major depression to bipolar disorder. Acta Psychiatr Scand. 2017;135(4):273–84. pmid:28097648
- 19. Kim JS, Baek JH, Choi JS, Lee D, Kwon JS, Hong KS. Diagnostic stability of first-episode psychosis and predictors of diagnostic shift from non-affective psychosis to bipolar disorder: a retrospective evaluation after recurrence. Psychiatry Res. 2011;188(1):29–33. pmid:21056477
- 20. Palomar-Ciria N, Cegla-Schvartzman F, Lopez-Morinigo J-D, Bello HJ, Ovejero S, Baca-García E. Diagnostic stability of schizophrenia: A systematic review. Psychiatry Res. 2019;279:306–14. pmid:31056225
- 21. Heslin M, Lomas B, Lappin JM, Donoghue K, Reininghaus U, Onyejiaka A, et al. Diagnostic change 10 years after a first episode of psychosis. Psychol Med. 2015;45(13):2757–69. pmid:25936425
- 22. Cronkite RC, Woodhead EL, Finlay A, Timko C, Unger Hu K, Moos RH. Life stressors and resources and the 23-year course of depression. J Affect Disord. 2013;150(2):370–7. pmid:23688913
- 23. Keller MB, Lavori PW, Mueller TI, Endicott J, Coryell W, Hirschfeld RM, et al. Time to recovery, chronicity, and levels of psychopathology in major depression. A 5-year prospective follow-up of 431 subjects. Arch Gen Psychiatry. 1992;49(10):809–16. pmid:1417434
- 24. Rund BR, Barder HE, Evensen J, Haahr U, ten Velden Hegelstad W, Joa I, et al. Neurocognition and Duration of Psychosis: A 10-year Follow-up of First-Episode Patients. Schizophr Bull. 2016;42(1):87–95. pmid:26101305
- 25. Zanelli J, Mollon J, Sandin S, Morgan C, Dazzan P, Pilecka I, et al. Cognitive Change in Schizophrenia and Other Psychoses in the Decade Following the First Episode. Am J Psychiatry. 2019;176(10):811–9. pmid:31256609
- 26. Levine SZ, Lurie I, Kohn R, Levav I. Trajectories of the course of schizophrenia: from progressive deterioration to amelioration over three decades. Schizophr Res. 2011;126(1–3):184–91. pmid:21093220
- 27. Colman I, Ploubidis GB, Wadsworth MEJ, Jones PB, Croudace TJ. A longitudinal typology of symptoms of depression and anxiety over the life course. Biol Psychiatry. 2007;62(11):1265–71. pmid:17692292
- 28. Kendler KS, Gatz M, Gardner CO, Pedersen NL. Personality and major depression: a Swedish longitudinal, population-based twin study. Arch Gen Psychiatry. 2006;63(10):1113–20. pmid:17015813
- 29. Duffy A, Goodday S, Passos IC, Kapczinski F. Changing the bipolar illness trajectory. Lancet Psychiatry. 2017;4(1):11–3. pmid:28012467
- 30. Duffy A, Vandeleur C, Heffer N, Preisig M. The clinical trajectory of emerging bipolar disorder among the high-risk offspring of bipolar parents: current understanding and future considerations. Int J Bipolar Disord. 2017;5(1):37. pmid:29164495
- 31. Maziade M, Roy MA, Fournier JP, Cliche D, Mérette C, Caron C, et al. Reliability of best-estimate diagnosis in genetic linkage studies of major psychoses: results from the Quebec pedigree studies. Am J Psychiatry. 1992;149(12):1674–86. pmid:1443244
- 32. Ribeiro-Fernández M, Díez-Suárez A, Soutullo C. Phenomenology and diagnostic stability of paediatric bipolar disorder in a Spanish sample. J Affect Disord. 2019;242:224–33. pmid:30205288
- 33. Shea MT, Stout R, Gunderson J, Morey LC, Grilo CM, McGlashan T, et al. Short-term diagnostic stability of schizotypal, borderline, avoidant, and obsessive-compulsive personality disorders. Am J Psychiatry. 2002;159(12):2036–41. pmid:12450953
- 34. Pelin H, Ising M, Stein F, Meinert S, Meller T, Brosch K, et al. Identification of transdiagnostic psychiatric disorder subtypes using unsupervised learning. Neuropsychopharmacology. 2021;46(11):1895–905. pmid:34127797
- 35. Grisanzio KA, Goldstein-Piekarski AN, Wang MY, Rashed Ahmed AP, Samara Z, Williams LM. Transdiagnostic Symptom Clusters and Associations With Brain, Behavior, and Daily Function in Mood, Anxiety, and Trauma Disorders. JAMA Psychiatry. 2018;75(2):201–9. pmid:29197929
- 36. Lee E, Lee D, Baek JH, Kim SY, Park W-Y. Transdiagnostic clustering and network analysis for questionnaire-based symptom profiling and drug recommendation in the UK Biobank and a Korean cohort. Sci Rep. 2024;14(1):4500. pmid:38402308
- 37. Slee VN. The International Classification of Diseases: ninth revision (ICD-9). Ann Intern Med. 1978;88(3):424–6. pmid:629506
- 38. Wilchesky M, Tamblyn RM, Huang A. Validation of diagnostic codes within medical services claims. J Clin Epidemiol. 2004;57(2):131–41. pmid:15125622
- 39. Lambert L, Blais C, Hamel D, Brown K, Rinfret S, Cartier R, et al. Evaluation of care and surveillance of cardiovascular disease: can we trust medico-administrative hospital data?. Can J Cardiol. 2012;28(2):162–8. pmid:22230034
- 40.
Rokach L, Maimon O. Clustering methods. Data mining and knowledge discovery handbook. Springer; 2005:321–52.
- 41. Severiano A, Carriço JA, Robinson DA, Ramirez M, Pinto FR. Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. PLoS One. 2011;6(5):e19539. pmid:21611165
- 42. Kim W, Woo YS, Chae J-H, Bahk W-M. The Diagnostic Stability of DSM-IV Diagnoses: An Examination of Major Depressive Disorder, Bipolar I Disorder, and Schizophrenia in Korean Patients. Clin Psychopharmacol Neurosci. 2011;9(3):117–21. pmid:23430042
- 43. Johnson-Kwochka A, Wu W, Luther L, Fischer MW, Salyers MP, Rollins AL. The Relationship Between Clinician Turnover and Client Outcomes in Community Behavioral Health Settings. Psychiatr Serv. 2020;71(1):28–34. pmid:31522631