The higher mortality rates in people with severe mental illness (SMI) may be partly due to inadequate integration of physical and mental healthcare. Accurate recording of SMI during hospital admissions has the potential to facilitate integrated care including tailoring of treatment to account for comorbidities. We therefore aimed to investigate the sensitivity of SMI recording within general hospitals, changes in diagnostic accuracy over time, and factors associated with accurate recording.
Methods and findings
We undertook a cohort study of 13,786 adults with SMI diagnosed during 2006–2017, using data from a large secondary mental healthcare database as reference standard, linked to English national records for 45,706 emergency hospital admissions. We examined general hospital record sensitivity across patients’ subsequent hospital records, for each subsequent emergency admission, and at different levels of diagnostic precision. We analyzed time trends during the study period and used logistic regression to examine sociodemographic and clinical factors associated with psychiatric recording accuracy, with multiple imputation for missing data.
Sensitivity for recording of SMI as any mental health diagnosis was 76.7% (95% CI 76.0–77.4). Category-level sensitivity (e.g., proportion of individuals with schizophrenia spectrum disorders (F20-29) who received any F20-29 diagnosis in hospital records) was 56.4% (95% CI 55.4–57.4) for schizophrenia spectrum disorder and 49.7% (95% CI 48.1–51.3) for bipolar affective disorder. Sensitivity for SMI recording in emergency admissions increased from 47.8% (95% CI 43.1–52.5) in 2006 to 75.4% (95% CI 68.3–81.4) in 2017 (ptrend < 0.001). Minority ethnicity, being married, and having better mental and physical health were associated with less accurate diagnostic recording. The main limitation of our study is the potential for misclassification of diagnosis in the reference-standard mental healthcare data.
Our findings suggest that there have been improvements in recording of SMI diagnoses, but concerning under-recording, especially in minority ethnic groups, persists. Training in culturally sensitive diagnosis, expansion of liaison psychiatry input in general hospitals, and improved data sharing between physical and mental health services may be required to reduce inequalities in diagnostic practice.
Why was this study done?
- People with severe mental illness (SMI) have increased mortality and morbidity, largely due to preventable medical conditions, and these disparities have the potential to be ameliorated through better healthcare integration.
- Accurate recognition of SMI during hospital admissions can be critical as it allows continuity of previous pharmacological and supportive treatments and tailoring of inpatient and discharge care to individual needs.
What did the researchers do and find?
- We examined the hospital discharge records of 13,786 individuals with SMI diagnosis from a mental health service, who had 45,706 admissions to English general hospitals between 2006 and 2017.
- We found that a psychiatric condition is recorded in around two-thirds of general hospital admissions of people with SMI. Recording of SMI diagnosis increased between 2006 and 2017.
- However, people from ethnic minority and married backgrounds were less likely to have psychiatric diagnosis recorded. Similarly, those with less severe mental or physical health symptoms were also less likely to have diagnosis recorded.
What do these findings mean?
- Despite improvements over the past decade, inequities related to ethnicity remain. Policy-makers and clinicians should endeavor to improve recognition and recording of SMI in general hospital settings to promote integrated physical and mental healthcare.
- A limitation of our study is that our use of electronic health records for the reference-standard means that some people with SMI may have been misclassified.
Citation: Mansour H, Mueller C, Davis KAS, Burton A, Shetty H, Hotopf M, et al. (2020) Severe mental illness diagnosis in English general hospitals 2006-2017: A registry linkage study. PLoS Med 17(9): e1003306. https://doi.org/10.1371/journal.pmed.1003306
Academic Editor: Stephanie L. Prady, The University of York, UNITED KINGDOM
Received: March 10, 2020; Accepted: July 21, 2020; Published: September 17, 2020
Copyright: © 2020 Mansour et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant aggregate data are found within the paper. The data used in this work have been obtained from the Clinical Record Interactive Search (CRIS), a system that has been developed for use within the NIHR Mental Health Biomedical Research Centre (BRC) at the South London and Maudsley NHS Foundation Trust (SLaM). It provides authorized researchers with regulated access to anonymized information extracted from SLaM's electronic clinical records system. Individual-level data are restricted in accordance to the strict patient led governance established at South London and The Maudsley NHS Foundation Trust, and by NHS Digital for the case of linked data. Data are available for researchers who meet the criteria for access to this restricted data: (1) SLaM employees or (2) those having an honorary contract or letter of access from the trust. For further details, and to obtain an honorary research contract or letter of access, contact the CRIS Administrator at email@example.com.
Funding: The authors received no specific funding for this work.
Competing interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: The data resource is funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. HM, AB, DO, and AS are supported by the UCLH NIHR Biomedical Research Centre. KD is funded by the NIHR Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. DO is in part supported by the NIHR Applied Health Research Collaboration (ARC) North Thames at Bart’s Health NHS Trust. RS declares receipt of research support within the last 5 years from Roche, Janssen, GSK, and Takeda. AS was funded by a fellowship from the Wellcome trust during the submitted work.
Abbreviations: ADL, activity of daily living; EHR, electronic health record; HES, Hospital Episode Statistics; HoNOS, Health of the Nation Outcome Scale; ICD-10, International Statistical Classification of Diseases and Related Health Problems, Tenth Revision; IQR, interquartile range; OR, odds ratio; SLaM, South London and Maudsley National Health Service Foundation Trust; SMI, severe mental illness
Severe mental illnesses (SMI), defined as schizophrenia spectrum and bipolar affective disorders, have lifetime prevalence of around 0.5% and 1% respectively [1, 2], and are associated with several physical comorbidities that increase the risk of general hospital admission [3, 4]. Life expectancy is 10–15 years lower for people with SMI , and this health gap is increasing over time , with SMI contributing to 3.5% of worldwide years lost to disability . The 2019 Lancet Commission on Physical Health of People with Mental Illness identified the need for multidisciplinary approaches to multimorbidity in people with mental illness . An important aspect of such healthcare integration is detection of psychiatric conditions in healthcare settings to allow continuity of previous care such as medication and tailoring of inpatient and discharge plans to account for comorbidity . However, the separation of physical and mental healthcare in the United Kingdom, with different hospital settings using discrete electronic health records (EHRs), may inhibit this.
There has been limited research into recognition of mental health conditions within secondary physical healthcare settings. One study investigated SMI recording in primary care , and another investigated recognition specifically of deliberate self-poisoning within one UK general hospital’s EHRs ; both were conducted over 20 years ago. A further study examined recording of alcohol disorders in primary and secondary care . Other studies have investigated accuracy of psychiatric, rather than general hospital, records, in which recognition of mental illness is likely to be higher . No studies have investigated time-trend changes or factors associated with systematic differences in SMI recording. Understanding such changes may inform future approaches to improving illness recording and elucidate potential biases in hospital records, which are being increasingly used for case-ascertainment in epidemiological studies .
We therefore aimed to evaluate the accuracy of SMI recording during English general hospital admissions of a person with preexisting SMI who is admitted to a general hospital for any health condition, using a large secondary mental healthcare database to identify people with SMI, and linked national general hospital data to assess diagnostic recording. Our specific objectives were to calculate the sensitivity of SMI diagnosis in general hospital records, evaluate time-trend changes of SMI diagnosis recording in general hospital records from 2006 to 2017, and examine association of sociodemographic and clinical factors with accuracy of psychiatric recording in general hospital records.
Study design and participants
We undertook a cohort study, using data from the South London and Maudsley National Health Service (NHS) Foundation Trust (SLaM), one of Europe’s largest secondary mental healthcare trusts providing support to around 1.36 million people living in 4 ethnically diverse communities in South London, UK (Croydon, Lambeth, Lewisham, and Southwark). We used the “Clinical Record Interactive Search” (CRIS) data extraction tool, which enables construction of databases suitable for research by identifying, retrieving, and linking a pseudonymized version of SLaM patient records for over 450,000 individuals . CRIS uses natural language processing (NLP) algorithms developed on General Architecture for Text Engineering (GATE) software  to extract information from unstructured fields of the clinical record. SLaM data were linked using deterministic matching procedures to NHS Digital’s Hospital Episode Statistics data source to identify admissions to any English hospital. Oxfordshire Research Ethics Committee C (18/SC/0372) approved these resources for secondary analysis. The terms of the ethical approval do not require consent to be provided, but all participants have the right to opt out of data use at any time. This study is reported as per the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guideline (S1 STROBE Checklist) .
These data were selected to generate “reference-standard” SMI diagnoses because they included information from the predominant diagnostic and treatment service for mental illnesses in the catchment area. Patients were diagnosed after assessment by mental health staff, e.g., a psychiatrist, nurse, or psychologist, according to the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) , which is the predominant diagnostic framework in the UK.
We included study participants who (1) had clinical contact with SLaM mental health services between 1 January 2006 and 31 March 2017 while aged 18 or over, (2) were diagnosed at any time with schizophrenia (ICD-10 code F20), schizotypal disorder (F21), delusional disorder (F22), schizoaffective disorder (F25), other nonorganic psychotic disorder (F28), unspecified nonorganic psychosis (F29), manic episode (F30), or bipolar affective disorder (F31), including those described in clinical coding or records as “probable” or “in remission,” and (3) were admitted to an English NHS general (nonpsychiatric) hospital after the first diagnosis of SMI in CRIS. Participants were identified from diagnoses in structured EHR diagnostic fields or unstructured text. Participants were assigned to only 1 diagnostic category following the “hierarchy” of psychiatric diagnoses  (e.g., an individual diagnosed sequentially with schizophrenia [F20] and a manic episode [F30] would be assigned to F20 group), as in previous studies . We did this to avoid double-counting patients who may have been diagnosed at different times within the reference-standard database as having a schizophrenia-like disorder and bipolar disorder; we judged that this most likely represented evolving clinical opinion rather than coexistence of the 2 disorders, which is clinically unlikely .
We obtained outcome data from Hospital Episode Statistics (HES) records, which include clinical diagnoses according to ICD-10 criteria from admissions to any hospital within England . The HES database is primarily designed to allocate payment to hospitals for the care they provide, and its secondary uses are for research and health service planning. The index date for our study was the first SMI diagnosis within SLaM, and we obtained data from HES on all subsequent admissions of included patients to general (i.e., nonpsychiatric) hospitals, including dates of admission and discharge, admission method (emergency, i.e., unplanned admission, or elective, such as admission for renal dialysis, wound dressing, chemotherapy, or elective surgery), and up to 20 primary and secondary recorded diagnoses. Our outcome of interest was recording of psychiatric illness in any of the 20 recorded primary or secondary diagnoses.
Diagnoses recorded in HES include those clinically identified by hospital staff during admissions, those derived from preexisting clinical records from secondary mental health trusts or previous hospital medical records, or those obtained following communication with primary care. Separate EHRs are used in different hospital trusts, meaning that diagnoses are not automatically entered in general hospital records from secondary mental healthcare or primary care records. Some EHRs may automatically populate diagnosis fields with previously recorded chronic conditions, although there are no data available to determine the extent of this practice.
We obtained age, sex, ethnicity (White, Mixed, Asian or British Asian, Black or Black British, and other) and marital status (single, married or cohabiting, divorced or separated, and widowed) from SLaM records data. We used the Index of Multiple Deprivation (IMD)  to rate neighborhood-level socioeconomic deprivation. Clinical presentation was derived using the Health of the Nation Outcome Scale (HoNOS), which is a clinician-rated measure routinely applied in UK mental health services to assessed patients with good validity and adequate reliability . HoNOS comprises of 12 subscales, each rated on a 5-point Likert scale with higher values indicating more severe problems; we dichotomized these into 0–1, indicating no or minor problems, and 2–4, indicating more severe problems. As we aimed to assess association of mental illness severity with diagnostic recording, we combined the subscales reflecting mental health symptoms (agitation, self-injury, drug/alcohol use, cognitive impairment, delusions/hallucinations and depressed mood) into an ordinal scale indicating 0 symptoms, 1 current mental health symptom, 2 current mental health symptoms, and 3+ current mental health symptoms, as in previous studies . We also used the physical illness and activity of daily living (ADL) impairment subscales as covariates. All covariates were derived from time closest to first general hospital admission.
Our prospective analysis plan is in S1 Text. We described sociodemographic characteristics according to whether SMI had ever been recorded in hospital records using chi-squared tests for categorical data and independent t tests for continuous data. We described the primary diagnoses for admissions.
- Sensitivity of general hospital SMI diagnosis. We examined sensitivity of psychiatric diagnosis recording at patient-level (proportion of people with SLaM SMI diagnosis who ever had a mental illness recorded in their complete general hospital records as a primary or secondary diagnosis) and emergency admission-level (proportion who have a mental illness recorded in primary or secondary diagnoses during each emergency admission). We chose to examine emergency admissions as nonemergency admissions are usually recurrent brief admissions, which we considered were unlikely to warrant a full diagnostic assessment . In response to peer-reviewer comments, we additionally calculated (1) patient-level sensitivity according to the number of previous hospital admissions (0, 1–5, ≥6) and (2) admission-level sensitivity according to the primary diagnosis recorded for each hospital admission (grouped into ICD-10 categories). We report our sensitivity calculations at different levels of diagnostic accuracy. Our primary analyses calculated sensitivity at the level of any psychiatric diagnosis (proportion of individuals with SLaM diagnosis of any F20-31 disorder who receive any psychiatric diagnosis [F00-99] in HES). We also examined category-specific sensitivity (e.g., proportion of individuals with schizophrenia spectrum disorders [F20-29] who received any F20-29 diagnosis in HES) and disorder-specific diagnosis (e.g. proportion of individuals with schizophrenia diagnosis [F20] who specifically received an F20 diagnosis in HES). We calculated 95% confidence intervals for sensitivity using the Clopper–Pearson method .
- Time-trend changes from 2006 to 2017. We calculated sensitivity for each participant’s first emergency hospital admission following SMI diagnosis stratified by year of admission and used Cochran–Armitage test to examine sensitivity changes over time .
- Association of sociodemographic and clinical factors with psychiatric diagnosis being unrecorded. We calculated the association of sociodemographic and clinical characteristics with unrecorded diagnosis (no psychiatric diagnosis ever being recorded at a patient level) using multivariable logistic regression. Included variables were age, sex, ethnicity, marital status, IMD, number of mental illness symptoms, physical illness, ADL impairment, and number of hospital admissions (log-transformed because of the skewed distribution). To explore the impact of missing data, we conducted 2 non-prespecified sensitivity analyses. We first repeated the analysis without HoNOS variables because these data were missing for 21% of the cohort. We also used multiple imputation with chained equations to create 20 imputed datasets using STATA’s mi package by replacing missing values using a model constructed from all available covariates and outcome variables; our imputation used predictive mean matching for continuous data and logistic regression for categorical data. We then conducted logistic regression on each imputed dataset before combining coefficients using Rubin’s rules . The fraction of missing information after imputation was 0.33, so 20 imputed datasets is likely to give replicable estimates of standard error .
All analyses were undertaken using STATA SE version 15 (Stata Corp. https://www.stata.com/).
We identified 28,832 individuals with F20-31 diagnosis who were seen by SLaM between 1 January 2006 and 31 March 2017 (Fig 1). We excluded 2,410 because of diagnosis of acute and transient psychotic disorder (F23) or induced delusional disorders (F24). A further 12,636 individuals were excluded as they had no hospital admissions in the study period. Our final sample included 13,786 individuals who had 45,706 emergency admissions (Fig 1). Primary ICD-10 diagnoses are described in S1 Table; mental disorder was the primary diagnosis in 7.9% of emergency hospital admissions.
CRIS, Clinical Record Interactive Search; F20, schizophrenia; F21, schizotypal disorder; F22, delusional disorder; F23, acute and transient psychotic disorder; F24, induced delusional disorders; F25, schizoaffective disorder; F28, other nonorganic psychotic disorder; F29, unspecified nonorganic psychosis; F30, manic episode; F31, bipolar affective disorder; HES, Hospital Episode Statistics; ICD-10, International Statistical Classification of Diseases and Related Health Problems, Tenth Revision; SMI, severe mental illness.
The mean age was 46.9 years, 51% of participants were female, and the majority were single (64.7%) (Table 1). Most were White ethnicity (59.5%), and the largest ethnic minority group was Black African/Caribbean (27.7%). Three-quarters (10,574, 76.7%) of participants had a schizophrenia spectrum disorder, and 3,212 (23.3%) had bipolar disorder. At the time closest to first general hospital admission, many participants displayed no (24.8%) or one (25.1%) significant mental health symptoms; full information on prevalence of clinical problems in individual HoNOS domains is in S2 Table. The median number of hospital admissions was 3 admissions (interquartile range [IQR] 1, 5) with median duration of follow-up being 7.19 years [IQR 0.4, 10]; 3,047 people died during follow-up.
Sensitivity of general hospital SMI diagnosis
We found that 10,574 of 13,786 people with SMI had any psychiatric illness recorded during their subsequent general hospital admissions, meaning that sensitivity at the level of each individual patient’s complete hospital records was 76.7% (95% CI 76.0–77.4) (Table 2). Patient-level sensitivity was 57.3% (55.8–58.8) for patients with only 1 admission, 80.7% (79.7–81.6) for those with 2–5 admissions, 92.8% (91.5, 93.9) for those with 6–10 admissions, and 96.7 (95.7, 97.6) for those with 11+ admissions.
Sensitivity is lower when examining more specific diagnosis. Sensitivity was 56.4% (55.4–57.4) for category-specific ICD-10 diagnosis for schizophrenia spectrum disorder (F20-29) and 49.7% (48.1–51.3) for bipolar affective disorders (F30-31). Full results for disorder-specific recording can be found in S3 Table. Patient-level sensitivity for schizophrenia (F20) was 45.1% (44.5–45.7) and 40.4% (39.5–41.3) for bipolar affective disorder (F31). Disorder-specific sensitivity for other rarer conditions such as schizoaffective or schizotypal disorder was lower.
For admission-level recordings, 32,033 of 45,706 emergency hospital admissions had any psychiatric diagnosis recorded meaning that sensitivity was 70.1% (69.7–70.5) (Table 3). Recording of any psychiatric diagnosis was 71.1% (70.7–71.6) for schizophrenia spectrum disorders and 67.1% (66.2–67.9) for bipolar affective disorders. Category-specific admission-level sensitivity was 45.5% (45.0–46.1) for admissions of people with schizophrenia spectrum disorder (F20-29) and 39.6% (38.7–40.5) for bipolar affective disorders. Admission-level sensitivity according to primary diagnosis varied from 33.1% (31.3–34.9) for admissions related to pregnancy, childbirth, and the puerperium (ICD-10 codes O00-O99) to 79.7% (78.4, 81.0) for poisoning-related admissions (T36-65) and 81.0% (79.0, 82.9) for endocrine, nutritional, and metabolic diseases (E00-E90) (see S1 Table for full results).
Time-trend changes from 2006 to 2017
Sensitivity of recording for any psychiatric diagnosis increased from 47.8% (43.1–52.5) for emergency admissions during 2006 to 75.4% (68.3–81.4) for admissions during 2017 (ptrend< 0.001 [χ2 = 326, 1 df]), although much of this change was observed between 2009 and 2012 (Fig 2; full data in S4 Table).
Points represent the proportion of people’s first emergency hospital admissions following severe mental illness diagnosis in which a mental illness is recorded. Error bars show 95% confidence interval, and linear trend line shows change over time.
Association of sociodemographic and clinical factors with psychiatric diagnosis being unrecorded
In unadjusted analyses, age, ethnicity, marital status, mental and physical symptoms, functional impairment, and number of hospital admissions were associated with diagnostic recording (Table 4). In mutually adjusted multivariable analysis, those from Black African/Caribbean backgrounds were more likely (odds ratio [OR] = 1.38 [95% CI 1.24, 1.55; p < 0.001]) to have no psychiatric diagnosis ever recorded compared with those from White ethnic backgrounds. Marital status was also associated with diagnostic accuracy; single people were less likely (OR = 0.78 [95% CI 0.63–0.92; p < 0.001]) to have no psychiatric disorder recorded compared with married individuals, as were divorced (OR = 0.76 [95% CI 0.63–0.92; p = 0.004]) or widowed people (OR = 0.77 [95% CI 0.60–1.00; p = 0.046]). More mental health symptoms were associated with greater diagnostic accuracy, with 2 (OR = 0.71 [95% CI 0.62–0.83; p < 0.001]) or 3 plus symptoms (OR = 0.61 [95% CI 0.52–0.73; p < 0.001]) being associated with lower risk of no psychiatric diagnosis being recorded. Difficulties with activities of daily living (OR = 0.71; 95% CI 0.74–0.95; p < 0.001) and physical illness (OR = 0.84; 95% CI 0.74–0.95; p = 0.004) were also associated with lower risk of unrecorded diagnosis. Results were consistent in sensitivity analyses without inclusion of HoNOS symptoms (S5 Table) and with multiple imputation for missing covariates (S6 Table).
In this study, we examined accuracy of general hospital records for people with SMI admitted to general hospitals, finding that at least some form of psychiatric diagnosis was recorded in 70.1% of individual emergency hospital admissions and in 76.7% of patients’ complete hospital discharge records. Our findings suggest that accuracy of SMI recording in general hospitals has improved over time with sensitivity for any psychiatric diagnosis in those experiencing emergency hospital admissions increasing from 47.8% in 2006 to 75.4% in 2017. Unrecorded psychiatric diagnosis was more likely in people with milder symptoms or higher ADL scores, married individuals, and ethnic minority groups.
Although there has been improvement in recording of SMI within the general hospitals investigated, our findings show there are nearly 25% of individuals with established SMI diagnosis who have never had a preexisting SMI recorded throughout their, on average, 3 subsequent general hospital admissions. Moreover, recording is lower for category-specific sensitivity. Thus, the proportion of individuals with schizophrenia spectrum disorders who received a diagnosis within that same ICD-10 F20-29 category was 56.4%, compared with 77.5% for recording of any psychiatric diagnosis, and for bipolar affective disorders, these figures were 49.7% and 74.6%, respectively. The lower sensitivity for more specific diagnoses may reflect uncertainty about diagnostic labels, including whether these are accurate and used or communicated appropriately ; there is the potential for disagreement between clinicians and for different diagnostic practices in different settings. The relatively low sensitivity at a category-level is potentially problematic, when considering the importance of specific diagnosis for treatment outcomes and continuity of care, such as the different symptom clusters, illness severity, and pharmacological treatment indicated for schizophrenia compared with, for example, an anxiety disorder .
We acknowledge, however, that it is not necessarily the role of a physician or surgeon in a physical healthcare setting to diagnose a specific psychiatric condition, and instead, recognition of the presence of a mental illness may suffice if it leads to a referral to more specialist mental healthcare service such as liaison psychiatry. Other holistic measures to promote the wellbeing of a general hospital inpatient with SMI may also be instituted after identification of the presence of a psychiatric disorder. These may include consultation with family to identify whether psychiatric symptoms are new or preexisting, discussion with community mental health teams, or provision of a side room offered so that sleep could be prioritized.
We are not aware of any previous studies that have examined sensitivity of psychiatric diagnosis recording in English general hospitals, so cannot compare our findings directly with others. Our findings are lower than the 88% and 96.3% coding accuracy reported for general practice EHR [10, 33] and deliberate self-poisoning admissions in UK hospital . However, general practice records are likely to include lifelong diagnostic records, rather than be a snapshot of a clinical episode such as hospital admissions, so may be more likely to include a diagnosis received in another service sector. Self-poisoning is likely to have been the cause of presentation to hospital, and so recording of this is expected to be higher. Sensitivity in our study was higher than the figure of 52% reported for recognition of alcohol disorders by hospital staff .
Increased recording of diagnosis since the introduction of payment by results in 2006/2007 from 49.5% to 81.3% in 2017 is likely due to a range of different reasons from changes to policy approaches such as the “Five-Year Forwards” plan for whole-person centered care , financial incentives , improvements in coding practices , and expansion of liaison psychiatric services , whereby psychiatric diagnoses are more readily available (whether assigned anew or confirmed from previous records) from mental health specialists.
The association between clinical symptoms and unrecorded psychiatric diagnosis showed a dose–response gradient. It is likely that increasing symptom severity reflects clinical complexity meaning that difficulties are more prominent, and diagnosis is therefore more likely to be recorded. Similarly, symptom severity might reflect more frequent or longer hospital admissions during which clinicians have more opportunity to investigate clinical records. These individuals might be better known to clinical staff as they have more regularly updated HES records. People with milder SMI are less likely to have acute psychiatric healthcare needs, so lower accuracy in milder cases may be of less concern.
Unrecorded diagnosis was more common in individuals from Black African/Caribbean or other ethnic minority backgrounds. There are several potential reasons for this, relating to patient or service-level factors . Patient-level factors include language barriers, lack of information disclosure, or distrust of clinicians from different backgrounds, and service-level factors include clinician bias, stigma, or lack of cultural awareness . Considering poor health outcomes for people from minority ethnic groups with SMI, including increased cardiovascular risk factors , reduced support post discharge , and increased rates of compulsory admissions , this is particularly concerning. Recording of SMI in general hospitals might be an early opportunity for support as this is a setting for key treatment decisions and an opportunity for enhanced continuity of care [9, 42]. We did not find association of diagnostic accuracy with Asian or mixed backgrounds, possibly because of the smaller sample size giving less statistical power or reflecting other factors such as socioeconomic status.
Counter to our expectation based on analyses of other mental disorders [43, 44], being married was associated with higher likelihood of diagnosis being unrecorded. This may be explained by marital status being a marker of SMI severity and chronicity, whereby symptoms are higher in those who are single as compared with those in relationships. However, adjustment for symptom severity did not attenuate this association. Alternatively, it may be that support from a partner makes mental health symptoms less apparent as clinicians might assume that someone is receiving support from home or feel less inclined to ask about symptoms of mental illness. Similarly, it might be that partners are less reluctant to disclose information in regard to SMI diagnosis because of increased stigma associated with such conditions.
Sensitivity appeared to vary according to the primary reason for admission so that admissions for poisoning (which may have been precipitated by mental health symptoms) or those for endocrine and metabolic conditions (which may result from psychotropic adverse effects) had higher diagnostic recording. The lower recording for pregnancy and childbirth-related is of concern and warrants further future investigation, though it may reflect coding practice differences.
Important strengths of this study include its large sample size, representativeness of people with SMI diagnosis, and data availability over a decade enabling analysis of changes over time. The main limitation is that EHRs are not primarily collected for research purposes, meaning that using SLaM records as the “reference standard” might be problematic because the amount of clinical contact before diagnosis, and the diagnostic process may have varied, so some of our cohort may have been misdiagnosed. However, SLaM provides specialist diagnostic services, and we grouped patients according to the most recent recorded diagnoses from either structured quantitative health outcomes or rich unstructured clinical records. This approach also allowed construction of a large cohort that was representative of people with clinically diagnosed SMI, which would not have been feasible had we interviewed all participants with a standardized clinical assessment. Although there is wider debate about the validity of psychiatric diagnostic constructs , SMI categories are considered stable and persistent over time . Furthermore, our primary analysis considered sensitivity at the level of all psychiatric diagnoses, for example, whether an individual with schizophrenia had any mental illness recorded, as we acknowledged the potential limitations of the reference standard.
Our cohort’s derivation from secondary mental health services may have meant that participants had more pronounced symptoms and care-seeking behaviors, which would likely result in overestimation of sensitivity, but we included individuals with SMI in remission and included a range of clinical severity. Although HES records cover all English hospitals, most admissions will have been in South London hospitals. Diagnostic practice in rural settings where clinical populations and resources may differ. Finally, use of general hospital discharge diagnoses may miss nuances of diagnostic practice in general hospital in which the SMI may have been recognized during the admission but not recorded on final discharge, and our observational study design meant that we were unable to examine whether diagnostic recording affected clinical outcomes.
Future studies should examine whether diagnostic recording affects outcomes, such as length of stay or readmission rate, and has any negative effects such as stigma or diagnostic overshadowing of physical illness. This may require more detailed scrutiny of individuals’ case records and could be analyzed as part of future evaluations of liaison/consultation psychiatry services. It is also important to consider other relevant metrics of diagnostic accuracy, such as positive predictive value or specificity, which would require reference-standard data representative of people without psychiatric illness. Future research should also aim to elucidate the mechanisms for association between ethnicity, marital status, and symptom severity and diagnostic recording in general hospitals and evaluate effective approaches to improving diagnostic practice.
Our findings have important clinical, research, and policy implications. Researchers wishing to use hospital EHRs such as HES to ascertain cases of schizophrenia-like illnesses and bipolar disorder should be aware that around one quarter of known cases are likely to be unrecorded and there is potential for systematic bias whereby ethnic minorities, married people, and people with milder symptoms will be missed. Although our findings suggest that sensitivity is improving over time, there were around 30% of admissions in which people with established SMI did not have any psychiatric diagnosis recorded, suggesting that more needs to be done by policymakers to bridge the gap for “whole-person centered” care. Hospital settings should endeavor to improve diagnostic recording, particularly for high-risk groups. This may include training staff in culturally sensitive diagnosis for ethnic minority populations, expansion of mental healthcare input in general hospitals and collaborative working with these liaison psychiatry services, and proactive contact with primary care and mental health services to elicit information about past psychiatric history. Better data sharing between physical and mental health services such as through harmonized clinical records could improve accuracy of mental illness in physical healthcare, and physical illness in mental healthcare services, to move towards truly integrated healthcare for people with mental illness.
STROBE, Strengthening the Reporting of Observational Studies in Epidemiology.
S1 Table. Primary diagnosis (ICD-10 code) for emergency hospital admissions of people with severe mental illness.
ICD-10, International Statistical Classification of Diseases and Related Health Problems, Tenth Revision.
S2 Table. Clinical characteristics of people with severe mental illness admitted to a general hospital, according to whether mental illness was recorded in their hospital records.
S3 Table. Disorder-specific sensitivity of general hospital emergency admission records for people with severe mental illness.
S4 Table. Recording of mental illness in people with severe mental illness admitted to general hospitals: By year of first emergency hospital admission.
S5 Table. Association of sociodemographic characteristics with recording of mental illness in general hospital records: Multivariable regression without Health of Nation Outcome Scale clinical characteristics.
S6 Table. Association of clinical and sociodemographic characteristics with psychiatric diagnosis of people with severe mental illness not being recorded in general hospital records: Multivariable regression with multiple imputation for missing variables.
- 1. Simeone JC, Ward AJ, Rotella P, Collins J, Windisch R. An evaluation of variation in published estimates of schizophrenia prevalence from 1990─ 2013: a systematic literature review. BMC Psychiatry. 2015;15(1):193.
- 2. Merikangas KR, Jin R, He J-P, Kessler RC, Lee S, Sampson NA, et al. Prevalence and correlates of bipolar spectrum disorder in the world mental health survey initiative. Archives of General Psychiatry. 2011;68(3):241–51.
- 3. Correll CU, Solmi M, Veronese N, Bortolato B, Rosson S, Santonastaso P, et al. Prevalence, incidence and mortality from cardiovascular disease in patients with pooled and specific severe mental illness: a large‐scale meta‐analysis of 3,211,768 patients and 113,383,368 controls. World Psychiatry. 2017;16(2):163–80.
- 4. Jayatilleke N, Hayes RD, Chang C-K, Stewart R. Acute general hospital admissions in people with serious mental illness. Psychological medicine. 2018;48(16):2676–83.
- 5. Saha S, Chant D, McGrath J. A systematic review of mortality in schizophrenia: is the differential mortality gap worsening over time? Archives of General Psychiatry. 2007;64(10):1123–31.
- 6. Hayes JF, Marston L, Walters K, King MB, Osborn DP. Mortality gap for people with bipolar disorder and schizophrenia: UK-based cohort study 2000–2014. The British Journal of Psychiatry. 2017;211(3):175–81.
- 7. Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. The Lancet. 2012;380(9859):2163–96.
- 8. Firth J, Siddiqi N, Koyanagi A, Siskind D, Rosenbaum S, Galletly C, et al. The Lancet Psychiatry Commission: a blueprint for protecting physical health in people with mental illness. The Lancet Psychiatry. 2019;6(8):675–712.
- 9. Phelan M, Stradins L, Morrison S. Physical health of people with severe mental illness: can be improved if primary care and mental health professionals pay attention to it. British Medical Journal Publishing Group; 2001.
- 10. Nazareth I, King M, Haines A, Rangel L, Myers S. Accuracy of diagnosis of psychosis on general practice computer system. British Medical Journal. 1993;307(6895):32–4.
- 11. Sellar C, Goldacre M, Hawton K. Reliability of routine hospital data on poisoning as measures of deliberate self poisoning in adolescents. Journal of Epidemiology & Community Health. 1990;44(4):313–5.
- 12. Mitchell AJ, Meader N, Bird V, Rizzo M. Clinical recognition and recording of alcohol disorders by clinicians in primary and secondary care: meta-analysis. The British Journal of Psychiatry. 2012;201(2):93–100.
- 13. Davis KA, Sudlow CL, Hotopf M. Can mental health diagnoses in administrative data be used for research? A systematic review of the accuracy of routinely collected diagnoses. BMC Psychiatry. 2016;16(1):263.
- 14. Casey JA, Schwartz BS, Stewart WF, Adler NE. Using electronic health records for population health research: a review of methods and applications. Annual review of public health. 2016;37:61–81.
- 15. Stewart R, Soremekun M, Perera G, Broadbent M, Callard F, Denis M, et al. The South London and Maudsley NHS foundation trust biomedical research centre (SLAM BRC) case register: development and descriptive data. BMC Psychiatry. 2009;9(1):51.
- 16. Cunningham H. GATE, a general architecture for text engineering. Computers and the Humanities. 2002;36:223–54.
- 17. Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Journal of Clinical Epidemiology. 2008;61(4):344–9.
- 18. Organization WH. ICD-10: international statistical classification of diseases and related health problems: tenth revision. 2004.
- 19. Surtees P, Kendell R. The hierarchy model of psychiatric symptomatology: an investigation based on present state examination ratings. The British Journal of Psychiatry. 1979;135(5):438–43.
- 20. Davis KAS, Bashford O, Jewell A, Shetty H, Stewart RJ, Sudlow CL, et al. Using data linkage to electronic patient records to assess the validity of selected mental health diagnoses in English Hospital Episode Statistics (HES). PLoS ONE. 2018;13(3).
- 21. Benabarre A, Vieta E, Colom F, Martinez-Aran A, Reinares M, Gasto C. Bipolar disorder, schizoaffective disorder and schizophrenia: epidemiologic, clinical and prognostic differences. European Psychiatry. 2001;16(3):167–72.
- 22. Digital N. Hospital Episode Statistics (HES) 2019 [cited 2019 Aug 24]. Available from: https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/hospital-episode-statistics
- 23. Smith T, Noble M, Noble S, Wright G, McLennan D, Plunkett E. The English indices of deprivation 2015. London: Department for Communities and Local Government. 2015.
- 24. Pirkis JE, Burgess PM, Kirk PK, Dodson S, Coombs TJ, Williamson MK. A review of the psychometric properties of the Health of the Nation Outcome Scales (HoNOS) family of measures. Health and Quality of Life Outcomes. 2005;3(1):76.
- 25. Mueller C, Molokhia M, Perera G, Veronese N, Stubbs B, Shetty H, et al. Polypharmacy in people with dementia: associations with adverse health outcomes. Experimental Gerontology. 2018;106:240–5.
- 26. Digital N. HES Data Dictionary: Admitted Patient Care 2018 [cited 2010 May 16]. Available from: https://digital.nhs.uk/binaries/content/assets/legacy/pdf/1/c/hes_data_dictionary_-_admitted_patient_care.pdf
- 27. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. John Wiley & Sons; Hoboken, New Jersey 2013.
- 28. Armitage P. Tests for linear trends in proportions and frequencies. Biometrics. 1955;11(3):375–86.
- 29. Rubin DB. Multiple imputation for nonresponse in surveys. Hoboken (NJ): John Wiley & Sons; 2004.
- 30. von Hippel PT. How many imputations do you need? A two-stage calculation using a quadratic rule. Sociological Methods & Research. 2018;49(3).
- 31. Perkins A, Ridler J, Browes D, Peryer G, Notley C, Hackmann C. Experiencing mental health diagnosis: a systematic review of service user, clinician, and carer perspectives across clinical settings. The Lancet Psychiatry. 2018;5(9):747–64.
- 32. Macdonald A, Adamis D, Craig T, Murray R. Continuity of care and clinical outcomes in the community for people with severe mental illness. The British Journal of Psychiatry. 2019;214(5):273–8.
- 33. Hardoon S, Hayes JF, Blackburn R, Petersen I, Walters K, Nazareth I, et al. Recording of severe mental illness in United Kingdom primary care, 2000–2010. PLoS ONE. 2013;8(12).
- 34. Maruthappu M, Sood HS, Keogh B. The NHS five year forward view: implications for clinicians. BMJ. 2014;349:g6518.
- 35. Marshall L, Charlesworth A, Hurst J. The NHS payment system: evolving policy and emerging evidence. London: The Nuffield Trust; 2014.
- 36. Sharpe M. Psychological medicine and the future of psychiatry. The British Journal of Psychiatry. 2014;204(2):91–2.
- 37. Nelson A. Unequal treatment: confronting racial and ethnic disparities in health care. Journal of the National Medical Association. 2002;94(8):666.
- 38. De Hert M, Cohen D, Bobes J, Cetkovich-Bakmas M, Leucht S, Ndetei DM, et al. Physical illness in patients with severe mental disorders. II. Barriers to care, monitoring and treatment guidelines, plus recommendations at the system and individual level. World Psychiatry. 2011;10(2):138–51.
- 39. Carliner H, Collins PY, Cabassa LJ, McNallen A, Joestl SS, Lewis-Fernández R. Prevalence of cardiovascular risk factors among racial and ethnic minorities with schizophrenia spectrum and bipolar disorders: a critical literature review. Comprehensive psychiatry. 2014;55(2):233–47.
- 40. Fontanella CA, Guada J, Phillips G, Ranbom L, Fortney JC. Individual and contextual-level factors associated with continuity of care for adults with schizophrenia. Administration and Policy in Mental Health and Mental Health Services Research. 2014;41(5):572–87.
- 41. Barnett P, Mackay E, Matthews H, Gate R, Greenwood H, Ariyo K, et al. Ethnic variations in compulsory detention under the Mental Health Act: a systematic review and meta-analysis of international data. The Lancet Psychiatry. 2019;6(4):305–17.
- 42. Eack SM, Newhill CE. Racial disparities in mental health outcomes after psychiatric hospital discharge among individuals with severe mental illness. Social Work Research. 2012;36(1):41–52.
- 43. Sommerlad A, Perera G, Singh-Manoux A, Lewis G, Stewart R, Livingston G. Accuracy of general hospital dementia diagnoses in England: sensitivity, specificity, and predictors of diagnostic accuracy 2008–2016. Alzheimer's & Dementia. 2018;14(7):933–43.
- 44. Wilkins CH, Wilkins KL, Meisel M, Depke M, Williams J, Edwards DF. Dementia undiagnosed in poor older adults with functional impairment. Journal of the American Geriatrics Society. 2007;55(11):1771–6.
- 45. Allsopp K, Read J, Corcoran R, Kinderman P. Heterogeneity in psychiatric diagnostic classification. Psychiatry Research. 2019;279:15–22.
- 46. Huda AS. The Medical Model in Mental Health: An Explanation and Evaluation. Oxford University Press,Oxford, United Kingdom 2019.