Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The first 20 months of the COVID-19 pandemic: Mortality, intubation and ICU rates among 104,590 patients hospitalized at 21 United States health systems

  • Michael C. Fiore ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    mcf@ctri.wisc.edu

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Stevens S. Smith,

    Roles Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Robert T. Adsit,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America

  • Daniel M. Bolt,

    Roles Data curation, Formal analysis, Methodology, Resources, Validation, Writing – original draft, Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Educational Psychology, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Karen L. Conner,

    Roles Project administration, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America

  • Steven L. Bernstein,

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation Department of Emergency Medicine, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire, United States of America

  • Oliver D. Eng,

    Roles Data curation, Software, Validation, Writing – review & editing

    Affiliation Institute for Clinical and Translational Research, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • David Lazuk,

    Roles Data curation, Software, Validation, Writing – review & editing

    Affiliation Yale-New Haven Health System, New Haven, Connecticut, United States of America

  • Alec Gonzalez,

    Roles Data curation, Software, Validation, Writing – review & editing

    Affiliation BlueTree Network, a Tegria Company, Madison, Wisconsin, United States of America

  • Douglas E. Jorenby,

    Roles Conceptualization, Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Heather D’Angelo,

    Roles Validation, Writing – review & editing

    Affiliation Carbone Cancer Center, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Julie A. Kirsch,

    Roles Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Family Medicine and Community Health, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Brian Williams,

    Roles Investigation, Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America, Department of Pediatrics, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Margaret B. Nolan,

    Roles Writing – review & editing

    Affiliation Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America

  • Todd Hayes-Birchler,

    Roles Data curation, Software, Validation, Writing – review & editing

    Affiliation Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America

  • Sean Kent,

    Roles Writing – review & editing

    Affiliation Department of Statistics, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Hanna Kim,

    Roles Formal analysis, Validation, Visualization, Writing – review & editing

    Affiliation Department of Educational Psychology, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Thomas M. Piasecki,

    Roles Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Wendy S. Slutske,

    Roles Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Family Medicine and Community Health, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Stan Lubanski,

    Roles Writing – review & editing

    Affiliation United States Census Bureau, Washington, D.C., United States of America

  • Menggang Yu,

    Roles Writing – review & editing

    Affiliation Department of Biostatistics & Medical Informatics, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Youmi Suk,

    Roles Writing – review & editing

    Affiliation Department of Human Development, Teachers College, Columbia University, New York, New York, United States of America

  • Yuxin Cai,

    Roles Formal analysis, Writing – review & editing

    Affiliation Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America

  • Nitu Kashyap,

    Roles Writing – review & editing

    Affiliations Yale-New Haven Health System, New Haven, Connecticut, United States of America, Yale School of Medicine, New Haven, Connecticut, United States of America

  • Jomol P. Mathew,

    Roles Writing – review & editing

    Affiliation Department of Population Health Sciences, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Gabriel McMahan,

    Roles Writing – review & editing

    Affiliation Department of Population Health Sciences, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Betsy Rolland,

    Roles Writing – review & editing

    Affiliations Institute for Clinical and Translational Research, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America, Carbone Cancer Center, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • Hilary A. Tindle,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America

  • Graham W. Warren,

    Roles Writing – review & editing

    Affiliation Department of Radiation Oncology, Medical University of South Carolina, Charleston, South Carolina, United States of America

  • Lawrence C. An,

    Roles Data curation, Writing – review & editing

    Affiliation Division of General Medicine, Rogel Cancer Center, University of Michigan, Ann Arbor, Michigan, United States of America

  • Andrew D. Boyd,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Biomedical and Health Information Sciences, College of Applied Health Sciences, University of Illinois at Chicago, Chicago, Illinois, United States of America

  • Darlene H. Brunzell,

    Roles Data curation, Writing – review & editing

    Affiliation Virginia Commonwealth University School of Medicine, Richmond, Virginia, United States of America

  • Victor Carrillo,

    Roles Data curation, Writing – review & editing

    Affiliation Hackensack Meridian Health, Hackensack University Medical Center, Hackensack, New Jersey, United States of America

  • Li-Shiun Chen,

    Roles Data curation, Writing – review & editing

    Affiliation Washington University in St. Louis School of Medicine, St. Louis, Missouri, USA

  • James M. Davis,

    Roles Data curation, Writing – review & editing

    Affiliation Duke Cancer Institute and Duke University Department of Medicine, Durham, North Carolina, United States of America

  • Deepika Dilip,

    Roles Data curation, Writing – review & editing

    Affiliation Memorial Sloan Kettering Cancer Center, New York, New York, United States of America

  • Edward F. Ellerbeck,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Population Health, University of Kansas Medical Center, Kansas City, Missouri, United States of America

  • Eduardo Iturrate,

    Roles Data curation, Writing – review & editing

    Affiliation New York University Langone Health, New York, New York, United States of America

  • Thulasee Jose,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, Minnesota, United States of America

  • Niharika Khanna,

    Roles Data curation, Writing – review & editing

    Affiliation University of Maryland School of Medicine, Baltimore, Maryland, United States of America

  • Andrea King,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Psychiatry and Behavioral Neuroscience, University of Chicago Comprehensive Cancer Center, Chicago, Illinois, United States of America

  • Elizabeth Klass,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, United States of America

  • Michael Newman,

    Roles Data curation, Writing – review & editing

    Affiliation University of Utah, Salt Lake City, Utah, United States of America

  • Kimberly A. Shoenbill,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Family Medicine and Lineberger Comprehensive Cancer Center, University of North Carolina School of Medicine, Chapel Hill, North Carolina, United States of America

  • Elisa Tong,

    Roles Data curation, Writing – review & editing

    Affiliation University of California Davis, Davis, California, United States of America

  • Janice Y. Tsoh,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Psychiatry and Behavioral Sciences, Hellen Diller Family Comprehensive Cancer Center, University of California San Francisco, San Francisco, California, United States of America

  • Karen M. Wilson,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Pediatrics, University of Rochester School of Medicine, Rochester, New York, United States of America

  • Wendy E. Theobald,

    Roles Writing – original draft, Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  •  [ ... ],
  • Timothy B. Baker

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Center for Tobacco Research and Intervention, School of Medicine and Public Health, University of Wisconsin School of Medicine and Public Health, Madison, WI, United States of America, Department of Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

  • [ view all ]
  • [ view less ]

Abstract

Main objective

There is limited information on how patient outcomes have changed during the COVID-19 pandemic. This study characterizes changes in mortality, intubation, and ICU admission rates during the first 20 months of the pandemic.

Study design and methods

University of Wisconsin researchers collected and harmonized electronic health record data from 1.1 million COVID-19 patients across 21 United States health systems from February 2020 through September 2021. The analysis comprised data from 104,590 adult hospitalized COVID-19 patients. Inclusion criteria for the analysis were: (1) age 18 years or older; (2) COVID-19 ICD-10 diagnosis during hospitalization and/or a positive COVID-19 PCR test in a 14-day window (+/- 7 days of hospital admission); and (3) health system contact prior to COVID-19 hospitalization. Outcomes assessed were: (1) mortality (primary), (2) endotracheal intubation, and (3) ICU admission.

Results and significance

The 104,590 hospitalized participants had a mean age of 61.7 years and were 50.4% female, 24% Black, and 56.8% White. Overall risk-standardized mortality (adjusted for age, sex, race, ethnicity, body mass index, insurance status and medical comorbidities) declined from 16% of hospitalized COVID-19 patients (95% CI: 16% to 17%) early in the pandemic (February-April 2020) to 9% (CI: 9% to 10%) later (July-September 2021). Among subpopulations, males (vs. females), those on Medicare (vs. those on commercial insurance), the severely obese (vs. normal weight), and those aged 60 and older (vs. younger individuals) had especially high mortality rates both early and late in the pandemic. ICU admission and intubation rates also declined across these 20 months.

Conclusions

Mortality, intubation, and ICU admission rates improved markedly over the first 20 months of the pandemic among adult hospitalized COVID-19 patients although gains varied by subpopulation. These data provide important information on the course of COVID-19 and identify hospitalized patient groups at heightened risk for negative outcomes.

Trial registration

ClinicalTrials.gov Identifier: NCT04506528 (https://clinicaltrials.gov/ct2/show/NCT04506528).

Introduction

COVID-19 (“COVID”) has disrupted virtually every aspect of society, infecting about 80 million individuals in the U.S. and causing almost one million COVID deaths through March 2022 [1]. It is important to track COVID outcomes over time, particularly among hospitalized COVID patients who are at heightened risk of severe outcomes. Such examination can inform clinical care, guide public health actions, influence policy, and identify vulnerable populations.

Cohort studies have shown meaningful changes in mortality throughout the COVID pandemic, although most reported outcomes are from early in the pandemic [26], often with modest sized samples. Such studies found decreasing mortality rates amongst COVID cases over time [2, 3, 5, 7, 8], and increased mortality when hospital admission rates for COVID were high [5, 9]. The National COVID Cohort Collaborative (N3C) retrospective cohort study [10] examined predictors of COVID mortality for 32,472 U.S. adults who were hospitalized with COVID between January 1, 2020, and December 7, 2020. Electronic health record (EHR) data showed that COVID related mortality decreased throughout the study. However, data on medical comorbidities were present in only 49% of N3C patients.

The present retrospective cohort study reports changes in COVID-associated mortality, intubation, and ICU admission rates among 104,590 patients hospitalized with COVID at 21 U.S. health systems from February 1, 2020, to September 30, 2021.

Methods

Study design

The COVID EHR Cohort at the University of Wisconsin (CEC-UW) is a retrospective cohort study. Presented results include data from February 1, 2020, to September 30, 2021. Health systems from across the U.S. were invited to participate and 21 joined the cohort (S1 Fig in S1 File) and transferred data regularly to the CEC-UW Coordinating Center in Madison, Wisconsin. Each data transfer included data dating back to February 1, 2020.

Ethics statement

The CEC-UW study was initially approved in May 2020 by the University of Wisconsin-Madison Health Sciences Minimal Risk Institutional Review Board (MR-IRB) with approval for the collection of de-identified EHR data from the 21 health systems. The MR-IRB also determined that the study met criteria for a human subjects research exemption and qualified for a waiver of informed consent under the Federal Common Rule. All participating health systems provided written notice of either their own institution’s IRB approval or determination of exemption status before sharing EHR data. In February 2021, the MR-IRB approved a change of protocol for a Limited Data Set, allowing the collection of additional information (e.g., death dates, five-digit zip codes) but excluding direct patient identifiers. Each patient in the data set from each health system was assigned an enduring cryptographically processed Patient ID based on the SHA256 algorithm, which yielded a 64-character unique and private hash-based message authentication code (HMAC). Study reporting follows STROBE guidelines (S1 Method in S1 File).

Data collection

Extraction, harmonization, and secure transfer of EHR data.

EHR data extraction code was created by programmers at UW School of Medicine and Public Health (Madison, WI), Yale New Haven Health (New Haven, CT), and Bluetree Network, Inc. [11]. Data elements were extracted for patient sociodemographic variables, general health information, clinical encounter data, pre-COVID and post-COVID ICD-10 diagnoses, laboratory test results, and medication information (S3 Method in S1 File).

The extraction code was customized at each health system to map to their EHR data to yield relatively uniform data sets. Additional data harmonization and quality assurance was done by CEC-UW staff (S3 Method in S1 File). Secure transfer of data from each of the 21 health systems was accomplished via the transfer of data files to a secure SFTP (secure shell [SSH] File Transfer Protocol) portal located at the UW-Madison CEC-UW Coordinating Center.

Extracted data categories.

Each health system transferred five source data files (S3 Method in S1 File) with patient- and encounter-level information on: 1) sociodemographic and health characteristics; 2) pre- and post-COVID ICD-10 diagnoses; 3) clinical encounter data including treatment site (e.g., inpatient, outpatient), encounter-based ICD-10 diagnoses, mortality, ICU admission, intubation, and other clinical data; 4) selected laboratory test results linked to encounters; and 5) selected medications linked to encounters. Health systems provided data only for closed clinical encounters (i.e., completed). For closed inpatient encounters, the patient must have been discharged or died during the hospitalization. Data on outcomes or treatment at nonparticipating health systems were not captured.

Analysis sample

The analysis sample comprised 104,590 adult patients hospitalized with COVID (Fig 1 and S2 Method in S1 File). Analysis sample inclusion criteria included: 1) ≥18 years old; 2) the inpatient encounter was the first COVID hospitalization with duration ≥ 24 hours (or, if < 24 hours, admission to ICU or death during the hospitalization); 3) COVID ICD-10 diagnosis (U07.1 or J12.82) during the hospitalization; 4) positive COVID PCR test result in a 14-day window (+/- 7 days centered at the admission date); and 5) prior contact with the health system to permit extraction of pre-COVID ICD-10 diagnoses to calculate the Elixhauser Comorbidity Score [12] (S5 Method in S1 File). Overall, 73.0% (n = 76,303) of the sample had both a positive PCR test result and a COVID ICD-10 diagnosis, 6.8% (n = 7,118) had only a positive PCR test, and 20.2% (n = 21,169) had only a COVID ICD-10 diagnosis at the time of hospitalization.

thumbnail
Fig 1. CEC–UW: Cohort criteria for inclusion in the analyzed sample of 104,590 hospitalized COVID–19 patients.

https://doi.org/10.1371/journal.pone.0274571.g001

Primary and secondary outcomes

The primary outcome was in-hospital mortality during the index COVID hospitalization documented via EHR. Secondary outcomes included: (1) endotracheal intubation and (2) ICU admission during hospitalization. All outcomes were binary.

Non-outcome variables

Patient-level variables include age (at time of entry into the cohort), sex, race, ethnicity, body mass index (BMI), insurance status, Elixhauser Comorbidity Score, and vaccination status (yes/no). Patients aged ≥ 90 years were coded as 90 at the time of data extraction. For certain analyses, age was categorized as: 18–59 years, 60–70 years, and over 70 years (cut-points suggested by class probability trees). See Table 1 for race, ethnicity, BMI categories, and insurance status categories. Race and ethnicity categories were based on definitions used by the National Institutes of Health [13]. The Elixhauser Comorbidity Score was calculated [12] using van Walraven weights (S5 Method in S1 File) based on ICD-10 diagnoses (present vs. absent) determined via a 5-year look back pre-COVID.

thumbnail
Table 1. Descriptive statistics for 104,590 hospitalized COVID–19 patients from February 2020 to September 2021.

https://doi.org/10.1371/journal.pone.0274571.t001

Statistical analysis

Statistical analysis plan.

A detailed statistical analysis plan [14] was prepared by CEC-UW scientists and reviewed by a Data Analytic Consulting Committee comprising NCI methodologists.

Descriptive statistics and missingness.

Descriptive statistics for the analysis sample characteristics and selected outcome analyses were computed using SAS version 9.4 (SAS Institute Inc). There were no missing data for the primary or secondary outcomes. Missing data for covariates are reported in Table 1.

Calculation of health system risk standardized mortality rates for health system/month.

Risk standardized mortality rates (RSMRs) adjusting for health systems and months followed a strategy presented by Silber and colleagues [1518] (S6 Method in S1 File). Covariates included age, sex, race, ethnicity, BMI, insurance status, Elixhauser score, and health system to control for such factors in comparing outcomes across health systems within months (S6 Fig in S1 File) and across months when pooling health systems (Fig 2 and S11, S12 Figs in S1 File). The same generalized linear mixed modeling (GLMM) strategy used for calculating RSMRs for health system was also used in calculating RSMRs for each month of the study period by interchanging health system random effects with month random effects. Thus, in some figures (Fig 2 and S11, S12 Figs in S1 File), the results of adjustments account solely for changes in the aggregate distributions of patient characteristics by month. S6 Fig in S1 File plots the health system RSMRs by month, adjusting for variability in patient characteristics across health system within month. Missingness occurred in only categorical covariates and was treated as its own category; its disproportionately strong association with negative outcomes argued against imputation.

thumbnail
Fig 2. Observed and adjusted in–hospital mortality rates and number of patients hospitalized per month across 21 health systems (March 2020 through September 2021).

https://doi.org/10.1371/journal.pone.0274571.g002

Changes in outcomes.

To evaluate changes over time in mortality, we compared rates for the first three months of the study (February 2020 to April 2020, Period 1) to rates for the last three months of the study (July 2021 to September 2021, Period 2). This post hoc approach captured change from the peak of mortality early in the pandemic to rates at the end of the 20-month study period (as per Asch et al [3]).

Changes in rates of mortality (Period 1 versus Period 2) were computed along with logistic regression-based odds ratios (ORs), 95% confidence intervals (CIs), and p-values. Changes in overall mortality were also analyzed for the patient-level covariates: age, sex, race, ethnicity, BMI, insurance status, and Elixhauser score; vaccination history was also used as a covariate in focused analyses. Effects are presented with and without covariate adjustment. The latter has clinical relevance since it reflects associations with person characteristics as they present in healthcare (where such characteristics co-occur with other risk factors). Alpha was set at .05 (two-tailed test); corrections for multiple tests were not made.

Results

Fig 1 depicts the full CEC-UW cohort (N = 1,154,612) drawn from the 21 health systems from February 1, 2020, to September 30, 2021, and shows the 104,590 hospitalized COVID patients meeting the analysis sample inclusion criteria.

Characteristics of the participating health systems

The number of analysis sample patients from each of the 21 participating health systems ranged from 386 to 15,584 (mean = 4,980 patients, SD = 4,104; median = 3,100).

Characteristics of analysis sample patients

Table 1 provides descriptive statistics for patient characteristics of the analysis sample. Month-by-month distributions of patient age (S2 Fig in S1 File), Elixhauser scores (S3 Fig in S1 File), and length of hospital stay in non-deceased patients (S4 Fig in S1 File) are provided in the supporting information.

Hospital admission rates over time

Fig 2 presents month-by-month hospital admission rates for COVID patients (as gray bars) over the study period collapsing across the 21 health systems. This figure reveals several peaks of admissions across the 20-month period. Rates for February 2020 were omitted from figures due to the small N (total N = 242).

Unadjusted and risk standardized mortality rates (RSMRs)

Fig 2 shows both the unadjusted (i.e., observed) rates and RSMRs per month collapsing across the 21 health systems. Fig 2 shows that the highest mortality rates occurred early in the pandemic in March and April 2020. However, there were modest increases in mortality rates during two later peaks in hospital admissions (December 2020 to January 2021 and July to August 2021). The temporal patterns in mortality over time were very similar in RSMR and unadjusted analyses (Fig 2). Across the health systems, mortality decreased from the first three months of the pandemic (February-April 2020) to the last three months of the study period (July 2021 to September 2021) from 18.6% (95% CI: 18% to 19%) to 7.3% (95% CI: 7% to 7.8%) (unadjusted) and from 16.4% (95% CI = 16% to 17%) to 9% (95% CI: 9% to 10%) (adjusted). However, Fig 2 shows that mortality rates appeared to plateau after the first several months of the pandemic and gains were slight after.

There was substantial variability in unadjusted mortality across the different health systems (S5 Fig in S1 File), and a general trend of decreasing mortality from early in the pandemic with rates plateauing thereafter. RSMR adjustment across health systems substantially decreased health system variability (S6 Fig in S1 File).

Mortality rates as a function of each of six patient-level variables

Figs 38 show unadjusted monthly mortality rates as a function of each of the six patient-level variables. Values for patient-level subpopulations of very small size and values for missing data are not shown in Figs 38 (All subpopulations are shown in S7-S10 Figs in S1 File).

thumbnail
Fig 3. Observed in–hospital mortality rates (Deaths/hospitalizations) and number of patients hospitalized per month for patient age groups (March 2020 through September 2021).

https://doi.org/10.1371/journal.pone.0274571.g003

thumbnail
Fig 4. Observed in–hospital mortality rates (Deaths/hospitalizations) and number of patients hospitalized per month for patient sex groups (March 2020 through September 2021).

https://doi.org/10.1371/journal.pone.0274571.g004

thumbnail
Fig 5. Observed in–hospital mortality rates (Deaths/hospitalizations) and number of patients hospitalized per month for patient race groups (March 2020 through September 2021).

https://doi.org/10.1371/journal.pone.0274571.g005

thumbnail
Fig 6. Observed in–hospital mortality rates (Deaths/hospitalizations) and number of patients hospitalized per month for patient ethnicity subpopulations (March 2020 through September 2021).

https://doi.org/10.1371/journal.pone.0274571.g006

thumbnail
Fig 7. Observed in–hospital mortality rates (Deaths/hospitalizations) and number of patients hospitalized per month for patient BMI groups (March 2020 through September 2021).

https://doi.org/10.1371/journal.pone.0274571.g007

thumbnail
Fig 8. Observed in–hospital mortality rates (Deaths/hospitalizations) and number of patients hospitalized per month for patient insurance status groups (March 2020 through September 2021).

https://doi.org/10.1371/journal.pone.0274571.g008

Intubation and ICU admission rates over time

S11 Fig in S1 File shows monthly intubation rates and S12 Fig in S1 File shows monthly ICU admission rates for March 2020 to September 2021 across the 21 health systems. S11 Fig in S1 File shows that intubation rates decreased early in the 20-month period and then largely plateaued. S12 Fig in S1 File shows that ICU admission rates varied substantially over time, increasing when hospital admission rates declined. Thus, the pattern observed with regard to intubation paralleled that observed with mortality, plateauing after the initial months of the pandemic. ICU admission may more closely reflect hospital policies and resources and admission surge rates leading to greater variation over time.

Change in mortality as a function of patient characteristics

Table 2 displays logistic regression results for the predictive effects of patient variables regarding mortality and mortality change: 1) unadjusted and adjusted effects of each patient variable (e.g., each race comparison category against its reference category—White) within the first three-month period (Period 1: February-April 2020) and within the last three-month period (Period 2: July-September 2021); 2) observed change within each patent variable category across the two time periods; and 3) differential effects of patient variables across time and in relation to mortality change observed in the reference condition. The adjusted effects reported for each patient variable category include the Elixhauser comorbidity index and the remaining tabled patient variables as covariates.

thumbnail
Table 2. Mortality rates for hospitalized COVID–19 patients during the first three and final three months of data collection.

https://doi.org/10.1371/journal.pone.0274571.t002

Listed comparisons from Table 2 that had especially robust effects (with adjusted analyses at p’s < .01), shows the following comparison categories predicted higher mortality (vs. the reference category) in Period 1: male patients (vs. females); Asian patients (vs. White patients); patients on Medicare or uninsured (vs. commercial insurance); obese and severely obese patients (vs. healthy weight); and patients aged 60–70 years and over 70 (vs. < 60). In Period 1 the odds of death were over 4 times greater in those over 70, almost 3 times higher in the uninsured, and about double for the severely obese. In Period 2 only the following comparison categories had higher adjusted mortality rates: male patients (vs. females); patients on Medicare (vs. commercial insurance); severely obese patients (vs. healthy weight); and patients aged 60–70 years and >70 (vs. < 60). Thus, many of the patient groups having the highest mortality rates early in the pandemic did not have significantly elevated mortality rates at the end of the pandemic.

Table 2 displays, in the two rightmost columns, ORs for mortality change across time periods found within each comparison category both without and with adjustment for change in the other tabled patient variables (including Elixhauser).

The OR estimates without adjustment show that virtually all groups of patients experienced significant decreases in mortality across time, except for some relatively small groups such as American Indian and Pacific Islander patients and patients indicating more than one race. The OR estimates with adjustment (in italicized rows) show which groups sustained disproportionate changes in mortality (relative to the reference condition) when other covariates were controlled; a list of the categories showing especially robust decreases includes those listing more than one race (vs. White), uninsured patients (vs. commercial insurance), and patients who were over 70 (vs. < 60). Again, this shows a pattern consistent with the notion of the greatest improvements in mortality occurring in those who were initially at the highest risk.

Because of the limited availability of vaccines during the study period there were relatively few participants who reported positive vaccine status. However, including vaccine status amongst the covariates for the period of July to September 2021 showed that the effects of the patient level characteristics were little affected.

The continuous Elixhauser score is not shown amongst the patient variables in Table 2. However, the logistic regression-based relations of the Elixhauser with the three outcomes are presented in S13-S15 Figs in S1 File. These show that the Elixhauser was fairly strongly related to mortality and ICU admission, especially in Period 1. Its relations with intubation were negligible. S1 Table in S1 File presents the estimated coefficients and statistical significance of these relations in Periods 1 and 2.

Discussion

This retrospective cohort study examined EHR data of 104,590 adult hospitalized patients with COVID from 21 U.S. health systems comprising a large diverse sample. Key COVID outcomes (rates of mortality, intubation, and ICU admission) were examined over the first 20 months of the pandemic, from February 1, 2020, to September 30, 2021.

The results show a marked decline in mortality rates, with mean unadjusted rates falling from 18.6% (95% CI: 18.0 to 19.2) in the first three months to 7.3% (95% CI: 6.9 to 7.8) in the last three months of the study period. Similar declines were seen with RSMR adjustment for age, sex, race, ethnicity, BMI, insurance status, and comorbidities. The greatest decline in mortality occurred early in the pandemic with modest increases in mortality occurring when hospital admissions increased (from November 2020 to January 2021 and from July 2021 to September 2021). Importantly, even though hospital admissions during the July to September 2021 peak exceeded levels seen early in the pandemic, mortality rates were about half of those seen early in the pandemic. These results agree with previous findings of a general improvement in COVID survivability over the course of the pandemic [2, 3, 5] but suggest that mortality improvements occurred primarily early and plateaued after the first several months. The initial decline in mortality rates likely reflects improvements in treatment and patient management [2, 3, 5, 19]. It is important to note that the above trends were found when data were collapsed across healthcare systems; thus, the patterns observed do not necessarily reflect the temporal association of admission and mortality rates that occurred in individual healthcare systems or hospitals. Other evidence gathered on hospitalized patients earlier in the pandemic (March-August 2020), suggests that late admission surges are associated with marked increases in mortality when examined on a per hospital basis [5]. In future analyses, the current data set will be used to examine the association of hospital admission and mortality at the level of the individual healthcare system.

ICU admissions rose substantially during periods when hospital admissions declined. The causes of such temporal association are unknown but warrant further study.

This research also found that improvement in mortality was generally present across all subpopulations of COVID patients examined in this study. However, adjusted mortality rates comparing the first and last 3 months of the study period suggested that some patient groups had significantly higher mortality rates across both periods relative to their reference condition: specifically, male patients (vs. females), those receiving Medicare (vs. commercial insurance), severely obese patients (vs. those of healthy weight), and patients 60 years of age and older (vs. those under 60). Other studies have found that male patients, the obese, and older patients are at heightened risk for severe COVID or COVID-related mortality [10, 2022], so these results were precedented. However, receipt of Medicare insurance has not been consistently found to index increased risk of severe COVID or death [22]. Its significant association with mortality in the present study occurred despite covarying out the effects of age and comorbid conditions. It is possible that it was found in the current study because its large sample afforded relatively great statistical power.

Most patient subpopulations showed significant decreases in mortality over the two study periods, including: males; females; Asians; Blacks; Whites; Hispanics; non-Hispanics; patients having Medicare, Medicaid, and commercial insurance; uninsured patients; patients who were underweight, obese, and severely obese; and all three age groups (under 60, 60–70, > 70). Declines were not significant for some relatively small groups such as patients who were Pacific Islanders, American Indians, and those claiming more than one race. Analyses using statistically adjusted variables revealed groups that showed disproportionately greater declines (p < .01): uninsured patients showed greater declines than those with commercial insurance, and patients over 70 years of age showed greater declines than those under 60.

Some studies have found higher rates of mortality rates among Black and Hispanic COVID patients [10, 2325] while others have not demonstrated that finding [2628]. The present study found that Black patients had a significantly lower mortality rate than Whites during the first 3 months of the pandemic and Hispanics had a significantly lower mortality rate by the end of the study period (both with unadjusted rates). No differences were found amongst these groups when adjusted rates were analyzed. It is unknown why Black individuals suffered higher mortality rates in some studies and not the current one. The lack of a significant finding in the current study is unlikely due to inadequate statistical power. It may instead relate to the nature of the samples in the different studies. Most studies finding such a difference comprised both non-hospitalized and hospitalized persons [10, 2325]. It may be that limiting the sample to hospitalized patients as in the current study restricts the range of illness severity in the sample and reduces the magnitudes of some associations. Some studies that have included a mix of hospitalized and non-hospitalized patients have not found racial differences in mortality [26], but these often were restricted with regard to sample sources and size. In sum, more research is needed to better understand how race is related to COVID severity.

Strengths and limitations

Strengths of the study include the integration and analysis of EHR data from a very large cohort of hospitalized COVID patients admitted to 21 health systems from across the United States. The resulting data set is one of the largest assembled to date, providing a uniquely informative depiction of clinical trends over the course of the first 20 pandemic months, the patient characteristics associated with important clinical outcomes, and changes in these associations over time.

Several study limitations should also be considered. First, laboratory tests (other than COVID-19 PCR test results) and treatments used during hospitalization were not included in the current analyses and could have influenced the findings. Second, some health systems comprised multiple hospitals and, due to limitations in the data available, hospital-related effects could not be explored. Third, many of the 21 health systems included academic hospitals which could affect the representativeness of the results. Fourth, data on treatments or outcomes that occurred outside the health systems were not available. Fifth, differences in the number of patients coming from the various health systems over time might have affected the temporal patterns observed. Sixth, some patient subgroups could not be evaluated with adequate power given small sample sizes. Seventh, inconsistencies in the recording of discharge dispositions across health systems prevented consideration of discharge to hospice as a mortality equivalent. Subgroup comparisons on in-hospital mortality alone could be biased if there are disparities in the use of palliative care [29]. Finally, it is possible that some patients in this sample died from conditions that were unrelated to their COVID infection.

Conclusions

This research has revealed marked improvements in mortality, intubation, and ICU admission rates across the first 20 months of the COVID pandemic amongst a sample of over 100,000 hospitalized patients with COVID, with only slight increases in mortality rates when COVID admissions rose markedly during pandemic surges occurring after the first few months of the pandemic (November 2020 to January 2021 and July to September 2021). Virtually all the different patient populations examined showed significant improvements in mortality rates over the course of the pandemic. However, some patient groups had relatively high mortality rates both early and late in the pandemic including males, those on Medicare, the severely obese, and those aged 60 and older. The findings highlight both overall progress in battling the COVID pandemic and populations that remain at heightened risk for negative outcomes. Finally, these findings suggest the need for additional research to identify clinical practices and treatments that contributed to the marked improvements in patient outcomes observed over time and that also attempts to identify other factors that influence differential treatment benefit across patient populations.

Supporting information

S1 File. Contains all the supporting tables and figures.

https://doi.org/10.1371/journal.pone.0274571.s001

(DOCX)

Acknowledgments

We are very grateful to the IT EHR teams and scientific collaborators at the 21 health systems for their help with this research. We would like to thank Robert T. Croyle, Ph.D., former Director of the Division of Cancer Control and Population Sciences at NCI, for his instrumental support of every aspect of this project.

References

  1. 1. Centers for Disease Control and Prevention. COVID Data Tracker. 2021. Accessed 15 May 2022. https://covid.cdc.gov/covid-data-tracker/#demographics
  2. 2. Anesi GL, Jablonski J, Harhay MO, et al. Characteristics, outcomes, and trends of patients with COVID-19–related critical illness at a learning health system in the United States. Ann Intern Med. May 2021;174(5):613–621. pmid:33460330
  3. 3. Asch DA, Sheils NE, Islam MN, et al. Variation in US hospital mortality rates for patients admitted with COVID-19 during the first 6 months of the pandemic. JAMA Intern Med. Apr 1 2021;181(4):471–478. pmid:33351068
  4. 4. Horwitz LI, Jones SA, Cerfolio RJ, et al. Trends in Covid-19 risk-adjusted mortality rates J Hosp Med. Feb 2021;16(2):90–92. pmid:33147129
  5. 5. Kadri SS, Sun J, Lawandi A, et al. Association between caseload surge and covid-19 survival in 558 US hospitals, March to August 2020. Ann Intern Med. Jul 6 2021; pmid:34224257
  6. 6. Docherty AB, Harrison EM, Green CA, et al. Features of 20 133 UK patients in hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: prospective observational cohort study. BMJ. May 22 2020;369:m1985. pmid:32444460
  7. 7. Finelli L, Gupta V, Petigara T, Yu K, Bauer KA, Puzniak LA. Mortality among US patients hospitalized with SARS-CoV-2 infection in 2020 JAMA Open. 2021;4(4):e216556. pmid:33830226
  8. 8. Petrilli CM, Jones SA, Yang J, et al. Factors associated with hospital admission and critical illness among 5279 people with coronavirus disease 2019 in New York City: prospective cohort study. BMJ. 2020;369doi:m1966 pmid:32444366
  9. 9. Richardson S, Hirsch JS, Narasimhan M, et al. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized adults with covid-19 in the New York City area. JAMA. Apr 22 2020; pmid:32320003
  10. 10. Bennett TD, Moffitt RA, Hajagos JG, et al. Clinical characterization and prediction of clinical severity of SARS-CoV-2 infection among US adults using data from the US National COVID Cohort Collaborative JAMA Netw Open. Jul 1 2021;4(7):e2116901. pmid:34255046
  11. 11. Bluetree Company. Health Care Consulting. Done. Better. 2021. Accessed 26 Oct 2021. https://www.bluetreenetwork.com/
  12. 12. van Walraven C, Austin PC, Jennings A, Quan H, Forster AJ. A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data. Med Care. Jun 2009;47(6):626–33. pmid:19433995
  13. 13. Racial and ethnic categories and definitions for NIH diversity programs and for other reporting purposes. National Institutes of Health. Publised April 8, 2015. Available from: https://grants.nih.gov/grants/guide/notice-files/not-od-15-089.html
  14. 14. Hiemstra B, Keus F, Wetterslev J, Gluud C, van der Horst ICC. DEBATE-statistical analysis plans for observational studies. BMC Med Res Methodol. Dec 9 2019;19(1):233. pmid:31818263
  15. 15. George EI, Rockova V, Rosenbaum PR, Saptopaa VA, Silber JH. Mortality rate estimation and standardization for public reporting: Medicare’s Hospital Compare. J Am Stat Assoc. 2017;112(519):933–947.
  16. 16. Silber JH, Satopaa VA, Mukherjee N, et al. Improving Medicare’s Hospital Compare Mortality Model. Health Serv Res. Jun 2016;51 Suppl 2:1229–47. pmid:26987446
  17. 17. Silber JH, Rosenbaum PR, Brachet TJ, et al. The Hospital Compare mortality model and the volume-outcome relationship. Health Serv Res. Oct 2010;45(5 Pt 1):1148–67. pmid:20579125
  18. 18. Silber JH, Rosenbaum PR, Niknam BA, et al. Comparing outcomes and costs of surgical patients treated at major teaching and nonteaching hospitals: a National Matched Analysis. Ann Surg. Mar 2020;271(3):412–421. pmid:31639108
  19. 19. Doidge JC, Gould DW, Ferrando-Vivas P, et al. Trends in intensive care for patients with COVID-19 in England, Wales, and Northern Ireland. Am J Respir Crit Care Med. Mar 1 2021;203(5):565–574. pmid:33306946
  20. 20. Gopalan N, Senthil S, Prabakar NL, Senguttuvan T, Bhaskar A, Jagannathan M, et al. Predictors of mortality among hospitalized COVID-19 patients and risk score formulation for prioritizing tertiary care—An experience from South India. PloS One, Feb 3 2022;17(2): e0263471. pmid:35113971
  21. 21. Soto A, Quiñones-Laveriano DM, Azañero J, Chumpitaz R, Claros J, Salazar L, et al. Mortality and associated risk factors in patients hospitalized due to COVID-19 in a Peruvian reference hospital. PloS One, Mar 2 2022;17(3):e0264789. pmid:35235613
  22. 22. Rosenthal N, Cao Z, Gundrum J, Sianis J, Safo S. Risk factors associated with in-hospital mortality in a US national sample of patients with COVID-19. JAMA Netw Open, Dec 1 2020;3(12):e2029058. pmid:33301018
  23. 23. Harrison SL, Fazio-Eynullayeva E, Lane DA, Underhill P, Lip GYH. Comorbidities associated with mortality in 31,461 adults with COVID-19 in the United States: A federated electronic medical record analysis. PLoS Med. Sep 2020;17(9):e1003321. pmid:32911500
  24. 24. Mude W, Oguoma VM, Nyanhanda T, Mwanri L, Njue C. Racial disparities in COVID-19 pandemic cases, hospitalisations, and deaths: A systematic review and meta-analysis. J Glob Health. 2021;11:05015. pmid:34221360
  25. 25. National Center for Health Statistics. Provisional death counts for coronavirus disease (Covid-19). 2021. Accessed 26 Oct 2021. https://www.cdc.gov/nchs/nvss/vsrr/covid19/index.htm
  26. 26. Kabarriti R, Brodin NP, Maron MI, et al. Association of race and ethnicity with comorbidities and survival among patients with COVID-19 at an urban medical center in New York. JAMA Netw Open. Sep 1 2020;3(9):e2019795. pmid:32975574
  27. 27. Ogedegbe G, Ravenell J, Adhikari S, et al. Assessment of racial and ethnic disparities in hospitalization and mortality in patients with COVID-19 in New York City JAMA Netw Open. Dec 1 2020;3(12):e2026881. pmid:33275153
  28. 28. Zakeri R, Bendayan R, Ashworth M, et al. A case-control and cohort study to determine the relationship between ethnic background and severe COVID-19. EClinicalMedicine. Nov 2020;28:100574. pmid:33052324
  29. 29. Nelson KE, Wright R, Peeler A, Brockie T, Davidson PM. Sociodemographic disparities in access to hospice and palliative care: An integrative review. Am J Hosp Palliat Care Nov 2021 38(11):1378–90. pmid:33423532