Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Mortality over time among COVID-19 patients hospitalized during the first surge of the pandemic: A large cohort study

  • Izabel Marcilio,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Writing – original draft

    Affiliation Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP), São Paulo, Brazil

  • Felippe Lazar Neto,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft

    Affiliation Emergency Department, Hospital das Clínicas da Faculdade de Medicina da Universidade de Sao Paulo, São Paulo, Brazil

  • Andre Lazzeri Cortez,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft

    Affiliation Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP), São Paulo, Brazil

  • Anna Miethke-Morais,

    Roles Conceptualization, Data curation, Funding acquisition, Project administration, Writing – review & editing

    Affiliation Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP), São Paulo, Brazil

  • Hillegonda Maria Dutilh Novaes,

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – review & editing

    Affiliation Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, Brazil

  • Heraldo Possolo de Sousa,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    Affiliation Emergency Department, Hospital das Clínicas da Faculdade de Medicina da Universidade de Sao Paulo, São Paulo, Brazil

  • Carlos Roberto Ribeiro de Carvalho,

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Divisao de Pneumologia, Instituto Do Coracao, Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP), Sao Paulo, Brazil

  • Anna Sara Shafferman Levin,

    Roles Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing

    Affiliation Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP), São Paulo, Brazil

  • Juliana Carvalho Ferreira ,

    Roles Conceptualization, Data curation, Methodology, Supervision, Writing – original draft

    juliana.ferreira@hc.fm.usp.br

    Affiliation Divisao de Pneumologia, Instituto Do Coracao, Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP), Sao Paulo, Brazil

  • Nelson Gouveia,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft

    Affiliation Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, Brazil

  • HCFMUSP COVID-19 Study Group

    Membership of the HCFMUSP COVID-19 Study Group is provided in the Acknowledgments.

    Affiliation Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP), São Paulo, Brazil

Abstract

Background

Capacity strain negatively impacts patient outcome, and the effects of patient surge are a continuous threat during the COVID-19 pandemic. Evaluating changes in mortality over time enables evidence-based resource planning, thus improving patient outcome. Our aim was to describe baseline risk factors associated with mortality among COVID-19 hospitalized patients and to compare mortality rates over time.

Methods

We conducted a retrospective cohort study in the largest referral hospital for COVID-19 patients in Sao Paulo, Brazil. We investigated risk factors associated with mortality during hospitalization. Independent variables included age group, sex, the Charlson Comorbidity Index, admission period according to the stage of the first wave of the epidemic (early, peak, and late), and intubation.

Results

We included 2949 consecutive COVID-19 patients. 1895 of them were admitted to the ICU, and 1473 required mechanical ventilation. Median length of stay in the ICU was 10 (IQR 5–17) days. Overall mortality rate was 35%, and the adjusted odds ratios for mortality increased with age, male sex, higher Charlson Comorbidity index, need for mechanical ventilation, and being admitted to the hospital during the wave peak of the epidemic. Being admitted to the hospital during the wave peak was associated with a 33% higher risk of mortality.

Conclusions

In-hospital mortality was independently affected by the epidemic period. The recognition of modifiable operational variables associated with patient outcome highlights the importance of a preparedness plan and institutional protocols that include evidence-based practices and allocation of resources.

Introduction

Two years after the first reports of COVID-19 cases in Wuhan, China, observational studies have identified individual risk factors associated with poorer outcome among hospitalized patients, such as older age, male sex, and comorbidities [13]. However, most published studies are from upper-middle economy and there is little knowledge about how risk factors impact hospitalization, mortality rate, and resource use in low- and middle-income countries (LMIC) [4].

Moreover, there is limited knowledge whether mortality rates have changed over time during the pandemic [5]. Recent reports from the United Kingdom and the United States suggest that mortality decreased over time [6, 7], as health professionals improved their experience with the disease and new treatments became available [8]. On the other hand, mortality rates may increase during periods of a more intense surge of cases [35]. Capacity strain negatively impacts patient care and outcome, and the effects of patient surge is a continuous threat during the COVID-19 pandemic as the availability of ICU beds, equipment, and specialized staff are decisive for optimal care [911]. Over the months of March to August 2020, the incidence of cases in Sao Paulo, Brazil, peaked and then slowly declined, and treatments such as corticosteroids or noninvasive ventilation became more frequently used [12, 13]. However, the impact of evolving clinical experience and new treatment options combined with changes in the incidence of cases on mortality in the context of an emergency preparedness plan is unknown.

Evaluating changes in mortality patterns over time is of foremost importance for resource planning and allocation and for improving patient health outcomes. As many countries experience second or third surges in COVID-19 hospitalizations after the resuming of social distancing measures, and new variants of concern are introduced, this understanding becomes paramount. Our aim was to describe clinical conditions, outcomes and risk factors associated with mortality among COVID-19 patients and to compare mortality rates over time for patients hospitalized in a large tertiary teaching hospital in São Paulo, Brazil, from March 30 to August 31, 2020.

Methods

We conducted a retrospective cohort study based on electronic health records (EHR) of COVID-19 related hospitalizations in the largest referral hospital for COVID-19 cases in Sao Paulo, Brazil. The research protocol was approved by the Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP) ethics committee (CAAE 32037020.6.0000.0068) and informed consent was waived due to the observational nature of the study.

Study setting

Our hospital is a tertiary teaching hospital in Sao Paulo, usually dedicated to treating high-complexity cases. It comprises approximately 2,400 beds and 20,000 healthcare personnel. Its main building, the Central Institute, operates with 900 beds, including an 84-bed intensive care unit (ICU), and a busy emergency department.

As part of the Emergency Operational Plan put in practice by the state’s Health Department, the Central Institute was designated to assisting COVID-19 patients only. Its ICU capacity was increased by about 4-fold by converting regular wards to ICUs, reaching a total number of 300 ICU beds during the peak of the first wave of the epidemic. The number of available ICU beds was managed as per patient demand and staff availability during the crisis period Patient care followed institutional protocols developed specifically for COVID-19 patients, including the use of personal protective equipment, ventilatory management with low tidal volumes and protocolized sedation. Specific drugs for treating COVID-19 were not recommended but could be used at the discretion of the attending physicians. Dexamethasone was used for most patients after the publication of a clinical trial showing benefit in mid-June [8].

Participants and data collection

We included all patients 18 years old and over consecutively admitted to the HCFMUSP from March 30 to August 31 with severe acute respiratory syndrome and a COVID-19 diagnosis confirmed either by real-time polymerase chain reaction (RT-PCR) or serology [1416]. RT-PCR was the preferred method for diagnosis. Serology was used as a confirmatory test for probable COVID-19 cases for whom an RT-PCR test collected up to the 10th day of symptoms onset was not available. A probable COVID-19 case was defined as a suspected case (patients presenting with severe acute respiratory syndrome, defined as individuals with acute upper respiratory symptoms and presenting with: dyspnea/respiratory discomfort or persistent pressure or pain in the chest or O2 saturation below 95% in room air or cyanosis of the lips or face) and a chest Computed Tomography or chest x-ray suggestive of COVID-19 [17]. Patients who were admitted in palliative care, patients with nosocomial COVID-19, defined as patients admitted to the hospital complex for other causes, who were infected with SARS-Cov-2 during their hospitalization, and patients transferred to other facilities during their care were excluded from our sample (Fig 1).

thumbnail
Fig 1. Study participant flow.

Flow of potentially eligible participants in the study, and final numbers included and analyzed.

https://doi.org/10.1371/journal.pone.0275212.g001

A database of all COVID-19 cases admitted during the study period was obtained from the hospital information system. Data from each patient was then collected from the EHR and compiled onto a standardized web-based platform (REDCap–Research Electronic Data Capture) by a trained team [18]. Collected data included demographic characteristics, presenting symptoms, comorbidities, lab results, use of medications, mechanical ventilation and other resources, and clinical outcome including death, discharge, or transfer to other health facility.

Statistical analysis

We used frequency and proportions for categorical variables, and median and interquartile range (IQR) for continuous variables. T-tests, Wilcoxon-rank sum and chi-square tests were performed according to variable distribution and type. Percentage of missing data for each variable is presented on S1 Table in S1 File. Because of the few missing values, we opted to use a complete-case analysis. No censoring was necessary once all patients admitted during the study period had been discharged when data analysis was performed.

First, we investigated risk factors associated with overall mortality during hospitalization with a logistic regression model framework: we first conducted a univariate logistic regression analysis, and then fitted a multivariate logistic regression including those independent variables with a resulting odds ratio (OR) with a p-value less than 0.2 from the univariate models. Independent variables included: age group, sex, the Charlson Comorbidity Index, admission period in relation to the epidemic (early, peak, and late), time from symptoms onset, and mechanical ventilation during hospitalization. These variables were chosen to represent both patient intrinsic (age, sex, comorbidities) and disease-severity mortality risk factors (need of mechanical ventilation, days of symptoms onset) and were selected based on prior published literature.

Second, we assessed the impact of the epidemic period on mortality rates. We sub-divided the study timeframe (6-month) in three time-periods according to the stage of the first wave of the epidemic: early (March to April); peak (May to June); and late (July to August). These periods represented the different capacity strains the Hospital faced (S1 Fig in S1 File). We then modeled both the risk of overall mortality and the probability of a 30-day mortality rate during hospitalization against the period in which the patient was admitted using a logistic regression model. We adjusted for age, sex, the Charlson Comorbidity Index and need for mechanical ventilation, all known risk factors for COVID-19 mortality. Statistical analyses were done in R version 3.6.2 [19].

Results

A total of 3753 patients were admitted between March 30 and August 31, of whom 2949 were confirmed cases according to our eligibility criteria. We excluded 19 patients transferred to other health facilities, 75 patients in palliative care at admission and 92 patients with nosocomial COVID-19 infection. Therefore, 2763 patients were included in our study (Fig 1). Median age was 61 (IQR 48–71) and 56% were male. There were 71 health care workers and 133 (11%) pregnant women. Table 1 shows sociodemographic and clinical characteristics of patients.

thumbnail
Table 1. Patient characteristic according to period of admission.

https://doi.org/10.1371/journal.pone.0275212.t001

Dyspnea (74%) and cough (68%) were the most frequent symptoms, and hypertension (58%) was the most frequent comorbidity at presentation. The median Charlson Comorbidity Index was 2 (1–3), and 217 (8%) patients were transitioned to palliative care at some point during hospitalization.

The median interval from symptoms onset to hospital admission was 7 days (IQR 5–11). 1449 of them were sent to the ICU at admission, while 1895 (69%) were admitted to the ICU at some point during hospitalization. Median length of stay (LOS) in the ICU was 10 (IQR 5–17), 1473 (55%) patients required mechanical ventilation and median duration of mechanical ventilation was 10 days (IQR 5–17) (Table 1).

The overall mortality rate was 34.6%, and among the 956 patients who died during hospitalization, 88% died within 30 days. Hospital LOS was 12 (7–21) days for patients discharged alive, and 13 (8–23) days for non-survivors. S1 Table and S2 Fig in S1 File. show the characteristics of patients according to outcome.

In the univariate logistic regression analysis, older age, male sex, comorbidities (measured by the Charlson Comorbidity index), need for mechanical ventilation, and being admitted to the hospital during the peak and late periods were associated with mortality. In the multivariate logistic regression analysis, the adjusted odds ratios (OR) for mortality increased with age (Table 2). Risk of death was also increased among male patients, and among those with higher Charlson Comorbidity Index. Being admitted to the hospital during the peak period of the epidemic was associated with a 33% higher risk of mortality (OR: 1.33 (IC95% 1.02–1.73) (Table 2). We found no differences in mortality risk between early and late period of admission.

thumbnail
Table 2. Variables associated with mortality in univariate and multivariate models.

https://doi.org/10.1371/journal.pone.0275212.t002

Fig 2 shows the mortality probability according to the period of hospital admission adjusted for age, sex, and Charlson Comorbidity Index. For all categories, there is a higher mortality probability for patients admitted during the peak period of the epidemic. S3 Fig in S1 File shows the increase in corticosteroids prescription over time.

thumbnail
Fig 2. Hospital mortality according to admission period.

Overall mortality probability during hospitalization according to admission period, classified as early (March and April 2020), peak (May and June 2020) and late (July and August 2020), and adjusted for need for mechanical ventilation, Charlson Comorbidity Index, sex, and age group.

https://doi.org/10.1371/journal.pone.0275212.g002

Discussion

In this cohort study, we analyzed data from 2763 COVID-19 patients admitted to a large tertiary teaching hospital between March and August 2020 and found that overall mortality was 34.6%. Older age, male sex, comorbidities and need for mechanical ventilation were risk factors associated with death, 55% of our patients required mechanical ventilation, and 69% were admitted to an ICU. In addition, we showed that admissions during the peak of the epidemic resulted in higher mortality rate after adjustment for patient individual-level data.

This is a large cohort of hospitalized patients with COVID-19 coming from a LMIC, describing the outcomes of patients treated in a large academic hospital in the context of an emergency state preparedness plan. The plan involved designating a hospital for COVID-19 patients and transforming ward beds and operating rooms into ICU. The hospital admitted patients from all regions of the metropolitan area of Sao Paulo, which has a total population of over 21 million people. As the hospital was the main referral center for severe cases, it was constantly under strain, which may have had an important impact on mortality rate, in addition to several recognized barriers for caring for severe patients in LMIC [20].

As expected, the age structure of our cohort was younger than high-income European countries, but comparable to Israel and the United States [2, 3, 5, 2125]. Common symptoms on admission included cough, fever, and dyspnea, and did not differ from the current literature [1, 2]. Most patients had at least one comorbidity, with a higher occurrence of hypertension and diabetes, as previously reported [1, 3, 24].

Although median LOS, median LOS in ICU, and duration of mechanical ventilation were similar to other studies, we found a higher overall mortality rate when compared to other tertiary centers in high-income countries [2, 3]. This might be due to the fact that our hospital was designated as a reference for high-severity cases only according to the state’s risk-stratified Emergency Plan. We thus admitted patients referenced from secondary hospitals in the metropolitan region of Sao Paulo, which may have biased our study population towards a higher severity population. Since there was no widely used marker of disease severity at hospital admission at the time of the study, such as ISARIC 4C [26], we were unable to test the hypothesis that our patients were more severe than patients from other cohorts, or to adjust our findings to disease severity. However, we can infer increased severity from the higher rates of need for invasive mechanical ventilation, 55%, compared to less than 10% in the UK [6] and 15% in Germany [2].

When comparing the mortality rate among intensive-care units, we found a higher mortality rate than Belgium, but similar to Germany, and lower than Russia [2, 3, 27]. A recently published cohort from our hospital including only critically ill patients during a slightly different period found a 49% mortality rate [28]. Risk factors for mortality were similar to those reported previously, including age, sex, and comorbidities [13, 5, 28].

We provided novel data demonstrating that the mortality rate in LMIC was higher during the peak period of the epidemic, and this association held true even after adjusting for age, sex, need for mechanical ventilation and the Charlson Comorbidity Index. Recent reports have shown that increased community spread, and higher caseload are associated with worsening mortality in the United States and Israel [5, 20]. Hospital capacity strain, which often results from high community spread, has been shown to negatively impact mortality. ICU overflow has been associated with a 6% ICU mortality increase in Belgium [3], while in the United States mortality decreased from high/very high surge to low/medium surge among patients 18 to 44 years old and among those 45 to 64 years old [10].

A large nationwide study of confirmed COVID-19 hospital admissions in Brazil has found similar results [4]. This finding is possibly a result of the overwhelming burden to which health services were exposed during periods of highest community transmission of SARS-CoV-2. The COVID-19 epidemic is characterized not only by the severity of cases, but also by a rapid increase in caseload, causing a strain on health systems around the world. In order to meet the high demand for attending critically ill COVID-19 patients, hospitals were provided with supplementary ICU beds, along with human and other resources. This rapid preparation of hospitals, however, could not prevent the overflow of patients. Thus, during peaks of caseload, hospitals could be functioning with less trained personnel, healthcare workers experiencing physical and emotional exhaustion, and temporary shortage of supplies, all of each, in turn, result in difficulties to adherence to best practices [3]. In our institution, the number of ICU beds was rapidly increased to try to meet the increased demand, but our biggest limitation was specialized teams, which had to be expanded with less experienced members during the periods of peak strain, which could have impacted clinical processes and outcomes. The additional overburden of the pandemic might have a greater impact in LMIC, where health care systems usually operate under limited resources. This could partially explain the higher in-hospital mortality found in our study [4].

We did not find a decrease in mortality rate over time as one might expect as a result of the advancing knowledge and availability of treating protocols, such as the widespread use of the prone position, use of noninvasive ventilation and the prescription of corticosteroids [6, 7, 13]. One possible explanation for this finding is that the potential benefit of a more appropriate treatment was overturned by the negative impact of patient overflow and the increased patient severity at admission.

Our study has some limitations. First, it is a single center study, in a large academic hospital with institutional treatment protocols, therefore the results may not be generalizable to other hospitals in LMIC. We collected data retrospectively, relying on information registered in EHR, which might have incompleteness or inaccuracies. Also, our population was probably biased towards high-severity cases, as admissions were managed by the State Emergency Plan, and a considerable proportion of patients were admitted under mechanical ventilation or were admitted directly to the ICU. We also acknowledge that other factors may have impacted outcomes over the time periods of the study, and for which we could not account, and therefore results may be influenced by residual confounding. We did not include any data on performance status, frailty or activities of daily living which could have impacted mortality.

This study also has important strengths. It consisted of a sizable cohort of patients admitted to the largest health care center in Brazil and one of the largest in the world dealing with COVID-19. The residential distribution of patients showed that our sample of patients was representative of the metropolitan region of São Paulo. Most importantly, previous studies of hospitalized patients with COVID-19 in Brazil were based on government records which have limited information on in-hospital trajectory, disease severity, and resource use during hospitalization [4, 12].

Conclusion

In this large cohort study including almost 3000 patients over a 5-month period, in-hospital mortality of COVID-19 patients was independently affected by the epidemic period in the city along with well-established risk factors. The association of mortality with the overburden of health services confirms the need of public health policies to flatten the epidemic curve. Moreover, the recognition of operational variables associated with patient outcome highlights the importance of creating a preparedness plan, developing institutional protocols that include evidence-based practices and allocation of resources use to improve patient outcomes.

Acknowledgments

We would like to acknowledge the outstanding work performed by healthcare workers and staff in our hospital during the COVID-19 crisis. We would also like to thank the Hospital das Clinicas COVID-19 crisis committee and the informatics department (NETI) for their support for this project. Finally, we would like to thank all members of the HCFMUSP COVID-19 Study Group: Tarcisio E.P. Barros-Filho1, Eloisa Bonfa1, Edivaldo M. Utiyama1, Aluisio C. Segurado1, Beatriz Perondi1, Amanda C. Montal1, Leila Harima1, Solange R.G. Fusco1, Marjorie F. Silva1, Marcelo C. Rocha1, Izabel Cristina Rios1, Fabiane Yumi Ogihara Kawano1, Maria Amélia de Jesus1, Esper Kallas1, Maria Cristina Peres Braido Francisco1, Carolina Mendes do Carmo1, Clarice Tanaka1, Maura Salaroli Oliveira1, Thaís Guimarães1, Carolina dos Santos Lázari1, Marcello M.C. Magri1, Julio F.M. Marchini1, Alberto José da Silva Duarte1, Ester C. Sabino1, Silvia Figueiredo Costa1

1Hospital das Clinicas da Faculdade de Medicina da Universidade de Sao Paulo (HCFMUSP)—Av. Dr. Enéas Carvalho de Aguiar, 255. 05403–000, São Paulo, Brazil

The lead author in the study group is Dr Aluisio Segurado (segurado@usp.br).

References

  1. 1. Garibaldi BT, Fiksel J, Muschelli J, et al. Patient Trajectories Among Persons Hospitalized for COVID-19 A Cohort Study. Ann Intern Med 2020; 174:33–44. pmid:32960645
  2. 2. Karagiannidis C, Mostert C, Hentschker C, et al. Case characteristics, resource use, and outcomes of 10021 patients with COVID-19 admitted to 920 German hospitals: an observational study. Lancet Respir Med 2020; 8: 853–62. pmid:32735842
  3. 3. Taccone FS, Goethem NV, Pauw RD, et al. The role of organizational characteristics on the outcome of COVID-19 patients admitted to the ICU in Belgium. Lancet Regional Health-Europe 2020; 2:100019. pmid:35104305
  4. 4. Ranzani OT, Bastos LSL, Gelli JGM, et al. Characterization of the first 250000 hospital admissions for COVID-19 in Brazil: a retrospective analysis of nationwide data. Lancet Respir Med 2021; 9:407–18.
  5. 5. Asch DA, Sheils NE, Islam MN, et al. Variation in US Hospital Mortality Rates for Patients Admitted With COVID-19 During the First 6 Months of the Pandemic. JAMA Intern Med 2021; 181:471–8. pmid:33351068
  6. 6. Docherty AB, Mulholland RH, Lone NI, et al. Changes in in-hospital mortality in the first wave of COVID-19: a multicentre prospective observational cohort study using the WHO Clinical Characterisation Protocol UK. Lancet Respir Med 2021;9: 773–85. pmid:34000238
  7. 7. Roth GA, Emmons-Bell S, Alger HM, et al. Trends in Patient Characteristics and COVID-19 In-Hospital Mortality in the United States During the COVID-19 Pandemic. JAMA Net Open 2021;4: e218828. pmid:33938933
  8. 8. Horby P, Lim WS, Emberson JR, et al. RECOVERY Collaborative Group. Dexamethasone in hospitalized patients with covid-19 preliminary report. N Engl J Med 2021; 384:693–704.
  9. 9. Kohn R. Broadening the Scope of Healthcare Operations: Expanding Capacity Strain Hospital-Wide. Crit Care Med 2020; 48:771–3. pmid:32301776
  10. 10. Toth AT, Tatem KS, Hosseinipour N, et al. Surge and Mortality in ICUs in New York City’s Public Healthcare System. Crit Care Med 2021; 49:1439–50. pmid:33861549
  11. 11. Brandão Neto RA, Marchini JF, Marino LO, et al. Mortality and other outcomes of patients with coronavirus disease pneumonia admitted to the emergency department: A prospective observational Brazilian study. PLoS One 2021;16: e0244532. pmid:33411707
  12. 12. de Souza WM, Buss LF, Candido DdS, et al. Epidemiological and clinical characteristics of the COVID-19 epidemic in Brazil. Nat Hum Behav 2020; 4:856–65. pmid:32737472
  13. 13. Kurtz P, Bastos LSL, Dantas LF, et al. Evolving changes in mortality of 13,301 critically ill adult patients with COVID-19 over 8 months. Intensive Care Med 2021; 47:538–48. pmid:33852032
  14. 14. Corman VM, Landt O, Kaiser M, et al. Detection of 2019 novel coronavirus (2019- nCoV) by real-time RT-PCR. Euro Surveill 2020; 3:2000045. https://doi.org/10.2807/1560-7917.ES.2020.25.3.2000045.
  15. 15. Costa SF, Buss L, Espinoza EPS, et al. Performance of a qualitative rapid chromatographic immunoassay to diagnose COVID-19 in patients in a middle-income country. J Clin Virol 2020; 131:104592. pmid:32827898
  16. 16. Lisboa Bastos M, Tavaziva G, Abidi SK, et al. Diagnostic accuracy of serological tests for covid-19: systematic review and meta-analysis. BMJ 2020;370:m2516. pmid:32611558
  17. 17. WHO-2019-nCoV-SurveillanceGuidance-2020.8. (World Health Organization, 2020). https://www.who.int/publications/i/item/who-2019-nCoV-surveillanceguidance-2020.8 (accessed Sep 20, 2021)
  18. 18. Harris PA, Taylor R, Minor BL, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform 2019; 95:103208. pmid:31078660
  19. 19. Team Rstudio. RStudio: Integrated Development for R. [Internet]. Boston, MA: Rstudio; 2018. Available from: http://www.rstudio.com/
  20. 20. Salluh JIF, Lisboa T, Bozza FA. Challenges for the care delivery for critically ill COVID-19 patients in developing countries: the Brazilian perspective. Crit Care 2020; 24:593. pmid:32998757
  21. 21. van Halem K, Bruyndonckx R, van der Hilst J, et al. Risk factors for mortality in hospitalized patients with COVID-19 at the start of the pandemic in Belgium: a retrospective cohort study. BMC Infect Dis 2020; 20:897. pmid:33246431
  22. 22. Berzuini C, Hannan C, King A, et al. Value of dynamic clinical and biomarker data for mortality risk prediction in COVID-19: a multicentre retrospective cohort study. BMJ Open 2020;10: e041983. pmid:32967887
  23. 23. Rossman H, Meir T, Somer J, et al. Hospital load and increased COVID-19 related mortality in Israel. Nat Commun 2021; 12:1904. pmid:33771988
  24. 24. Cummings MJ, Baldwin MR, Abrams D. Epidemiology, clinical course, and outcomes of critically ill adults with COVID-19 in New York City: a prospective cohort study. Lancet 2020; 395:1763–70. pmid:32442528
  25. 25. Richardson S, Hirsch JS, Narasimhan M, et al. Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area. JAMA 2020; 323:2052–9. pmid:32320003
  26. 26. Knight S R, Ho A, Pius R, Buchan I, Carson G, Drake T M et al. Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score BMJ 2020; 370: m3339 pmid:32907855
  27. 27. Moiseev S, Avdeev S, Brovko M, Bulanov N, Tao E, Fomin V. Outcomes of intensive care unit patients with COVID-19: a nationwide analysis in Russia. Anaesthesia 2021; 76:11–2. pmid:33015828
  28. 28. Ferreira JC, Ho YL, Besen BAMP, et al. Protective ventilation and outcomes of critically ill patients with COVID-19: a cohort study. Ann Intensive Care 2021; 11:92. pmid:34097145