Background and Aims
Recently, glucose variability (GV) has been reported as an independent risk factor for mortality in non-diabetic critically ill patients. However, GV is not incorporated in any severity scoring system for critically ill patients currently. The aim of this study was to establish and validate a modified Simplified Acute Physiology Score II scoring system (SAPS II), integrated with GV parameters and named GV-SAPS II, specifically for non-diabetic critically ill patients to predict short-term and long-term mortality.
Training and validation cohorts were exacted from the Multiparameter Intelligent Monitoring in Intensive Care database III version 1.3 (MIMIC-III v1.3). The GV-SAPS II score was constructed by Cox proportional hazard regression analysis and compared with the original SAPS II, Sepsis-related Organ Failure Assessment Score (SOFA) and Elixhauser scoring systems using area under the curve of the receiver operator characteristic (auROC) curve.
4,895 and 5,048 eligible individuals were included in the training and validation cohorts, respectively. The GV-SAPS II score was established with four independent risk factors, including hyperglycemia, hypoglycemia, standard deviation of blood glucose levels (GluSD), and SAPS II score. In the validation cohort, the auROC values of the new scoring system were 0.824 (95% CI: 0.813–0.834, P< 0.001) and 0.738 (95% CI: 0.725–0.750, P< 0.001), respectively for 30 days and 9 months, which were significantly higher than other models used in our study (all P < 0.001). Moreover, Kaplan-Meier plots demonstrated significantly worse outcomes in higher GV-SAPS II score groups both for 30-day and 9-month mortality endpoints (all P< 0.001).
We established and validated a modified prognostic scoring system that integrated glucose variability for non-diabetic critically ill patients, named GV-SAPS II. It demonstrated a superior prognostic capability and may be an optimal scoring system for prognostic evaluation in this patient group.
Citation: Liu W-Y, Lin S-G, Zhu G-Q, Poucke SV, Braddock M, Zhang Z, et al. (2016) Establishment and Validation of GV-SAPS II Scoring System for Non-Diabetic Critically Ill Patients. PLoS ONE 11(11): e0166085. https://doi.org/10.1371/journal.pone.0166085
Editor: Chiara Lazzeri, Azienda Ospedaliero Universitaria Careggi, ITALY
Received: July 16, 2016; Accepted: October 21, 2016; Published: November 8, 2016
Copyright: © 2016 Liu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by grants from National Natural Science Foundation of China (81500665), Zhejiang Provincial Natural Science Foundation (Y14H070034), High Level Creative Talents from Department of Public Health in Zhejiang Province and Project of New Century 551 Talent Nurturing in Wenzhou. AstraZeneca R&D provided support in the form of salaries for author Martin Braddock, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: AstraZeneca R&D provided support in the form of salaries for author Martin Braddock, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.
Abbreviations: MIMIC-III, Multiparameter Intelligent Monitoring in Intensive Care database III; ICU, intensive care unit; SAPS, simplified acute physiology score; SOFA, sepsis-related organ failure assessment score; APACHE, acute physiology and chronic health evaluation; GCS, Glasgow Coma Scale; GV-SAPS II, Glucose Variability associated SAPS II Scoring System; SQL, structure query language; auROC, area under the curve of the receiver operator characteristic; SD, standard deviation; IQR, inter-quartile range; GluSD, standard deviation of blood glucose levels; Gluavg, average of glucose levels; HR, hazard ratio; CI, confidence interva; GV, glucose variability; WBC, white blood cell; BUN, urea nitrogen; PO2, partial pressure of oxygen.
Critical care medicine is a multi-disciplinary specialty concerned with the management of life-threatening conditions in critically ill patients. These patients account for 11.3% of hospital mortality and even a high mortality rate in the six months after discharge [1,2]. Over the last three decades, several scoring systems for critical illness have been proposed for assisting physicians to quantify severity of disease and assess the prognosis. The Simplified Acute Physiology Score (SAPS) is one of the most widely used scoring systems at intensive care unit (ICU), which was first constructed in 1984 as an improvement of the Acute Physiology And Chronic Health Evaluation (APACHE) scoring system. The second generation SAPS score (SAPS II), was further validated in several studies and proved to be applicable in other cohorts [3,4,5,6].
Blood glucose levels are a crucial physiological variable for patients admitted to an ICU department with infection, sepsis and other critical conditions [7,8,9]. Of note, acute hyperglycemia and hypoglycemia were reported as independent detrimental factors for hospital mortality . In scoring systems for critical illness, however, serum glucose levels have shown no significant association after adjusting for other parameters [6,11]. In recent years, glucose variability has been increasingly recognized as an independent risk factor for mortality in non-diabetic patients at ICU rather than blood glucose level [12,13,14]. Therefore, glucose variability can be considered as a novel parameter in scoring system for non-diabetic subjects at ICU.
The aim of this study was to construct and validate a modified SAPS II scoring system with additional glucose variability parameters. The system is designed to be specific for non-diabetic patients from ICU and was tested on a patient cohort from the Beth Israel Deaconess Medical Center to determine its effectiveness in predicting the accuracy of SAPS II for the risk of short-term and long-term mortality. Furthermore, the prognostic ability of the novel scoring system was compared with other standard scoring systems.
Material and Methods
The Multi-parameter Intelligent Monitoring in Intensive Care III version 1.3 (MIMIC-III v1.3) is a publicly and freely available database comprising de-identified health-related data associated with over forty thousand patients who come from a variety critical care units of the Beth Israel Deaconess Medical Center between 2001 and 2012 . In order to apply for permission to access the database, researchers are mandated to complete the NIH web-based training course named “Protecting Human Research Participants” (Our certification number: 1605699).
In this study, we by extracted data from MIMIC III database, established and validated a modified SAPS II scoring system incorporating glucose variability and named the new scoring system Glucose Variability associated SAPS II Scoring System (GV-SAPS II). The training cohort consisted of individuals admitted to ICU in the Beth Israel Deaconess Medical Center from 2001 to 2008 and the validation cohort comprised of patients admitted during 2009 to 2012 from the same database.
The start date for follow-up was the date of patient’s admission. The date of death for patients was obtained from Social Security Death Records from the US government. All the patients were followed up for at least 9 months.
Population selection and definitions
A total of 58,976 ICU admissions were recorded in the MIMIC III database. Patients with diabetes were excluded from our study, and this was determined by medical history, diagnosis at admission (International Classification of Disease 9 code: 250.xx) or admission HbA1c value of ≥ 6.5% (recommended for the diagnosis from the American Diabetes Association ). For non-diabetic patients, hyperglycemia was defined as any serum glucose level ≥ 11.1 mmol/l, and hypoglycemia was defined as any glucose measurement ≤ 3.9 mmol/l .
Subjects who met the following criteria were excluded: (1) missing of individual data greater than 5% or lack of glucose measurements;(2) outliers exited; (3) diabetic patients; (4) age < 18y; (5) not the first admission; (6) hospital stay length less than 2 days; (7) total glucose measures < 3 times; (8) the mean interval of glucose records more than 24 hours.
Patient data was exacted from MIMIC III using structure query language (SQL) with Mysql tools (version 5.6.24), including patient identifiers, demographic parameters, clinical parameters, laboratory parameters and scoring systems. According to the patient identifier system, we can obtain the hospital records of a particular patient from 2001 to 2012 at Beth Israel Deaconess Medical Center. Records of baseline characteristics were exacted in the first 24 hours after patient admission.
Physiological information (heart rate, respiratory rate, systolic blood pressure and diastolic blood pressure) was measured by bedside monitors. Age, gender, the length of stay in hospital, readmission records were also recorded in the database.
Laboratory measurements included white blood cell (WBC) and platelet count, urea nitrogen (BUN), serum potassium, serum sodium, partial pressure of oxygen (PO2), fraction of inspiration O2, bicarbonate, serum glucose, creatinine, and bilirubin. The mean interval of glucose records were 20 hours. Hyperglycemia and hypoglycemia were mapped to classes according to the following thresholds: 0: non-hyperglycemia, non-hypoglycemia; 1: hyperglycemia, hypoglycemia.
Three other standard scoring systems were evaluated enabling a comparison with our GV-SAPS II (original SAPS II, Sepsis-related Organ Failure Assessment Score (SOFA) and Elixhauser comorbidity score). Scores were all calculated using physiological measurements and clinical information according to published recommendations and accepted formulae [6,18,19].
Construction of the GV-SAPS II Score
In this study, three parameters were defined as glucose variability components and are: hyperglycemia, hypoglycemia and standard deviation of blood glucose levels (GluSD). For the training cohort, glucose variability components and SAPS II score were selected for Cox proportional hazard regression analysis for determining the association with prognosis and survival time. The hazard or instantaneous risk of death h(t) at time t after randomization for a patient with variables xl,…,xn has the form h(t) = h0(t) exp(b1x1 + b2x2 + … bnxn). According to the coefficients, a prognostic index (PI = b1x1 + b2x2 + … + bnxn) can be calculated for each patient on the basis of the final mode. Higher values of index signify a worse prognosis, and lower signify a better prognosis . Therefore, the PI can be used as a novel prognostic scoring system, named GV-SAPS II score, based on four parameters (hyperglycemia, hypoglycemia, GluSD and SAPS II score). For ease of use, we defined GV-SAPS II score as a ten-fold PI.
To compare the 30-day and 9-month prognostic ability of GV-SAPS II score with other models, the area under the curve of the receiver operator characteristic (auROC) curve was determined, which is a measure of discrimination. In addition, the standard index of validity, such as the Youden index, sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, positive predictive value, and negative predictive value, were calculated according to the ROC results.
We categorized GluSD into three groups using optimal binning strategies: G1: ≤ 0.7 mmol/l, G2: 0.7 to 2.1 mmol/l, G3: ≥ 2.1 mmol/l. In the training cohort, the hazard ratios (HRs) and 95% confidence intervals (CIs) of scoring system parameters were calculated using Cox proportional hazard regression. In addition, Kaplan–Meier survival curves were calculated to describe the incidence of outcomes after 30 days and 9 months and stratified by different risk levels of the GV-SAPS II.
The Kolmogorov–Smirnov test was used to determine whether sample data were likely to be derived from a normal distribution population. Continuous variables were summarized as mean ± standard deviation (SD) or median (inter-quartile range (IQR)), respectively. The categorical variables were displayed as counts or percentages (%). The characteristics of the study population in two cohorts were compared using Student’s t test or non-parametric Wilcoxon test for continuous variables and χ2-test for categorical variables. All P-values were two-sided and a P value of < 0.05 was considered statistically significant. Analyses were performed in SPSS version 20.0 (SPSS, Chicago, IL, USA), MedCalc version 12.7 (MedCalc Software, Ostend, Belgium).
Characteristics of the study sample
A total of 58,976 admission records were extracted and enrolled in our cohort. After exclusion of those who did not meet the inclusion criteria, 4,895 and 5,048 eligible individuals were finally included in the training and validation cohorts, respectively (Fig 1).
*There is no overlap between training and validation cohorts.
Table 1 summarizes the patient characteristics and glucose indices for the two cohorts. In the training cohort, median and IQR of GluSD was 1.1 mmol/l (0.7 to 1.8 mmol/l), of which the proportion of hyperglycemia patients was 14.2% and hypoglycemia was 6.6%. In the validation cohort, median and IQR of GluSD was 1.0 mmol/l (0.7 to 1.6 mmol/l), of which the proportion of hyperglycemia patients was 10.6% and hypoglycemia was 6.0%. The scoring systems of training subjects showed the scores were 4.0 (2.0 to 6.0), 31.0 (22.0 to 45.0), 0.0 (-1.0 to 4.0) in SOFA, SAPS II, Elixhauser score, respectively. In the validation cohort, the prognostic scores were 3.0 (1.0–5.0), 29.0 (21.0–43.0), 0.0 (-1.0–6.0) in SOFA, SAPS II and Elixhauser score. Hospital characteristics and clinical outcomes showed that the 30-day mortality of subjects was 12.5% and 9.7% in training and validation cohorts, respectively. Furthermore, the mortality of the two cohorts were 18.7% and 15.9% at the end of 9 months.
Construction of the GV-SAPS II
Glucose variability was defined as the GluSD per patient in our study and this has been widely used in previous studies . Measures of hyperglycemia and hypoglycemia as outcomes of serious glucose fluctuations, were included in the glucose variability components as well.
As shown in Table 2, both glucose variability components (GluSD, hyperglycemia, hypoglycemia) and SAPS II scores were associated with 30-day mortality of critically ill patients in the univariate analysis. After entering the data into the multivariate Cox proportional hazards regression analyses, these components and the SAPS II score were shown to be independent risk factors for 30-day mortality. The hazard ratio of each variables as follow: GluSD level in G2 (HR = 1.731, 95% CI: 1.300–2.304, P < 0.001), GluSD level in G3 (HR = 1.641, 95% CI: 1.100–2.448, P < 0.015), hyperglycemia (HR = 2.516, 95% CI: 1.860–3.405, P < 0.001), hypoglycemia (HR = 1.952, 95% CI: 1.556–2.449, P < 0.001), SAPS II score (HR = 1.055, 95% CI: 1.050–1.060, P < 0.001).
Application of GV-SAPS II to ICU short-term and long-term outcomes
After applying the GV-SAPS II scoring system for enrolled subjects, the mean scores from the training and validation cohorts were 24 ± 10, and 19 ± 10 respectively. In the training cohorts, the HRs of the new scoring system were 1.098 (95% CI: 1.088–1.107, P < 0.001) and 1.093 (95% CI: 1.085–1.101, P < 0.001) for 30-day and 9-month mortality. In the validation cohort, HRs were 1.111 (95% CI: 1.102–1.121, P < 0.001) and 1.102 (95% CI: 1.093–1.111, P < 0.001) in adjusted models.
The performance of GV-SAPS II to predict 30-day and 9-month outcomes in the training cohort is presented in Fig 2A and 2B using ROC analysis. The auROC of new scoring system was 0.825 (95% CI: 0.814–0.835, P< 0.001) after 30 days and 0.764 (95% CI: 0.752–0.776, P< 0.001) after 9 months, which were significantly higher than other scoring systems determined in our study (all P < 0.001). The auROC of SAPS II, SOFA, Elixhauser scores are: 0.796 (95% CI: 0.784–0.807, P< 0.001), 0.790 (95% CI: 0.778–0.801, P< 0.001), 0.720 (95% CI: 0.708–0.733, P< 0.001) in 30 days and 0.740 (95% CI: 0.728–0.752, P< 0.001), 0.717 (95% CI: 0.705–0.730, P< 0.001), 0.722 (95% CI: 0.710–0.735, P< 0.001) after 9 months. Moreover, we used an optimal cut-off value of 28 and 26 for 30-day and 9-month prediction respectively. The sensitivities were 75.94% and 71.33% respectively, the specificities were 73.23% and 67.55% respectively (Table 3).
In the validation cohort, the novel scoring system also presented an improved capability to predict 30-day and 9-month mortality. As shown in Fig 2C and 2D, the new scores were assessed with an auROC of 0.824 (95% CI: 0.813–0.834, P< 0.001) for 30 days and 0.738 (95% CI: 0.725–0.750, P< 0.001) for 9 months. In the same cohort, SAPS II had an auROC of 0.793 (95% CI: 0.782–0.804, P< 0.001) and 0.722 (95% CI: 0.710–0.735, P< 0.001), SOFA scores of 0.772 (95% CI: 0.760–0.783, P< 0.001) and 0.674 (95% CI: 0.661–0.687, P< 0.001), Elixhauser scores of 0.724 (95% CI: 0.712–0.736, P< 0.001) and 0.724 (95% CI: 0.712–0.737, P< 0.001), significantly lower than GV-SAPS II score (all P < 0.001). Using the best cutoff values of 26 and 24 for 30 days and 9 months, the sensitivities were 77.91% and 70.61% respectively, the specificities were 71.11% and 63.25% respectively (Table 3).
Survival distributions in different risk levels of the GV-SAPS II
To understand the survival distributions in different risk levels of the novel scoring system, we classified GV-SAPS II score into quartiles as follows: group 1 (< 22); group 2 (22 to 34); group 3 (34 to 41); group 4 (> 41). As shown in Fig 3, Kaplan-Meier curves indicate significantly worse outcomes in patients in higher score groups for both 30-day and 9-month mortality (all P< 0.001).
SAPS is one of many ICU scoring systems, which has been available since 1984 and designed to measure and predict the severity and prognosis of disease. The SAPS II score is calculated from 12 physiological measurements including age, heart rate, systolic blood pressure, temperature, GCS, mechanical ventilation or CPAP, PaO2, FiO2, urine output, blood urea nitrogen, sodium, potassium, bicarbonate, bilirubin, white blood cell, chronic diseases, type of admission. In this study, we constructed a modified SAPS II scoring system by adding glucose variability parameters (hyperglycemia, hypoglycemia, SD of blood glucose levels), named GV-SAPS II, for non-diabetic critically ill subjects. Although it was based on 30-day outcomes, we have demonstrated a prognostic value both in short-term and long-term mortality measurements using ROC analysis. In comparison with other standard scoring systems, GV-SAPS II performed significantly better with a higher auROC in both training and validation cohorts. Moreover, Kaplan-Meier survival curves showed that higher GV-SAPS II score groups were associated with a higher risk for death at 30 days and 9 months.
To our knowledge, this is the first modified prognostic scoring system that integrates glucose variability for non-diabetic critically ill patients. In previous studies, various physiological parameters were considered to build scoring systems, including serum glucose concentration. After adjusting for other parameters, the glucose level showed no significance prognostic capability [6,11]. In contrast, abnormal glucose levels have been demonstrated to represent an increased risk of mortality in several studies of critically ill patients [22,23,24,25]. The conclusion for these contradictory observations suggests that glucose variability, rather than serum glucose concentration has a crucial role in the mortality of critically ill patients [26,27,28,29]. From a clinical perspective, a single point serum glucose measurement can be easily influenced by a wide range of confounders, such as drug, diet, inflammation and physiological stress state. Therefore, it may not adequately reflect metabolic state in patients with critical illness. On the contrary, glucose variability may reveal dynamic changes of glucose levels, assessing the control of blood glucose. Moreover, the underlying mechanism for glucose variability has been reported to be associated with oxidative stress, neuronal damage, and blood coagulation activity [13,21]. In a vitro study, it has been demonstrated that acute fluctuations of glucose may be more detrimental to endothelial cell function than a constant abnormal level of glucose. This may contribute to increasing cardiovascular risk and reducing the homeostatic potential of the vasculature to accommodate perturbations in stress . Thus it is feasible that glucose variability may play an important role in pathological processes associated with patients who are critically ill, suggesting that glucose variability should be considered as a part of the future development of prognostic models predicting patient mortality.
In this study, patients with diabetes were excluded from our study. Although glucose variability has been shown to be an independent risk factor in several mixed cohorts, previous studies have reported nonsignificant association between glucose variability and mortality of patients with diabetes [29,31]. In addition, it is a subject of debate as to whether hyperglycemia is an independent risk factor for patients with diabetes in ICU [29,32,33]. It has been proposed that these patients may become desensitized to rapid fluctuation of glucose levels, however, firm evidence is lacking and future research needs to establish specific models which may be applicable to patients with diabetes.
There are four main limitations of the present study. First, this is a single center cohort study and different conclusions may be reached using patient records from other centers, suggesting that a multicenter and prospective study are needed. Secondly, in order to ensure the accuracy of glucose variability, enough times of blood glucose test are needed. Thirdly, although SAPS II is still most widely used model, SAPS III has been available since 2005  and a lack of surgery site information in the patient data base precluded a comparison of our model with SAPS III. Fourthly, due to the inconsistent pattern for glycemic metabolism, the diabetes patients have been excluded in our study. This may limit the scope of this scoring tool. Additionally, patients with impaired fasting glucose or impaired fasting glucose may be included in our cohort, which may have an impact on our prognostic system.
We have constructed a modified prognostic scoring system that integrates glucose variability for non-diabetic patients who are critically ill. The GV-SAPS II scoring system was shown to have superior prognostic capability in study cohorts and may have utility as a scoring system for medical decision making and prognostic evaluation.
- Conceptualization: WYL FXS MHZ.
- Data curation: WYL SVP MB.
- Formal analysis: WYL SGL.
- Funding acquisition: FXS MHZ.
- Investigation: WYL GQZ ZZ ZM.
- Methodology: WYL SGL.
- Project administration: FXS MHZ.
- Resources: ZZ ZM.
- Software: WYL SGL.
- Supervision: FXS MHZ.
- Validation: WYL SGL.
- Visualization: WYL MHZ.
- Writing – original draft: WYL SGL MHZ.
- Writing – review & editing: SVP MB MHZ.
- 1. Zimmerman JE, Kramer AA, Knaus WA (2013) Changes in hospital mortality for United States intensive care unit admissions from 1988 to 2012. Crit Care 17: R81. pmid:23622086
- 2. Wunsch H, Guerra C, Barnato AE, Angus DC, Li G, Linde-Zwirble WT (2010) Three-year outcomes for Medicare beneficiaries who survive intensive care. JAMA 303: 849–856. pmid:20197531
- 3. Schuster HP, Schuster FP, Ritschel P, Wilts S, Bodmann KF. The ability of the Simplified Acute Physiology Score (SAPS II) to predict outcome in coronary care patients. Intensive Care Med. 1997;23:1056–61 pmid:9407241
- 4. Agha A, Bein T, Frohlich D, Hofler S, Krenz D, Jauch KW. ["Simplified Acute Physiology Score" (SAPS II) ina the assessment of severity of illness in surgical intensive care patients]. Chirurg. 2002;73:439–42 pmid:12089827
- 5. Sekulic AD, Trpkovic SV, Pavlovic AP, Marinkovic OM, Ilic AN. Scoring Systems in Assessing Survival of Critically Ill ICU Patients. Med Sci Monit. 2015;21:2621–9 pmid:26336861
- 6. Le Gall JR, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. 1993;270:2957–63 pmid:8254858
- 7. Kavanagh BP, McCowen KC. Clinical practice. Glycemic control in the ICU. N Engl J Med. 2010;363:2540–6 pmid:21175316
- 8. Donati A, Damiani E, Domizi R, Botticelli L, Castagnani R, Gabbanelli V, et al. Glycaemic variability, infections and mortality in a medical-surgical intensive care unit. Crit Care Resusc. 2014;16:13–23 pmid:24588431
- 9. Ooi YC, Dagi TF, Maltenfort M, Rincon F, Vibbert M, Jabbour P, et al. Tight glycemic control reduces infection and improves neurological outcome in critically ill neurosurgical and neurological patients. Neurosurgery. 2012;71:692–702; discussion 702 pmid:22688953
- 10. Bagshaw SM, Egi M, George C, Bellomo R. Early blood glucose control and mortality in critically ill patients in Australia. Crit Care Med. 2009;37:463–70 pmid:19114915
- 11. Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest. 1991;100:1619–36 pmid:1959406
- 12. Meyfroidt G, Keenan DM, Wang X, Wouters PJ, Veldhuis JD, Van den Berghe G. Dynamic characteristics of blood glucose time series during the course of critical illness: effects of intensive insulin therapy and relative association with mortality. Crit Care Med. 2010;38:1021–9 pmid:20124887
- 13. Hermanides J, Vriesendorp TM, Bosman RJ, Zandstra DF, Hoekstra JB, Devries JH. Glucose variability is associated with intensive care unit mortality. Crit Care Med. 2010;38:838–42 pmid:20035218
- 14. Todi S, Bhattacharya M. Glycemic variability and outcome in critically ill. Indian J Crit Care Med. 2014;18:285–90 pmid:24914256
- 15. Saeed M, Villarroel M, Reisner AT, Clifford G, Lehman LW, Moody G, et al. Multiparameter Intelligent Monitoring in Intensive Care II: a public-access intensive care unit database. Crit Care Med. 2011;39:952–60 pmid:21283005
- 16. Diagnosis and classification of diabetes mellitus. Diabetes Care. 2012;35 Suppl 1:S64–71
- 17. Finfer S, Chittock DR, Su SY, Blair D, Foster D, Dhingra V, et al. Intensive versus conventional glucose control in critically ill patients. N Engl J Med. 2009;360:1283–97 pmid:19318384
- 18. Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22:707–10 pmid:8844239
- 19. van Walraven C, Austin PC, Jennings A, Quan H, Forster AJ. A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data. Med Care. 2009;47:626–33 pmid:19433995
- 20. Schlichting P, Christensen E, Andersen PK, Fauerholdt L, Juhl E, Poulsen H, et al. Prognostic factors in cirrhosis identified by Cox's regression model. Hepatology. 1983;3:889–95 pmid:6354903
- 21. Eslami S, Taherzadeh Z, Schultz MJ, Abu-Hanna A. Glucose variability measures and their effect on mortality: a systematic review. Intensive Care Med. 2011;37:583–93 pmid:21279326
- 22. Yan CL, Huang YB, Chen CY, Huang GS, Yeh MK, Liaw WJ. Hyperglycemia is associated with poor outcomes in surgical critically ill patients receiving parenteral nutrition. Acta Anaesthesiol Taiwan. 2013;51:67–72 pmid:23968657
- 23. Farrokhi F, Smiley D, Umpierrez GE. Glycemic control in non-diabetic critically ill patients. Best Pract Res Clin Endocrinol Metab. 2011;25:813–24 pmid:21925080
- 24. Lheureux O, Preiser JC. Year in review 2013: Critical Care—metabolism. Crit Care. 2014;18:571 pmid:25672544
- 25. Deane AM, Horowitz M. Dysglycaemia in the critically ill—significance and management. Diabetes Obes Metab. 2013;15:792–801 pmid:23368662
- 26. Farrokhi F, Chandra P, Smiley D, Pasquel FJ, Peng L, Newton CA, et al. Glucose variability is an independent predictor of mortality in hospitalized patients treated with total parenteral nutrition. Endocr Pract. 2014;20:41–5 pmid:24013986
- 27. Pisarchik AN, Pochepen ON, Pisarchyk LA. Increasing blood glucose variability is a precursor of sepsis and mortality in burned patients. PLoS One. 2012;7:e46582 pmid:23056354
- 28. Lipska KJ, Venkitachalam L, Gosch K, Kovatchev B, Van den Berghe G, Meyfroidt G, et al. Glucose variability and mortality in patients hospitalized with acute myocardial infarction. Circ Cardiovasc Qual Outcomes. 2012;5:550–7 pmid:22693348
- 29. Egi M, Bellomo R, Stachowski E, French CJ, Hart G. Variability of blood glucose concentration and short-term mortality in critically ill patients. Anesthesiology. 2006;105:244–52 pmid:16871057
- 30. Risso A, Mercuri F, Quagliaro L, Damante G, Ceriello A. Intermittent high glucose enhances apoptosis in human umbilical vein endothelial cells in culture. Am J Physiol Endocrinol Metab. 2001;281:E924–30 pmid:11595647
- 31. Sechterberger MK, Bosman RJ, Oudemans-van Straaten HM, Siegelaar SE, Hermanides J, Hoekstra JB, et al. The effect of diabetes mellitus on the association between measures of glycaemic control and ICU mortality: a retrospective cohort study. Crit Care. 2013;17:R52 pmid:23510051
- 32. Siegelaar SE, Hoekstra JB, DeVries JH. Special considerations for the diabetic patient in the ICU; targets for treatment and risks of hypoglycaemia. Best Pract Res Clin Endocrinol Metab. 2011;25:825–34 pmid:21925081
- 33. Falciglia M, Freyberg RW, Almenoff PL, D'Alessio DA, Render ML. Hyperglycemia-related mortality in critically ill patients varies with admission diagnosis. Crit Care Med. 2009;37:3001–9 pmid:19661802
- 34. Metnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, et al. SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med. 2005;31:1336–44 pmid:16132893