Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The delta neutrophil index is a prognostic factor for postoperative mortality in patients with sepsis caused by peritonitis

  • Jong Wan Kim,

    Roles Writing – original draft, Writing – review & editing

    Affiliation Department of Surgery, Dongtan Sacred Heart Hospital, Hallym University, College of Medicine, Seoul, Korea

  • Jun Ho Park ,

    Roles Writing – original draft, Writing – review & editing

    zooono@hally.or.kr

    Affiliation Department of Surgery, Kangdong Sacred Heart Hospital, Hallym University College of Medicine, Seoul, Korea

  • Doo Jin Kim,

    Roles Data curation

    Affiliation Department of Surgery, Kangdong Sacred Heart Hospital, Hallym University College of Medicine, Seoul, Korea

  • Won Hyuk Choi,

    Roles Data curation

    Affiliation Department of Surgery, Kangdong Sacred Heart Hospital, Hallym University College of Medicine, Seoul, Korea

  • Jin Cheol Cheong,

    Roles Data curation

    Affiliation Department of Surgery, Kangdong Sacred Heart Hospital, Hallym University College of Medicine, Seoul, Korea

  • Jeong Yeon Kim

    Roles Data curation

    Affiliation Department of Surgery, Dongtan Sacred Heart Hospital, Hallym University, College of Medicine, Seoul, Korea

Abstract

Introduction

The delta neutrophil index (DNI) represents the fraction of circulating immature granulocytes and is a marker of infection and sepsis. Our objective was to evaluate the usefulness of DNI for predicting in-hospital mortality within 30 days after surgery in patients with sepsis caused by peritonitis by means of comparing DNI, white blood cell (WBC) count, neutrophil percentage, and C-reactive protein (CRP) before and after surgery.

Materials and methods

We performed a retrospective analysis of demographic, clinical, and laboratory data. DNI, WBC count, neutrophil percentage, and CRP were measured before surgery, and at 12–36 h (day 1) and 60–84 h (day 3) after surgery.

Results

There were 116 (73.7%) survivors and 44 (26.3%) non-survivors. The rates of septic shock, norepinephrine administration, renal replacement, mechanical ventilator therapy, and reoperation, the Simplified Acute Physiology Score-3 (SAPS3), and the Sepsis-related Organ Failure Assessment (SOFA) score were greater in non-survivors. DNI on day 3 was better than the other laboratory variables for predicting mortality. DNI was correlated with the SAPS3 (r = .46, p = .00) and SOFA score (r = .45, p = .00). The optimal cut-off DNI for predicting mortality was 7.8% (sensitivity: 77.3%; specificity: 95.9%). In receiver-operating characteristic curve analysis, DNI on day 3 was the best indicator of mortality (area under the curve: .880; 95% confidence interval: .80–.96).

Conclusions

Our results indicate that DNI is better than other laboratory variables for predicting postoperative mortality in patients with sepsis caused by peritonitis. DNI > 7.8% on day 3 was a reliable predictor of postoperative mortality.

Introduction

Sepsis is one of the most common causes of death following surgery. Despite recent advances in antibiotics and general critical care practices, the mortality rate due to severe sepsis and septic shock is increasing worldwide.[13] Surgical site infection is a particularly serious problem that can delay recovery after surgery, increase hospital stay, and increase medical expenditure. The mortality rate due to sepsis was reported to range from 20% to 30%, and early recognition and risk stratification are necessary to improve the outcomes of patients with sepsis[4, 5].

Many investigators have searched for reliable biomarkers to aid the diagnosis and management of sepsis. The two most frequently used biomarkers are C-reactive protein (CRP) and procalcitonin, although they have limited value as diagnostic and prognostic markers.[6] To date, no single biologic marker has been shown to reliably identify patients who are at risk of developing severe sepsis or septic shock.[7, 8] Several clinical scores have been developed to assess disease severity and predict the outcome of sepsis that included the Acute Physiology and Chronic Health Evaluation (APACHE) score, Sequential Organ Failure Assessment (SOFA) score, and Simplified Acute Physiology Score (SAPS).

During infection, immature neutrophils enter the circulation. This “left-shift” response to infection is defined as an elevated ratio of immature granulocytes to total granulocytes.[9] Although it can be a useful marker of infection in clinical practice, modern automated cell analyzers can provide information on leukocyte differentials based on the nuclear lobularity of white blood cells (WBC) and the cytochemical myeloperoxidase (MPO) reaction.[10, 11] The delta neutrophil index (DNI), calculated as the difference between the leukocyte differential in the MPO channel and the leukocyte differential in the nuclear lobularity channel, was significantly associated with disseminated intravascular coagulation scores, the positive blood culture rate, and the mortality rate in patients with suspected sepsis.[10] Moreover, some studies have reported that the DNI is a more useful marker than the WBC count and CRP for predicting mortality in patients with sepsis.[1214] However, these studies mostly comprised patients who underwent nonsurgical treatment.

Therefore, the aim of this study was to evaluate the usefulness of DNI for predicting postoperative mortality in patients with sepsis caused by peritonitis by means of comparing the DNI, WBC count, neutrophil percentage, and CRP before and after surgery.

Materials and methods

Patients and characteristics

This retrospective, observational study was performed at Kangdong Sacred Heart Hospital and Dongtan Sacred Heart Hospital, which are 600-bed teaching hospitals in Seoul, Korea. This study was approved by the institutional review board at Kangdong Sacred Heart Hospital (Ref. 2016-10-022-001). All data were fully anonymized before access and IRB waived the requirement for informed consent.

Patients who underwent surgery to treat sepsis caused by peritonitis between July 2011 and May 2016 were included in this study. Sepsis was defined according to the new consensus with diagnosis based on the combination of infection and SOFA score ≥ 2 points. Septic shock can be identified with a clinical construct of sepsis with persisting hypotension requiring vasopressors to maintain MAP ≥65 mm Hg and having a serum lactate level >2 mmol/L (18 mg/dL) despite adequate volume resuscitation.[9] Patients aged < 18 years, pregnant women, patients with hematologic abnormalities, and patients who received granulocyte colony stimulating factors, glucocorticoid, or other immunosuppressants were excluded from the study.

This study included a total of 160 patients, of whom 95 were recruited from the Kangdong Sacred Heart Hospital and 65 from the Dongtan Sacred Heart Hospital; their clinical characteristics are listed in Table 1. There were 116 (72.5%) survivors and 44 (27.5%) non-survivors. The rates of septic shock, norepinephrine administration, reoperation, renal replacement and mechanical ventilator therapy, and the ASA classification, SAPS3, and SOFA score were greater in non-survivors than in survivors.

thumbnail
Table 1. Clinical characteristics of survivors and non-survivors.

https://doi.org/10.1371/journal.pone.0182325.t001

Data collection

Patient data, including age, gender, diagnosis, operation time, transfusion, blood culture results, presence of septic shock, and hospital mortality were retrieved from medical records. In-hospital mortality was defined as death within 30 days of surgery for sepsis. We also retrieved data regarding reoperation, mechanical ventilation, and renal replacement therapy. The SAPS3[15] and SOFA score [11] were calculated to measure the severity of sepsis. The American Society of Anesthesiologists Physical Status classification system (ASA classification)[16] was recorded by the attending anesthesiologist.

DNI and laboratory tests

Laboratory tests, which included DNI, WBC count, neutrophil percentage, and CRP, were measured within 12 h before surgery (day 0), at 12–36 h after surgery (day 1), and 60–84 h after surgery (day 3). DNI is routinely recorded in the complete blood count tests at our institution. DNI was determined using an automatic cell analyzer (ADIVA 2120 Hematology System; Siemens Healthcare Diagnostics, Forchheim, Germany). After red blood cell lysis, the cell size and stain intensity were measured using the tungsten-halogen-based optical system of the MPO channel to count and differentiate granulocytes, lymphocytes, and monocytes based on their size and MPO content. This was followed by cell counting and classification according to size, lobularity, and nuclear density, using the laser diode-based optical system of the lobularity nuclear density channel. The DNI was calculated as the neutrophil and the eosinophil subfraction measured in the MPO channel minus the polymorphonuclear neutrophil (PMN) subfraction measured in the nuclear lobularity channel, as previously described.[10]

Statistical analysis

Statistical analyses were performed using SPSS 19.0 (IBM Corp., Armonk, NY, USA). Continuous variables are presented as the median (interquartile range) and categorical variables as the absolute number and percentage. As the normality test, a skewness and kurtosis test was used. Between-group comparisons were made using χ2 tests for categorical variables and independent-samples t tests for continuous variables. We used binary logistic regression analysis to assess the mortality rate according to the WBC count, neutrophil percentage, CRP, and DNI. The correlation between the DNI and clinical severity scores was tested using Pearson’s correlation analysis. The strength of the correlation was described using the guide that Evans suggests for absolute value of r. [17] Receiver-operating characteristic (ROC) curves were plotted and the Youden Index method was used to determine the optimal cut-off values for DNI, WBC count, neutrophil percentage, and CRP for predicting mortality. The area under the curve (AUC) was calculated to compare the performance of each marker for predicting mortality. In all analyses, a p-value of < .05 was considered statistically significant.

Results

Comparison of DNI and other laboratory markers between survivors and non-survivors

The WBC count and neutrophil percentage on days 0 and 1 tended to be lower in non-survivors than in survivors, but the differences were not statistically significant. On day 3, there were statistically significant differences in the WBC count, neutrophil percentage, and CRP between the two groups(S1 Table). The DNI was significantly greater in non-survivors than in non-survivors before surgery and on days 1 and 3 after surgery (Fig 1). Logistic regression analysis was performed using data collected on day 3 when there were statistically significant differences in the WBC count, neutrophil percentage, CRP, and DNI. In this analysis, DNI was associated with postoperative mortality, with an odds ratio of 1.286 (p < .01) (Table 2).

thumbnail
Fig 1. Comparison of changes in WBC count, neutrophil percentage, CRP, and DNI between the survivors and non-survivors.

CRP, C-reactive protein; DNI, delta neutrophil index; WBC, white blood cell. *p < .05 vs. survivors.

https://doi.org/10.1371/journal.pone.0182325.g001

thumbnail
Table 2. Logistic regression analysis of laboratory variables on postoperative day 3 for predicting postoperative mortality.

https://doi.org/10.1371/journal.pone.0182325.t002

Relationship between DNI and clinical severity scores

DNI was positively correlated with the SAPS3 (r = .46, p < .001, 95% confidence interval [CI]: 280–.524) and SOFA score (r = .45, p < .001, 95% confidence interval [CI]: 273 –.531) (Fig 2). The r values of DNI and clinical severity scores (SAPS3, SOFA score) were 0.45 and 0.46, which could be interpreted as positive moderate correlations.

thumbnail
Fig 2. Correlation between clinical severity scores and the DNI on day 3 (60–84 h) after surgery.

DNI, Delta neutrophil index; SAPS3, Simplified Acute Physiology Score-3; SOFA, Sepsis-related Organ Failure Assessment.

https://doi.org/10.1371/journal.pone.0182325.g002

Performance of DNI and other laboratory markers for predicting mortality

To obtain the optimal DNI cut-off value to predict mortality, we performed ROC curve analysis and calculated the AUC. As shown in Fig 3, the ROC curves revealed that the DNI on day 3 showed better performance for predicting mortality than did the WBC count, neutrophil percentage, and CRP, with an AUC of .88 (95% confidence interval [CI]: .804–.957). The AUCs for SAPS3 and SOFA score were both .85. When the DNI was analyzed for each measurement time individually, the AUCs were .65, .71, and .88 for the DNI on days 0, 1, and 3, respectively. The optimal cut-off DNI for predicting mortality was 7.8%, with a sensitivity of 77.3% and specificity of 95.9% (Table 3).

thumbnail
Fig 3. Receiver-operating characteristic curves for differentiating between survivors and non-survivors.

CRP, C-reactive protein; DNI, delta neutrophil index; SAPS3, Simplified Acute Physiology Score-3; SOFA, Sepsis-related Organ Failure Assessment; WBC, white blood cell.

https://doi.org/10.1371/journal.pone.0182325.g003

thumbnail
Table 3. Performance of laboratory markers for differentiating between survivors and non-survivors determined by receiver characteristic curve analysis.

https://doi.org/10.1371/journal.pone.0182325.t003

Discussion

Sepsis is a leading cause of death in critically ill patients and its prevalence is increasing globally every year.[1820] Early detection and early treatment of sepsis are essential to improve the patient’s outcome. Biomarkers such as CRP, procalcitonin, and various cytokines are elevated in sepsis. Therefore, these biomarkers are sometimes used as prognostic and diagnostic markers in patients with sepsis. There is a need to find more suitable and specific biomarkers for sepsis. The DNI is a known marker of infection, but many studies are still under way to evaluate its clinical usefulness in sepsis. Our data suggest that DNI measured at 60–84 h after surgical treatment of sepsis caused by peritonitis is a predictor of postoperative mortality.

The reported mortality rate in patients with sepsis caused by peritonitis ranges from 30%–50%,[21, 22] which is similar to the results in our study of a carefully selected cohort of patients. We also found that the rates of septic shock, norepinephrine administration, renal replacement, and mechanical ventilator therapy, and the ASA score, SAPS3, and SOFA score were greater in non-survivors than in survivors. These results are consistent with those of prior studies of sepsis.[12, 23] It is also intriguing that the AUCs for the SAPS3 and SOFA score (both .86) were similar to the AUC for the DNI (.88). Despite these similarities, the SAPS3 and SOFA score are calculated using distinct, complicated formulas. In our study, the optimal cut-off DNI for predicting mortality was 7.8%. Similarly, a previous study by Kim et al[13] reported that the optimal cut-off DNI for predicting mortality was 7.6% in patients with gram negative bacteremia. Meanwhile, Park et al[12] reported that a DNI > 6.5% was a good predictor of severe sepsis and septic shock within 24 h of admission to an intensive care unit. However, neither of those studies involved surgical patients. In this study, we retrieved the DNI, WBC count, neutrophil percentage, and CRP data from the medical records of patients who underwent surgery for peritonitis. These factors were measured before surgery and daily after surgery. On postsurgical day 3 (60–84 h), the WBC count, neutrophil percentage, and CRP were statistically significant predictors of mortality. For the DNI, the values on each measurement day were significant predictors of mortality, and the predictive value was greatest on day 3. Kim et al[13] reported that, in patients with gram negative bacteremia, the risk of early mortality was greatest in patients whose DNI remained higher than the initial value until 3 days after the onset of bacteremia. Lee et al[24] reported that a cut-off DNI of 2% at 72 h after the onset of neonatal sepsis was associated with the 7-day mortality rate. However, these studies involved nonsurgical treatment. Olivier et al[25] previously reported that the accuracy of CRP and procalcitonin as a predictor was greatest on postoperative day 4 in patients with colorectal cancer. Similar to that study, we reported that the DNI on postoperative day 3 was the best predictor of mortality in patients with sepsis caused by peritonitis. These results suggest that the DNI on postoperative day 3 accurately reflects the effect of surgical treatment on the progression of sepsis and patients who maintain a high DNI until 3 days after surgery have a poor prognosis; therefore, DNI on day 3 could be an alarm to check patients’ status once more and to consider other treatment strategies. In this study, we examined the correlation between DNI and postoperative mortality in patients with peritonitis-induced sepsis at different time points following surgery for the first time. Using DNI for postsurgery patients represents a novel approach because several previous studies focused on comparing changes in CRP and procalcitonin levels in nonsurgical patients at different time points. This study also demonstrated the correlation with clinical scores such as SOFA and SAPS 3, which measure the severity of illness and the outcome of sepsis.

Our study had several limitations. In particular, this was a retrospective review of medical records. For this reason, we could only evaluate data for the WBC count, neutrophil percentage, and CRP, which are routinely measured at our hospitals, whereas other biological markers, such as procalcitonin, lactic acid, and Disseminated Intravascular Coagulopathy score are not routinely assessed and could not be analyzed in this study. Because the blood samples for laboratory testing are routinely obtained from patients at around 7 a.m. at our hospitals, the blood samples taken on days 0, 1, and 3 were collected < 12 h before surgery, 12–36 h after surgery, and 60–84 h after surgery. The wide time intervals inevitably led to large gaps between the measurements. There are two limitations regarding statistics. First, the laboratory variables for predicting postoperative mortality were analyzed by the logistic regression instead of the binominal regression in Table 2. It may have affected the result according to the prevalence of the event. However, these laboratory variables for predicting mortality were also compared by other methods. The second limitation is about the normality test for data. In this study, skewness and kurtosis were used for the normality test. This may be a weak point of this study, but there are several papers arguing that there is no problem in testing for the normality using skewness and kurtosis.[2630] Finally, because of the small sample size in this study, additional studies with large numbers of patients are needed to validate the clinical usefulness of the DNI as a predictor of postoperative mortality in patients with sepsis caused by peritonitis.

Despite these limitations, our results demonstrate that the DNI is a useful marker for predicting mortality of septic patients who underwent surgical treatment of peritonitis. The DNI is increasingly being performed as a routine laboratory test, along with complete blood count, and does not require any additional time or cost in clinical settings, unlike other biomarkers such as CRP and procalcitonin. The time and cost-saving feature of DNI make it advantageous in this setting. Prospective, multicenter studies with large numbers of patients are needed to validate our findings that the DNI is a promising marker for predicting the prognosis after peritonitis surgery and whether it should be introduced into the clinical guidelines for the surgical management of sepsis.

Conclusion

Our study found that DNI, which reflects the proportions of immature granulocytes in circulating blood, was more accurate than the WBC count, neutrophil percentage, and CRP for predicting mortality of patients undergoing surgical treatment of sepsis caused by peritonitis. In particular, a DNI > 7.8% at 60–84 h after surgery was a strong predictor of postoperative mortality. Therefore, these findings suggest that the DNI may be a useful marker in the management of patients undergoing surgical treatment of sepsis caused by peritonitis.

Supporting information

S1 Table. Comparison of WBC count, neutrophil percentage, CRP, DNI, SAPS3 and SOFA score between the survivors and non-survivors.

https://doi.org/10.1371/journal.pone.0182325.s001

(DOCX)

Acknowledgments

The authors thank Yunmi Kim and Seongman Cha for their valuable support of this research.

References

  1. 1. Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. The New England journal of medicine. 2001;345(19):1368–77. Epub 2002/01/17. pmid:11794169.
  2. 2. Coen D, Cortellaro F, Pasini S, Tombini V, Vaccaro A, Montalbetti L, et al. Towards a less invasive approach to the early goal-directed treatment of septic shock in the ED. The American journal of emergency medicine. 2014;32(6):563–8. Epub 2014/03/29. pmid:24666743.
  3. 3. Jo YH, Kim K, Lee JH, Kang C, Kim T, Park HM, et al. Red cell distribution width is a prognostic factor in severe sepsis and septic shock. The American journal of emergency medicine. 2013;31(3):545–8. Epub 2013/02/06. pmid:23380094.
  4. 4. Dickinson JD, Kollef MH. Early and adequate antibiotic therapy in the treatment of severe sepsis and septic shock. Current infectious disease reports. 2011;13(5):399–405. Epub 2011/08/09. pmid:21822574.
  5. 5. Huttunen R, Aittoniemi J. New concepts in the pathogenesis, diagnosis and treatment of bacteremia and sepsis. The Journal of infection. 2011;63(6):407–19. Epub 2011/08/16. pmid:21840338.
  6. 6. Pierrakos C, Vincent JL. Sepsis biomarkers: a review. Critical care (London, England). 2010;14(1):R15. Epub 2010/02/11. pmid:20144219; PubMed Central PMCID: PMCPMC2875530.
  7. 7. Kofoed K, Andersen O, Kronborg G, Tvede M, Petersen J, Eugen-Olsen J, et al. Use of plasma C-reactive protein, procalcitonin, neutrophils, macrophage migration inhibitory factor, soluble urokinase-type plasminogen activator receptor, and soluble triggering receptor expressed on myeloid cells-1 in combination to diagnose infections: a prospective study. Critical care (London, England). 2007;11(2):R38. Epub 2007/03/17. pmid:17362525; PubMed Central PMCID: PMCPMC2206456.
  8. 8. Shapiro NI, Trzeciak S, Hollander JE, Birkhahn R, Otero R, Osborn TM, et al. A prospective, multicenter derivation of a biomarker panel to assess risk of organ dysfunction, shock, and death in emergency department patients with suspected sepsis. Critical care medicine. 2009;37(1):96–104. Epub 2008/12/04. pmid:19050610.
  9. 9. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315:801–10. pmid:26903338; PubMed Central PMCID: PMC4968574.
  10. 10. Nahm CH, Choi JW, Lee J. Delta neutrophil index in automated immature granulocyte counts for assessing disease severity of patients with sepsis. Annals of clinical and laboratory science. 2008;38(3):241–6. Epub 2008/08/22. pmid:18715852.
  11. 11. Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive care medicine. 1996;22(7):707–10. Epub 1996/07/01. pmid:8844239.
  12. 12. Park BH, Kang YA, Park MS, Jung WJ, Lee SH, Lee SK, et al. Delta neutrophil index as an early marker of disease severity in critically ill patients with sepsis. BMC infectious diseases. 2011;11:299. Epub 2011/11/02. pmid:22040292; PubMed Central PMCID: PMCPMC3213213.
  13. 13. Kim HW, Yoon JH, Jin SJ, Kim SB, Ku NS, Jeong SJ, et al. Delta neutrophil index as a prognostic marker of early mortality in gram negative bacteremia. Infection & chemotherapy. 2014;46(2):94–102. Epub 2014/07/16. pmid:25024871; PubMed Central PMCID: PMCPMC4091368.
  14. 14. Seok Y, Choi JR, Kim J, Kim YK, Lee J, Song J, et al. Delta neutrophil index: a promising diagnostic and prognostic marker for sepsis. Shock (Augusta, Ga). 2012;37(3):242–6. Epub 2012/01/20. pmid:22258230.
  15. 15. Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, et al. SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive care medicine. 2005;31(10):1345–55. Epub 2005/09/01. pmid:16132892; PubMed Central PMCID: PMCPMC1315315.
  16. 16. Keats AS. The ASA classification of physical status—a recapitulation. Anesthesiology. 1978;49(4):233–6. Epub 1978/10/01. pmid:697075.
  17. 17. Evans J.D. Straightforward Statistics for the Behavioral Sciences. Brooks/Cole Publishing; Pacific Grove, Calif.: 1996.
  18. 18. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Critical care medicine. 2001;29(7):1303–10. Epub 2001/07/11. pmid:11445675.
  19. 19. Finfer S, Bellomo R, Lipman J, French C, Dobb G, Myburgh J. Adult-population incidence of severe sepsis in Australian and New Zealand intensive care units. Intensive care medicine. 2004;30(4):589–96. Epub 2004/02/14. pmid:14963646.
  20. 20. Lagu T, Rothberg MB, Shieh MS, Pekow PS, Steingrub JS, Lindenauer PK. Hospitalizations, costs, and outcomes of severe sepsis in the United States 2003 to 2007. Critical care medicine. 2012;40(3):754–61. Epub 2011/10/04. pmid:21963582.
  21. 21. Calandra T, Cohen J. The international sepsis forum consensus conference on definitions of infection in the intensive care unit. Critical care medicine. 2005;33(7):1538–48. Epub 2005/07/09. pmid:16003060.
  22. 22. Crandall M, West MA. Evaluation of the abdomen in the critically ill patient: opening the black box. Current opinion in critical care. 2006;12(4):333–9. Epub 2006/07/01. pmid:16810044.
  23. 23. Pupelis G, Drozdova N, Mukans M, Malbrain ML. Serum procalcitonin is a sensitive marker for septic shock and mortality in secondary peritonitis. Anaesthesiology intensive therapy. 2014;46(4):262–73. Epub 2014/10/09. pmid:25293477.
  24. 24. Lee SM, Eun HS, Namgung R, Park MS, Park KI, Lee C. Usefulness of the delta neutrophil index for assessing neonatal sepsis. Acta paediatrica (Oslo, Norway: 1992). 2013;102(1):e13–6. Epub 2012/11/06. pmid:23121679.
  25. 25. Facy O, Paquette B, Orry D, Binquet C, Masson D, Bouvier A, et al. Diagnostic Accuracy of Inflammatory Markers As Early Predictors of Infection After Elective Colorectal Surgery: Results From the IMACORS Study. Annals of surgery. 2016;263(5):961–6. Epub 2015/07/03. pmid:26135691.
  26. 26. Curran PJ, West SG, Finch JF. The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods. 1996; 1(1):l6~29.
  27. 27. Gao S, Mokhtarian P, Johnston R. Nonnormality of data in structural equation models, Journal of Transportation Research Board. 2008;(2082):116–124.
  28. 28. Mardia KV. Applications of some measures of multivariate skewness and kurtosis in testing normality and robustness studies. The Indian Journal of Statistics. 1974;36(2):115–128.
  29. 29. Royston JP. An extension of Shapiro and Wilk's W test for normality to large samples. Applied Statistics. 1982;31(2):115–124.
  30. 30. West SG, Finch J, Curran P J. Structural equation models with nonnormal variables: Problems and remedies. In: Structural equation modeling: Concepts, issues, and applications. Thousand Oaks, CA; 1995. pp. 56–75.