http://orcid.org/0000-0002-1022-2227
Figures
Abstract
Background
Vital signs, i.e. respiratory rate, oxygen saturation, pulse, blood pressure and temperature, are regarded as an essential part of monitoring hospitalized patients. Changes in vital signs prior to clinical deterioration are well documented and early detection of preventable outcomes is key to timely intervention. Despite their role in clinical practice, how to best monitor and interpret them is still unclear.
Objective
To evaluate the ability of vital sign trends to predict clinical deterioration in patients hospitalized with acute illness.
Study Selection
Studies examining intermittently monitored vital sign trends in acutely ill adult patients on hospital wards and in emergency departments. Outcomes representing clinical deterioration were of interest.
Results
Of 7,366 references screened, only two were eligible for inclusion. Both were retrospective cohort studies without controls. One examined the accuracy of different vital sign trend models using discrete-time survival analysis in 269,999 admissions. One included 44,531 medical admissions examining trend in Vitalpac Early Warning Score weighted vital signs. They stated that vital sign trends increased detection of clinical deterioration. Critical appraisal was performed using evaluation tools. The studies had moderate risk of bias, and a low certainty of evidence. Additionally, four studies examining trends in early warning scores, otherwise eligible for inclusion, were evaluated.
Conclusions
This review illustrates a lack of research in intermittently monitored vital sign trends. The included studies, although heterogeneous and imprecise, indicates an added value of trend analysis. This highlights the need for well-controlled trials to thoroughly assess the research question.
Citation: Brekke IJ, Puntervoll LH, Pedersen PB, Kellett J, Brabrand M (2019) The value of vital sign trends in predicting and monitoring clinical deterioration: A systematic review. PLoS ONE 14(1): e0210875. https://doi.org/10.1371/journal.pone.0210875
Editor: Shane Patman, University of Notre Dame Australia, AUSTRALIA
Received: July 24, 2018; Accepted: January 3, 2019; Published: January 15, 2019
Copyright: © 2019 Brekke et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Protocol for this systematic review is registered in PROSPERO: CRD42017080303 Available from: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42017080303. All other relevant data are within the paper and its Supporting Information files.
Funding: The author received no specific funding for this work.
Competing interests: Dr. John Kellett is a major shareholder, director and chief medical officer of Tapa Healthcare DAC. The authors confirm that this does not alter their adherence to PLOS ONE policies on sharing data and materials.
Introduction
Vital signs, including respiratory rate, oxygen saturation, blood pressure, pulse and temperature, are the simplest, cheapest and probably most important information gathered on hospitalized patients [1]. However, despite being introduced into clinical practice more than a century ago, surprisingly few attempts have been made to quantify their clinical performance [2]. In the last few decades, vital signs have become an area of active research [1] and numerous studies have reported that changes in vital signs occur several hours prior to a serious adverse event [3–7].
Today, vital signs play an important role in emergency departments (ED) and on the wards, to determine patients at risk of deterioration [6–11]. Even though it is accurately predicted by vital sign changes, clinical deterioration often goes unnoticed, or is not detected until it is too late to treat [12–15]. This is mainly caused by inadequate recording of vital signs or as a result of an inappropriate response to abnormal values [1, 14–16]. Among nurses and doctors there is insufficient knowledge and appreciation of vital sign changes and their implications for patient care [17–20]. The importance of monitoring vital signs in clinical practice is indisputable, but how to best monitor and interpret them and how frequently they should be measured is still unclear [21, 22].
This review searched the literature for studies that explicitly tried to determine and quantify the increase or decrease in risk associated with changes of intermittently measured vital signs. We, therefore, confined our search only to those papers that measured vital signs intermittently, and not to those that used continuous monitoring and novel wearable technology
Methods
Objective
The aim of this systematic review was to evaluate the ability of intermittent vital sign trends to predict clinical deterioration in acutely ill patients in hospital.
Protocol and registration
The protocol for this review was registered in PROSPERO: CRD42017080303. Both the protocol and the article are developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines (S1 Appendix) [23, 24].
Eligibility criteria
Inclusion criteria: all studies based on intermittent vital sign trends in acutely ill adult patients on hospital wards and in EDs, including all observational studies and controlled trials assessing prognosis. Trends were defined as the changes between two or more consecutive measurements of vital sign values, with a minimum of 3 hours and a maximum of 24 hours between measurements. Articles in English, Danish, Norwegian or Swedish were included.
Exclusion criteria: case series and case reports, studies on patients with specific conditions or with less than 100 participants, or patients directly admitted to ICU. All studies reporting trends in continuous monitoring were excluded.
Outcomes: in-hospital mortality or mortality up to 30 days after hospital discharge, transfer to ICU, cardiac arrest, calls to a rapid response system, or any other outcome reported that was associated with clinical deterioration.
Information sources
We searched PubMed, Embase, Cochrane Library and CINAHL on October 26th 2017. The databases were searched without time restrictions or filters for language and study design. The search was updated on December 28th 2017, adding the term “trajectory” to the original search (S2 Appendix). PROSPERO was searched for relevant ongoing or recently completed systematic reviews, last on December 18th. All studies assessed in full-text were screened for relevant citing articles using Scopus and Web of Science (S3 Appendix). Experts in the field were contacted to identify additional relevant studies.
Search
The search strategy was developed through a series of preliminary searches using a broad range of relevant keywords and thesauri, including; vital sign, deterioration and trend (S2 Appendix). An information specialist from the Medical Research Library at University of Southern Denmark reviewed the search strategy before the final searches were conducted.
Study selection
Reference handling and duplicate screening was performed using EndNote and Covidence. After removal of duplicates, titles and abstracts were screened independently by two authors (LHP and IJB). Disagreements regarding inclusion were resolved through discussion. In case of continued disagreement, inclusion was decided by a third author.
Eligible studies were read in full length by LHP and IJB and separately assessed against inclusion and exclusion criteria decided by all authors (S4 Appendix). Disagreements were discussed with the other authors, and consensus decided inclusion.
Data collection process
Data from included studies were extracted separately by LHP and IJB using a preformed data extraction sheet. Collection included: study characteristics, settings, demographics, intervention details and outcomes.
Risk of bias in individual studies
Critical appraisal was performed in duplicates by the two reviewers. Neither of the authors were blinded. The Quality in Prognosis Studies (QUIPS) tool for prognostic studies [25] was used to evaluate the included studies. The risk of bias was rated within six domains: study participation, study attrition, prognostic factor measurement, outcome measurement, study confounding and statistical analysis and reporting, assessing the risk of bias as either high, moderate or low.
Risk of bias across studies
The certainty of evidence was evaluated inspired by the Grading of Recommendations Assessment (GRADE) [26]. GRADE is originally designed to evaluate the certainty of evidence in randomized controlled trials. The approach assesses the strength of the body of evidence within five domains: within-study risk of bias (QUIPS), directness, heterogeneity, precision of effect estimates and risk of publication bias. An overall judgement regarding the certainty of the evidence was awarded for each examined outcome, as high, moderate, low or very low. As our study was observational by nature and did not address effect, evidence was not upgraded based on standard criteria. LHP and IJB evaluated the studies independently. Results were compared and discussed with the other authors.
Results
Study selection and characteristics
The final search yielded 7,366 studies after removal of duplicates. However, 7,340 were deemed irrelevant (Fig 1). Twenty-six were read in full-text and another nine were added through other sources: seven through citation tracking [27–33] and two additional studies recommended by experts [34, 35]. Of the thirty-five studies assessed, two were eligible for inclusion. Details of the study selection are presented in Fig 1.
Abbreviation: EWS–early warning score.
We excluded thirty-three studies assessed in full-text. Twenty-five, as they did not fulfil our eligibility criteria; fourteen did not examine trend, seven focused on trends in clinical scoring systems and three incorporated elements of vital sign trends in multi-parameter risk stratification models, but did not present sufficient data to enable analysis. Five studies examined trends in vital signs or EWS in patients with specific conditions and four studies were excluded due to wrong study design. Reasons for exclusion and details are given in S4 Appendix.
We found two cohort studies eligible for inclusion. One including 269,999 medical and surgical admissions in five hospitals in Illinois, by Churpek et al. [36] and one including 44,531 medical admissions to a Canadian regional hospital, by Kellett et al. [37]. Both were retrospective analyses of vital signs collected in electronic medical records that included: respiratory rate, heart rate, systolic and diastolic blood pressure, temperature and oxygen saturation.
Churpek et al. aimed to compare the accuracy of different methods of modelling vital sign trends for detecting clinical deterioration on the wards using discrete-time survival analysis. Six different trend models were tested against the predictive value of current vital signs alone (Table 1). Transfers to intensive care unit (ICU), cardiac arrests and deaths on the ward were analysed as a composite outcome. Vital signs were averaged for each four-hour time block, and the variables at the beginning on each interval used to predict risk of deterioration during that time block.
Kellett et al. aimed to assess whether changes in vital signs would enable detection of in-hospital mortality. They assigned a weighted Vitalpac Early Warning Score (ViEWS) to each vital sign and averaged the score for each twenty-four hour period of admission. Change in mean score between the first five and the last five days of admission were then compared for survivors and non-survivors. Further study characteristics are given in Table 1.
Risk of bias within included studies
None of the studies accounted for loss to follow-up and no clear assessment of confounders were stated. Statistical analyses varied substantially and the overall risk of bias was rated as moderate for both studies, S5 Appendix.
Risk of bias across studies
As both studies are observational, the certainty of the evidence was regarded as low. With only one article per outcome, inconsistency was not evaluated. We found no serious indirectness in the studies and publication bias was not suspected. Therefore, Churpek et al. received an overall low rating, while Kellett et al. was downgraded to very low, due to serious imprecision. See S5 Appendix for full description.
Results of individual studies
Churpek et al. performed univariate analysis of the different trend models and the current value, followed by bivariate analysis combining the trend models with the current value. Through univariate analysis, they found respiratory rate to be the best predictor of deterioration when using the current value, AUC 0.70 (95% CI 0.70–0.70). Standard deviation of respiratory rate was found to be more accurate than the current value (AUC 0.71 (95% CI 0.71–0.71)). Bivariate analyses increased accuracy for all vital signs compared to the current value alone, but the optimal method varied for the different vital signs. The model including the current respiratory rate and the maximum rate prior to current was the most the accurate predictor (AUC 0.73). When averaging the change in accuracy for all vital signs, vital sign slope resulted in the greatest increase (AUC improvement 0.013), while the change from previous value resulted in an average decrease of model accuracy (AUC -0.002).
Analysing trajectories in ViEWS weighted vital signs for the first five and the last five days of admission, Kellett et al. found that the score for respiratory rate increased the most in non-survivors (0.92 (SD 1.22)–1.46 (SD 1.34)) and decreased the most in survivors (0.24 (SD 0.71)–0.10 (SD 0.49)). Combining respiratory rate with other vital signs was not more accurately associated with in-hospital mortality. Due to large standard deviations, none of the vital sign trends were statistically significant.
The heterogeneity between the two studies was high. Apart from methodology and outcomes, the cohorts differed in several ways: Churpek et al. looked at both medical and surgical ward patients, with an unspecified number of elective surgical patients. Average age was 60 years and in-hospital mortality was 1.0%. Kellett et al. looked at medical admissions, with an average age of 67.5 years and an in-hospital mortality of 4.6%, Table 1.
The literature search also identified seven studies on trends in EWS. The results of four studies, otherwise eligible for inclusion, were evaluated and summarized in Table 2. The remaining three studies were based on data from the same cohort as Kellett et al [37].
Discussion
This systematic review looked at trends in intermittently monitored vital signs and identified two studies eligible for inclusion. Both examined intermittent vital sign trends as an independent predictor of clinical deterioration. Although largely heterogeneous, with a low certainty of evidence, they suggested trends to be associated with deterioration.
Churpek et al. found respiratory rate to be the most accurate predictor, both for current value and when adding trend models. The most accurate model varied between the vital signs. Although trend statistically increased model accuracy for all vital signs, the improvements were considered minor. Kellett et al. suggested a correlation between increasing ViEWS weighted vital signs and in-hospital mortality. Similarly to Churpek et al., they found respiratory rate to be best associated with outcome, with the largest increase in score for non-survivors and decrease for survivors. However, due to large standard deviations, their findings were not statistically significant.
In essence, both studies suggest that more precise prognostic information can be obtained from changes in vital signs if they undergo manipulation. Kellett et al suggested that the values should be weighted, and Churpek et al found that the difference from the current and previous value was less valuable than the vital sign slope, vital sign variability, and the most deranged values since admission. Their findings also illustrates the lack of consensus in what constitutes trends, and how to best interpret them.
Considering vital signs central role in daily clinical practice, their results, although only suggestive, should be of interest to clinicians caring for patients on wards or in EDs. A lot of effort is going into developing continuous monitoring on the assumption that the trends it will reveal will be clinically valuable and superior to intermittent monitoring [41]. Although considering the technology promising, three recent systematic reviews did not find sufficient evidence in to support the implementation of routinely continuous monitoring of vital signs in general wards [42–44]. Results of this systematic review suggest that combining the widespread use of electronic healthcare systems to record intermittently monitored vital signs with trend analysis could improve the prediction of deterioration prior to a serious adverse event and help direct limited resources towards the patients at risk.
As illustrated by this review, there is an apparent lack of high quality evidence regarding trends in intermittently monitored vital signs. The studies included are retrospective analyses of pre-existing cohorts, without control groups, and with complete heterogeneity. Thus, they have a low (or very low) certainty of evidence. Interestingly, both studies found respiratory rate to be best associated with clinical course, a standpoint receiving a growing support [1, 44, 45]. Currently, there is no reliable and convenient way to evaluate respiratory rate, but recent technological advances will soon enable automated monitoring of respiratory rate [2, 44], and can prove to be a major advance in monitoring. Ultimately, both trends in vital signs in general and respiratory rate in particular, should be subjected to evaluation through well-controlled prospective multicentre cohort studies.
Several studies examining trajectories of intermittently monitored vital signs were not eligible for inclusion (S4 Appendix). These consisted of; risk stratification models with elements of vital sign trends, trends in EWS and in patients with specific conditions, including; cardiac arrest [46], advanced stage of cancer [34], acute respiratory condition [47], repeated emergency team activations [48] and normotensive ED patients [31]. Although not subject for inclusion, they are mentioned to give an account of the total number of studies on vital sign trends identified by the review.
Likewise, studies on trends in EWS, otherwise meeting the inclusion criteria, are listed in Table 2, in order to make the review more informative. They illustrate a potential correlation between trends and clinical deterioration. As observational studies with small sample sizes and low number of events, their findings should be interpreted with caution. They were all evaluated to have a moderate risk of bias and a very low certainty of evidence.
However, there are multiple limitations to such risk stratification models. In a recent article, Baker & Gerdin [49] discussed the clinical usefulness of the large number of prediction models developed for use in critical care. They emphasised the current focus on trying to optimise the precision of these models, rather than testing the performance of the models to real-world interventions and their impact on outcomes. Similarly, Pedersen et al. [10] highlighted the need to evaluate the endpoints currently used to validate these predictive models (e.g. ICU-transfer, cardiac arrest and in-hospital mortality). They argued for the importance of developing systems that specifically can identify patients who are salvageable, if provided with optimal treatment and care.
Disappointingly, only two studies were found eligible for inclusion in this review of intermittently monitored vital sign trends. Still, the fact that there is little or no high quality evidence supporting trends in vital signs and the myriads of scoring systems developed to the means of predicting clinical deterioration, should be an essential contribution to evidence based practice.
Strengths
The search strategy was developed for a high sensitivity, with the aim of identifying all studies examining trend, without filtering for time or language. An information specialist reviewed the search strategy before the final searches were conducted. Only studies examining continuous monitoring were excluded on time criteria, in the abstract screening. Hence, changing the minimum time to 1 hour would not yield any further eligible studies. Reference tracking and outreach to relevant experts did not identify any other eligible studies that were not identified by the original search.
Limitations
This review only descriptively analysed the eligible studies identified and did not quantify data or perform a meta-analysis. Due to the wide applicability of the search terms “vital signs” and “trend”, only a small number of the articles were deemed relevant and assessed in full text. To reflect the clinical ward setting, the protocol for the review narrowed the inclusion criteria to studies analysing trends with a minimum of 3 hours and a maximum of 24 hours between measurements [21, 22]. The evidence supporting measurement frequency is limited at best, and as a result, no studies were excluded on this criterion alone during abstract screening. Apart from reference tracking and expert outreach, attempts to pursue grey literature were not made.
Conclusions
The two eligible studies identified suggest that trend analysis of intermittent vital signs would increase the accuracy for detection of clinical deterioration on general wards and in EDs. However, the external validity of these findings is challenging to test–and there is a need to shift the focus towards clinical feasibility. Furthermore, the results of this review show there is no consensus on how to best analyse trends. Given that trend-models are externally validated through well-controlled prospective multicentre cohort studies, authors of this review, consider them promising and welcome as a valuable addition to clinical decision support.
Acknowledgments
We would like to thank the information specialists at the Medical Research Library at University of Southern Denmark for help with the search strategy, Dr. Daanyaal Wasim for his suggestions during revision and the experts that responded to our request for additional literature.
References
- 1. Kellett J, Sebat F. Make vital signs great again–A call for action. Eur J Intern Med. 2017;45(Supplement C):13–9. https://doi.org/10.1016/j.ejim.2017.09.018.
- 2.
Kellett J. The Assessment and Interpretation of Vital Signs. In: DeVita MA, Hillman K, Bellomo R, Odell M, Jones DA, Winters BD, et al., editors. Textbook of Rapid Response Systems: Concept and Implementation. Cham: Springer International Publishing; 2017. p. 63–85.
- 3. Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K. A comparison of Antecedents to Cardiac Arrests, Deaths and EMergency Intensive care Admissions in Australia and New Zealand, and the United Kingdom—the ACADEMIA study. Resuscitation. 2004;62(3):275–82. https://doi.org/10.1016/j.resuscitation.2004.05.016. pmid:15325446
- 4. Buist M, Bernard S, Nguyen TV, Moore G, Anderson J. Association between clinically abnormal observations and subsequent in-hospital mortality: a prospective study. Resuscitation. 2004;62(2):137–41. https://doi.org/10.1016/j.resuscitation.2004.03.005. pmid:15294398
- 5. Hillman KM, Bristow PJ, Chey T, Daffurn K, Jacques T, Norman SL, et al. Antecedents to hospital deaths. Intern Med J. 2001;31(6):343–8. pmid:11529588
- 6. Henriksen DP, Brabrand M, Lassen AT. Prognosis and risk factors for deterioration in patients admitted to a medical emergency department. PLoS One. 2014;9(4):e94649. Epub 2014/04/11. pmid:24718637.
- 7. Barfod C, Lauritzen MMP, Danker JK, Sölétormos G, Forberg JL, Berlac PA, et al. Abnormal vital signs are strong predictors for intensive care unit admission and in-hospital mortality in adults triaged in the emergency department—a prospective cohort study. Scand J Trauma Resusc Emerg Med. 2012;20(1):28. pmid:22490208
- 8. Ljunggren M, Castren M, Nordberg M, Kurland L. The association between vital signs and mortality in a retrospective cohort study of an unselected emergency department population. Scand J Trauma Resusc Emerg Med. 2016;24:21. pmid:26940235.
- 9. Farrohknia N, Castrén M, Ehrenberg A, Lind L, Oredsson S, Jonsson H, et al. Emergency Department Triage Scales and Their Components: A Systematic Review of the Scientific Evidence. Scand J Trauma Resusc Emerg Med. 2011;19(1):42. pmid:21718476
- 10. Pedersen NE, Oestergaard D, Lippert A. End points for validating early warning scores in the context of rapid response systems: a Delphi consensus study. Acta Anaesthesiol Scand. 2016;60(5):616–22. pmid:26708159
- 11. Cardona-Morrell M, Prgomet M, Lake R, Nicholson M, Harrison R, Long J, et al. Vital signs monitoring and nurse–patient interaction: A qualitative observational study of hospital practice. Int J Nurs Stud. 2016;56(Supplement C):9–16. https://doi.org/10.1016/j.ijnurstu.2015.12.007.
- 12. Franklin C, Mathew J. Developing strategies to prevent inhospital cardiac arrest: analyzing responses of physicians and nurses in the hours before the event. Crit Care Med. 1994;22(2):244–7. Epub 1994/02/01. pmid:8306682.
- 13. Sankey CB, McAvay G, Siner JM, Barsky CL, Chaudhry SI. "Deterioration to Door Time": An Exploratory Analysis of Delays in Escalation of Care for Hospitalized Patients. J Gen Intern Med. 2016;31(8):895–900. Epub 2016/03/13. pmid:26969311
- 14. Smith LB, Banner L, Lozano D, Olney CM, Friedman B. Connected care: reducing errors through automated vital signs data upload. Comput Inform Nurs. 2009;27(5):318–23. Epub 2009/09/04. pmid:19726926.
- 15. Leuvan CH, Mitchell I. Missed opportunities? An observational study of vital sign measurements. Crit Care Resusc. 2008;10(2):111–15. Epub 2008/06/05. pmid:18522524.
- 16. Schmidt PE, Meredith P, Prytherch DR, Watson D, Watson V, Killen RM, et al. Impact of introducing an electronic physiological surveillance system on hospital mortality. BMJ quality & safety. 2015;24(1):10–20. Epub 2014/09/25. pmid:25249636.
- 17. Chua WL, Mackey S, Ng EKC, Liaw SY. Front line nurses’ experiences with deteriorating ward patients: a qualitative study. Int Nurs Rev. 2013;60(4):501–9. pmid:24131252
- 18. Hogan J. Why don’t nurses monitor the respiratory rates of patients? Br J Nurs. 2006;15(9):489–92. Epub 2006/05/26. pmid:16723921.
- 19. Wheatley I. The nursing practice of taking level 1 patient observations. Intensive Crit Care Nurs. 2006;22(2):115–21. https://doi.org/10.1016/j.iccn.2005.08.003. pmid:16274994
- 20. Smith GB, Poplett N. Knowledge of aspects of acute care in trainee doctors. Postgrad Med J. 2002;78(920):335–8. pmid:12151686
- 21. Smith GB, Recio-Saucedo A, Griffiths P. The measurement frequency and completeness of vital signs in general hospital wards: An evidence free zone? Int J Nurs Stud. 2017;74:A1–A4. https://doi.org/10.1016/j.ijnurstu.2017.07.001. pmid:28701265
- 22. Yoder JC, Yuen TC, Churpek MM, Arora VM, Edelson DP. A prospective study of nighttime vital sign monitoring frequency and risk of clinical deterioration. JAMA Internal Medicine. 2013;173(16):1554–5. pmid:23817602
- 23. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews. 2015;4(1):1. pmid:25554246
- 24. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339. pmid:19622551
- 25. Hayden JA, Côté P, Bombardier C. Evaluation of the quality of prognosis studies in systematic reviews. Ann Intern Med. 2006;144(6):427–37. pmid:16549855
- 26. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6. pmid:18436948
- 27. Kellett J, Rasool S. The prediction of the in-hospital mortality of acutely ill medical patients by electrocardiogram (ECG) dispersion mapping compared with established risk factors and predictive scores—a pilot study. Eur J Intern Med. 2011;22(4):394–8. Epub 2011/07/20. pmid:21767758.
- 28. Kellett J, Woodworth S, Wang F, Huang W. Changes and their prognostic implications in the abbreviated Vitalpac early warning score (ViEWS) after admission to hospital of 18,853 acutely ill medical patients. Resuscitation. 2013;84(1):13–20. https://doi.org/10.1016/j.resuscitation.2012.08.331. pmid:22955051
- 29. Kellett J, Wang F, Woodworth S, Huang W. Changes and their prognostic implications in the abbreviated VitalPAC Early Warning Score (ViEWS) after admission to hospital of 18,827 surgical patients. Resuscitation. 2013;84(4):471–6. Epub 2012/12/12. pmid:23228559.
- 30.
Mao Y, Chen Y, Hackmann G, Chen M, Lu C, Kollef M, et al., editors. Medical Data Mining for Early Deterioration Warning in General Hospital Wards. 2011 IEEE 11th International Conference on Data Mining Workshops; 2011 11–11 Dec. 2011.
- 31. Puskarich MA, Nandi U, Long BG, Jones AE. Association between persistent tachycardia and tachypnea and in-hospital mortality among non-hypotensive emergency department patients admitted to the hospital. Clinical and experimental emergency medicine. 2017;4(1):2–9. Epub 2017/04/25. pmid:28435896
- 32. Quarterman CP, Thomas AN, McKenna M, McNamee R. Use of a patient information system to audit the introduction of modified early warning scoring. J Eval Clin Pract. 2005;11(2):133–8. Epub 2005/04/09. pmid:15813711.
- 33. Wong J, Taljaard M, Forster AJ, van Walraven C. Does adding risk-trends to survival models improve in-hospital mortality predictions? A cohort study. BMC Health Serv Res. 2011;11(1):171. pmid:21777460
- 34. Bruera S, Chisholm G, Santos RD, Crovador C, Bruera E, Hui D. Variations in Vital Signs in the Last Days of Life in Patients With Advanced Cancer. J Pain Symptom Manage. 2014;48(4):510–7. https://doi.org/10.1016/j.jpainsymman.2013.10.019. pmid:24731412
- 35. Goldstein BA, Chang TI, Winkelmayer WC. Classifying individuals based on a densely captured sequence of vital signs: An example using repeated blood pressure measurements during hemodialysis treatment. J Biomed Inform. 2015;57(Supplement C):219–24. https://doi.org/10.1016/j.jbi.2015.08.010.
- 36. Churpek MM, Adhikari R, Edelson DP. The value of vital sign trends for detecting clinical deterioration on the wards. Resuscitation. 2016;102:1–5. Epub 2016/02/24. pmid:26898412.
- 37. Kellett J, Murray A, Woodworth S, Huang W. Trends in weighted vital signs and the clinical course of 44,531 acutely ill medical patients while in hospital. Acute Med. 2015;14(1):3–9. Epub 2015/03/07. pmid:25745643.
- 38. Groarke JD, Gallagher J, Stack J, Aftab A, Dwyer C, McGovern R, et al. Use of an admission early warning score to predict patient morbidity and mortality and treatment success. Emerg Med J. 2008;25(12):803–6. pmid:19033494.
- 39. Kellett J, Emmanuel A, Deane B. Who will be sicker in the morning? Changes in the Simple Clinical Score the day after admission and the subsequent outcomes of acutely ill unselected medical patients. Eur J Intern Med. 2011;22(4):375–81. https://doi.org/10.1016/j.ejim.2011.03.005. pmid:21767755
- 40. Wang J, Hahn SS, Kline M, Cohen RI. Early in-hospital clinical deterioration is not predicted by severity of illness, functional status, or comorbidity. Int J Gen Med. 2017;10:329–34. pmid:29033602.
- 41.
Cardona-Morrell M, Zimlichman E, Taenzer A. Continuous Monitoring for Early Detection of Deterioration on General Care Units. In: DeVita MA, Hillman K, Bellomo R, Odell M, Jones DA, Winters BD, et al., editors. Textbook of Rapid Response Systems: Concept and Implementation. Cham: Springer International Publishing; 2017. p. 277–87.
- 42. Cardona-Morrell M, Prgomet M, Turner RM, Nicholson M, Hillman K. Effectiveness of continuous or intermittent vital signs monitoring in preventing adverse events on general wards: a systematic review and meta-analysis. Int J Clin Pract. 2016;70(10):806–24. pmid:27582503
- 43. Downey CL, Chapman S, Randell R, Brown JM, Jayne DG. The impact of continuous versus intermittent vital signs monitoring in hospitals: A systematic review and narrative synthesis. Int J Nurs Stud. 2018;84:19–27. https://doi.org/10.1016/j.ijnurstu.2018.04.013. pmid:29729558
- 44. van Loon K, van Zaane B, Bosch EJ, Kalkman CJ, Peelen LM. Non-Invasive Continuous Respiratory Monitoring on General Hospital Wards: A Systematic Review. PLoS One. 2015;10(12):e0144626. pmid:26658343
- 45. Cretikos MA. Respiratory rate: the neglected vital sign. The Medical journal of Australia. 2008;188(11):657–9. pmid:18513176
- 46. Kim WY, Shin YJ, Lee JM, Huh JW, Koh Y, Lim CM, et al. Modified early warning score changes prior to cardiac arrest in general wards. PLoS One. 2015;10 (6) (no pagination)(e0130523).
- 47. Zimlichman E, Szyper-Kravitz M, Shinar Z, Klap T, Levkovich S, Unterman A, et al. Early recognition of acutely deteriorating patients in non-intensive care units: Assessment of an innovative monitoring technology. J Hosp Med. 2012;7(8):628–33. pmid:22865462.
- 48. Still M, Vanderlaan J, Brown C, Gordon M, Graham K, Holder C, et al. Predictors of Second Medical Emergency Team Activation Within 24 Hours of Index Event. J Nurs Care Qual. 2017. Epub 2017/06/29. pmid:28658191.
- 49. Baker T, Gerdin M. The clinical usefulness of prognostic prediction models in critical illness. Eur J Intern Med. 2017;45(Supplement C):37–40. https://doi.org/10.1016/j.ejim.2017.09.012.