Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Tele-Rapid Response Team (Tele-RRT): The effect of implementing patient safety network system on outcomes of medical patients–A before and after cohort study

  • Ahmed N. Balshi,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Writing – original draft, Writing – review & editing

    Affiliation Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Mohammed A. Al-Odat,

    Roles Conceptualization, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Abdulrahman M. Alharthy,

    Roles Project administration, Writing – original draft, Writing – review & editing

    Affiliation Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Rayan A. Alshaya,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Writing – original draft, Writing – review & editing

    Affiliation Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Hanan M. Alenzi,

    Roles Data curation, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia, Nursing Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Alhadzia S. Dambung,

    Roles Data curation, Writing – original draft, Writing – review & editing

    Affiliations Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia, Nursing Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Huda Mhawish,

    Roles Data curation, Methodology, Supervision, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia, Nursing Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Saad M. Altamimi,

    Roles Data curation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia

  • Waleed Th. Aletreby

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

    waleedaletreby@gmail.com

    Affiliation Critical Care Department, King Saud Medical City, Riyadh, Saudi Arabia

Correction

24 Jul 2024: Balshi AN, Al-Odat MA, Alharthy AM, Alshaya RA, Alenzi HM, et al. (2024) Correction: Tele-Rapid Response Team (Tele-RRT): The effect of implementing patient safety network system on outcomes of medical patients–A before and after cohort study. PLOS ONE 19(7): e0307983. https://doi.org/10.1371/journal.pone.0307983 View correction

Abstract

Background

Rapid Response Teams were developed to provide interventions for deteriorating patients. Their activation depends on timely detection of deterioration. Automated calculation of warning scores may lead to early recognition, and improvement of RRT effectiveness.

Method

This was a “Before” and “After” study, in the “Before” period ward nurses activated RRT after manually recording vital signs and calculating warning scores. In the “After” period, vital signs and warning calculations were automatically relayed to RRT through a wireless monitoring network.

Results

When compared to the before group, the after group had significantly lower incidence and rate of cardiopulmonary resuscitation (CPR) (2.3 / 1000 inpatient days versus 3.8 / 1000 inpatient days respectively, p = 0.01), significantly shorter length of hospital stay and lower hospital mortality, but significantly higher number of RRT activations. In multivariable logistic regression model, being in the “After” group decreases odds of CPR by 33% (OR = 0.67 [95% CI: 0.46–0.99]; p = 0.04). There was no difference between groups in ICU admission.

Conclusion

Automated activation of the RRT significantly reduced CPR events and rates, improved CPR success rate, reduced hospital length of stay and mortality, but increased the number of RRT activations. There were no differences in unplanned ICU admission or readmission.

Introduction

Hospitalized patients can experience several adverse events (AEs), up to and including unplanned admission to the intensive care unit (ICU) or cardiac arrest and death [1]. AEs rates can be as high as 18%, even in countries with well-developed healthcare systems [2]. As many as half of the AEs are preventable [3]. Deteriorating patients in hospitals often experience antecedent deterioration of vital signs for an average duration of 6 hours [1, 4]. If such deteriorations were recognized on time, AEs can be prevented by providing simple interventions to prevent further deterioration [5]. Accordingly, several healthcare authorities have advocated the concept of rapid response teams (RRT), sometimes called rapid response systems (RRS) [6, 7].

Regardless of the structure of RRTs, which varies among countries and according to hospital needs [8, 9], the team remains the efferent (responding) limb of the process and must be activated to provide further assessment and interventions [10]. To be effective, they depend on the afferent limb for activation, which uses specific physiological parameters and predefined thresholds of deterioration to trigger RRT activation, such as the National Early Warning Score (NEWS) or its modified version, Modified Early Warning Score (MEWS) [11, 12]. Since the calculation of these scores and subsequent RRT activation are usually performed manually and depend on staff attentiveness, frequency of measurement, workload, and willingness to call for help [13], there are inevitable delays in RRT activation, which can eventually undermine its effectiveness [1, 14]. Several studies have described delayed RRT activation as one of the most important causes of lack of efficacy [2].

An attempt to decrease delays in RRT activation is by real-time recording of vital signs and automating the calculation of warning scores; however, these modifications did not eliminate the need for human activation of RRT since the alarming vital signs and RRT activation prompts are relayed to ward nurses (either on central screens or paging) [11, 13, 1518]. Tele-monitoring systems have been designed to overcome this gap by relaying the data of deteriorating patients directly to RRTs, eliminating human factors in activation. Few studies have reported the effectiveness of such systems [15, 16]. However, others have focused on the system’s performance, such as the time to complete vital sign recording, completeness of data, and end-user satisfaction [19].

In this study, we report the effectiveness and patient-centered outcomes of a telemonitoring system that directly relays patient’s vital signs and warning scores to the RRT. We conducted this study under the hypothesis that implementing the system would decrease severe AEs due to early activation of RRT.

Materials and methods

This was a before-after cohort study comparing prospective data after intervention to retrospective data before. We conducted the study in a large government hospital in the central region of Saudi Arabia (1200 inpatient beds), where the ICU provides outreach services in the form of an RRT to the general ward.

RRT structure and function

The RRT consisted of an intensivist, two intensive care nurses, and a respiratory therapist. The RRT covers referrals to the ICU by primary admitting specialties, in addition to 48 hours follow up of patients discharged from the ICU regardless of their condition, since our hospital lacks a step-down unit. The main purpose of RRT is the early management of deteriorating patients to stop their deterioration and prevent unplanned ICU admission or cardiac arrest. This could be achieved by simple interventions such as suctioning, administering analgesics, antipyretics, antihypertensives and intravenous fluids, providing supplemental oxygen, and chest physiotherapy. Patients who have already deteriorated significantly and become critically ill are beyond the scope of RRT; such patients require more intensive interventions such as endotracheal intubation or initiation of vasoactive medications, and their ICU admission is advisable. If the RRT interventions fail to prevent further deterioration, the patient is handed over to the mobile team or admitted to the ICU. Accordingly, RRT is not the only source of admission to the ICU from the ward, and the majority of ICU admissions from the ward are through the mobile team, which tends to refer critically ill patients who are beyond the scope of RRT. ICU admissions by RRT were all considered unplanned. During COVID-19 pandemic, all COVID-19 positive patients were admitted to isolation wards under the supervision of ICU, and were discharged to general wards only upon negative swab results, the RRT applied standard infection control precautions when activated throughout the study.

RRT activation criteria

As per hospital policy, RRT may be deployed if the patient’s vital signs show objective deterioration based on an early alert system, which utilizes the criteria of MEWS, and a patient is eligible for RRT activation with a score ≥ 5. Although a triggering score of 6 was found to be an excellent predictor of ICU admission [12], the cutoff value of 5 for the MEWS score was chosen as an extra precaution to identify deteriorating patients as early as possible (S1 Table). Once activated, the team followed-up the patient daily without the need for reactivation until discharge from their services.

Procedure and patients

We included data from 8 months between January and August 2020 as the pre-intervention period “Before” group, while the post-intervention period “After” group included data from the last 4 months of 2020 and the first 4 months of 2021 (September 2020 –April 2021). Patient data from both groups were collected from the RRT register and the hospital’s electronic database, and the quality and completeness were supervised by two authors. Recorded data included age, sex, whether the patient was a new referral to RRT, or was being followed-up for 48 h after ICU discharge. The main diagnostic medical category included internal medicine, neurology, nephrology, pulmonology, hem-oncology (surgical patients in the study were not included due to feasibility of implementation in the surgical units), MEWS upon RRT activation, and number of RRT activations per patient (discounting false activations that resulted from connectivity problems with the sensors). We also recorded the length of stay (LOS) of each patient in the ward; however, the reported LOS in this study includes only days in the ward before discharge, ICU admission/readmission, or death. Accordingly, for patients discharged from the ICU, the LOS did not include the period of stay in the ICU. For both groups, the following outcome variables were recorded: ICU admission or readmission, ward cardiopulmonary arrest and subsequent CPR occurrence, and death. Patients transferred to other healthcare facilities were not followed up and were considered alive at discharge.

We included all adult patients (age ≥ 18 years) in the medical wards, followed by RRT, regardless of whether they had new activation or follow-up after ICU discharge. We excluded the surgical wards, patients not followed by RRT, and patients labelled as “Do Not Resuscitate.” The exclusion of surgical patients was due to feasibility, as we had limited number of sensors and bedside devices. All patients were enrolled in the study only once to maintain data independence. Accordingly, we accounted for only the first episode of RRT activation, even if there were subsequent episodes.

Outcomes

The primary outcome measures were the occurrence of CPR, CPR rate, and CPR success rate. Successful CPR was defined according to our hospital’s policy as return of spontaneous circulation (ROSC) for at least 20 min [20]. The secondary outcomes included ICU admission, number of RRT activations per patient (including first-time activation and subsequent visits), and medical-ward hospital mortality.

Intervention

We applied Masimo Patient SafetyNet TM (Masimo, Irvine, CA) to all patients of the “After” group. The system is composed of sensors connected to bed-side devices that non-invasively monitor patient’s vital signs, wirelessly send data to a server capable of simultaneously registering 200 patients, and display real-time information (updated every 5–30 min according to the patient’s condition) on a central screen that can display data of up to 40 patients. A previously validated [21, 22] RD rainbow SET-2 Neo ® sensor was used to capture the heart rate, respiratory rate, and oxygen saturation, whereas blood pressure was measured using a root machine (inflatable arm cuff). The system also included “Replica,” a mobile application that allows authorized personnel to view patient data and receive alarms on smartphones. The software was pre-programmed to alarm visually and audibly when any of the vital signs included in the MEWS calculation (systolic blood pressure, heart rate, respiratory rate, and peripheral oxygen saturation) exceeded its upper or lower limits, as well as when the total MEWS was ≥ five based on automated calculation, with level of consciousness and temperature as a manual input by the ward nurse every 4 hours.

Masimo provided the Patient SafetyNet TM system; however, they were not involved in the data collection, analysis, or drafting of this study. The study was approved by the local institutional review board with waiver of consent (registration number: H1RI-07-Jan20-02), as the application of the tele-RRT system was considered a performance improvement project, and registered at researchregistry.com # 7898. This study followed the ethical principles outlined in the Declaration of Helsinki.

Statistical method

Continuous data are summarized as mean ± standard deviation (SD) and discrete data as frequencies and percentages (n, %). Continuous data were compared using Student’s t-test or Wilcoxon rank sum test as appropriate, and discrete data by chi-square test or Fisher’s exact test, as appropriate. We calculated the CPR rate as the number of events divided by inpatient days in ward times 1000 (unit is CPR / 1000 inpatient days).

We fitted a multivariable logistic regression model of predictors of CPR, using the backward deletion method to retain variables in the model if their p values were > 0.1. The goodness of fit of the model was evaluated using the Hosmer–Lemeshow test (well fitted if p > 0.05), and presented using area under the receiver operator characteristics curve of probability prediction of the model along with the percentage of correctly classified cases. We also explored the fulfillment of logistic regression assumptions.

As a sensitivity test for the primary outcome, we fitted a Kaplan–Meier curve for survival of both groups and reported the p-value of the log-rank test.

All statistical tests were two-tailed and considered statistically significant if the p-value was < 0.05, without correction for multiple testing; hence, their results could only be considered exploratory. The commercially available statistical package STATA ® was used for analyses (StataCorp. 2015. Stata statistical software: Release 14. College Station, TX, StataCorp LP).

Results

The “Before” and “After” groups included data of 2346 and 2151 patients respectively (Fig 1). Notably, the DNR rates were similar in both study periods. Table 1 shows the demographic and clinical characteristics of both the groups. There were no differences in sex distribution, percentage of patients discharged from the ICU, or MEWS at the time of RRT activation. However, the “After” group had a higher average age compared to “Before” group. In both groups, the predominant diagnostic category was internal medicine, without differences in the distribution of all categories between the groups (S1 Fig).

thumbnail
Table 1. Demographic and clinical characteristics of study groups.

https://doi.org/10.1371/journal.pone.0277992.t001

Table 2 shows the primary and secondary outcomes. “Before” group had 78 episodes of CPR, and total in-patient days of 20,510. This accounts for a CPR incidence of 3.3% and a CPR rate of 3.8 / 1000 inpatient days (95% confidence interval (CI): 3–4.7). Whereas, “After” group had a total of 17,945 inpatient days and 42 CPR episodes, which yielded CPR incidence of 1.95% and CPR rate of 2.3 / 1000 inpatient days (95% CI: 1.7–3.2). CPR incidence in the “After” group was significantly lower than “Before” group (p = 0.01). The CPR success rate was significantly higher in the “After” group compared to “Before” group (59.5% vs. 38.5%; p = 0.04). There was no statistically significant difference in the percentage of ICU admissions between the groups. In contrast, the “Before” group had a significantly higher average LOS and fewer RRT activations. Moreover, 3% of RRT activations were false due to connectivity issues which could not be judged except at the patient’s bedside. We report only the true ones, S2 Fig shows the triggers of RRT activation in both groups. The overall hospital mortality of medical wards was significantly lower in the “After” period (5.4% vs. 4%, 95% CI: 0.6–2.2; p < 0.001).

The logistic regression model of CPR prediction initially included variables of age, gender, discharge from ICU, MEWS, number of RRT activations, diagnostic category, and the variable of interest (“Before” or “After” group) (S2 Table). The backward deletion method retained three variables in the final model: age (odds ratio (OR) = 1.14 [95% CI: 1.1–1.2]; p < 0.001), number of RRT activations (OR = 0.92 [95% CI: 0.9–0.95]; p < 0.001), and “After” group (OR = 0.67 [95% CI: 0.46–0.99]; p = 0.04). The model was well fitted (Hosmer–Lemeshow test p = 0.12), correctly classified 97.3% of the data, and had an area under the curve of 71% (S3 Fig). A linear relationship between continuous predictors and log CPR was established by Box–Tidwell test p values > 0.05, and there was no collinearity between continuous predictors (correlation coefficient r between age and number of activations = -0.002, p = 0.9). The significantly lower CPR incidence and rate in the “After” group was supported by a significant p value of the log-rank test (p = 0.01) of the depicted Kaplan–Meier curve in the sensitivity analysis (Fig 2).

Discussion

In this study, we found that applying Masimo Patient SafetyNetTM in medical wards was associated with lower incidence and rate of CPR, higher CPR success rate, shorter LOS, lower hospital mortality, and more RRT activation. The significant predictors of cardiopulmonary arrest and CPR were age (OR = 1.14), number of RRT activations (OR = 0.92), and connection to SafetyNet (OR = 0.67). These results indicate that as age increased by 1 year, the odds of CPR increased by 14%. As the number of RRT activations increased by 1 day, the odds of CPR decreased by 8%, and being in the “After” group decreased the odds of CPR by 33%. These improvements in patient outcomes may be attributed to the timely recognition of worsening vital signs in deteriorating patients.

Since the introduction of RRTs early in the 2000s, several studies have questioned their efficacy, showing no improvement in CPR rates, unplanned ICU admission, average LOS, or hospital mortality, including the MERIT study [23]. This may be explained by the dependence of the RRT in its early models on activation by ward staff, who had to assess the patients and calculate warning scores manually. It follows that if this activation was delayed, the intervention of the RRT would also be delayed and possibly ineffective. What might support this hypothesis is that when the systems evolved to the automated calculation of warning scores and electronic prompts of activation, the results of studies, including this study, almost consistently showed significant improvement, particularly in CPR rates, unplanned ICU admission, LOS, and hospital mortality [13, 16, 17], even when the system still required manual input such as the respiratory rate or level of consciousness. This improvement was also reflected in systematic reviews [1] despite the inevitable differences between studies (in terms of design, population, and RRT structure), thus yielding high heterogeneity percentages, which cast a shadow over those benefits. Similarly, an increased number of activations could also be generated by the severity of the patients, recognized early by the automated system and perhaps not recognized by the healthcare provider, or the opposite, errors in the evaluation of the monitoring system that the healthcare provider could then refute.

One of the most commonly reported outcomes of automated RRT systems is the increase in the number of RRT activations [16, 24], as was the case in our study, since there is no human clinical judgment of the patient’s condition, and the activation is entirely based on numerical values. Undoubtedly, this imposes a burden on team members and increases their workload. However, from another perspective, frequent checks by the team may be advantageous to patients, as their condition gets more frequently re-evaluated, and their management is regularly updated. We demonstrated this benefit in our study as the reduced odds of CPR with increased RRT activation, also shown by others [13, 24], possibly because of the forward progression of management and prevention of deterioration. Notably, the high number of activations and low rates of unplanned admissions indicate a high success rate of RRT management. The finding of increased number of RRT visits may be an indication to reallocate more resources and workforce to RRTs by hospital administrations and policymakers.

ICU admissions were similar in both groups, probably because the need to admit or re-admit patients to the ICU was mandated by the complexity and criticality of their condition, which is beyond the scope of simple interventions offered by the RRT and would have eventually occurred regardless of the team, particularly for medical diagnoses. Many studies that reported a significant reduction in ICU admission and RRT activations included surgical patients [25, 26], who are known to have the most complications in the first three postoperative days [26]. However, studies including both surgical and medical patients have failed to demonstrate such a reduction [27, 28]. A clinical focus review by Michard et al. [29] concluded that continuous surveillance might reduce ICU admissions; however, the review mainly included studies on postoperative patients, leaving them to question which type of patients may benefit from such interventions. Although the “After” period had significantly lower hospital mortality in the medical wards, we cannot claim that this was entirely because of the intervention, as excluded surgical patients were not considered; however, the intervention may have been a contributing factor.

The CPR success rate was notably higher in the “After” group. Although this result cannot be directly attributed to the monitoring system, we speculate that it may have indirectly contributed to it. Having the patient under surveillance by the RRT would probably have decreased the workload of the ward staff; in addition, frequent evaluation and management by the RRT may have caused the precipitating factor of arrest to be easily and quickly reverted. Moreover, the participation of an intensivist and experienced critical care nurses in the CPR could also be a contributing factor. However, this hypothesis remains to be confirmed.

This study demonstrated the benefits of applying the Masimo Patient SafetyNetTM system for automated MEWS calculation and RRT activation. By demonstrating reduced CPR incidence and rate, improved CPR success rate, and reduced hospital LOS and mortality, although coupled with an increased number of RRT activations, we showed the benefits of Tele-RRT in medical patients, who could possibly be even more complex than surgical patients because of comorbidities and advanced age [30]. However, the inclusion of two manual inputs (temperature and LOC) limits the complete automation of the system. Our study enrolled approximately 4500 patients and extended for 16 months. We ranked it among medium-to-large studies in terms of size and duration. However, further studies are needed to evaluate the success of Tele-RRT systems in surgical wards and mixed settings.

Our study has several limitations. The “Before” and “After” designs lack randomization, which subjects the study to possible biases and unmeasured confounders. We included all eligible patients within the study period; therefore, we did not perform any sample size or power calculations. However, our results indicate that the study is adequately powered for the primary outcome of CPR occurrence, as to detect the observed difference between both groups as significant with a 5% type I error rate and 80% power, 2200 patients per group are required; however, for the outcome of CPR rate, our study was underpowered, since the required sample size would be approximately 14000 patients per group. We lacked data on severity scores; however, we included MEWS at the time of RRT activation, which was comparable between the groups. We did not account for total hospital mortality, as was customary in similar studies, since the study did not include hospital wards; however, a reduction in hospital mortality in medical wards was shown. The exclusion of surgical patients is also a limitation as we cannot generalize our results to that group. The study was conducted during the COVID-19 pandemic; however, we did not differentiate between COVID-19 positive and negative patients, which may have yielded different results. We only considered the diagnostic category when other confounding factors, such as comorbidities, could have been imbalanced between the study groups. Furthermore, each group was quite heterogeneous, including different diagnoses with different severities, a situation in which stratification may have been warranted. However, we did not perform stratification because of the small number of events in addition to an under-fitted logistic regression model. This was a single-center study, reflecting the management in only one hospital, which limits the generalizability of its results to the entire region or country. We recommend further studies on surgical or a mix of patients with a design that avoids comparison with historical controls while observing ethical issues. Observational studies that use matching techniques may be an option.

Conclusion

Automated activation of the RRT by Masimo Patient SafetyNetTM applied to medical ward patients significantly reduced CPR events and rates, reduced hospital length of stay, and increased the number of RRT activations. There was no difference in the ICU admission rates. Further evaluation of the system in surgical wards and mixed settings was conducted.

Supporting information

S1 Fig. Medical diagnoses of both groups.

https://doi.org/10.1371/journal.pone.0277992.s003

(DOCX)

S3 Fig. ROC curve of predictive ability of logistic regression model.

https://doi.org/10.1371/journal.pone.0277992.s005

(DOCX)

Acknowledgments

We would like to thank Editage (www.editage.com) for English language editing.

References

  1. 1. Maharaj R, Raffaele I, Wendon J. Rapid response systems: a systematic review and meta-analysis. Crit Care. 2015 Jun 12;19(1):254. pmid:26070457
  2. 2. Barwise A, Thongprayoon C, Gajic O, Jensen J, Herasevich V, Pickering BW. Delayed Rapid Response Team Activation Is Associated With Increased Hospital Mortality, Morbidity, and Length of Stay in a Tertiary Care Institution. Crit Care Med. 2016 Jan;44(1):54–63. pmid:26457753
  3. 3. Buist M, Harrison J, Abaloz E, Van Dyke S. Six year audit of cardiac arrests and medical emergency team calls in an Australian outer metropolitan teaching hospital. BMJ. 2007 Dec 8;335(7631):1210–2. pmid:18048504
  4. 4. Chan PS, Jain R, Nallmothu BK, Berg RA, Sasson C. Rapid Response Teams: A Systematic Review and Meta-analysis. Arch Intern Med. 2010 Jan 11;170(1):18–26. pmid:20065195
  5. 5. Jones DA, DeVita MA, Bellomo R. Rapid-response teams. N Engl J Med. 2011 Jul 14;365(2):139–46. pmid:21751906
  6. 6. The Joint Commission announces the 2009 National Patient Safety Goals and requirements. Jt Comm Perspect. 2008 Jul;28(7):1, 11–5. pmid:18795721
  7. 7. Berwick DM, Calkins DR, McCannon CJ, Hackbarth AD. The 100,000 lives campaign: setting a goal and a deadline for improving health care quality. JAMA. 2006 Jan 18;295(3):324–7. pmid:16418469
  8. 8. Priestley G, Watson W, Rashidian A, Mozley C, Russell D, Wilson J, et al. Introducing Critical Care Outreach: a ward-randomised trial of phased introduction in a general hospital. Intensive Care Med. 2004 Jul;30(7):1398–404. pmid:15112033
  9. 9. Chan PS, Khalid A, Longmore LS, Berg RA, Kosiborod M, Spertus JA. Hospital-wide code rates and mortality before and after implementation of a rapid response team. JAMA. 2008;300:2506–13.
  10. 10. Jackson S, Penprase B, Grobbel C. Factors Influencing Registered Nurses’ Decision to Activate an Adult Rapid Response Team in a Community Hospital. Dimens Crit Care Nurs. 2016 Mar-Apr;35(2):99–107. pmid:26836604
  11. 11. Escobar GJ, Liu VX, Schuler A, Lawson B, Greene JD, Kipnis P. Automated Identification of Adults at Risk for In-Hospital Clinical Deterioration. N Engl J Med. 2020 Nov 12;383(20):1951–1960. pmid:33176085
  12. 12. Balshi AN, Huwait BM, Noor ASN, Alharthy AM, Madi AF, Ramadan OE, et al. Modified Early Warning Score as a predictor of intensive care unit readmission within 48 hours: a retrospective observational study. Rev Bras Ter Intensiva. 2020 Jun;32(2):301–307.
  13. 13. Bellomo R, Ackerman M, Bailey M, Beale R, Clancy G, Danesh V, et al; Vital Signs to Identify, Target, and Assess Level of Care Study (VITAL Care Study) Investigators. A controlled trial of electronic automated advisory vital signs monitoring in general hospital wards. Crit Care Med. 2012 Aug;40(8):2349–61.
  14. 14. Sandroni C, D’Arrigo S, Antonelli M. Rapid response systems: are they really effective? Crit Care. 2015 Mar 16;19(1):104. pmid:25887250
  15. 15. Heller AR, Mees ST, Lauterwald B, Reeps C, Koch T, Weitz J. Detection of Deteriorating Patients on Surgical Wards Outside the ICU by an Automated MEWS-Based Early Warning System With Paging Functionality. Ann Surg. 2020 Jan;271(1):100–105. pmid:29771722
  16. 16. Subbe CP, Duller B, Bellomo R. Effect of an automated notification system for deteriorating ward patients on clinical outcomes. Crit Care. 2017 Mar 14;21(1):52. pmid:28288655
  17. 17. Schmidt PE, Meredith P, Prytherch DR, Watson D, Watson V, Killen RM, et al. Impact of introducing an electronic physiological surveillance system on hospital mortality. BMJ Qual Saf. 2015 Jan;24(1):10–20. pmid:25249636
  18. 18. Bailey TC, Chen Y, Mao Y, Lu C, Hackmann G, Micek ST, et al. A trial of a real-time alert for clinical deterioration in patients hospitalized on general medical wards. J Hosp Med. 2013 May;8(5):236–42. pmid:23440923
  19. 19. McGrath SP, Perreard IM, Garland MD, Converse KA, Mackenzie TA. Improving Patient Safety and Clinician Workflow in the General Care Setting With Enhanced Surveillance Monitoring. IEEE J Biomed Health Inform. 2019 Mar;23(2):857–866.
  20. 20. Chan PS, Tang Y; American Heart Association’s Get With the Guidelines®‐Resuscitation Investigators. Risk-Standardizing Rates of Return of Spontaneous Circulation for In-Hospital Cardiac Arrest to Facilitate Hospital Comparisons. J Am Heart Assoc. 2020 Apr 7;9(7):e014837.
  21. 21. Barker SJ. "Motion-resistant" pulse oximetry: a comparison of new and old models. Anesth Analg. 2002 Oct;95(4):967–72.
  22. 22. Richards NM, Giuliano KK, Jones PG. A prospective comparison of 3 new-generation pulse oximetry devices during ambulation after open heart surgery. Respir Care. 2006 Jan;51(1):29–35. pmid:16381614
  23. 23. Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, et al; MERIT study investigators. Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005 Jun 18–24;365(9477):2091–7.
  24. 24. Jones S, Mullally M, Ingleby S, Buist M, Bailey M, Eddleston JM. Bedside electronic capture of clinical observations and automated clinical alerts to improve compliance with an Early Warning Score protocol. Crit Care Resusc. 2011 Jun;13(2):83–8. pmid:21627575
  25. 25. Taenzer AH, Pyke JB, McGrath SP, Blike GT. Impact of pulse oximetry surveillance on rescue events and intensive care unit transfers: a before-and-after concurrence study. Anesthesiology. 2010 Feb;112(2):282–7. pmid:20098128
  26. 26. Stites M, Surprise J, McNiel J, Northrop D, De Ruyter M. Continuous Capnography Reduces the Incidence of Opioid-Induced Respiratory Rescue by Hospital Rapid Resuscitation Team. J Patient Saf. 2021 Sep 1;17(6):e557–e561. pmid:28731933
  27. 27. Thompson JS, Baxter BT, Allison JG, Johnson FE, Lee KK, Park WY. Temporal Patterns of Postoperative Complications. Arch Surg. 2003;138(6):596–603. pmid:12799329
  28. 28. Brown H, Terrence J, Vasquez P, Bates DW, Zimlichman E. Continuous monitoring in an inpatient medical-surgical unit: a controlled clinical trial. Am J Med. 2014 Mar;127(3):226–32.
  29. 29. Michard F, Kalkman CJ. Rethinking Patient Surveillance on Hospital Wards. Anesthesiology. 2021 Sep 1;135(3):531–540. pmid:34237129
  30. 30. Nathanson B., McGee W., Lederman E. et al. Differences in severity and resource utilization for medical and surgical ICU patients. Crit Care 17 (Suppl 2), P490 (2013).