Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Non-Invasive Continuous Respiratory Monitoring on General Hospital Wards: A Systematic Review

  • Kim van Loon ,

    K.vanLoon-3@umcutrecht.nl

    Affiliation Division of Anesthesiology, Intensive Care and Emergency Medicine, University Medical Center Utrecht, Utrecht, The Netherlands

  • Bas van Zaane,

    Affiliation Division of Anesthesiology, Intensive Care and Emergency Medicine, University Medical Center Utrecht, Utrecht, The Netherlands

  • Els J. Bosch,

    Current address: Department of Anesthesiology, Pain Medicine and Palliative Care, Radboud University Medical Center, Nijmegen, The Netherlands

    Affiliation Division of Anesthesiology, Intensive Care and Emergency Medicine, University Medical Center Utrecht, Utrecht, The Netherlands

  • Cor J. Kalkman,

    Affiliation Division of Anesthesiology, Intensive Care and Emergency Medicine, University Medical Center Utrecht, Utrecht, The Netherlands

  • Linda M. Peelen

    Affiliations Division of Anesthesiology, Intensive Care and Emergency Medicine, University Medical Center Utrecht, Utrecht, The Netherlands, Julius Center for Health Sciences and Primary Care and Division of Anesthesiology, Intensive Care and Emergency Medicine, University Medical Center Utrecht, Utrecht, The Netherlands

Abstract

Background

Failure to recognize acute deterioration in hospitalized patients may contribute to cardiopulmonary arrest, unscheduled intensive care unit admission and increased mortality.

Purpose

In this systematic review we aimed to determine whether continuous non-invasive respiratory monitoring improves early diagnosis of patient deterioration and reduces critical incidents on hospital wards.

Data Sources

Studies were retrieved from Medline, Embase, CINAHL, and the Cochrane library, searched from 1970 till October 25, 2014.

Study Selection

Electronic databases were searched using keywords and corresponding synonyms ‘ward’, ‘continuous’, ‘monitoring’ and ‘respiration’. Pediatric, fetal and animal studies were excluded.

Data Extraction

Since no validated tool is currently available for diagnostic or intervention studies with continuous monitoring, methodological quality was assessed with a modified tool based on modified STARD, CONSORT, and TREND statements.

Data Synthesis

Six intervention and five diagnostic studies were included, evaluating the use of eight different devices for continuous respiratory monitoring. Quantitative data synthesis was not possible because intervention, study design and outcomes differed considerably between studies. Outcomes estimates for the intervention studies ranged from RR 0.14 (0.03, 0.64) for cardiopulmonary resuscitation to RR 1.00 (0.41, 2.35) for unplanned ICU admission after introduction of continuous respiratory monitoring,

Limitations

The methodological quality of most studies was moderate, e.g. ‘before-after’ designs, incomplete reporting of primary outcomes, and incomplete clinical implementation of the monitoring system.

Conclusions

Based on the findings of this systematic review, implementation of routine continuous non-invasive respiratory monitoring on general hospital wards cannot yet be advocated as results are inconclusive, and methodological quality of the studies needs improvement. Future research in this area should focus on technology explicitly suitable for low care settings and tailored alarm and treatment algorithms.

Introduction

In high care facilities, like an Intensive Care Unit (ICU), monitors are often continuously reporting physiological patient variables, such as heart rate or respiratory rate. Physicians interpret these values and the resulting alarms, and act appropriately if needed to prevent physiological decline.

In contrast, on general hospital wards, patient monitoring takes place at a minimal level and merely consists of intermittent observations by nurses. Physiological variables are typically registered only once every shift, i.e., at best once every 8–10 hours.[1,2] Deterioration that occurs in between these observations is more likely to go unnoticed and could result in detrimental outcomes, such as cardiopulmonary arrest, unscheduled intensive care unit (ICU) admission, and in-hospital mortality.[1,35]

Since respiratory failure is the most common primary cause of ICU admission from general hospital wards [57], an abnormal respiratory rate (generally above 30 breaths per minute [1,8]) could be an important and sensitive clinical predictor for current or future serious adverse events.[4,9,10] In daily practice however respiration is only intermittently observed by caregivers and expressed as an approximate respiratory rate, sometimes combined with rough estimates of tidal volume (‘deep’, ‘shallow’), intermittent pulse oximetry, or more subjective parameters such as the patient’s skin color including apparent signs of cyanosis. Preferably such intermittent subjective observations are supported by reliable electronic or mechanical bedside equipment.[11]

The purpose of this systematic review was to examine whether continuous respiratory monitoring can assist caregivers on the general hospital ward with early detection of deteriorating patients, and improve patient safety by reducing the incidence of critical events. We reviewed publications on the use of continuous non-invasive respiratory monitoring in patients admitted to a general hospital ward in clinical practice. These publications include intervention studies, investigating the effect of continuous respiratory monitoring on clinical outcomes, and diagnostic studies, evaluating the ability to detect abnormal vital signs in comparison to a chosen reference standard. Furthermore, as methodological quality assessment tools for this type of research are currently unavailable, we summarize methodological pitfalls in the design and reporting of monitoring studies based on our findings in this systematic review.

Materials and Methods

Search strategy and study selection

Electronic databases Medline (Pubmed), Embase, CINAHL, and the Cochrane library were searched for publications on continuous respiratory monitoring on general hospital wards from 1966 through October 2014. Synonyms for ‘hospital ward’, ‘continuous monitoring’ and ‘respiration’ were included along with search filters (S1 File). Duplicates were automatically eliminated. Based on titles and abstracts, two reviewers (KL and EB) eliminated studies that did not evaluate a continuous non-invasive monitor, pediatric-, fetal- or animal studies, and studies that did not monitor a respiratory physiological variable. As respiration comprises ventilation and oxygenation, devices monitoring any of these vital signs were considered respiratory monitors. To find additional papers that were missed with our original search we also searched Web of Knowledge (URL: http://apps.webofknowledge.com). Since we aimed to focus on continuous respiratory monitoring in clinical practice, we included all original studies performed on general hospital wards, with the outcome defined as serious adverse events (mortality, cardiopulmonary arrests, ICU admission, and length of ICU or hospital admission). Furthermore, we also included diagnostic accuracy studies, which evaluated whether the device is able to detect respiratory abnormalities accurately.

Data extraction

After selection of relevant articles, two reviewers (KL and EB) assessed full text articles independently. Two data extraction forms were developed, one for papers concerning clinical outcomes, one for articles concerning diagnostic accuracy (S2 File). Discrepancies between reviewers were discussed with an epidemiologist (LP) or a clinician (BZ) until consensus was reached among authors.

Quality assessment

Two independent reviewers (KL and EB) assessed the methodological quality of included studies. Since there are no specific methodological quality assessment tools for research on monitoring technology, we used modified Standards for Reporting Studies of Diagnostic Accuracy (STARD) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS) criteria for diagnostic studies, and the Consolidated Standards Of Reporting Trials (CONSORT) and Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statements for articles focusing on clinical outcomes.[1215] These modified criteria are listed in the S3 File.

Results

The search yielded 1254 publications, which were handled as presented in the flowchart (Fig 1). After reviewing titles and abstracts, 61 publications remained. From these, eleven studies were further analyzed; the other 50 studies were excluded as the paper did not describe original research (n = 10), the study was performed outside the general ward (n = 32), the study evaluated the agreement between two monitoring methods in healthy volunteers or did not investigate the monitoring system itself but used it as a tool to describe the population (n = 7), or full-text could not be retrieved (n = 3). The eleven studies that were included evaluated eight different monitoring systems.

The remainder of the results section below describes the six intervention studies from three different viewpoints.[1621] An overview of the five diagnostic studies can be found in the supporting information (S1S3 Tables).[2226] First we describe the technical aspects of the monitoring systems (including the sensing principles, signal analysis, and caregiver notification), second we describe the study design, and third we summarize the individual study outcomes.

I—Technical aspects of monitoring systems

Continuous electronic patient monitoring aims to translate physiological parameters that describe the current status of the patient’s vital systems into interpretable indicators to allow follow-up and appropriate action. The entire process consists of three steps: sensing the relevant parameter(s), interpretation of the measured variables (signal analysis), and notification of caregivers.[27] Table 1 gives an overview of these three aspects for each of the studies. For the diagnostic studies this can be found in S1 Table.

thumbnail
Table 1. Technical characteristics of non-invasive continuous monitors in intervention studies.

https://doi.org/10.1371/journal.pone.0144626.t001

Sensing principles.

A sensor translates vital signs such as respiratory rate or arterial oxygen saturation to an electronic signal. Monitors selected in this review measured breathing rate[16], oxygen saturation (SpO2)[1820] or both[17,21]. Most devices incorporated conventional sensing principles, such as pulse oximetry to measure arterial oxygen saturation and electrocardiography (ECG) -based transthoracic impedance to measure respiratory rate.[1721] The transmission of the signals from the patient to the device was wireless in two devices.[16,18] None of the devices evaluated in the intervention studies incorporated a sensing principle that is capable to directly identify upper airway obstruction by detecting loss of airflow.

Signal analysis.

There was considerable variation in the way the crude electronic signals were handled and translated into interpretable numerical and graphical indicators. Four monitors used a simple translation. The other two monitors made use of so-called ‘smart alarm control’[17,21], where advanced data modeling techniques, such as fuzzy logic, neural networking, and pattern recognition [27,28], were used to ease interpretation of changes in multiple monitor signals and to reduce the amount of false alarms. The Biosign algorithm, which was investigated in the studies by Hravnak and Watkinson[17,21], involved conventional hardwired sensing principles, with new data driven algorithms to present a single score for the patient’s vital status. The signal analysis in the article of Taenzer was supplemented with efforts to reduce false positive alarms, including evaluation of the robustness of the arterial pulse wave, by calibration and by notification delay.[20]

Caregiver notification system.

As ward nurses spend only a limited amount of their time in the immediate vicinity of the patient (the nurse to patient ratio varied between 1:4 and 1:10 patients in the studies), the monitoring system needs to alert caregivers in time to successfully facilitate prevention of serious adverse events. The simplest notification strategy used was a bedside audible and displayed alarm. In three studies, the monitor was able to alert responsible caregivers who were physically present in the patient’s room or near the central nursing station when an alarm was triggered.[17,19,21] The most extensive strategy was implemented by Kisner notifying physicians and nurses via mobile phone, where the physician received electronic documentation from the system describing the event [18].

II Study design

Table 2 summarizes methodological quality of the intervention studies that were included. For the five diagnostic studies, this summary is provided in S2 Table. The six intervention studies aimed to evaluate the additional value of continuous bedside monitoring compared to intermittent physiological observations on clinical outcomes. Watkinson and Ochroch conducted randomized controlled trials.[19,21] In the comparator arm of the Watkinson trial patients’ vital signs were recorded manually and with electronic devices at intervals. For patients in the comparator arm of the trial by Ochroch, vital signs were measured and recorded intermittently and in more than 95% of the patients ECG telemetry monitoring was also performed.[19] Other studies used a before-after design[1618,20], which has the drawback that differences in outcomes can also be due to differences in patient characteristics rather than just the intervention of continuous monitoring itself. This may in particular be the case in the study of Kisner and Brown in which also retrospective data was used.[16,18] Brown described that the decision on admission to the control- or intervention unit was practically random; however patient outcomes in the intervention unit before implementation of the monitor system, and the control unit before and after implementation differ.[16] In contrast to other studies, the before- after- study of Taenzer does present baseline characteristics only on the ward level rather than on the level of individual patients.

thumbnail
Table 2. Summary of methodological quality of the intervention studies.

https://doi.org/10.1371/journal.pone.0144626.t002

III Outcomes of the studies

Table 3 presents the characteristics and outcomes for the intervention studies. In S3 Table the results for the diagnostic studies are summarized.

thumbnail
Table 3. Summary of characteristics and outcomes for intervention studies.

https://doi.org/10.1371/journal.pone.0144626.t003

In all intervention studies the incidence of the primary outcome was lower during continuous monitoring, although not always statistically significant. Taenzer found a statistically significant reduction of ICU admission rates (2.1% vs. 1.1%, p = 0.003).[20] In the Brown study, the length of stay on the ICU decreased significantly after implementation of the monitoring system when compared to the control unit and the intervention unit before implementation (respectively 63.4 days vs. 85.4 days vs. 120.1 days per 1000 patients).[16] When we compare the length of stay on the ICU for patients admitted to the intervention unit, the decrease after introduction of the monitor system did not reach statistical significance. Overall, the ICU admission rates in this study did not change.[16] In Table 3 outcomes are reported as proportions and to facilitate comparison between before-after studies only data from the intervention unit was summarized. Relative risks (RRs) were calculated with information extracted from the papers for serious adverse events (SAE) and ICU admission rates (Figs 2 and 3). RRs for SAEs ranged from 0.14 to 0.97 and RRs for ICU admission ranged from 0.51 to 1.00. We do not provide pooled summary estimates in the forest plots, as studies differed considerably in terms of outcome, intervention and study design. Three studies chose a composite endpoint as primary outcome,[17,20,21] combining serious adverse events defined as ICU admission, readmission, rescue events and mortality. Kisner chose an intermediate outcome, the incidence of atrial fibrillation, which is known to be associated with increased morbidity, mortality, prolonged hospital stay and increased costs after cardiothoracic surgery.[18] The primary outcome of Ochroch was defined as ICU admission rate.[19] Three outcomes were mentioned as primary outcomes.

thumbnail
Fig 2. Forest plot of comparison: Serious Adverse Events (SAE) for continuous versus intermittent respiratory monitoring on general hospital wards.

https://doi.org/10.1371/journal.pone.0144626.g002

thumbnail
Fig 3. Forest plot of comparison: ICU admission for continuous versus intermittent respiratory monitoring on general hospital wards.

https://doi.org/10.1371/journal.pone.0144626.g003

Patient comfort was reportedly minimally affected by the monitor system in the study of Taenzer, Kisner and Brown.[16,18,20] The acceptance rate of the Masimo pulse oximeter was high with only 1.8% of patients refusing to wear the sensor continuously.[20] 16% of the patients in the study of Watkinson, in which conventional sensor technology was used, were monitored for the full 72 h.(21) The monitor was removed if requested by nurses to allow mobilization (37%), by the patient (30%), in case of a serious adverse event (18%), or for other reasons (15%). In the study of Kisner the pulse oximeter was wireless and placed on the patient’s ear lobe.[18] None of the selected articles mentioned the occurrence of pressure ulcers during or after long-term vital sign monitoring.

Alarm rates were mentioned in four studies and ranged from 0.03 to 4 alerts per patient or bed per day.[16,17,20,21]

Discussion

Based on the findings of this systematic review, implementation of routine continuous respiratory monitoring on general hospital wards cannot yet be advocated. Results were inconclusive and in the available intervention studies clinical implementation was incomplete. Furthermore, methodological quality of most studies was moderate, e.g. ‘before-after’ designs, incomplete reporting of primary outcomes, and incomplete clinical implementation of the monitoring system.

A decade ago, Folke reported on available techniques and devices for non-invasive respiratory monitoring.[11] At that time, clinical research evaluating these devices was not available. Our systematic review focused on this next step, by including articles evaluating the clinical impact of non-invasive continuous respiratory monitoring systems. It is interesting to note that we did not observe such a large diversity in sensing principles as described earlier by Folke.[11] Our search strategy yielded only five diagnostic and six intervention studies that evaluated continuous respiratory monitors on general hospital wards. The selected articles predominantly applied conventional sensing principles sometimes combined with innovative signal analysis to monitor general ward patients. In the present review, only two monitoring devices covered sensing principles that were tailored to low care clinical settings, including patient comfort demands.[16,25,26] Conventional sensing principles, often leaving the patient attached to wires, give less patient comfort and more frequent dislodgement of the sensor. A high number of false positive alarms, e.g. by sensor dislodgement, can be extremely disruptive for patient and caregiver, especially in low care clinical settings.[29,30] The frequency and tolerability of false positive alarms for each unique monitoring system in this setting was not extensively studied for the monitoring systems that were included in our systematic review.

This systematic review on continuous respiratory monitoring has some limitations. First, we were unable to pool study results into one overall effect estimate, as the studies differed considerably with respect to the physiological variables that were monitored. Devices monitoring any vital sign related to ventilation or oxygenation matched the inclusion criteria, but with these devices many other vital parameters (i.e. heart rate, temperature) were included in the monitoring strategy under study. A second reason for refraining from pooling individual effect estimates were differences in study design and methodological quality of the studies. A second limitation of this systematic review is the domain we chose in the search and selection strategy. By only selecting studies that were performed on hospital wards, we excluded devices that were potentially suitable for this setting but have not yet been studied as such. Monitoring devices can ‘legally’ be used in a low care patient ward setting if they were developed and validated in an ICU or operating room setting. At the moment such ‘off label’ use is generally accepted, but hardly investigated. Therefore, this systematic review is not able to give an overview of all sensor technologies and monitoring devices that are actually used in the low care clinical setting. Finally, our review almost certainly suffers from publication bias. Regulations regarding the need for clinical validation research before introducing a new non-invasive monitoring device on the market are less stringent when compared to pharmaceutical interventions and it is conceivable that device manufacturers will not support publication of negative study results.

A solid methodological base for research on physiological monitoring is currently scarce and methodological quality of the included studies was moderate to poor. This impedes the assessment of the relevance and validity and makes comparison of alternative monitoring strategies difficult. Based on our findings, we provide the following suggestions for the design and reporting of the evaluation and validation of continuous monitoring systems:

Continuous physiological monitoring is a process of repeatedly sensing one or more physiological variables, analyzing the resulting time series, followed by notification and action on pre-defined changes in relevant vital signs. The ideal monitoring strategy should include unobtrusive sensors that are well tolerated by the patient, have a high sensitivity and a high positive predictive value. The passive sensor array in the Jacobs study had a high positive predictive value of 98.9% with a corresponding low false alarm rate of 0.16 per patient day.[25] The latter is important to alert caregivers in time, but at the same time prevent ‘alarm fatigue’ resulting from false alarms.[31,32] Finally, a well-designed notification system might also contain decision support algorithms to help caregivers decide on the most appropriate immediate therapeutic interventions.

In monitoring studies the elements of the monitoring strategy should preferably be investigated separately, and subsequently as a whole. To be able to study the effect on patient outcome, the entire monitoring strategy, from sensing to action, should be operational. A single dysfunctional component can completely obscure potential improvement of patient outcome. A clear example of the latter is the carefully designed and reported randomized controlled trial by Watkinson, where continuous monitoring was not found to influence the incidence of ICU admission and cardiac arrest.[21] As the authors indicate themselves, this might be explained by the fact that they were unable to implement timely caregiver notification of abnormal vital signs during the trial. As a result, abnormalities often went unnoticed, and no action was undertaken to prevent further deterioration. Ideally, after optimizing the individual components e.g. the notification strategy, the clinical effect of continuous monitoring on patient outcomes is studied as a complete monitoring strategy in a randomized controlled trial. Note that this includes consensus on the therapeutic interventions performed. By not doing so, and thus performing various interventions for the same incidents, one does not test the monitoring strategy, but rather the interventions performed. Clinical evaluation of monitoring strategies shows parallels with the workup for a new diagnostic tool, starting with initial safety, diagnostic accuracy (test-research), and reproducibility studies. If a monitor passes these initial tests, subsequent studies should focus on the additional diagnostic value, and eventually diagnostic intervention research investigating the effect on patient outcomes. [3335]

In monitoring studies, selection and reporting of the outcome should be done carefully. In contrast to a ‘classic’ diagnostic workup, monitoring does not estimate the probability of the presence of a disease once. Instead, the monitoring system tries to continuously update the probability that a patient will become critically ill in the near future. This difference brings along several issues in the selection and definition of the outcome measure.

First, ‘vital instability’ is not a diagnosis per se, but an undesirable patient status which may lead to critical illness and potential death in the very near future. Hence, its definition implicitly contains elements of the prognosis of the patient. For example, passing a given threshold for a vital sign (heart rate, respiratory rate, oxygen saturation or systolic blood pressure) makes the patient ‘instable’ as it is known from literature that passing this threshold strongly increases the probability of a serious adverse event from 2.5% to 35%.[36]

Second, vital signs change over time as part of natural history of a disease. Vital instability is hence a gliding scale, which may be interpreted differently by different caregivers. Hence, clear-cut and detailed definitions are required, e.g., the maximum acceptable deviation from baseline in percentages (%).

Third, when comparing the measurements by the monitoring system with a reference standard, differences in measurement frequency are encountered: the monitoring system senses continuously, whereas the reference standard are observations at discrete time points, for example once per shift by the nurse. When calculating accuracy the repeated measurements from the monitoring system have to be ‘summarized’ into a binary outcome. The way this summary is made influences the conclusion on the accuracy of the monitoring systems.

Fourth, selection of the clinical outcome in the diagnostic intervention study of a monitoring strategy is not straightforward. Mortality would seem a logical primary outcome in an intervention study evaluating the effect of safety monitoring. However, in-hospital mortality rates are low (between 0.8% for elective and 5.5% for emergency admissions [37]) and many hospital deaths cannot be prevented as they are due to the natural progression of disease. Unplanned ICU admission [1,36,3840] and cardiopulmonary arrest rates [3,40,41] were often chosen in publications evaluating implementation of early warning systems. However, unplanned admission to the ICU might be considered a serious adverse event but alternatively, it can be an adequate early therapeutic decision that will positively influence the course of disease. Therefore, rescue events including unplanned ICU admissions should be explicitly predefined and considered as composite endpoints. An alternative substitute for mortality could be the length of hospital or ICU stay as in the study of Brown.

A final recommendation for monitoring research is to focus not only on patient outcomes, but also on feasibility of (part of) the monitoring strategy. This includes patient acceptability (freedom of movement, possible discomfort) and acceptability for nursing staff (ease of interpretation, false alarm rate, notification system–timely appropriate decision support versus disruptive irrelevant alerts). For example, future miniaturized wireless sensor technology may possibly eliminate the drawbacks of conventional ‘wired’ monitoring such as patient discomfort and increased staff workload from false alarms caused by sensor dislodgment. Ignoring aspects of feasibility may obscure the additional value of an otherwise well designed monitoring system.

Conclusions

Based on the results of the studies selected in this systematic review, implementation of routine continuous (respiratory) monitoring on general hospital wards cannot yet be advocated. The methodological quality of studies evaluating electronic patient monitors on general hospital wards needs improvement. Future research in this area should focus on technology explicitly suitable for low care clinical settings and development of alarm algorithms tailored to the specific hospital ward setting.

Supporting Information

S1 File. Search strategy.

Search was performed on October 25, 2014.

https://doi.org/10.1371/journal.pone.0144626.s001

(PDF)

S2 File. Checklist for intervention research and diagnostic studies.

Data extraction form.

https://doi.org/10.1371/journal.pone.0144626.s002

(PDF)

S3 File. Modified assessment tool used to describe study quality.

Since there are no specific methodological quality assessment tools for research on monitoring technology, we used modified Standards for Reporting Studies of Diagnostic Accuracy (STARD), Quality Assessment of Diagnostic Accuracy Studies (QUADAS), Consolidated Standards Of Reporting Trials (CONSORT) and Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statements.

https://doi.org/10.1371/journal.pone.0144626.s003

(PDF)

S4 File. References (50 articles) that were not included in the systematic review.

https://doi.org/10.1371/journal.pone.0144626.s004

(PDF)

S1 Table. Technical characteristics of non-invasive continuous monitors in diagnostic studies.

https://doi.org/10.1371/journal.pone.0144626.s006

(DOCX)

S2 Table. Summary of methodological quality of the diagnostic studies.

https://doi.org/10.1371/journal.pone.0144626.s007

(DOCX)

S3 Table. Summary of characteristics and outcomes for diagnostic studies.

https://doi.org/10.1371/journal.pone.0144626.s008

(DOCX)

Acknowledgments

Ralph So, M.D., consultant in anesthesiology and intensive care in the Albert Schweitzer hospital in Dordrecht, the Netherlands, has contributed by reading and commenting on the manuscript.

Author Contributions

Conceived and designed the experiments: KVL BVZ LP CK. Performed the experiments: KVL EB LP. Analyzed the data: KVL EB LP BVZ. Wrote the paper: KVL BVZ LP CK.

References

  1. 1. Goldhill DR, White SA, Sumner A. Physiological values and procedures in the 24 h before ICU admission from the ward. Anaesthesia. 1999;54(6):529–34. pmid:10403864
  2. 2. McGain F, Cretikos MA, Jones D, Van Dyk S, Buist MD, Opdam H, et al. Documentation of clinical review and vital signs after major surgery. Med J Aust. 2008;189(7):380–3. pmid:18837681
  3. 3. Buist M, Bernard S, Nguyen TV, Moore G, Anderson J. Association between clinically abnormal observations and subsequent in-hospital mortality: a prospective study. Resuscitation. 2004; 62(2):137–41. pmid:15294398
  4. 4. Fieselmann JF, Hendryx MS, Helms CM, Wakefield DS. Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients. J Gen Intern Med. 1993; 8(7):354–60. pmid:8410395
  5. 5. Rosenberg AL, Watts C. Patients readmitted to ICUs: a systematic review of risk factors and outcomes. Chest. 2000; 118(2):492–502. pmid:10936146
  6. 6. Jonsson T, Jonsdottir H, Möller AD, Baldursdottir L. Nursing documentation prior to emergency admissions to the intensive care unit. Nurs Crit Care. 2011; 16(4):164–9. pmid:21651656
  7. 7. Rosenberg AL, Hofer TP, Hayward RA, Strachan C, Watts CM. Who bounces back? Physiologic and other predictors of intensive care unit readmission. Crit Care Med. 2001; 29(3):511. pmid:11373413
  8. 8. Hillman K, Bristow P, Chey T, Jacques T, Normal SL, Bishop GF, et al. Antecedents to hospital deaths. Intern Med J. 2001; 31:343–8. pmid:11529588
  9. 9. Goldhill DR, McNarray AF. Physiological abnormalities in early warning scores are related to mortality in adult inpatients. Br J Anaesth. 2004; 92(6):882–4. pmid:15064245
  10. 10. Cretikos M, Bellomo R, Hillman K, Chen J, Finfer S, Flabouris A. Respiratory rate: the neglected vital sign. Med J Aust. 2008; 188(11):657–9. pmid:18513176
  11. 11. Folke M, Cernerud L, Ekström M, Hök B. Critical review of non-invasive respiratory monitoring in medical care. Med Biol Eng Comput. 2003; 41(4):377–83. pmid:12892358
  12. 12. Bossuyt PMP, Reitsma JBJ, Bruns DED, Gatsonis CAC, Glasziou PPP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ. 2003; 326:41–4. pmid:12511463
  13. 13. Whiting P, Rutjes AWS, Reitsma JB, Bossuyt PMM, Kleijnen J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2000; 3:25.
  14. 14. Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010; 340(c332):698–702.
  15. 15. Des Jarlais DC, Lyles C, Crepaz N, TREND group. Improving the Reporting Quality of Nonrandomized Evaluations of Behavioral and Public Health Interventions: The TREND Statement. American Journal of Public Health. 2004; 94(3):361–6. pmid:14998794
  16. 16. Brown H, Terrence J, Vasquez P, Bates DW, Zimlichman E. Continuous monitoring in an inpatient medical-surgical unit: A controlled clinical trial. Am J Med. 2014; 115(2): 421–31.
  17. 17. Hravnak M, Devita MA, Clontz A, Edwards L, Valenta C, Pinsky MR. Cardiorespiratory instability before and after implementing an integrated monitoring system. Crit Care Med. 2011; 39(1):65–72. pmid:20935559
  18. 18. Kisner D, Wilhelm MJ, Messerli MS, Zünd G, Genoni M. Reduced incidence of atrial fibrillation after cardiac surgery by continuous wireless monitoring of oxygen saturation on the normal ward and resultant oxygen therapy for hypoxia. Eur J Cardiothorac Surg. 2009; 35(1):111–5. pmid:18835783
  19. 19. Ochroch EA, Russell MW, Hanson WC, Devine GA, Cucchiara AJ, Weiner MG, et al. The impact of continuous pulse oximetry monitoring on intensive care unit admissions from a postsurgical care floor. Anesth Analg. 2006; 102(3):868–75. pmid:16492843
  20. 20. Taenzer AH, Pyke JB, McGrath SP, Blike GT. Impact of pulse oximetry surveillance on rescue events and intensive care unit transfers: a before-and-after concurrence study. Anesthesiology. 2010; 112(2):282–7. pmid:20098128
  21. 21. Watkinson PJ, Barber VS, Price JD, Hann A, Tarassenko L, Young JD. A randomised controlled trial of the effect of continuous electronic physiological monitoring on the adverse event rate in high risk medical and surgical patients. Anaesthesia. 2006; 61(11):1031–9. pmid:17042839
  22. 22. Anderson W, Brock-Utne AJ, Brock-Utne JG, Brodsky JB. Evaluation of a respiratory rate monitor in postsurgical patients. J Clin Anesth. 1992; 4(4):289–91. pmid:1384579
  23. 23. Flisberg P, Jakobsson J, Lundberg J. Apnea and bradypnea in patients receiving epidural bupivacaine-morphine for postoperative pain relief as assessed by a new monitoring method. J Clin Anesth. 2002; 14(2):129–34. pmid:11943527
  24. 24. Hravnak M, Edwards L, Clontz A, Valenta C, Devita MA, Pinsky MR. Defining the incidence of cardiorespiratory instability in patients in step-down units using an electronic integrated monitoring system. Arch Intern Med. 2008; 168(12):1300–8. pmid:18574087
  25. 25. Jacobs JL, Apatov N, Glei M. Increasing vigilance on the medical/surgical floor to improve patient safety. J Adv Nurs. 2007;57(5):472–81. pmid:17284271
  26. 26. Zimlichman E, Szyper-Kravitz M, Shinar Z, Klap T, Levkovich S, Unterman A, et al. Early recognition of acutely deteriorating patients in non-intensive care units: assessment of an innovative monitoring technology. J Hosp Med. 2012; 7(8):628–33. pmid:22865462
  27. 27. Taenzer AH, Pyke JB, McGrath SP. A review of current and emerging approaches to address failure-to-rescue. Anesthesiology. 2011; 115(2):421–31. pmid:21587063
  28. 28. Hassanien AE, Al-Shammari ET, Ghali NI. Computational intelligence techniques in bioinformatics. Comput Biol Chem. 2013; 47:37–47. pmid:23891719
  29. 29. Burgess LPA, Herdman TH, Berg BW, Feaster WW, Hebsur S. Alarm limit settings for early warning systems to identify at-risk patients. J Adv Nurs. 2009; 65(9):1844–52. pmid:19694847
  30. 30. Chambrin MC. Alarms in the intensive care unit: how can the number of false alarms be reduced? Crit Care. 2001; 5(4):184–8. pmid:11511330
  31. 31. Edworthy J, Hellier E. Alarms and human behaviour: implications for medical alarms. Br J Anaesth. 2006; 97(1):12–7. pmid:16698858
  32. 32. Hagenouw RRPM. Should we be alarmed by our alarms? Curr Opin An.aesthesiol. 2007; 20(6):590–4.
  33. 33. Van den Bruel A, Cleemput I, Aertgeerts B, Ramaekers D, Buntinx F. The evaluation of diagnostic tests: evidence on technical and diagnostic accuracy, impact on patient outcome and cost-effectiveness is needed. J of Clin Epidem. 2007; 60(11):1116–22.
  34. 34. di Ruffano LF, Hyde CJ, McCaffery KJ, Bossuyt PMM, Deeks JJ. Assessing the value of diagnostic tests: a framework for designing and evaluating trials. BMJ. 2012; 344:686–6.
  35. 35. Moons KGM, Biesheuvel CJ, Grobbee DE. Test research versus diagnostic research. Clin Chem. 2004; 50(3):473–6 pmid:14981027
  36. 36. Lighthall GK, Markar S, Hsiung R. Abnormal vital signs are associated with an increased risk for critical events in US veteran inpatients. Resuscitation. 2009; 80(11):1264–9. pmid:19744762
  37. 37. Campbell MJ, Jacques RM, Fotheringham J, Maheswaran R, Nicholl J. Developing a summary hospital mortality index: retrospective analysis in English hospitals over five years. BMJ. 2012; 344:e1001. pmid:22381521
  38. 38. Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, et al. Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005; 365(9477): 2091–7. pmid:15964445
  39. 39. Cretikos M, Chen J, Hillman K, Bellomo R, Finfer S, Flabouris A, et al. The objective medical emergency team activation criteria: a case-control study. Resuscitation. 2007; 73(1):62–72. pmid:17241732
  40. 40. Subbe CP. Validation of a modified Early Warning Score in medical admissions. QJM. 2001; 94(10):521–6. pmid:11588210
  41. 41. Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart GK, Opdam H, et al. A prospective before-and-after trial of a medical emergency team. Med J Aust. 2003; 179:283–7. pmid:12964909