http://orcid.org/0000-0002-4697-0358
Figures
Abstract
Background
The effect of a multi-faceted handoff strategy in a high volume internal medicine inpatient setting on process and patient outcomes has not been clearly established. We set out to determine if a multi-faceted handoff intervention consisting of education, standardized handoff procedures, including fixed time and location for face-to-face handoff would result in improved rates of handoff compared with usual practice. We also evaluated resident satisfaction, health resource utilization and clinical outcomes.
Methods
This was a cluster randomized controlled trial in a large academic tertiary care center with 18 inpatient internal medicine ward teams from January-April 2013. We randomized nine inpatient teams to an intervention where they received an education session standardizing who and how to handoff patients, with practice and feedback from facilitators. The control group of 9 teams continued usual non-standardized handoffs. The primary process outcome was the rate of patients handed over per 1000 patient nights. Other process outcomes included perceptions of inadequate handoff by overnight physicians, resource utilization overnight and hospital length of stay. Clinical outcomes included medical errors, frequency of patients requiring higher level of care overnight, and in-hospital mortality.
Results
The intervention group demonstrated a significant increase in the rate of patients handed over to the overnight physician (62.90/1000 person-nights vs. 46.86/1000 person-nights, p = 0.002). There was no significant difference in other process outcomes except resource utilization was increased in the intervention group (26.35/1000 person-days vs. 17.57/1000 person-days, p-value = 0.01). There was no significant difference between groups in medical errors (4.8% vs. 4.1%), need for higher level of care or in hospital mortality. Limitations include a dependence of accurate record keeping by the overnight physician, the possibility of cross-contamination in the handoff process, analysis at the cluster level and an overall low number of clinical events.
Citation: Tam P, Nijjar AP, Fok M, Little C, Shingina A, Bittman J, et al. (2018) Structured patient handoff on an internal medicine ward: A cluster randomized control trial. PLoS ONE 13(4): e0195216. https://doi.org/10.1371/journal.pone.0195216
Editor: Nicole Heussen, Medical faculty RWTH Aachen, GERMANY
Received: April 17, 2017; Accepted: March 8, 2018; Published: April 19, 2018
Copyright: © 2018 Tam et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by the Canadian Medical Protective Agency GRNT--2706 to PT and the Michael Smith Foundation for Health Research to NAK. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Efforts to improve patient safety and resident physician well-being resulted in an international push to limit resident work hours [1–2]. After the implementation of such restrictions in Canada, the United States, and Europe, the results are varied, with some studies showing worse patient outcomes, negative impacts on resident quality of life [1] with yet others showing a decrease in adverse events [3]. These changes emphasized the importance of “handoff”, a term used to describe the transfer of patient information from the outgoing physician of care to the incoming on-call physician [4].
At large institutions with high volumes of inpatients, handoff on all patients is not feasible, thereby requiring daytime physicians to prioritize a smaller subset of patients to convey potential issues on. From a survey of 26 physicians, it was noted that incomplete and omitted information in handoff was a significant issue and considered to lead to failure to anticipate and communicate problems to on-call physicians [5]. Previous work showed poor handoff specifically implicated in 20–24% of medical errors [4], while a more recent survey of Canadian residents showed that nearly half of respondents were directly involved in or witnessed an adverse event related to handoff [6]. Given this, the World Health Organization (WHO) and other regulatory bodies prioritized optimizing handoff as a top patient safety initiative [1,7–8].
A number of strategies for optimal handoff were suggested with standardization being noted most frequently [4]. Other suggested strategies include providing training or education and addressing environmental issues such as lighting, interruptions and noise [1,4,9]. Despite a call from the Accreditation Council for Graduate Medical Education (ACGME) to develop curricula [10], many residency programs do not educate trainees in the process of handoffs, with approximately 57% of Canadian residents learning this skill informally from other residents or staff [5]. Some of these strategies have recently been evaluated in a randomized trial of handoff methods in a surgical training program, demonstrating no clinically significant differences in patient outcomes [11]. We set out to evaluate implementation of standardized handoff among medical ward patients in a parallel controlled trial.
We conducted a cluster randomized controlled study to assess the effect of implementing a multi-faceted and standardized handoff intervention on the rates of handoff by residents. The intervention consisted of training and education on the type of patient to handoff, what information to handoff, and identifying a specific time and location for uninterrupted face-to-face handoff. We also assessed this intervention on resident satisfaction, and patient level outcomes including health resource utilization and clinical events. Clustering by ward teams was employed to minimize contamination of the structured handoff process between medical trainees within the same teams.
Methods
Study design
We conducted a cluster randomized-controlled trial (RCT) within the internal medicine inpatient wards at Vancouver General Hospital (VGH) between January 2013 and April 2013. Eligible ward medical teams consisted of one attending physician, 3–4 residents and 2–3 medical students. The physician staff and students are designated by a team color and change every four weeks. However, patients generally stay on their designated team throughout their hospital admission (96.6%). Ward teams that consisted of only one attending and one resident were not included in this study. All patients admitted to the eligible Internal Medicine wards were also included in this study.
Nine inpatient medical teams were randomized to intervention and nine teams were randomized to usual care by the PI (PT) by drawing lots as a manual method of simple randomization. There was no allocation concealment. The intervention was targeted at resident trainees within medical teams. Residents were placed on certain ward teams by the chief medical resident, who was not involved in this study. They were allocated, per usual methods, to ensure an equal number of senior and junior residents on each team. All residents on the intervention teams were included in the intervention, since any one of them could be providing handoffs. Patients admitted to various inpatient teams was in a generally random fashion, depending on bed availability.
Study setting
VGH is a 950-bed academic, tertiary care center located in Vancouver, British Columbia. The internal-medicine service, also known as the Clinical Teaching Unit (CTU) has an average daily census of 100–110 medical patients. During daytime hours, the medicine service consists of six teams, each comprised of one attending physician and one to four residents and two to four medical students at various levels of training.
On-call clinical associates (CAs) are senior level residents (generally in post-graduate years 3–5) who cover evening shifts between 18:00–07:00 hours. The primary handoff period occurs from the daytime teams to a single CA who is responsible for all the CTU ward patients overnight.
Intervention
The intervention group received a 45-minute training and education session on the importance and evidence for patient handoff, standardization of type of patient and information to handoff as well designating a fixed time (17:30–18:00) and dedicated quiet location for face-to-face handoff (4). One faculty member and one resident delivered the education session at the start of each monthly block to trainees. For the type of patient to handoff, trainees were instructed to handoff all patients who had any of: (i) investigations pending, (H) currently located in a high acuity unit, (A) abnormal vital signs in the preceding 24 hours, (N) newly admitted in the last 24 hours, and (D) dying. The hand off criteria (iHAND) was developed following a literature review and focus groups of eight clinical faculty members and six CAs. Validation of iHAND was done in a case control analysis of 90 inpatients, where the effectiveness of clinical gestalt, MEWS, and iHAND were evaluated using logistic regression analyses and receiver operating characteristic (ROC) curves [12]. The iHAND criteria showed a moderately significant correlation with requiring assessment overnight S1 File.
Trainees were also instructed to handoff information following the widely adopted SIGNOUT? mnemonic (Sick or do not resuscitate, Identifying data, General hospital course, New events of the day, overall health status, Upcoming possibilities with plan, Tasks to complete, ?Questions) [11]. Participants in the trainee session practiced handoffs to one another in small groups for the last 10–15 minutes with the facilitators supervising and providing feedback. Lastly, participants were given a pocket card with the mnemonics taught for use during handoff S3 File. The usual care group was given no specific instructions and handoff practices were left to the discretion of the team.
Study outcomes
The primary outcome of the study was the rate of patient handoffs to the CA. Patient handoff events were only counted once per overnight shift per patient but patients may have had other handoff events during the course of their admission. In addition, total patient encounters represented an individual patient and included any and all documented handoffs, nursing questions, physical assessments, and actions taken by the CA overnight. The CAs completed data collection forms on all patients they received handoff on as well as patients that required assessment during the overnight shift S2 File.
We also measured the satisfaction of the handoff process as perceived by the CAs along with resident satisfaction. Health resource utilization was assessed using aggregate length of stay of patients admitted to the CTU and resource utilization for patients assessed by the CA overnight. Resource utilization, measured at the level of the patient, including radiographic imaging, blood tests, electrocardiogram, blood transfusions, IV fluid administration, and antibiotics were obtained through medical record review of all patients seen by the CA. Clinical endpoints analyzed at the level of the patient, included frequency of patients transferred to the Intensive Care Unit (ICU) and/or referred to the Critical Care Outreach Team (CCOT); aggregate rate of in hospital mortality of patients admitted to the CTU; and evaluation of medical errors of patients handed off to the CAs. Clinical endpoint data were collected through inpatient chart review and data on ICU transfers or CCOT referrals were provided by the ICU department. We only included ICU transfers and/or CCOT referrals occurring in the time frame of 18:00–07:00.
To further evaluate the effect of the intervention on patient safety, an additional outcome of medical errors was included in the study. A trained research assistant and physician team member (APN) blinded to the randomization of the patient conducted chart reviews on each patient handed off during the study period. For determination of medical errors, all examining physician notes, nursing notes, orders, and any incident reports were reviewed during the 48 hour period after a patient was handed off. The 48-hour limit was instituted to try and capture errors that might be directly attributed to handoff. All medical errors (including medication errors, procedure related errors, diagnosis or history and physical related errors, and falls) and preventable adverse events (any injury or harm to a patient arising from medical care delivery) were evaluated from chart review and were consistent with definitions from the IPASS study [3]. Chart review was possible on 94.3% of the original patient cohorts for evaluation of medication errors (446/473).
Statistical analysis
We used intention to treat analysis. The sample size was powered to 80% to detect a 30% increase in proportion of patient handoff between the two groups with an alpha of 0.05 using the assumption that the average proportion of handoff is 5% (total sample size = 7560 patient nights). Assuming the average follow-up time is 10 days, the study will include 9 teams for the intervention and usual care group, respectively, and each team will take care of 45 patients.
For each outcome, the total number of events and total person-nights of each team were summarized. The event rate was calculated as per 1000 person-nights. Poisson regression model was conducted to compare the event rate between the two treatment groups. Team was the unit of analysis and total person-night was used as an offset in the Poisson regression. The relative risk of the two groups and its 95% confidence interval from Poisson regression model were reported. In the sensitivity analysis, regression model was performed with adjusting for the number of patients per resident in each team for resource utilization and clinical outcomes.
Comparison of proportion of medical errors was done using Chi-square test. Survey results of the CAs were compared using Bowker’s test of asymmetry between intervention and control groups, while trainee satisfaction survey results were examined using Chi-square test. Missing data from surveys were excluded from analysis. All analyses were conducted using SAS software, version 9.2 (SAS Institute). A p value <0.05 was considered statistically significant. This study was approved by the University of British Columbia and Vancouver Coastal Health Authority ethics boards. Informed consent of the residents was obtained by the voluntary participation in completing the surveys after reading the accompanying cover letter. This approach was approved by the Ethics Board. A waiver of consent was provided for patient level information since it was limited to chart review, involved minimal risk, and did not involve a therapeutic, clinical, or diagnostic intervention.
Registration in the clinicaltrials.gov registry was delayed till February 14, 2013, while recruitment for the study was from January 14, 2013 to April 7, 2013. This was inadvertent and due to a clerical error. However, the study was approved by the Ethics board May 3, 2012 and there were no changes to the protocol or primary end points from when recruitment began to the registration of the trial. The authors confirm that all ongoing and related trials for this intervention are registered.
Results
There were 48 residents and 1168 patients (8652 patient nights) during the study time (Fig 1). There was a similar number of residents and volumes of patients on the intervention and control teams (Table 1). Data on the total number of patients and their characteristics were provided by the hospital and were fairly balanced between groups. On the Clinical Teaching Units, most patients were elderly and the most common discharge diagnosis included pneumonia or influenza, sepsis, or gastrointestinal problems.
Over the study period, the CA’s recorded a total of 1,150 patient encounters over the study duration (8652 person-nights). There were 599 patient encounters recorded in the intervention group and 551 in the control group. Of the 1,150 there were 265 patient handoffs (patients formally handed off to the CA) in the intervention group and 208 in the control group. In the intervention group, 49% (130/265) of the handoffs occurred face-to-face and 41.5% occurred over the phone. For the control group, face-to-face handoff occurred 38.5% (80/208) of the time, while 51.9% was over the phone.
Process outcomes
The primary outcome of the rate of patient handoffs over to the CA by the primary team at the start of the overnight shift is demonstrated in Table 2. The handoff intervention group demonstrated a significantly higher proportion of patient handoffs to the CA (62.90/1000 person-days vs. 46.86/1000 person-days, p-value = 0.002) compared with usual practices.
Other outcomes included resident and CA satisfaction. Resident participation in the survey was low with a 62.5% response rate (30/48). There was no difference in the proportion of patients where the CA did not receive necessary handoff information. Satisfaction with the handoff process from both the CA and CTU resident perspective was not significantly different between intervention and control groups as shown in Table 3.
Resource utilization
Average hospital length of stay was not significantly different either (9.25 vs. 9.28 days, p-value = 0.97). However, the proportion of patients receiving additional resource utilization was increased in the intervention group compared with the control group. Individual health resource utilization components were not significantly different between groups (Table 2).
Clinical outcomes
Table 2 also includes secondary clinical outcomes of ICU transfer, CCOT referral, and in-hospital mortality, none of which were significantly different. Medical errors and potentially adverse events were infrequent and not significantly different between the two arms (Table 2).
Sensitivity analysis
We adjusted for clustering in resource utilization and clinical outcomes, and the findings were generally unchanged except that use of blood products was significantly associated with the intervention (adjusted RR 2.94, 95%CI: 1.03–8.43, p = 0.04; unadjusted RR 2.74, 95%CI:0.98–7.68, p = 0.06).
Discussion
The implementation of a multi-faceted structured handoff program resulted in significantly more patients being handed off to the overnight physician and increased resource utilization compared with non-standardized handoff practices, but no significant differences in clinical outcomes or medical errors.
The bundled intervention demonstrated increased patient handoff and health resource utilization compared with usual handoff practices. These findings are consistent with other studies [13–15] and recommendations by the ACGME to improve handoff processes [16]. Our intervention may have led to increased health resource utilization because the CA does often receive specific instructions for investigations to be followed up overnight. Increased use of ECGs may reflect a common request to evaluate a complaint of chest pain. Increased use of blood products may reflect instructions to transfuse blood given a specific hemoglobin result. These findings suggest that a structured training program on handoff with feedback can lead to improved handoff practices. From the resident and CA surveys, satisfaction with handoff was modest and not different in both intervention and control group. However, response rates were low, limiting interpretation of these findings. Resident satisfaction with formalized handoffs has already been identified in a number of studies [14–15,17].
The research demonstrating a significant impact of formal and standardized handoff processes in terms of resident training and clinical outcomes is limited. Our negative results on patient outcomes are consistent with other studies [18–20]. Using a case-based computer simulation to provide opportunities to teach and practice handoffs, a study by Johnson et al. on pediatrics residents did not find any significant differences in patient outcomes such as rapid response calls or transfers to the ICU with implementation of the module [18]. Formalized handoff processes can result in increased confidence among medical providers and a perceived decrease in “near-miss” events [19], but no demonstration of an actual improvement in patient outcomes. Use of face-to-face handoff also did not show improved patient outcomes among hospitalized medical patients [20]. In a prospective pre-post test study by Starmer et al., handoff on all patients using a multifaceted handoff bundled intervention in 9 pediatric inpatients centers showed a 23% reduction in medical error rates with handoff practices [21]. However, this study design used a time series analysis that is at risk for bias for differing co-interventions at different time points and temporal changes in outcomes. Outcomes were assessed on all patients, not just those seen by on-call physicians. Further, this study’s intervention of handing off all in-patients is not easily applied to high patient volume settings. There may be other efforts required to show a handoff bundle is effective in reducing medical errors or improving patient outcomes. The strongest and most recent randomized trial of formalized patient handoff in a surgical residency program did not show any difference in mortality, medical errors or length of stay [11]. This may indicate a need for more tailored handoff strategies for different settings. Others have commented on the need for robust information systems that involve an effective electronic medical record along with a sustainable cultural change program [22].
The potential reasons for the negative findings in change in clinical outcomes between our two groups are likely multi-fold. Despite an increase in patients handed off, we did not identify any significant differences in patient outcomes. Handoff to the evening CA traditionally occurs for the seriously unwell patients on the ward as standard of care and thus the residents assigned to the control group may have also similarly identified and handed off patients at high risk for being seen by overnight physicians thus minimizing differences in ICU and CCOT transfers. Other patient clinical deterioration events may also be less or difficult to predict so handoff on a select subset of patients may miss a significant proportion of patients needing evaluation by the overnight physician. Furthermore, overnight CAs are, in general, experienced senior-level residents. One can postulate that whether they received a patient handoff or not, CA’s were able to stabilize and manage patients quickly and appropriately by reviewing the chart once notified by nurses. Also, our medical error rate was lower than expected. Safety measures built into our system such as physician alerts for abnormal laboratory values, modified assignment nursing staff allowing for closer monitoring of sicker patients and residents on-call in the emergency department overnight may have allowed for closer follow-up on patient issues identified during the daytime.
The strengths of the study include a parallel controlled trial design and multiple outcomes measured in a high volume patient setting. We also used a multi-faceted intervention that included not only mnemonics, but also observation and feedback during the education session and a specific time and location for uninterrupted face-to-face handoff. Our study focused on the internal medicine wards with a general census of over 100 patients, common in many general internal medicine residency programs. However, our study has limitations. Data were dependent on the accurate record keeping by the CA, however there is no evidence to suggest a difference in accuracy between the intervention and control arm. Although we employed clustering in our intervention, there may have been some contamination in the handoff process between intervention and control. Conducting the analysis at the cluster level did not enable us to take advantage of patient level analysis, such as variation in cluster size and allowing adjustment for patient level characteristics. The number of clinical events including serious medical errors was low in our study, thus limiting our ability to detect smaller changes in these events. Results from our survey were limited due to lower than expected participation in the survey. Our study was carried out in a high volume academic tertiary care center with a single experienced resident covering overnight shifts and as such, our findings may not be generalized to lower volume hospitals or hospitals without trainees. Finally, we did not explore the effect of having a single CA covering over 100 patients and whether having more physicians to share the workload along with improved handoff would improve patient outcomes.
Conclusions
While there is widespread recognition for the need in creating a handoff process in the inpatient hospital setting [23], an evidence-based approach for internal medicine residency programs remains to be determined. Our handoff bundle of resident training and education, standardization, mnemonics, and face-to-face handoff did not succeed in an improvement in general patient outcomes in a high volume in patient medical service. Novel methods to improve clinical outcomes associated with handoff need to be explored.
Acknowledgments
Special thanks to Hong Qian for her assistance with statistical analysis. We also appreciate the hard work of our research assistants: Smrita Grewal and Shahin Zangenehpour.
References
- 1. Pattani R, Wu PE, Dhalla IA. Resident duty hours in Canada: Past, present and future. CMAJ. 2014;186(10): 761–5. pmid:24847138
- 2.
Policy Statement: Handover Education in Canadian Residency Programs, April 2014. Canadian Association of Internes and Residents. http://residentdoctors.ca/wp-content/uploads/2014/12/CAIR-Policy-Statement-on-Handovers_FINAL-EN.pdf. Accessed June 1, 2015.
- 3. Starmer AJ, Spector R, Srivastava R, West DC, Rosenbluth G, Allen AD, et al, for the I-PASS Study Group. Changes in Medical Errors after Implementation of a Handoff Program. N Engl J Med. 2014;371(19): 1803–12. pmid:25372088
- 4. Riesenberg LA, Leitzsch J, Massucci JL, Jaeger J, Rosenfeld JC, Patow C, et al. Residents’ and Attending Physicians’ Handoffs: A Systematic Review of the Literature. Acad Med. 2009;84(12): 1775–1787. pmid:19940588
- 5. Borowitz SM, Waggoner-Fountain LA, Bass EJ, Sledd RM. Adequacy of information transferred at resident sign-out (inhospital handover of care): a prospective survey. Qual Saf Health Care. 2008;17(1): 6–10. pmid:18245212
- 6.
Rayar M, Little C, Meloche J, Noy S, McCarrey M. Residents’ Perspectives on Handover: Results of the Canadian Association of Internes and Residents 2013 National Resident Survey. Presented at 2014 Canadian Conference on Medical Education, Ottawa. April 26th, 2014.
- 7.
The Joint Commission. 2009 Hospital National Patient Safety Goals. http://www.jointcommission.org/PatientSafety/Solutions/
- 8.
World Health Organization. High 5s Project action on patient safety. Geneva (Switzerland): The Organization; 2010. www.who.int/patientsafety/implementation/solutions/high5s/ps_high5sprojectoverview_fs_2010_en.pdf
- 9. Starmer AJ, Spector ND, Srivastava R, Allen AD, Landrigan CP, Sectish TC; I-PASS Study Group. I-pass, a mnemonic to standardize verbal handoffs. Pediatrics. 2012;129(2): 201–04. pmid:22232313
- 10.
Accreditation Council for Graduate Medical Education. Common Program Requirements. http://www.acgme.org/acgmeweb/Portals/0/PFAssets/ProgramRequirements/CPRs2013.pdf
- 11. Clanton J, Gardner A, Subichin M, McAlvanah P, Hardy W, Shah A, et al. Patient Hand-Off iNitiation and Evaluation (PHONE) study: A randomized trial of patient handoff methods. Am J Surg. 2017;213(2): 299–306. pmid:27998549
- 12. Bittman J, Tam P, Little C, Khan N. Who to handover: a case-control study of a novel scoring system to prioritise handover of internal medicine inpatients. Postgrad Med J. 2017;93(1100): 313–318. pmid:27655897
- 13. Horwitz L, Moin T, Green M. Development and implementation of an oral sign-out skills curriculum. J Gen Intern Med. 2007;22(10): 1470–1474. pmid:17674110
- 14. Chu ES, Reid M, Schulz T, Burden M, Mancini D, Ambardekar AV, et al. A structured handoff program for interns. Acad Med. 2009;84(3): 347–52. pmid:19240442
- 15. Gakhar B and Spencer A. Using direct observation, formal evaluation, and an interactive curriculum to improve the sign-out practices of internal medicine interns. Acad Med. 2010;85(7): 1182–1188. pmid:20375830
- 16.
Riebschleger M, Philbert I. New Standards for Transitions of Care: Discussion and Justification. ACGME: Enhancing Quality of Care, Supervision, and Resident Professional Development. https://www.acgme.org/acgmeweb/Portals/0/PDFs/jgme-11-00-57-59[1].pdf
- 17. Van Eaton EG, Horvath KD, Lober WB, Rossini AJ, Pellegrini CA. A randomized controlled trial evaluating the impact of a computerized rounding and sign-out system on continuity of care and resident work hours. J Am Coll Surg. 2005;200(4): 538–545. pmid:15804467
- 18. Johnson DP, Zimmerman K, Staples B, McGann KA, Frush K, Turner DA. Multicenter development, implementation and patient safety impacts of a simulation-based module to teach handovers to pediatric residents. Hosp Pediatr. 2015;5(3): 154–9. pmid:25732989
- 19. Payne CE, Stein JM, Leong T, Dressler DD. Avoiding handover fumbles: a controlled trial of a structured handover tool versus traditional handover methods. BMJ Qual Saf. 2012;21(11): 925–32. pmid:22706931
- 20. Schouten WM, Burton MC, Jones LD, Newman J, Kashiwagi DT. Association of face-to-face handoffs and outcomes of hospitalized internal medicine patients. J Hosp Med. 2015;10(3): 137–41. pmid:25736613
- 21. Starmer AJ, Sectish TC, Simon DW, Keohane C, McSweeney ME, Chung EY, et al. Rates of medical errors and preventable adverse events among hospitalized children following implementation of a resident handoff bundle. JAMA. 2013;310(21): 2262–2270. pmid:24302089
- 22. Colligan L, Brick D, Patterson ES. Changes in Medical Errors with a Handoff Program—Comment. NEJM. 2015;372(5): 490–91.
- 23. Allen S, Caton C, Cluver J, Mainous AG, Clyburn B. Targeting improvements in patient safety at a large academic center: an institutional handoff curriculum for graduate medical education. Acad Med. 2014;89(10): 1366–9. pmid:25119553