Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A brief intervention for preparing ICU families to be proxies: A phase I study

  • Alison E. Turnbull ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    turnbull@jhmi.edu

    Affiliations Outcomes After Critical Illness and Surgery (OACIS) Group, Johns Hopkins University, Baltimore, Maryland, United States of America, Division of Pulmonary and Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland, United States of America, Department of Epidemiology, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America

  • Caroline M. Chessare,

    Roles Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliations Outcomes After Critical Illness and Surgery (OACIS) Group, Johns Hopkins University, Baltimore, Maryland, United States of America, Division of Pulmonary and Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland, United States of America

  • Rachel K. Coffin,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Medical Intensive Care Unit, Johns Hopkins Hospital, Baltimore, Maryland, United States of America

  • Dale M. Needham

    Roles Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    Affiliations Outcomes After Critical Illness and Surgery (OACIS) Group, Johns Hopkins University, Baltimore, Maryland, United States of America, Division of Pulmonary and Critical Care Medicine, School of Medicine, Johns Hopkins University, Baltimore, Maryland, United States of America, Department of Physical Medicine and Rehabilitation, School of Medicine, Johns Hopkins University, Baltimore, Maryland, United States of America

A brief intervention for preparing ICU families to be proxies: A phase I study

  • Alison E. Turnbull, 
  • Caroline M. Chessare, 
  • Rachel K. Coffin, 
  • Dale M. Needham
PLOS
x

Abstract

Background

Family members of critically ill patients report high levels of conflict with clinicians, have poor understanding of prognosis, struggle to make decisions, and experience substantial symptoms of anxiety, depression, and post-traumatic stress regardless of patient survival status. Efficient interventions are needed to prepare these families to act as patient proxies.

Objectives

To assess a brief “patient activation” intervention designed to set expectations and prepare families of adult intensive care unit (ICU) patients to communicate effectively with the clinical team.

Design

Phase I study of acceptability and immediate side effects.

Setting and participants

122 healthcare proxies of 111 consecutive patients with a stay of ≥24 hours in the Johns Hopkins Hospital Medical ICU (MICU), in Baltimore, Maryland.

Intervention

Reading aloud to proxies from a booklet (Flesch-Kincard reading grade level 3.8) designed with multidisciplinary input including from former MICU proxies.

Results

Enrolled proxies had a median age of 51 years old with 83 (68%) female, and 55 (45%) African-American. MICU mortality was 18%, and 37 patients (33%) died in hospital or were discharged to hospice. Among proxies 98% (95% CI: 94% - 100%) agreed or strongly agreed that the intervention was appropriate, 98% (95% CI: 92% - 99%) agreed or strongly agreed that it is important for families to know the information in the booklet, and 54 (44%, 95% CI 35%– 54%) agreed or strongly agreed that parts of the booklet are upsetting. Upset vs. non-upset proxies were not statistically or substantially different in terms of age, sex, education level, race, relation to the patient, or perceived decision-making authority.

Conclusions

This patient activation intervention was acceptable and important to nearly all proxies. Frequently, the intervention was simultaneously rated as both acceptable/important and upsetting. Proxies who rated the intervention as upsetting were not identifiable based on readily available proxy or patient characteristics.

Introduction

The proportion of Medicare beneficiaries mechanically ventilated during the last month of life has risen steadily over the last 10 years.[1,2] The majority of these patients lack decision-making capacity and reply on family members to communicate with the intensive care unit (ICU) clinical team.[3,4] These family members report high levels of conflict with clinicians,[5,6] have poor understanding of prognosis,[710] struggle to make decisions,[1113] and experience substantial symptoms of anxiety, depression[14,15], and post-traumatic stress [1619] regardless of patient survival status. In response to these challenges, the Society of Critical Care Medicine and the American Thoracic Society have endorsed clinical practice guidelines on family-centered care in the ICU[20] and engaging family members in shared decision making[21].

ICU clinicians commonly report that family members’ incorrectly optimistic expectations for patient recovery is a major challenge to effective communication [2225]. Effective communication with families is also time-consuming, not consistently taught during critical care training programs[26], and requires advanced communication skills [27,28]. It is therefore unsurprising that prompt, multi-disciplinary family meetings have not been widely adopted[29,30] despite their endorsement as an indicator of high-quality ICU care [31].

Against this background, we recognize that family members of incapacitated patients have strong incentives to ensure that communication with ICU clinicians is clear and meaningful. “Patient activation” is a type of intervention that seeks to equip patients with the skills and confidence required to effectively engage healthcare providers for purposes of clinical decision-making [32,33]. Although traditionally used directly with patients in the outpatient setting, patient activation can be adapted to provide a similar intervention for ICU families. Therefore, we designed an intervention to help set appropriate expectations about patient recovery, explain the role of a healthcare proxy in the ICU, and prepare families to communicate effectively with the ICU clinical team. We recognize that family members prefer different decision-making roles and that some family members have strong emotional or psychological aversions to assuming decision-making responsibility[34]. Hence, this evaluation was designed as a Phase I study to assess the acceptability and immediate side effects of this brief activation intervention for ICU families.

Methods

Intervention design

The intervention was designed to 1) help set expectations about patient recovery from critical illness 2) educate adult family members in the medical intensive care unit (MICU) at Johns Hopkins Hospital (JHH) about the role of a healthcare proxy and 3) prepare proxies to communicate effectively with their ICU clinical team. Input from multi-disciplinary stakeholders was solicited during design of the intervention. First, as part of a qualitative study of physician-perceived facilitators and barriers to discussing post-hospitalization outcomes with ICU families,[24] intensivists at 20 hospitals across the U.S. were asked to describe the behaviors of effective ICU proxies, and to suggest questions that proxies should ask intensivists. We used these responses to draft an initial version of a short booklet and elicited feedback from the following JHH stakeholders: the JHH Patient and Family Advisory Council, MICU social workers, risk management (legal counsel), patient relations, chaplaincy and spiritual care, the MICU end-of-life interest group (primarily comprised of nurses), MICU nurse practitioners and physician assistants, as well as pulmonary and critical care fellows and MICU attending physicians. Iterative changes were made based on feedback throughout this process. The families of 6 current MICU patients who were not enrolled in the study also were asked to provide feedback.

The resulting intervention consisted of reading aloud from the final version of the booklet and then providing participants with the booklet for review. The 554-word booklet used in this study required 3.5 minutes to read aloud, with a Flesch-Kincard reading grade level of 3.8 and Flesch reading ease score of 85. The booklet contains black-and-white icons designed to be recognizable to a socio-economically and racially diverse population [35], and is freely available for download under at www.piperscience.org/proxy-activation. All interactions with study participants, including recruiting, consenting, and delivering the intervention were performed by white females (A.E.T., C.M.C., R.K.C.) of similar age (25–35 years old).

Study design

This investigation was designed as a Phase I study to assess the intervention’s acceptability to ICU families and identify immediate side effects [36]. We assessed acceptability by asking all participants to respond to the following two statements using a 5-point Likert scale ranging from Strongly agree to Strongly disagree: 1) “The booklet is appropriate for adult friends and family-members of ICU patients. 2) “It is important for families of ICU patients to know the information in the booklet. On an a priori basis, we defined the intervention as acceptable if ≥80% of participants described the intervention as both appropriate and important for adult friends and family members of ICU patients. Study sample size was designed to estimate the proportions of ICU proxies who rated the intervention as appropriate and important with a 5% margin of error (95% confidence interval width of 10%). We also anticipated that participants might find information in the booklet upsetting at the time of the intervention and treated this as a potential immediate side-effect. This outcome was evaluated by asking all participants to respond to the statement “Parts of the booklet are upsetting using the same 5-point Likert scale.

Recruitment

All recruitment took place in the JHH MICU, located in the inner city of Baltimore, Maryland between January and May 2016. The MICU census was screened 7 days per week to identify all consecutive eligible study participants. Family members[20] became eligible for recruitment as soon as their loved one had been a patient in the MICU for 24 hours. When multiple members of the family were available to participate the study team members enrolled the patient’s health agent or surrogate. Evaluation of this recruitment strategy have been previously published.[37] In this paper we refer to these people as proxies to encompass both healthcare agents and healthcare surrogates who have distinct legal definitions under Maryland state law.[38,39] If the family member initially enrolled was not the patient’s legal healthcare proxy, additional attempts were made to also enroll a legal proxy. Interviews were conducted in private spaces within the MICU but outside the patient’s room. Participants provided oral, in-person consent, which was documented using a standardized consent form and received a $10 gift card upon interview completion. Additional information about family recruitment and data collection are provided in Table A of S1 File. Johns Hopkins Medicine IRB Committee X approved this study number: IRB00080137. The IRB deemed oral consent as appropriate because participating in the study did not involve any procedure for which written consent is normally required outside of the research context.

Analyses

The primary outcomes were the proportions of participants who agreed or strongly agreed that the intervention is appropriate and that it is important for families of ICU patients to know the information conveyed by the intervention. Starting during the third week of the study, participants who agreed or strongly agreed that the information was important were asked to identify the most important pages in the booklet, and asked their opinion, via multiple-choice survey questions, regarding when and how the intervention should be delivered.

The secondary outcome was the proportion of participants who agreed or strongly agreed that the intervention was upsetting. Participants who found the intervention upsetting were asked to discuss what they found upsetting via an open-ended question. Transcribed narrative responses to this question were analyzed using a limited application of the framework method[40] with A.E.T., C.M.C., and R.K.C each independently applying open coding, then agreeing on themes, and finally independently charting the themes present in each response.

Participants who agreed or strongly agreed that the intervention was upsetting versus those who did not agree were compared for differences using descriptive statistics, the Wilcoxon-Mann-Whitney two-sample test for continuous variables, the Chi-square test for categorical values, and the Fisher’s exact test when cells counts were <10. The study was not powered or designed to test hypotheses about differences in the distribution of participant or patient characteristics; therefore, to encourage appropriate interpretation of statistical comparisons, we report both the p-value and the absolute value of the effect size (Cohen’s d) to provide an indication of the magnitude of effect.[41,42] The “Neither Agree or Disagree” response was combined with the Strongly agree and Agree responses as a sensitivity analysis. All statistics were generated using the R programming language version 3.3.2 (Vienna, Austria).

Results

We enrolled 122 proxies representing 111 eligible patients (Fig 1). Enrolled proxies had a median age of 51 years old (interquartile range (IQR) 39, 61) and 14 years of formal education (IQR 12, 16), with 83 (68%) female, 55 (45%) Black or African-American, and 79 (65%) the legal healthcare proxy according to Maryland law (Table 1). Patients had a median length of stay of 5 days (IQR 3,9) in the ICU and of 11 days (IQR 7, 25) in the hospital,(Table 2) with 101 patients (91%) living at home prior to hospitalization. ICU mortality was 18% and 37 patients (33%) died in hospital or were discharged to hospice.

Among the 122 proxies interviewed, 120 (98%, 95% CI 94% - 100%) agreed or strongly agreed that the intervention booklet was appropriate for adult friends and family of ICU patients, and 119 (98%, 95% CI 92% - 99%) agreed or strongly agreed that it is important for families to know the information in the booklet (Table 3). Although every page was cited by at least one proxy as being the most important, the most frequently cited pages page 15, which guides proxies who believe their loved one may be dying on what to ask their doctor, and page 16 which stresses that proxies are not alone and are welcome to work with their family or religious leader (Fig 2). Rather than citing a specific page as being important, many proxies instead indicated a section or theme of the booklet. The section with questions that proxies should ask was cited by 33 unique proxies (Table 4).

thumbnail
Table 3. Proxy responses to questions about booklet content and delivery.

https://doi.org/10.1371/journal.pone.0185483.t003

thumbnail
Table 4. Proxies responses to the question: “Which page or part of the booklet did you find upsetting and why was it upsetting? (N = 122).

https://doi.org/10.1371/journal.pone.0185483.t004

Histogram of booklet pages cited by proxies in response to the question: “In your opinion, which pages in the booklet are most important for ICU proxies to know?” Many proxies cited multiple pages of the booklet as being important. The written content of each page is provided within Table B of S1 File. Complete content including images are available for download at www.piperscience.org/proxy-activation.

Of these same 122 proxies, 54 (44%, 95% CI 35%– 54%) agreed or strongly agreed that parts of the booklet are upsetting. Among the proxies who found the intervention upsetting, 51 (94%) agreed or strongly agreed that the intervention was simultaneously acceptable and important. In fact, 5 of the 6 proxies who strongly agreed that the booklet was upsetting, also strongly agreed that it is important for families to know the information in the booklet. Among proxies asked to elaborate on what was upsetting, the most common theme mentioned by 15 proxies (12%, 95% CI 7%– 20%) was acknowledgment that critically ill patients may die, and the second most common theme cited by 12 proxies (10%, 95% CI 5% - 17%) related to page 15 (Table 4).

When compared to the 68 proxies who did not find the booklet upsetting, proxies who found the booklet upsetting were not statistically or substantially different in age, sex, education level, race, relation to the patient, ICU day at time of the interview, perceived decision-making authority, or prior experience in ICUs (absolute value of all effect sizes ≤0.38) (Table 5). The patients whose proxies who found the booklet upsetting were of similar age, lived in zip codes with similar median incomes, and experienced similar rates of hospital mortality (absolute value of all effect sizes ≤0.32). Results were qualitatively similar in the sensitivity analysis (Table C of S1 File).

thumbnail
Table 5. Participant characteristics by response to the statement: "Parts of the booklet are upsetting".

https://doi.org/10.1371/journal.pone.0185483.t005

There were 97 proxies enrolled after the third week of the study who agreed or strongly agreed that the study information was important. Asked when and how the information in the intervention should be conveyed, 57 (59%, 95% CI 48% - 69%) said as soon as the proxy arrived in the ICU, 33 (34%, 95% CI 25% - 44%) said after the proxy spoke to a doctor about their loved ones care, and 6 (6%, 95% CI 3% - 14%) said only if their loved ones health was not improving. When asked about how to provide the information, 54 (56%, 95% CI 45% - 66%) wanted to have a face-to-face conversation, 32 (33%, 95% CI 24% - 43%) wanted to receive a paper version of the booklet and 9 (9%, 95% CI 5% - 17%) preferred viewing a video.

Discussion

In this Phase I study of an intervention to educate ICU families about the role of a healthcare proxy and prepare them to communicate effectively with clinicians, 98% of proxies rated the intervention as both appropriate and important, and 44% also found the intervention upsetting. Proxies considered recommended questions for intensivists the most important information within the intervention. Demographics of proxies and patients were similar comparing proxies who did versus did not find the intervention upsetting.

Providing ICU families with an informational leaflet is endorsed by the Agency for Healthcare Research and Quality as a process measure of high quality palliative care in the ICU [43]. Previous leaflets designed for use in the ICU [29,4447] have largely targeted the families of dying patients, and provided information about the clinical environment such as commonly used medical jargon, procedures, ICU rules, and explanations of the equipment in a patient’s room. Our intervention was markedly different from previous leaflets in four important ways. First, our intervention was designed to be appropriate for all adult family members of ICU patients regardless of survival prognosis. Second, the booklet in our intervention functioned not as information that a family could choose to access, but as a script that was read aloud and verbatim to each participant. Reading aloud demonstrates that saying the words “death” and “dying” is acceptable in the ICU setting and ensures that all participants receive the same intervention regardless of available time, interest, or health literacy. Third, the intervention directly addressed that not all ICU patients survive or recover sufficiently to live at home, thereby helping to set appropriate expectations. Finally, our intervention made no attempt to explain a patient’s diagnosis, clinical care, prognosis, or treatment options; rather, we focused on how proxies should attempt to obtain this information from ICU clinicians.

Providing families with information is not sufficient to ensure engagement or shared decision-making [48]. Those who choose to be proxies must see themselves as active participants, bestowed with the authority to convey information about the patient’s goals and values, as well as a responsibility to obtain information about prognosis and treatment options. This challenge requires redefining the family member’s role, similar to patient activation in the outpatient setting [49,50]. We addressed this challenge by describing ICU proxies as people who volunteer for a responsibility that is respected, psychologically taxing, and vitally important.

The high prevalence of proxies rating the intervention as upsetting and the inability to anticipate which proxies will be upset means that the intervention booklet should not be left in waiting rooms. Although 56% of proxies said they wanted to receive information via a face-to-face conversation, we believe this rate would have been even higher if proxies had been permitted to select multiple responses to this question since many proxies said they preferred to have both a face-to-face conversation and receive written material that could be shared with other family members. As one proxy explained: “It’s really important to talk to someone. I would have thrown this away if it had just been handed to me on admission.

This Phase I study had potential limitations. It was conducted in a single ICU and excluded families who did not physically visit the ICU or did not speak English. Similar interventions will need to be tailored to their jurisdiction given that statutes about who can serve as a proxy for patients who lack decisional capacity vary widely across states.[51] The study also only addressed proxy’s immediate reactions to the intervention which may have changed over time, particularly after discharge. Further study is needed to determine whether describing parts of the booklet as “upsetting” immediately following the intervention correlates with any long-term mental health symptoms.[52,53] As a Phase I study there was no attempt to estimate the intervention’s impact on proxy behavior or patient care. Despite these limitations, the study has important strengths including being designed to ensure all participants received the same exposure to the intervention, being conducted in a socio-economically diverse population, and being developed with input from ICU proxies and a large multi-disciplinary group of relevant stakeholders.

Many questions remain to be answered about this intervention. The most pressing question is whether it impacts proxy behavior and communication. Additional research is needed to determine if the intervention improves proxy activation. There are also logistical questions, namely who should deliver the intervention, as well as issues of cost-effectiveness. If the intervention positively impacts proxy behavior and is cost-neutral, it will face the same challenges which limit the use of interventions designed to foster patient/family engagement and shared decision-making, namely, resistance to change and the lack of reward for clinical utilization [54].

Conclusions

This Phase I, single-center study of a brief intervention designed to set expectations, explain an ICU proxy’s role in the ICU setting, and prepare proxies to communicate effectively with clinicians was acceptable and important to nearly all 122 participating ICU proxies. Frequently, the intervention was simultaneously rated as upsetting by these same proxies, with neither patient nor proxy characteristics associated with this finding. This intervention represents the early stages of an attempt to adapt the principles of patient activation to the ICU setting. Additional research is required to determine if this approach impacts proxy behavior.

Supporting information

Acknowledgments

The authors wish to thank the Johns Hopkins Hospital Patient and Family Advisory Council, Jeanne-Marie LaFrance and Amy Durocher of the Johns Hopkins MICU social work team, the MICU nurse practitioners and physician assistants, Jeffrey Natterman of the Johns Hopkins Health System risk management and patient care, Jane Hill and Markia Dallas from Johns Hopkins Hospital Patient Relations, Matt Norvell and John Ponnala from Johns Hopkins Chaplaincy & Spiritual care, and the Johns Hopkins MICU end-of-life interest group. All booklet illustrations were created by Susie Hancock and Khoon Lay Gan. An To and Mohammad Shaear assisted with data collection. Anahita Rabiee, Mohamed Hashem, and Victor Dinglas assisted with data management.

References

  1. 1. Teno JM G P. Change in end-of-life care for medicare beneficiaries: Site of death, place of care, and health care transitions in 2000, 2005, and 2009. JAMA. 2013;309: 470–477. pmid:23385273
  2. 2. Teno JM, Gozalo P, Khandelwal N, Curtis JR, Meltzer D, Engelberg R, et al. Association of Increasing Use of Mechanical Ventilation Among Nursing Home Residents With Advanced Dementia and Intensive Care Unit Beds. JAMA Intern Med. 2016;176: 1809–1816. pmid:27723891
  3. 3. Luce JM. A national survey of end-of-life care for critically ill patients. Am J Respir Crit Care Med. 1998;158: 1163–1167. pmid:9769276
  4. 4. Torke AM, Sachs GA, Helft PR, Montz K, Hui SL, Slaven JE, et al. Scope and outcomes of surrogate decision making among hospitalized older adults. JAMA Intern Med. 2014;174: 370–377. pmid:24445375
  5. 5. Abbott KH, Sago JG, Breen CM, Abernethy AP, Tulsky JA. Families looking back: one year after discussion of withdrawal or withholding of life-sustaining support. Crit Care Med. 2001;29: 197–201. pmid:11176185
  6. 6. Schuster RA, Hong SY, Arnold RM, White DB. Investigating conflict in ICUs-is the clinicians’ perspective enough? Crit Care Med. 2014;42: 328–335. pmid:24434440
  7. 7. LeClaire MM, Oakes JM, Weinert CR. Communication of prognostic information for critically ill patients. Chest. 2005;128: 1728–1735. pmid:16162781
  8. 8. Lee Char SJ, Evans LR, Malvar GL, White DB. A randomized trial of two methods to disclose prognosis to surrogate decision makers in intensive care units. Am J Respir Crit Care Med. 2010;182: 905–909. pmid:20538959
  9. 9. Chiarchiaro J, Buddadhumaruk P, Arnold RM, White DB. Quality of Communication in the ICU and Surrogate’s Understanding of Prognosis*: Crit Care Med. 2015;43: 542–548. pmid:25687030
  10. 10. Alonso W, Hupcey JE, Kitko L. Caregivers’ perceptions of illness severity and end of life service utilization in advanced heart failure. Heart Lung J Acute Crit Care. 2017;46: 35–39. pmid:27788935
  11. 11. Wendler D, Rid A. Systematic Review: The Effect on Surrogates of Making Treatment Decisions for Others. Ann Intern Med. 2011;154: 336–346. pmid:21357911
  12. 12. Schenker Y, Crowley-Matoka M, Dohan D, Tiver GA, Arnold RM, White DB. I don’t want to be the one saying “we should just let him die”: intrapersonal tensions experienced by surrogate decision makers in the ICU. J Gen Intern Med. 2012;27: 1657–1665. pmid:23011253
  13. 13. Chiarchiaro J, Buddadhumaruk P, Arnold RM, White DB. Prior Advance Care Planning Is Associated with Less Decisional Conflict among Surrogates for Critically Ill Patients. Ann Am Thorac Soc. 2015;12: 1528–1533. pmid:26240996
  14. 14. van Beusekom I, Bakhshi-Raiez F, de Keizer NF, Dongelmans DA, van der Schaaf M. Reported burden on informal caregivers of ICU survivors: a literature review. Crit Care. 2016;20: 16. pmid:26792081
  15. 15. Cameron JI, Chu LM, Matte A, Tomlinson G, Chan L, Thomas C, et al. One-Year Outcomes in Caregivers of Critically Ill Patients. N Engl J Med. 2016;374: 1831–1841. pmid:27168433
  16. 16. Jones C, Skirrow P, Griffiths RD, Humphris G, Ingleby S, Eddleston J, et al. Post-traumatic stress disorder-related symptoms in relatives of patients following intensive care. Intensive Care Med. 2004;30: 456–460. pmid:14767589
  17. 17. Azoulay E, Pochard F, Kentish-Barnes N, Chevret S, Aboab J, Adrie C, et al. Risk of post-traumatic stress symptoms in family members of intensive care unit patients. Am J Respir Crit Care Med. 2005;171: 987–994. pmid:15665319
  18. 18. Anderson WG, Arnold RM, Angus DC, Bryce CL. Posttraumatic stress and complicated grief in family members of patients in the intensive care unit. J Gen Intern Med. 2008;23: 1871–1876. pmid:18780129
  19. 19. McAdam JL, Fontaine DK, White DB, Dracup KA, Puntillo KA. Psychological symptoms of family members of high-risk intensive care unit patients. Am J Crit Care Off Publ Am Assoc Crit-Care Nurses. 2012;21: 386–393; quiz 394. pmid:23117902
  20. 20. Davidson JE, Aslakson RA, Long AC, Puntillo KA, Kross EK, Hart J, et al. Guidelines for Family-Centered Care in the Neonatal, Pediatric, and Adult ICU. Crit Care Med. 2017;45: 103–128. pmid:27984278
  21. 21. Kon AA, Davidson JE, Morrison W, Danis M, White DB. Shared Decision Making in ICUs: An American College of Critical Care Medicine and American Thoracic Society Policy Statement. Crit Care Med. 2015;44: 188–201. pmid:26509317
  22. 22. You JJ, Downar J, Fowler RA, Lamontagne F, Ma IWY, Jayaraman D, et al. Barriers to Goals of Care Discussions With Seriously Ill Hospitalized Patients and Their Families: A Multicenter Survey of Clinicians. JAMA Intern Med. 2015;175: 549–556. pmid:25642797
  23. 23. Hillman KM, Cardona-Morrell M. The ten barriers to appropriate management of patients at the end of their life. Intensive Care Med. 2015;41: 1700–1702. pmid:25749572
  24. 24. Turnbull AE, Davis WE, Needham DM, White DB, Eakin MN. Intensivist-reported Facilitators and Barriers to Discussing Post-Discharge Outcomes with Intensive Care Unit Surrogates: A Qualitative Study. Ann Am Thorac Soc. 2016;13: 1546–1552. http://dx.doi.org/10.1513/AnnalsATS.201603-212OC pmid:27294981
  25. 25. Wysham NG, Hua M, Hough CL, Gundel S, Docherty SL, Jones DM, et al. Improving ICU-Based Palliative Care Delivery: A Multicenter, Multidisciplinary Survey of Critical Care Clinician Attitudes and Beliefs. Crit Care Med. 2016; pmid:27618270
  26. 26. Richman PS, Saft HL, Messina CR, Berman AR, Selecky PA, Mularski RA, et al. Palliative and end-of-life educational practices in US pulmonary and critical care training programs. J Crit Care. 2016;31: 172–177. pmid:26507641
  27. 27. Sullivan AM, Rock LK, Gadmer NM, Norwich DE, Schwartzstein RM. The Impact of Resident Training on Communication with Families in the ICU: Resident and Family Outcomes. Ann Am Thorac Soc. 2016; pmid:26989925
  28. 28. Schwarze ML, Campbell TC, Cunningham TV, White DB, Arnold RM. You Can’t Get What You Want: Innovation for End-Of-Life Communication in the ICU. Am J Respir Crit Care Med. 2016;193: 14–16. pmid:26474354
  29. 29. Penrod JD, Luhrs CA, Livote EE, Cortez TB, Kwak J. Implementation and evaluation of a network-based pilot program to improve palliative care in the intensive care unit. J Pain Symptom Manage. 2011;42: 668–671. pmid:22045370
  30. 30. Kohn R, Madden V, Kahn JM, Asch DA, Barnato AE, Halpern SD, et al. Diffusion of Evidence-based Intensive Care Unit Organizational Practices. A State-Wide Analysis. Ann Am Thorac Soc. 2017;14: 254–261. pmid:28076685
  31. 31. Nelson JE, Mulkerin CM, Adams LL, Pronovost PJ. Improving comfort and communication in the ICU: a practical new tool for palliative care performance measurement and feedback. Qual Saf Health Care. 2006;15: 264–271. pmid:16885251
  32. 32. Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the Patient Activation Measure (PAM): Conceptualizing and Measuring Activation in Patients and Consumers. Health Serv Res. 2004;39: 1005–1026. pmid:15230939
  33. 33. Hibbard JH, Greene J. What the evidence shows about patient activation: better health outcomes and care experiences; fewer data on costs. Health Aff Proj Hope. 2013;32: 207–214. pmid:23381511
  34. 34. DeKeyser Ganz F, Engelberg R, Torres N, Curtis JR. Development of a Model of Interprofessional Shared Clinical Decision Making in the ICU: A Mixed-Methods Study. Crit Care Med. 2015; pmid:26565629
  35. 35. Isotype: Design and Contexts 1925–1971 by Christopher Burke. Hyphen Press; 2013.
  36. 36. FAQClinicalTrials.gov—Clinical Trial Phases [Internet]. [cited 26 Jan 2017]. https://www.nlm.nih.gov/services/ctphases.html
  37. 37. Turnbull AE, Hashem MD, Rabiee A, To A, Chessare CM, Needham DM. Evaluation of a strategy for enrolling the families of critically ill patients in research using limited human resources. PLOS ONE. 2017;12: e0177741. pmid:28542632
  38. 38. Schwartz AAGJS. Who Can Make Health Care Decisions For Another? Defining Health Care Proxies Under Maryland Law [Internet]. 2006. http://www.marylandattorneygeneral.gov/Health%20Policy%20Documents/proxies_definition.pdf
  39. 39. Frosh, Attorney General Brian E. Summary Of Maryland Health Care Decisions Act [Internet]. 2014. http://www.marylandattorneygeneral.gov/Health%20Policy%20Documents/HCDAsummary.pdf
  40. 40. Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13: 117. pmid:24047204
  41. 41. Sullivan GM, Feinn R. Using Effect Size—or Why the P Value Is Not Enough. J Grad Med Educ. 2012;4: 279–282. pmid:23997866
  42. 42. Chavalarias D, Wallach J, Li A, Ioannidis JA. Evolution of reporting p values in the biomedical literature, 1990–2015. JAMA. 2016;315: 1141–1148. pmid:26978209
  43. 43. Penrod JD, Pronovost PJ, Livote EE, Puntillo KA, Walker AS, Wallenstein S, et al. Meeting standards of high-quality intensive care unit palliative care: clinical performance and predictors. Crit Care Med. 2012;40: 1105–1112. pmid:22202706
  44. 44. Daly K, Kleinpell RM, Lawinger S, Casey G. The effect of two nursing interventions on families of ICU patients. Clin Nurs Res. 1994;3: 414–422. pmid:7703871
  45. 45. Azoulay E, Pochard F, Chevret S, Jourdain M, Bornstain C, Wernet A, et al. Impact of a family information leaflet on effectiveness of information provided to family members of intensive care unit patients: a multicenter, prospective, randomized, controlled trial. Am J Respir Crit Care Med. 2002;165: 438–442. pmid:11850333
  46. 46. Lautrette A, Darmon M, Megarbane B, Joly LM, Chevret S, Adrie C, et al. A communication strategy and brochure for relatives of patients dying in the ICU. N Engl J Med. 2007;356: 469–478. pmid:17267907
  47. 47. Mistraletti G, Umbrello M, Mantovani ES, Moroni B, Formenti P, Spanu P, et al. A family information brochure and dedicated website to improve the ICU experience for patients’ relatives: an Italian multicenter before-and-after study. Intensive Care Med. 2016; 1–11. pmid:27830281
  48. 48. Joseph-Williams N, Elwyn G, Edwards A. Knowledge is not power for patients: a systematic review and thematic synthesis of patient-reported barriers and facilitators to shared decision making. Patient Educ Couns. 2014;94: 291–309. pmid:24305642
  49. 49. Joseph-Williams N, Edwards A, Elwyn G. Power imbalance prevents shared decision making. BMJ. 2014;348: g3178–g3178. pmid:25134115
  50. 50. Hibbard JH, Gilburt H. Supporting people to manage their health: An introduction to patient activation. London: The King’s Fund; 2014.
  51. 51. DeMartino ES, Dudzinski DM, Doyle CK, Sperry BP, Gregory SE, Siegler M, et al. Who Decides When a Patient Can’t? Statutes on Alternate Decision Makers. N Engl J Med. 2017;376: 1478–1482. pmid:28402767
  52. 52. Carson SS, Cox CE, Wallenstein S, et al. Effect of palliative care–led meetings for families of patients with chronic critical illness: A randomized clinical trial. JAMA. 2016;316: 51–62. pmid:27380343
  53. 53. Kentish-Barnes N, Chevret S, Champigneulle B, Thirion M, Souppart V, Gilbert M, et al. Effect of a condolence letter on grief symptoms among relatives of patients who died in the ICU: a randomized clinical trial. Intensive Care Med. 2017; 1–12.
  54. 54. Elwyn G, Scholl I, Tietbohl C, Mann M, Edwards AG, Clay C, et al. “Many miles to go …”: a systematic review of the implementation of patient decision support interventions into routine clinical practice. BMC Med Inform Decis Mak. 2013;13: S14. pmid:24625083