Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Patient-Selection of a Clinical Trial Primary Outcome: The ENHANCE-AF Outcomes Survey

  • Randall S. Stafford ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Writing – original draft, Writing – review & editing

    rstafford@stanford.edu

    Affiliation Stanford University School of Medicine, Stanford Prevention Research Center, Stanford, California, United States of America

  • Eli N. Rice,

    Roles Writing – review & editing

    Affiliation Stanford University School of Medicine, Center for Clinical Research, Stanford, California, United States of America

  • Rushil Shah,

    Roles Data curation, Writing – original draft

    Affiliation Division of Cardiovascular Medicine, Stanford University School of Medicine, Stanford, California, United States of America

  • Mellanie T. Hills,

    Roles Conceptualization, Methodology

    Affiliation Stop Afib.org, Greenwood, Texas, United States of America

  • Julio C. Nunes,

    Roles Writing – review & editing

    Affiliation Department of Psychiatry, Yale University, New Haven, Connecticut, United States of America

  • Katie DeSutter,

    Roles Data curation, Project administration

    Affiliation Division of Cardiovascular Medicine, Stanford University School of Medicine, Stanford, California, United States of America

  • Amy Lin,

    Roles Formal analysis

    Affiliation Department of Biomedical Data Science, Stanford University School of Medicine, Stanford, California, United States of America

  • Karma Lhamo,

    Roles Project administration

    Affiliation Stanford University School of Medicine, Center for Clinical Research, Stanford, California, United States of America

  • Bryant Lin,

    Roles Conceptualization, Investigation

    Affiliation Division of Primary Care and Population Health, Stanford University School of Medicine, Stanford, California, United States of America

  • Ying Lu,

    Roles Formal analysis

    Affiliation Department of Biomedical Data Science, Stanford University School of Medicine, Stanford, California, United States of America

  • Paul J. Wang

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Writing – review & editing

    Affiliation Division of Cardiovascular Medicine, Stanford University School of Medicine, Stanford, California, United States of America

Abstract

Introduction

Before the initiation of the ENHANCE-AF clinical trial, which tested a novel digital shared decision-making tool to guide the use of anticoagulants in stroke prevention for patients with atrial fibrillation, this study aimed to identify the most appropriate, patient-selected primary outcome and to examine whether outcome selection varied by demographic and clinical characteristics.

Methods

Our cross-sectional survey asked 100 participants with atrial fibrillation to rank two alternative scales based on the scales’ ability to reflect their experiences with decision-making for anticoagulation. The Decisional Conflict Scale (DCS), a 16-item scale, measures perceptions of uncertainty in choosing options. The 5-item Decision Regret Scale (DRS) focuses on remorse after a healthcare decision. We included adults with non-valvular AFib and CHA2DS2VASc scores of at least 2 for men and 3 for women. Multivariable logistic regression with backward selection identified characteristics independently associated with scale choice.

Results

The DCS was chosen over the DRS by 77% [95% confidence interval (CI) 68 to 85%] of participants. All subgroups designated a preference for the DCS. Those with higher CHA2DS2VASc scores (≥5, n = 26) selected the DCS 54% of the time compared with 86% of those with lower scores (<5, n = 74; p =  0.002). Multiple logistic regression confirmed a weaker preference for the DCS among those with higher CHA2DS2VASc scores.

Conclusions

Individuals with atrial fibrillation preferred the DCS over the DRS for measuring their decision-making experiences. As a result of this survey, the DCS was designated as the ENHANCE-AF clinical trial’s primary endpoint.

Introduction

Atrial fibrillation (AFib) is a common arrhythmia affecting more than 6 million individuals worldwide [1]. AFib is associated with significant morbidity, mortality, and socio-economic burden, particularly from stroke and thromboembolism [2]. Anticoagulation use, despite its potentially serious adverse effects, is beneficial for embolic stroke prevention in at-risk AFib patients. A significant proportion of eligible AFib patients, however, do not receive the full benefits of anticoagulation due to inadequate prescription practices and limited medication adherence and persistence, leading to suboptimal anticoagulation use and preventable embolic events [3,4]. Additionally, the process by which clinicians and patients discuss the initiation of anticoagulation is not standardized, and the level of patient participation in decision-making varies greatly [5]. Traditionally, the annual stroke risk calculator, CHA2DS2VASc score computed by clinicians is used to recommend oral anticoagulation to all patients except those with minimal stroke risk [6]. However, this paternalistic decision-making process often occurs without engaging patient participation and can lead to a lack of patient understanding and satisfaction, wasted healthcare resources, and preventable adverse outcomes [7,8]. Shared decision-making strategies can, therefore, improve patient satisfaction, lead to better decisions, better align decisions with patient preferences, and increase medication adherence and persistence [8,9].

The ENHANCE-AF trial (Engaging Patients to Help Achieve Increased Patient Choice and Engagement for AF Stroke Prevention, NCT04096781) envisaged using patient-selected outcomes to evaluate the impact of our shared decision-making digital tool (details found at afibguide.com and afibguide.com/clinician) [8,9]. A patient-selected primary outcome would better assess the quality of decision-making in a way that is meaningful and helpful to those with AFib [7]. Patient-centered outcomes closely align with patient experiences and are associated with a better quality of life, symptom scores, and greater satisfaction with care [7]. In contrast, traditional approaches that use epidemiological outcomes to ascertain patient results are tied to standard diagnostic criteria, natural history, and pathophysiology, which may be inherently less important to patients. As a result, these outcomes often fail to capture the full spectrum of events that are most meaningful to patients. On the other hand, patient-centered outcomes direct attention to the intrinsic needs, beliefs, and emotions of patients in conjunction with a physician’s medical expertise and assessment [7]. Over the past decade, there has been a notable shift in clinical research towards the inclusion of patient-centered outcomes. This manuscript reports on our effort to advance patient-centered outcome research by having patients with AFib determine the most appropriate outcome measure to evaluate the impact of a healthcare delivery system intervention. To our knowledge, no other major clinical trials have used patients’ input for the selection of the primary outcome.

The ENHANCE-AF project sought to develop and rigorously test a novel digital patient-clinician shared decision-making tool focused on stroke prevention in patients with AFib [8]. The current study was carried out during the design phase of the digital tool [10] to determine the primary outcome measure for the subsequent clinical trial as well as to measure if patient-preferred outcomes are consistent across patient characteristics.

Methods

This cross-sectional study using a survey was designed to have individuals with AFib determine the most appropriate outcome measure for the ENHANCE-AF clinical trial and ascertain if patient-preferred outcomes were consistent across patient demographic and clinical characteristics. Additionally, the study also helped to refine the eligibility, recruitment, and data management methods later used in the clinical trial. Notably, there was no overlap in participants between the two studies.

Although we had initially envisioned testing a broad range of alternative outcome measures, we determined that only two scales were suitable for direct comparison and assessment, the Decisional Conflict Scale (DCS) [11] and the Decision Regret Scale (DRS) [12]. Other scales considered included: Preparation for Decision-Making [13], Satisfaction with Decision scale [14], Multi-Dimensional Measure of Informed Choice [15], Observing Patient Involvement in Decision Making scale [16], and Combined Outcome Measure for Risk Communication and Treatment Decision Making Effectiveness [17]. These scales were excluded for several reasons, including lack of applicability to AFib, mismatch with the decision-making context, and overall participant burden.

The DCS is a comprehensive 16-item measurement tool that assesses various aspects of individuals’ personal perceptions about past decisions such as information supplied, values clarity, support received, uncertainty, and effectiveness [11]. The DCS was based on the decisional conflict concept of Janis and Mann and later developed into a survey scale by the North American Nursing Diagnosis Association [11]. The 5-item DRS developed by the Ottawa Health Research Institute, Ottawa Hospital, ON, Canada measures several aspects of regret after a healthcare decision [12].

Between August 1, 2019, and November 7, 2019, we recruited an independent sample of 100 Stanford Healthcare AFib outpatients who satisfied the identical eligibility criteria established for our intended clinical trial [8]. Using a convenience sample from both cardiology and primary care clinics, we included adults with non-valvular AFib, CHA2DS2VASc scores of at least 2 for men and 3 for women, and who were able to provide written consent and follow instructions in English or Spanish. We excluded participants with hemodynamically significant mitral stenosis, mechanical valve replacement, or other indications for anticoagulation, as well as those with contraindications to anticoagulation.

Each participant completed a 15-minute-long questionnaire consisting of seven sections and 34 questions (S1 Supplemental Material) administered in-person by a trained clinical research coordinator utilizing a computer-based Research Electronic Data Capture (REDCap) database. Prior to the study, the survey had been pretested in three AFib patients and received approval from our project’s patient advocate with AFib. Individuals were given the choice to complete this survey in either English or Spanish. At survey initiation, participants were provided the DRS and DCS questions and asked to review, but not answer the questions. We ensured survey anonymity and confidentiality by implementing mechanisms to prevent unauthorized access. Participants ranked the DCS and DRS on the scales’ ability to meaningfully reflect their “decision-making experience with atrial fibrillation stroke prevention and blood thinners.” To facilitate the process, participants initially received the DCS and DRS forms and were then given ample time to comprehensively review and understand their content. Additionally, we gathered data on clinical diagnoses, duration of anticoagulation, and participant demographics. To foster patient engagement and empowerment, participants were also asked to select a favored clinical trial name among three that were proposed.

Human subjects institutional review board approval was obtained via an expedited review (Stanford IRB 51678). The study was conducted as per the original protocol. All study participants completed the entire study without any interruptions. There were no missing data or protocol deviations. No adverse events were reported.

Patient involvement

Beyond the outcomes survey that is the focus of this article, patient involvement was crucial at every stage of our project: from designing the digital tool and planning a clinical trial to conducting the randomized controlled trial and dissemination of the tool. Using an end-user design model, the digital Stanford Medicine AFib tool (afibguide.com and afibguide.com/clinician) was created to improve patient-centered outcomes. Refined around patient-identified needs, the tool was iteratively tested by 25 patients [10]. During clinical trial planning, we relied on our ENHANCE-AF patient advocate (MTH) to contribute to study design and serve as a bridge between the academic study team and the AFib community. After input from our patient advocate, we pretested our outcomes survey on three other AFib patients and incorporated their feedback prior to study recruitment. For the clinical trial (n = 1001) recruitment strategies were influenced by patient input. All trial participants exposed to the digital tool were asked to provide feedback about the tool [9]. Once completed, trial results and tool access were disseminated through scientific presentations, professional organizations, and the patient advocacy group, Stop Afib.org.

Statistical analysis

We designed a survey to identify patient preferences for a primary outcome measure to be used in a clinical trial of the effectiveness of a digital shared decision-making tool [8, 9]. Our planned sample of 100 participants was selected to provide a 10% margin of error on the estimated proportion of the population favoring one scale over the other. That is, 40% of 100 participants preferring one scale and 60% preferring the other would yield a statistically significant difference at p <  0.05. The sample population was summarized using descriptive statistics: continuous variables were summarized as mean and standard deviations and categorical variables were listed as numbers and frequencies. We characterized CHA2DS2VASc scores as median and interquartile range (IQR) given its right-skewed distribution of values. Two-tailed p-values below 0.05 were considered statistically significant. Multivariable logistic regression was used to identify demographic, concomitant comorbidities, and medication usage that statistically moderated the choice of outcome scale. Model selection was based on backward selection to minimize the Akaike Information Criterion. This approach allowed all potential predictors (see Table 1) to be entered into the model, followed by the sequential removal of those that did not significantly contribute to the model. Logistic regression assessed the independent multiplicative effect of these covariates on the odds of selecting the DCS over the DRS. R Studio (Boston, MA, USA) and STATA (Stata Corp., College Station, TX, USA) were utilized for statistical analysis.

thumbnail
Table 1. Scale preference by participant characteristics with bivariate odds ratio for favoring the decision conflict scale over the decisional regret scale.

https://doi.org/10.1371/journal.pone.0318858.t001

Results

One hundred participants with AFib were enrolled between August and November 2019. The mean participant age (SD) was 76 (9) years, and 22% of total participants were female (Table 1). Along with AFib, 72% of participants had hypertension, 36% had vascular disease, 27% had stroke, 24% had diabetes mellitus, and 18% had heart failure. The median CHA2DS2VASc score was 3.5 (interquartile range 3-5, mean 3.7, SD 1.35), and 83% of participants were taking oral anticoagulants. The survey was completed by all participants (100%) in English. The co-morbidities, age, and anticoagulation use in the sample closely resembled that of individuals diagnosed with AFib in the United States [18] and the ENHANCE-AF clinical trial [9]. The sample for this survey study, however, had more participants who were male.

Overall, 77% of participants [95% confidence interval (CI) 68 to 85%] ranked DCS above DRS. The bivariate comparisons showed that 86% of patients with low CHA2DS2VASc scores (n = 74) selected DCS, compared to only 54% of those with high scores (n = 26) (p =  0.002) (Table 1). We found no significant difference in the likelihood of favoring DCS based on other patient characteristics. Multiple logistic regressions confirmed that higher CHA2DS2VASc scores were associated with a less strong preference for DCS (Table 2). The multivariable logistic regression predicted DCS vs. DRS preference (C-statistic 0.70) based on the inclusion of CHA2DS2VASc score and anticoagulation status. In this model, predicted preference for DCS varied from 51% (high score on anticoagulation) to 96% (lower score not on anticoagulation). Of three compelling name choices, 47% of participants selected “ENHANCE-AF: Engaging Patients to Help Achieve Increased Patient Choice and Engagement for Atrial Fibrillation Stroke Prevention” as the preferred study name for the clinical trial.

thumbnail
Table 2. Stepwise backward logistic regression model of predictors of DCS vs. DRS preference.

https://doi.org/10.1371/journal.pone.0318858.t002

Discussion

This study evaluated AFib patient preference between two different decision-making outcomes scales - the Decisional Conflict Scale (DCS) [11] and the Decision Regret Scale (DRS) [12]. The 16-item DCS measures personal perceptions of uncertainty in choosing options. In contrast, the DRS primarily focuses on feelings of remorse following a healthcare decision. A majority (77%) of the participants chose the DCS over the DRS. Participant endorsement of the DCS over the DRS may reflect the disadvantages of the DRS noted by past researchers. In general, the DRS indicates minimal regret in many decision-making settings [19,20] and therefore may be less useful in differentiating the quality of decision-making. Other studies indicate lower consistency and internal reliability for the DRS compared to the DCS [21].

We evaluated whether some patient groups might vary in their scale preference. A high CHA2DS2VASc score was the only statistically significant moderator of scale choice. Participants with high scores ( ≥ 5) still preferred the DCS although much less strongly than those with lower scores ( < 5). In addition, the multiple logistic regression modeling included oral anticoagulant consumption as a meaningful, but non-significant predictor of scale choice. Even the most extreme category formed by these two data elements continued to prefer the DCS over the DRS. On this basis, we designated the DCS as our primary outcome for our clinical trial with the DRS designated as a key secondary outcome variable. We also named our randomized controlled trial in accordance with the participants’ preference.

Study limitations

Our study has several potential limitations. Although we assessed patient preferences for the DCS vs the DRS, other potential patient-centered outcomes were not assessed. This study was conducted on those with AFib seen at Stanford Healthcare and may not be representative of all patients in the U.S. with AFib. The study findings are perhaps most pertinent to individuals with AFib who have access to tertiary healthcare facilities and possess health insurance.

Conclusions

Individuals with AFib preferred the DCS (77%) over the DRS (23%) for measuring their decision-making experience with oral anticoagulation for stroke prevention. Except for CHA2DS2VASc scores, both bivariate and multivariate logistic regressions found no statistically significant correlates of scale choice, providing reassurance of patients’ preference for the DCS across a range of patient characteristics. Our innovative strategy led to meaningful patient involvement in clinical trial design, thereby enhancing this trial’s patient-centeredness. The subsequent ENHANCE-AF clinical trial set DCS as its primary endpoint. This trial demonstrated that use of our digital shared decision-making tool resulted in lower DCS scores when compared to usual care [9]. By engaging AFib patients in the clinical trial design process, we used a collaborative and innovative approach to choose an outcome measure meaningful to the target patient population. This approach of involving consumers with a clinical condition of interest in defining study outcomes has potential applications in other technically complex clinical scenarios. This study also speaks to the feasibility of gathering this useful input, rather than having researchers impose this choice on their participants. Future randomized controlled trials should consider planned patient involvement in the selection of key trial outcomes.

Supporting Information

References

  1. 1. Li H, Song X, Liang Y, Bai X, Liu-Huo W-S, Tang C, et al. Global, regional, and national burden of disease study of atrial fibrillation/flutter, 1990–2019: results from a global burden of disease study, 2019. BMC Public Health. 2022;22(1):2015. pmid:36329400
  2. 2. Chugh SS, Blackshear JL, Shen WK, Hammill SC, Gersh BJ. Epidemiology and natural history of atrial fibrillation: clinical implications. J Am Coll Cardiol. 2001;37(2):371–8. pmid:11216949
  3. 3. Hsu JC, Freeman JV. Underuse of vitamin K antagonist and direct oral anticoagulants for stroke prevention in patients with atrial fibrillation: a contemporary review. Clin Pharmacol Ther. 2018;104(2):301–10. pmid:29328506
  4. 4. Chan PS, Maddox TM, Tang F, Spinler S, Spertus JA. Practice-level variation in warfarin use among outpatients with atrial fibrillation (from the NCDR PINNACLE program). Am J Cardiol. 2011;108(8):1136–40. pmid:21798501
  5. 5. Seaburg L, Hess EP, Coylewright M, Ting HH, McLeod CJ, Montori VM. Shared decision making in atrial fibrillation: where we are and where we should be going. Circulation. 2014;129(6):704–10. pmid:24515956
  6. 6. Lip GYH, Nieuwlaat R, Pisters R, Lane DA, Crijns HJGM. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the euro heart survey on atrial fibrillation. Chest. 2010;137(2):263–72. pmid:19762550
  7. 7. Edgman-Levitan S, Schoenbaum SC. Patient-centered care: achieving higher quality by designing care through the patient’s eyes. Isr J Health Policy Res. 2021;10(1):21. pmid:33673875
  8. 8. Baykaner T, Pundi K, Lin B, Lu Y, DeSutter K, Lhamo K, et al. The ENHANCE-AF clinical trial to evaluate an atrial fibrillation shared decision-making pathway: Rationale and study design. Am Heart J. 2022;247:68–75. pmid:35092723
  9. 9. Wang PJ, Lu Y, Mahaffey KW, Lin A, Morin DP, Sears SF, et al. Randomized clinical trial to evaluate an atrial fibrillation stroke prevention shared decision-making pathway. J Am Heart Assoc. 2023;12(3):e028562. pmid:36342828
  10. 10. Nunes JC, Baykaner T, Pundi K, DeSutter K, True Hills M, Mahaffey KW, et al. Design and development of a digital shared decision-making tool for stroke prevention in atrial fibrillation. JAMIA Open. 2023;6(1):ooad003. pmid:36751465
  11. 11. O’Connor AM. Validation of a decisional conflict scale. Med Decis Making. 1995;15(1):25–30. pmid:7898294
  12. 12. Brehaut JC, O’Connor AM, Wood TJ, Hack TF, Siminoff L, Gordon E, et al. Validation of a decision regret scale. Med Decis Making. 2003;23(4):281–92. pmid:12926578
  13. 13. Bennett C, Graham ID, Kristjansson E, Kearing SA, Clay KF, O’Connor AM. Validation of a preparation for decision making scale. Patient Educ Couns. 2010;78(1):130–3. pmid:19560303
  14. 14. Holmes-Rovner M, Kroll J, Schmitt N, Rovner DR, Breer ML, Rothert ML, et al. Patient satisfaction with health care decisions: the satisfaction with decision scale. Med Decis Making. 1996;16(1):58–64. pmid:8717600
  15. 15. Michie S, Dormandy E, Marteau TM. The multi-dimensional measure of informed choice: a validation study. Patient Educ Couns. 2002;48(1):87–91. pmid:12220754
  16. 16. Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung W-Y, et al. The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect. 2005;8(1):34–42. pmid:15713169
  17. 17. Edwards A, Elwyn G, Hood K, Robling M, Atwell C, Holmes-Rovner M, et al. The development of COMRADE--a patient-based outcome measure to evaluate the effectiveness of risk communication and treatment decision making in consultations. Patient Educ Couns. 2003;50(3):311–22. pmid:12900105
  18. 18. Tsao CW, Aday AW, Almarzooq ZI, Alonso A, Beaton AZ, Bittencourt MS, et al. Heart disease and stroke statistics-2022 update: a report from the American heart association. Circulation. 2022;145(8):e153–639. pmid:35078371
  19. 19. Kim H, Bang W, Shim M, Oh CY, Cho SY, Chung MS, et al. Decision regret after prostate biopsy for prostate cancer diagnosis: a Korean multicenter cohort study. BMC Public Health. 2024;24(1):1725. pmid:38943112
  20. 20. Becerra Pérez MM, Menear M, Brehaut JC, Légaré F. Extent and predictors of decision regret about health care decisions: a systematic review. Med Decis Making. 2016;36(6):777–90. pmid:26975351
  21. 21. Goh AC, Kowalkowski MA, Bailey DE Jr, Kazer MW, Knight SJ, Latini DM. Perception of cancer and inconsistency in medical information are associated with decisional conflict: a pilot study of men with prostate cancer who undergo active surveillance. BJU Int. 2012;110(2 Pt 2):E50–6. pmid:22145791