This study quantitatively evaluated the comparative efficacy and safety of new oral anticoagulants (dabigatran, rivaroxaban, and apizaban) and warfarin for treatment of nonvalvular atrial fibrillation. We also compared these agents under different scenarios, including population with high risk of stroke and for primary vs. secondary stroke prevention.
We used multiple criteria decision analysis (MCDA) to assess the benefit-risk of these medications. Our MCDA models contained criteria for benefits (prevention of ischemic stroke and systemic embolism) and risks (intracranial and extracranial bleeding). We calculated a performance score for each drug accounting for benefits and risks in comparison to treatment alternatives.
Overall, new agents had higher performance scores than warfarin; in order of performance scores: dabigatran 150 mg (0.529), rivaroxaban (0.462), apixaban (0.426), and warfarin (0.191). For patients at a higher risk of stroke (CHADS2 score≥3), apixaban had the highest performance score (0.686); performance scores for other drugs were 0.462 for dabigatran 150 mg, 0.392 for dabigatran 110 mg, 0.271 for rivaroxaban, and 0.116 for warfarin. Dabigatran 150 mg had the highest performance score for primary stroke prevention, while dabigatran 110 mg had the highest performance score for secondary prevention.
Citation: Hsu JC, Hsieh C-Y, Yang Y-HK, Lu CY (2015) Net Clinical Benefit of Oral Anticoagulants: A Multiple Criteria Decision Analysis. PLoS ONE 10(4): e0124806. doi:10.1371/journal.pone.0124806
Academic Editor: Igor Linkov, US Army Engineer Research and Development Center, UNITED STATES
Received: April 29, 2014; Accepted: March 19, 2015; Published: April 21, 2015
Copyright: © 2015 Hsu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: We selected results from several published studies to provide the data on benefits and risks of oral anticoagulants and warfarin on various sub-criteria for our models. Table 1 shows the data imputed in the model, including the overall and different scenarios.
Funding: Dr. Hsu was supported by the Taiwan National Science Council Fellowship (Fellowship ID 102-2917-I-564-013). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The prevalence and incidence of atrial fibrillation (AF) have increased in the past two decades, in part due to the aging population . More than 6.5 million patients are diagnosed with AF in the US currently, and the number is estimated to reach 12.1 million in 2050 [2–3]. AF is a major risk factor for ischemic stroke  and accounts for about 12–20% of ischemic strokes [4–5]. The importance of active prevention of AF-induced stroke is increasingly recognized.
Warfarin has been used to lower the risk of stroke in patients with AF for decades. Previous studies indicated that dose-adjusted warfarin significantly reduces the incidence of stroke, but its use is associated with risk of bleeding [6–7]. Patients on warfarin therapy must be periodically monitored with dose adjustments as necessary. In recent years, new oral anticoagulants (dabigatran, rivaroxaban, and apizaban) became available as treatment options for preventing stroke for patients with AF . These medicines have the characteristics of ideal oral anticoagulants for long-term use: effective in preventing stroke, low risk of bleeding, a wide therapeutic window, a low propensity for food and drug interactions, and administration in fixed dosages [6, 8]. The 2011 guideline by American Heart Association recommended using dabigatran as the alternative in patients with AF .
A number of large randomized controlled trials have shown the efficacy and safety of new oral anticoagulants in patients with AF. These include the RE-LY trial [10–11], ROKET-AF trial , AVERROES trial [13–14], and ARISTOTLE trial . In the last few years, several meta-analyses have been conducted to study the comparative efficacy and safety of oral anticoagulants [8, 15–19]. They found no statistically significant difference in efficacy (e.g., prevention of ischemic stroke) between the three drugs, although apixaban and dabigatran were numerically superior to rivaroxaban [16–17]. However, with a lower risk of intracranial bleeding, new oral anticoagulants appear to have a more favorable safety profile, making them promising alternatives to warfarin . Particularly, apixaban produced significantly fewer major bleedings [16–17] and gastrointestinal bleedings  than dabigatran 150 mg twice a day (BID) and rivaroxaban 20 mg once a day (QD). Dabigatran 150 mg BID was superior to rivaroxaban for some efficacy endpoints, whereas major bleeding was significantly lower with dabigatran 110 mg BID and apixaban 5 mg BID .
Despite these studies, it remains unclear which new anticoagulant agent is the optimal choice. There is a lack of integrated benefit-risk assessment of treatment options. Thus, evidence is limited in terms of the benefit-risk balance for each oral anticoagulant, for each clinical endpoint representing risks or benefits, and for patients of different characteristics .
A recent analysis by Canestaro et al. (2013) assessed the cost-effectiveness of oral anticoagulants for treatment of AF among patients aged 70 years with an average CHADS2 score, a clinical prediction rule for estimating the risk of stroke in patients with non-rheumatic AF [22–23]. This analysis used a Markov state transition decision tree model, a threshold of $100,000 per quality-adjusted life year, and incremental cost-effectiveness ratios . However, instead of providing a priority/ranking of medications for decision making, it merely used “incremental costs” to express the additional financial burden needed to bear under specific conditions in order to achieve the similar treatment effect (with consideration of risk) between alternative drugs. Further, rather than comparing drugs for specific clinical endpoints representing risks and benefits (e.g., intracranial bleeding), it merely assessed broadly defined outcomes (e.g., bleeding). Lastly, this study focused on the general scenario (70-year-old patients with an average CHADS2 score) only without considering other common treatment scenarios.
Our study aims to address the above gaps by using multiple criteria decision analysis (MCDA) to conjointly and quantitatively evaluate the comparative efficacy and safety of new oral anticoagulant agents and warfarin for treatment of nonvalvular atrial fibrillation. We also compared these agents under different scenarios: general scenario, patients with a high risk of stroke (CHADS2 score≥3), and patients taking one of these medicines for primary or for secondary stroke prevention. We chose this method because it can evaluate therapeutic alternatives by integrating multiple criteria in an explicit manner, including the trade-offs between benefits and risks [25–26].
MCDA is a method for supporting decision making and has been used in fields of economics and management [27–28]. MCDA can also be used to support healthcare decisions, for instance, for assessing risks and benefits of medical technologies. It is a sound framework for integrating multiple benefit and risk criteria based on their perceived value, and using this as a basis for comparing alternative treatments. Its advantages, compared with head-to-head clinical trials, include expressing all effects (favorable and unfavorable) of different performance metrics (e.g., measurable quantities, scoring systems, relative frequencies, health outcomes); capturing trade-offs among the effects; and calculating the weight for each outcome against other outcomes [25–26]. Using a decision value tree, a performance score can be calculated for a drug to represent its benefit-risk balance, considering the health utilities, relative to other drugs. Both benefit and risk criteria can be split into multiple sub-criteria in case of different primary endpoints, subgroups, and interactions [21, 26, 29]. We used similar methods to assess the comparative benefit-risk balance of oral phosphodiesterase type 5 inhibitors for erectile dysfunction .
Decision models were created to compare the benefit-risk balance of new oral anticoagulant agents and warfarin under four scenarios: (1) the general population (70 year-old), (2) patients with a higher risk of stroke (CHADS2 score≥3), (3) primary stroke prevention, and (4) secondary stroke prevention. Selection of criteria and sub-criteria in this study was based on good decision analysis practice [31–32], which recommends that criteria should have the following key characteristics: being clinically important, essential, non-redundant, operational, complete, and reflecting the goals of decision and questions of study. According to these principles, we reviewed the literature and selected criteria (benefits and risks) to create our decision models.
For the general population, we followed Canestaro et al (2013)  and used the effect sizes of prevention of ischemic stroke and prevention of systemic embolism as sub-criteria for benefits, and risks of intracranial bleeding and extracranial bleeding as sub-criteria for risks (Fig 1). For patients with a higher risk of stroke, we followed Schneeweiss et al (2012)  and used prevention of stroke or systemic embolism as a sub-criterion for benefits, and major bleeding as a sub-criterion for risks. For primary or secondary stroke prevention, we followed Rasmussen et al (2012)  and used prevention of stroke or systemic embolism and prevention of death from vascular causes as sub-criteria for benefits, and intracranial bleeding and other local bleeding as sub-criteria for risks. These three studies were published in major journals and their data sources were large RCTs and/or meta-analyses of RCTs. Therefore, we selected these studies to provide the comparative data on benefits (the reciprocal of hazard ratios to represent “prevention” effects) and risks (hazard ratios) of oral anticoagulants and warfarin on various sub-criteria for our models, which are not available from single RCTs, or cohort or case-control studies [15–16, 24]. Warfarin was used as a baseline alternative when it is one of the options; otherwise, rivaroxaban was used as a baseline alternative.
Our MCDA modeling overall involved the following steps: (i) develop decision models with multiple criteria (decision value tree), (ii) pull data from the literature on effect sizes (with 95% confidence intervals) for benefit and risk criteria for each drug compared with other drugs, (iii) for each criterion, scale and normalize the values of the effect (and 95% confidence intervals) of all drugs so that the range is between 0 and 1, (iv) estimate the weight for each criterion against other criteria based on health utilities representing their relative importance from patients’ perspectives, (v) and finally based on ranking of drugs using standardized effect sizes and weighting of their health utilities, calculate a performance score for each drug, integrating its benefit-risk balance, considering health utilities, against therapeutic alternatives.
To accommodate uncertainties, instead of inputting only the exact values for hazard ratios (or the reciprocal of hazard ratios) reported in published studies, we used the “Three Point Estimate” method to allow the model to consider values within the 95% confidence interval of the hazard ratios (or the reciprocal of hazard ratios). Table 1 shows the data imputed in the model, including the overall and different scenarios [15–16, 24, 33–35].
To compare drugs for each single criterion, we scaled and normalized the values of the effect and their intervals using “Single-attribute Utility Function”  method with appropriate quadratic function so that the range is between 0 and 1 (0 represents the least preferred and reflects the lowest possible value among all drugs; and 1 represents the most preferred and reflects the highest possible value among all drugs). The quadratic utility functions are defined as follows:
Next, we estimated the weight for each criterion against other criteria based on health utilities representing their relative importance that partly reflect the severity of disease and patients’ concerns. We reviewed the literature for existing health utility measures (mean and range from experts’ and patients’ views) of all possible health status of criteria (Table 2); where no health utility measures exist, our assumed health utilities are noted in Table 2. While health utility measures exist for (some) criteria, little is known about their relative importance against each other. Therefore, we used the “Analytic Hierarchy Process” [37–38] method to estimate the weight for each criterion against other criteria. This method provides a framework for ranking the criteria by calculated weights and for evaluating therapeutic alternatives. The weight for each criterion are determined by sequentially comparing the reciprocal of health utilities (Table 2) of all possible pairs of criteria and the eigenvectors  calculated in Analytic Hierarchy Process [33–35]. Specific (sub)criteria that are of higher concern to patients have higher values in weights. Based on this approach, the weights for “benefits” and “risks” criteria for the general population were 0.631 and 0.369 respectively. The weights for sub-criteria in descending order were prevention of ischemic stroke (0.43), risk of intracranial bleeding (0.252), prevention of systemic embolism (0.202), and risk of extracranial bleeding e.g., gastrointestinal bleeding (0.116).
Finally, we calculated a performance score for each oral anticoagulant agent and warfarin that combined all of its sub-criteria of benefits and risks and their weights, relative to other agents; drugs with higher performance scores are preferred. Sensitivity analyses of weights (derived from the range of health utilities; Table 2) for major sub-criteria (prevention of ischemic stroke and risk of intracranial bleeding) were also conducted to determine how variations in the assigned weights for these criteria would affect the results.
The general population (70 years old)
Table 3 presents the results of MCDA by a ranking matrix. Considering the overall benefit-risk, dabigatran 150 mg BID (0.529) had the highest performance score; other anticoagulants in descending order by performance scores were rivaroxaban 20 mg QD (0.462), apixaban 5 mg BID (0.426), and warfarin (0.191). On benefits alone, dabigatran 150 mg BID had the highest performance score (0.57); other anticoagulants in descending order based on performance scores were rivaroxaban 20 mg QD (0.506), apixaban 5 mg BID (0.393), and warfarin (0.284). On the basis of risks alone, anticoagulants in descending order by performance scores were apixaban 5 mg BID (0.483), dabigatran 150 mg BID (0.458), rivaroxaban 20 mg QD (0.386), and warfarin (0.030).
Iso-performance score curves for prevention of ischemic stroke (reflected by the reciprocal of hazard ratio) and risk of intracranial bleeding (reflected by the hazard ratio) are shown in Fig 2. Each iso-performance score curve was calculated according to multi-attribute utility function principles . For prevention of ischemic stroke and risk of intracranial bleeding, two major sub-criteria of concerns to physicians when selecting an anticoagulant agent, dabigatran 150 mg BID was the top priority for the general population because its performance score was closest to the highest iso-performance score curve (0.8). In contrast, warfarin and rivaroxaban were the least preferred choices; their performance scores were closest to the lowest iso-performance score curve (0.2).
Patients with a higher risk of stroke
For patients with a high risk of stroke (CHADS2 score≥3), we found that apixaban had the highest performance score (0.686) considering both “benefits” and “risks” criteria. Other anticoagulants in descending order by performance scores were dabigatran 150 mg BID (0.462), dabigatran 110 mg BID (0.392), rivaroxaban 20 mg QD (0.271), and warfarin (0.116). When we focused on benefits only, apixaban 5 mg BID had the highest performance score (0.748); other anticoagulants in descending order based on performance scores were dabigatran 150 mg BID (0.697), dabigatran 110 mg BID (0.535), rivaroxaban 20 mg QD (0.372), and warfarin (0.12). When we focused on risks only, anticoagulants in descending order by performance scores were apixaban 5 mg BID (0.586), dabigatran 110 mg BID (0.165), rivaroxaban 20 mg QD (0.109), warfarin (0.109) and dabigatran 150 mg BID (0.085).
Primary and secondary prevention
For primary stroke prevention, we only compared new oral anticoagulants. In the overall benefit-risk assessment, anticoagulants in descending order by performance scores were dabigatran 150 mg BID (0.678), apixaban 5 mg BID (0.589), rivaroxaban 20 mg QD (0.581), and dabigatran 110 mg BID (0.474). The order was similar when we focused on benefits only: dabigatran 150 mg BID (0.753), rivaroxaban 20 mg QD (0.642), apixaban 5 mg BID (0.629), and dabigatran 110 mg BID (0.468).
For secondary stroke prevention, anticoagulants in descending order by performance scores were dabigatran 110 mg BID (0.901), apixaban 5 mg BID (0.601), dabigatran 150 mg BID (0.585), and rivaroxaban 20 mg QD (0.581) in the overall benefit-risk assessment. The order was the same when we assessed risks only; based on performance scores: dabigatran 110 mg BID (0.817), apixaban 5 mg BID (0.554), dabigatran 150 mg BID (0.467), and rivaroxaban 20 mg QD (0.353).
Fig 3 showed the ranking of oral anticoagulants under various scenarios by histograms. It not only indicated the ranking of overall performance scores for each alternative, but also how “benefits” and “risks” contributed toward performance scores. In Fig 3, the 95% confidence intervals of hazard ratios reflected the minimum and maximum values in our models to represent uncertainties.
We conducted sensitivity analyses of weights for prevention of ischemic stroke (which has the highest weight among “benefits” sub-criteria) and risk of intracranial bleeding (which has the highest weight among “risks” sub-criteria) on performance scores for the general population. We found that if the weight for prevention of ischemic stroke was between 0.05 and 0.65, dabigatran 150 mg BID and rivaroxaban 20 mg QD had the highest performance scores (Fig 4). Also, dabigatran 150 mg BID and rivaroxaban 20 mg QD were the optimal choices when the weight for prevention of intracranial bleeding was less than 0.32 (Fig 5).)
This is the first study to compare the benefit-risk balance of oral anticoagulants in patients with nonvalvular atrial fibrillation through MCDA with consideration of the relative importance of different clinical outcomes from patients’ perspectives. The MCDA method can compare more than two drugs; it can compare the effects of multiple drugs on the same outcome (clinical endpoints to reflect efficacy and/or risks); and it can also “conjointly” evaluate the comparative efficacy and safety of multiple drugs, considering their benefits, risks, and the benefit-risk balance at the same time [25–26]. Our results indicate that among new oral anticoagulants, dabigatran 150 mg BID, compared with rivaroxaban 20 mg QD and apixaban 5 mg BID, might be the first choice for patients with AF in the overall risk-benefit assessment. When we consider specifically prevention of ischemic stroke and risk of intracranial bleeding, dabigatran 150 mg BID still has high priority. Our sensitivity analyses also indicate that dabigatran 150 mg BID is either first or second choice if the weights for prevention of ischemic stroke and risk of intracranial bleeding are within certain ranges.
Our analysis aims to provide an integrated evaluation of risks and benefits; thus, cost was not included. Our results differ with the findings by Canestaro et al, which was a cost-effectiveness analysis. Canestaro et al found that apixaban 5 mg BID is the optimal choice, it being the most cost-effective strategy, and warfarin is the best option in probabilistic sensitivity analysis .
Our analyses show the differences between anticoagulants in relation to specific outcomes of benefits and risks. Such risk-benefit-risk assessment of drugs can help to guide clinicians in making treatment decisions for individual patients. For instance, while dabigatran 150 mg BID is the best choice in the overall benefit-risk assessment, its benefit is small for prevention of systemic embolism, and in fact, its performance score is the lowest among all drugs when the risk of extracranial bleeding is the main consideration. In this case, dabigatran 150 mg BID is still not the suggested choice for patients with a high risk of extracranial bleeding (especially for older patients), even though it has the highest performance score in our overall benefit-risk assessment.
For patients with a higher risk of stroke (CHADS2 score≥3), our results indicate that apixaban 5 mg BID is the first choice, and it is substantially better than the next alternative by performance scores (0.686 vs. 0.462 for dabigatran 150 mg BID). This result is similar to Schneeweiss et al , who compared efficacy and safety of all agents based on data from several large clinical trials. Schneeweiss et al also proposed that apixaban is the best mainly due to statistically similar rates of stroke and systemic embolism but a much lower risk of major bleeding compared with other drugs. Our study also shows the differences between drugs toward other clinical endpoints using an integrated risk-benefit assessment, which provides helpful information to clinicians and patients.
Our findings are also similar to the indirect comparison analysis by Rasmussen et al  Rasmussen et al found that for primary stroke prevention, new oral anticoagulants showed some differences in efficacy and risk of bleeding, but no drug is significantly better than the other based on their balance of benefits and risks. For secondary stroke prevention, dabigatran 110 mg BID seems to be safer than other drugs. Our MCDA analysis found that dabigatran 150 mg BID is the first priority for primary stroke prevention; other drugs have similar performance scores. For secondary stroke prevention, dabigatran 110 mg BID is the priority; it is substantially better than the next choice (apixaban 5 mg BID) by performance scores.
This study has important clinical and policy implications. Despite great efforts made on comparative effectiveness research of new drugs, little attention has been paid to quantitative methods for integrated, comparative assessments of benefit-risk balances of drugs. Previous studies only compared drugs’ effects on single clinical outcomes one at a time [15–16]. In contrast, our study compared drugs’ effects on multiple clinical outcomes at once and additionally our method integrates benefits and risks. Our study provides an example of how benefit-risk balance of alternative drugs can be compared in an integrated fashion using available evidence. We also compared these agents under different scenarios, including population with a high risk of stroke and for primary and secondary stroke prevention. Integrated assessments of benefit-risk of medicines are valuable for clinical practice.
In spite of its findings and contributions, this study has several limitations. First, the present results only considered pharmacological options for patients with AF, and provided suggestions for choosing appropriate medications in clinical practice. This study did not consider “the necessity of taking new oral anticoagulants for the individual patient” (e.g., the probability of stroke or bleeding) or patient’s disease history. New anticoagulants should be used in patients without serious renal/liver/heart insufficiency for prevention of stroke. Second, most decision models including our models are a simplification of decision making when treating real patients. Our models considered specific clinical endpoints for measuring “benefits” and “risks” (e.g., intracranial bleeding) rather than broadly defined outcomes (e.g., bleeding) providing more detailed benefit-risk assessment of oral anticoagulants; however, outcomes can be further stratified, for example, using specific endpoints such as risk of gastrointestinal bleeding rather than including it in the category of local bleeding. We also did not consider medications’ properties such as interaction with other drugs, adherence rate, risk of switching medications, off-label or inappropriate use leading to adverse events and so on. Third, how to determine the suitable weights for each criterion with consideration of physicians’ and patients’ views has been a major challenge in MCDA modeling. While patient preferences need to be considered, these are not well studied to date. Thus, we adopted Analytic Hierarchy Process to estimate the weight for each criterion against other criteria based on existing health utility measures and conducted sensitivity analyses of weights to consider uncertainties, although these may not be particularly sensitive to individual patient preferences and trade-offs between different outcomes. Fourth, this study focused on four scenarios (general, high risk of stroke, primary and secondary stroke prevention), our findings and recommendations may not apply to other scenarios (e.g., patients without AF or patients >80 years old). Further research is therefore warranted to assess the benefit-risk of anticoagulants under different scenarios. Finally, drugs may have accumulated benefits and risks; however, time-dependant nature of risk and benefit was not considered in our MCDA models. Research is needed to advance MCDA method to enable consideration of time-dependant risks and benefits.
To reduce the social and economic burdens of stroke, the most effective way is to prevent its occurrence. In addition to controlling modifiable risk factors associated with stroke, anticoagulant drugs play an important role for the prevention of stroke. However, clinicians and patients often face the challenge of making decisions between multiple treatment choices without integrated, comparative benefit-risk evidence. Using the MCDA quantitative method, this study evaluated the integrated efficacy and safety of oral anticoagulants and compared five treatment options under different scenarios. Our analysis presents a useful meta-analytic approach that allows studies of different types to be synthesized for an integrated assessment of the comparative risk-benefit balance of several drugs at once. Such evidence helps clinicians and patients to make an appropriate treatment decision to prevent stroke under the safer condition.
Dr. Hsu conducted part of this work as a research fellow in the Harvard Medical School Fellowship in Pharmaceutical Policy Research.
Conceived and designed the experiments: JCH CYH YHKY CYL. Performed the experiments: JCH CYH CYL. Analyzed the data: JCH CYL. Contributed reagents/materials/analysis tools: JCH CYL. Wrote the paper: JCH CYH YHKY CYL.
- 1. Go AS, Hylek EM, Phillips KA, Chang Y, Henault LE, Selby JV et al. Prevalence of diagnosed atrial fibrillation in adults: national implications for rhythm management and stroke prevention: the AnTicoagulation and Risk Factors in Atrial Fibrillation (ATRIA) Study. JAMA 2001;285:2370–5. pmid:11343485
- 2. Miyasaka Y, Barnes ME, Gersh BJ, Cha SS, Bailey KR, Abhayaratna WP et al. Secular trends in incidence of atrial fibrillation in Olmsted County, Minnesota, 1980 to 2000, and implications on the projections for future prevalence. Circulation 2006;114:119–25. pmid:16818816
- 3. Marini C, De Santis F, Sacco S, Russo T, Olivieri L, Totaro R et al. Contribution of atrial fibrillation to incidence and outcome of ischemic stroke: results from a population-based study. Stroke 2005;36:1115–9. pmid:15879330
- 4. Yip PK, Jeng JS, Lee TK, Chang YC, Huang ZS, Ng SK et al. Subtypes of ischemic stroke. A hospital-based stroke registry in Taiwan (SCAN-IV). Stroke 1997;28:2507–12. pmid:9412641
- 5. Wolf PA, Abbott RD, Kannel WB. Atrial fibrillation as an independent risk factor for stroke: the Framingham Study. Stroke 1991;22:983–8. pmid:1866765
- 6. Turpie AG. New oral anticoagulants in atrial fibrillation. Eur Heart J 2008;29:155–65. pmid:18096568
- 7. Cairns JA, Connolly S, McMurtry S, Stephenson M, Talajic M. Canadian Cardiovascular Society atrial fibrillation guidelines 2010: prevention of stroke and systemic thromboembolism in atrial fibrillation and flutter. Can J Cardiol 2011;27:74–90. doi: 10.1016/j.cjca.2010.11.007. pmid:21329865
- 8. Miller CS, Grandi SM, Shimony A, Filion KB, Eisenberg MJ. Meta-analysis of efficacy and safety of new oral anticoagulants (dabigatran, rivaroxaban, apixaban) versus warfarin in patients with atrial fibrillation. Am J Cardiol 2012;110:453–60. doi: 10.1016/j.amjcard.2012.03.049. pmid:22537354
- 9. Wann LS, Curtis AB, Ellenbogen KA, Estes NA, Ezekowitz MD, Jackman WM et al. 2011 ACCF/AHA/HRS focused update on the management of patients with atrial fibrillation (update on dabigatran): a report of the American College of Cardiology Foundation/American Heart Association Task Force on practice guidelines. J Am Coll Cardiol 2011;57:1330–7. doi: 10.1016/j.jacc.2011.01.010. pmid:21324629
- 10. Connolly SJ, Ezekowitz MD, Yusuf S, Eikelboom J, Oldgren J, Parekh A et al. Dabigatran versus warfarin in patients with atrial fibrillation. N Engl J Med 2009;361:1139–51. doi: 10.1056/NEJMoa0905561. pmid:19717844
- 11. Connolly SJ, Ezekowitz MD, Yusuf S, Reilly PA, Wallentin L. Newly identified events in the RE-LY trial. N Engl J Med 2010;363:1875–6. doi: 10.1056/NEJMc1007378. pmid:21047252
- 12. Patel MR, Mahaffey KW, Garg J, Pan G, Singer DE, Hacke W et al. Rivaroxaban versus warfarin in nonvalvular atrial fibrillation. N Engl J Med 2011;365:883–91. doi: 10.1056/NEJMoa1009638. pmid:21830957
- 13. Connolly SJ, Eikelboom J, Joyner C, Diener HC, Hart R, Golitsyn S et al. Apixaban in patients with atrial fibrillation. N Engl J Med 2011;364:806–17. doi: 10.1056/NEJMoa1007432. pmid:21309657
- 14. Granger CB, Alexander JH, McMurray JJ, Lopes RD, Hylek EM, Hanna M et al. Apixaban versus warfarin in patients with atrial fibrillation. N Engl J Med 2011;365:981–92. doi: 10.1056/NEJMoa1107039. pmid:21870978
- 15. Rasmussen LH, Larsen TB, Graungaard T, Skjoth F, Lip GY. Primary and secondary prevention with new oral anticoagulant drugs for stroke prevention in atrial fibrillation: indirect comparison analysis. BMJ 2012;345:e7097. doi: 10.1136/bmj.e7097. pmid:23129490
- 16. Schneeweiss S, Gagne JJ, Patrick AR, Choudhry NK, Avorn J. Comparative efficacy and safety of new oral anticoagulants in patients with atrial fibrillation. Circ Cardiovasc Qual Outcomes 2012;5:480–6. doi: 10.1161/CIRCOUTCOMES.112.965988. pmid:22787066
- 17. Lip GY, Larsen TB, Skjoth F, Rasmussen LH. Indirect comparisons of new oral anticoagulant drugs for efficacy and safety when used for stroke prevention in atrial fibrillation. J Am Coll Cardiol 2012;60:738–46. doi: 10.1016/j.jacc.2012.03.019. pmid:22575324
- 18. Medi C, Hankey GJ, Freedman SB. Stroke risk and antithrombotic strategies in atrial fibrillation. Stroke 2010;41:2705–13. doi: 10.1161/STROKEAHA.110.589218. pmid:20930160
- 19. Paciaroni M, Agnelli G, Venti M, Alberti A, Acciarresi M, Caso V. Efficacy and safety of anticoagulants in the prevention of venous thromboembolism in patients with acute cerebral hemorrhage: a meta-analysis of controlled studies. J Thromb Haemost 2011;9:893–8. doi: 10.1111/j.1538-7836.2011.04241.x. pmid:21324058
- 20. Baker WL, Phung OJ. Systematic review and adjusted indirect comparison meta-analysis of oral anticoagulants in atrial fibrillation. Circ Cardiovasc Qual Outcomes 2012;5:711–9. pmid:22912382
- 21. Guo JJ, Pandey S, Doyle J, Bian B, Lis Y, Raisch DW. A review of quantitative risk-benefit methodologies for assessing drug safety and efficacy-report of the ISPOR risk-benefit management working group. Value Health 2010;13:657–66. doi: 10.1111/j.1524-4733.2010.00725.x. pmid:20412543
- 22. Gage BF, Waterman AD, Shannon W, Boechler M, Rich MW, Radford MJ. Validation of clinical classification schemes for predicting stroke: results from the National Registry of Atrial Fibrillation. JAMA 2001;285:2864–70. pmid:11401607
- 23. Gage BF, van Walraven C, Pearce L, Hart RG, Koudstaal PJ, Boode BS et al. Selecting patients with atrial fibrillation for anticoagulation: stroke risk stratification in patients taking aspirin. Circulation 2004;110:2287–92. pmid:15477396
- 24. Canestaro WJ, Patrick AR, Avorn J, Ito K, Matlin OS, Brennan TA et al. Cost-effectiveness of oral anticoagulants for treatment of atrial fibrillation. Circ Cardiovasc Qual Outcomes 2013;6:724–31. doi: 10.1161/CIRCOUTCOMES.113.000661. pmid:24221832
- 25. Mussen F, Salek S, Walker S. A quantitative approach to benefit-risk assessment of medicines—part 1: the development of a new model using multi-criteria decision analysis. Pharmacoepidemiol Drug Saf 2007;16 Suppl 1:S2–S15. pmid:17546573
- 26. Mussen F, Salek S, Walker S, Phillips L. A quantitative approach to benefit-risk assessment of medicines—part 2: the practical application of a new model. Pharmacoepidemiol Drug Saf 2007;16 Suppl 1:S16–41. pmid:17546574
- 27. Karasakal EK, Köksalan ME, Koksalan M. Generating a Representative Subset of the Efficient Frontier in Multiple Criteria Decision Making. Operations Research 2009;57:187–99.
- 28. Köksalan M, Wallenius J, Zionts S. Multiple Criteria Decision Making: From Early History to the 21st Century. Singapore: World Scientific 2011.
- 29. Mussen F, Salek S, Walker S. A quantitative approach to benefit-risk assessment of medicines—part 1: the development of a new model using multi-criteria decision analysis; part 2: the practical application of a new model. Pharmacoepidemiol Drug Saf 2007;16 Suppl 1:S42–6. pmid:17546572
- 30. Hsu JC, Tang DH, Lu CY. Risk-Benefit Assessment of Oral Phosphodiesterase Type 5 Inhibitors for treatment of Erectile Dysfunction: A Multiple Criteria Decision Analysis. International Journal of Clinical Practice 2014; epub ahead of print.
- 31. Keeney RL. Value-Focused Thinking: A Path to Creative Decisionmaking. Harvard University Press 1996.
- 32. Weinstein MC, O'Brien B, Hornberger J, Jackson J, Johannesson M, McCabe C et al. Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices—Modeling Studies. Value Health 2003;6:9–17. pmid:12535234
- 33. Meenan RT, Saha S, Chou R, Swarztrauber K, Pyle Krages K, O’keeffe-Rosetti MC et al. Cost-effectiveness of echocardiography to identify intracardiac thrombus among patients with first stroke or transient ischemic attack. Med Decis Making 2007;27:161–77. pmid:17409366
- 34. Lee S, Mullin R, Blazawski J, Coleman CI. Cost-effectiveness of apixaban compared with warfarin for stroke prevention in atrial fibrillation. PLoS One 2012;7:e47473. doi: 10.1371/journal.pone.0047473. pmid:23056642
- 35. O'Brien CL, Gage BF. Costs and effectiveness of ximelagatran for stroke prophylaxis in chronic atrial fibrillation. JAMA 2005;293:699–706. pmid:15701911
- 36. Feeny D, Furlong W, Torrance GW, Goldsmith CH, Zhu Z, DePauw S et al. Multiattribute and single-attribute utility functions for the health utilities index mark 3 system. Med Care 2002;40:113–28. pmid:11802084
- 37. Saaty TL. How to make a decision: The analytic hierarchy process. European Journal of Operational Research 1990;48:9–26.
- 38. Saaty TL, Peniwati K. Group decision making: drawing out and reconciling differences. Pittsburgh, PA: RWS Publications 2008.
- 39. Saaty TL. Decision-making with the AHP: Why is the principal eigenvector necessary. European Journal of Operational Research 2003;145:85–91.
- 40. Stevens K, McCabe C, Brazier J, Roberts J. Multi-attribute utility function or statistical inference models: a comparison of health state valuation models using the HUI2 health state classification system. J Health Econ 2007;26:992–1002. pmid:17276531