http://orcid.org/0000-0002-1268-5102
Figures
Abstract
Background
Adequate disease and treatment-related risk knowledge of people with Multiple Sclerosis (pwMS) is a prerequisite for informed choices in medical encounters. Previous work showed that MS risk knowledge is low among pwMS and role preferences are different in Italy and Germany.
Objective
We investigated the level of risk knowledge and role preferences in 8 countries and assessed putative variables associated with risk knowledge.
Methods
An online-survey was performed based on the Risk knowledge questionnaire for people with relapsing-remitting MS (RIKNO 2.0), the electronic Control Preference Scale (eCPS), and other patient questionnaires. Inclusion criteria of participants were: (1) age ≥18 years, (2) a diagnosis of relapsing-remitting MS (RRMS), (3) being in a decision making process for a disease modifying drug.
Results
Of 1939 participants from Germany, Italy, the Netherlands, Serbia, Spain and Turkey, 986 (51%) (mean age 38.6 years [range 18–67], 77% women, 7.8 years of disease duration) completed the RIKNO 2.0, with a mean of 41% correct answers. There were less than 50 participants in the UK and Estonia and data were not analysed. Risk knowledge differed across countries (p < 0.001). Variables significantly associated with higher risk knowledge were higher education (p < 0.001), previous experience with disease modifying drugs (p = 0.001), correct answer to a medical data interpretation question (p < 0.001), while higher fear for wheelchair dependency was negatively associated to risk knowledge (p = 0.001).
Citation: Giordano A, Liethmann K, Köpke S, Poettgen J, Rahn AC, Drulovic J, et al. (2018) Risk knowledge of people with relapsing-remitting multiple sclerosis – Results of an international survey. PLoS ONE 13(11): e0208004. https://doi.org/10.1371/journal.pone.0208004
Editor: Orhan Aktas, Heinrich-Heine-Universitat Dusseldorf, GERMANY
Received: March 29, 2018; Accepted: November 9, 2018; Published: November 29, 2018
Copyright: © 2018 Giordano et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was supported by grants from the Fondazione Italiana Sclerosi Multipla (FISM, www.aism.it) (grant No. 2010/R/37 to AS) and by the German Hertie Foundation (www.ghst.de/en) (grant number 12-03-2010 to CH) as part of the AutoMS project. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: K. Liethmann was partly financed by a grant on adherence factors in MS (ADEPT) by Genzyme Sanofi-Aventis. J. Drulovic has received honoraria as speaker and for participation in Advisory Boards from Merck Serono, Teva, Bayer Schering, Sanofi Genzyme, and Medis. J. Sastre-Garriga has received compensation for participating on Advisory Boards, speaking honoraria and travel expenses for scientific meetings, consulting services or research support from Celgene, Novartis, Biogen, Teva, Merck, Almirall, and Genzyme. I. Galea has received funding for travel and conference attendance from Teva and research funding from Merck Serono; he has served as a scientific advisor to Evgen. A. Solari has been a board member of Merck Serono and Novartis. She has received speaker honoraria from Almirall, Excemed, Genzyme, Merck Serono, and Teva. C. Heesen has received speaker honoraria and travel grants from Biogen, Genzyme, Sanofi Aventis, Merck, Novartis and Roche. All other authors declare that they have no competing interests. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Good clinical practice in medical decision making is increasingly recognised as a shared process between the physician and the patient [1,2]. This so called shared decision making (SDM) is defined as an interactive process between the health care provider (e.g. doctor or nurse) and the patient. Both parties have different and all-relevant information that are essential for the decision making process [3]. In chronic diseases as multiple sclerosis (MS) SDM is even more important, particularly as different treatment options are available [4]. Accordingly, two studies reported that people with MS (pwMS) claim active roles in decision making [4,5].
One prerequisite for SDM is the sharing of relevant disease and treatment-related risk knowledge appraised by methods of evidence-based medicine [6,7], because risk knowledge is necessary to enable patients to get to an informed choice [8]. Risk knowledge as communicated in evidence-based patient information (EBPI) can be measured through questionnaires and can be assessed as a crucial surrogate for SDM processes [9]. It has indeed been shown that EBPI is able to increase informed choices of pwMS [10,11]. In addition, risk knowledge seems to contribute to treatment adherence [10,12].
Previous work indicates low levels of MS risk knowledge among pwMS in Germany [13,14] and differences in role preferences in medical decision making between Germany and Italy [15.]. Until now, little is known about further cross-cultural differences in MS risk knowledge. Thus, the aim of the present study was to investigate the level of risk knowledge amongst pwMS from different European countries, and to assess the role of demographic and clinical characteristics on risk knowledge. In addition, we assessed the role preferences of pwMS regarding medical decision making.
Material and methods
An online-survey was performed in 8 countries using the secure online survey program EFS Survey.
Ethics statement
The study protocol was approved by the following: ethics committee of the Hamburg Chamber of Physicians (PV3559 6.9.2010); ethics committee of the Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy; ethics committee of the Faculty of Medicine University of Belgrade, Serbia; Izmir Katip Celebi University Ethical Review Board, Turkey; Comité Ético de Investigación Clínica del Hospital Universitario Vall d’Hebron, Barcelona, Spain; University of Southampton Ethics and Research Governance Office (approval number: 18783); Medische Ethische Toetsings Commissie Brabant, The Netherlands; Tallinn Medical Research ethics committee, Estonia. Participants were informed that data analysis was anonymous.
Recruitment of participants
The survey was performed in Estonia, Germany, Italy, the Netherlands, Serbia, Spain, Turkey and the United Kingdom (UK). To get meaningful results per country we aimed to get at least 50 participants from each country. Different recruitment strategies were applied: Germany and Spain recruited via homepages, Italy and the Netherlands via National MS Society mailing lists, Serbia and Turkey via personal contact with patients in the MS clinic.
Inclusion criteria of participants were: (1) age ≥18 years, (2) a diagnosis of relapsing-remitting MS (RRMS) (as the main questionnaire addresses people with RRMS), (3) being in a decision making process for a disease modifying drug (DMD) as we aimed to address those patients for whom risk knowledge is most relevant.
Questionnaires
The Risk knowledge questionnaire for people with RRMS (RIKNO 2.0) is a self-assessed inventory consisting of 19 multiple choice items; a total score (range 0–21) is obtained by summing up correct answers [13,14]. The RIKNO 2.0 was translated-culturally adapted from German to UK English, and from UK English into Dutch, Estonian, French, Italian, Serbian, Spanish and Turkish using a recognised procedure [14]. All the RIKNO 2.0 versions used in the online survey are reported in S1 Appendix. A German validation study with 708 pwMS showed on average 10.2 correct answers (SD 3.3). Mean item difficulty was 46% (range 20–79%) [14].
The Multiple Sclerosis Knowledge Questionnaire (MSKQ) is a 25-item self-assessed, on general MS knowledge [16], for newly-diagnosed MS patients. Originally developed in Italian, translations of the MSKQ have been performed to Dutch, English, and German. The total score is obtained by summing up correct answers (possible range: 0–25). Two versions of the questionnaire exist, for re-administration (in the present survey we used version A). The MSKQ was well accepted by pwMS, it has good reliability and, importantly, proved to be responsive in a randomised-controlled trial on an information aid for newly-diagnosed pwMS [16].
The electronic, self-administered Control Preference Scale (eCPS) was used to assess the patient preferred interaction style in medical decision making. It consists of five “cards” each describing, by a cartoon and a written sentence, a role preference. Based on the first two preferred cards, participants are classified into 6 role preference styles that can be collapsed into 3 (autonomous, shared, and passive) [15]. The eCPS was found to be well accepted and useful by pwMS; it was as reliable as the original face-to-face version [15]. Originally devised in US English, the CPS was translated-adapted into Italian, German, Serbian, Estonian and Dutch.
Demographic and clinical data
Participants filled in the following general information: gender, age, education, and living situation. They also completed the following: MS course and duration, current decision making process, current and former DMD treatment, level of impairment (Patient Determined Disease Steps, PDDS scale) [17,18], type of referral center, medical data interpretation competence (single question with 3 possible answers, one correct) [19], perception of disease severity (visual analogue scale, VAS), fear for wheelchair dependency (VAS). [20] General risk aversion/inclination was assessed with a VAS and general risk behaviour (VAS) [21].
Our main focus was the RIKNO 2.0 questionnaire, thus the order of presentation was the following: general and clinical questions, RIKNO 2.0, eCPS, and MSKQ. As some questionnaires were not available in all the nine languages, questionnaires used in each country are listed in S1 Table.
Hypotheses
The following study questions and hypotheses were investigated: (1) There is an overall low level of risk knowledge and different risk knowledge levels between the participating countries. (2) Concerning variables associated to risk knowledge, we hypothesized people with higher educational background, younger age [21] and living in northern Europe to have higher risk knowledge. In addition, we hypothesized a positive association of risk knowledge with the following variables: gender, current follow-up at a MS center, level of impairment, current DMD treatment, previous experience with DMD, being in a DMD decision making phase, medical data interpretation ability, disease duration, perception of disease severity, and fear for wheelchair dependency. (3) Assuming that MSKQ addresses general MS knowledge in newly-diagnosed pwMS, we hypothesized that RIKNO 2.0 and MSKQ are moderately correlated. (4) Based on previous work, we hypothesized that pwMS of different countries to have different role preferences [15].
The data which form the basis for the analysis can be found in S1 Dataset.
Data analysis
We assumed on average less than 50% correct answers (total score <10.5) in the RIKNO 2.0. Differences in RIKNO 2.0 scores across countries were calculated using ANOVA. A mixed model regression approach was used to investigate the effect on RIKNO 2.0 scores of the following independent variables: gender, education, being followed at a MS center, being on DMD, previous experience with DMD, medical data interpretation competence, level of impairment, age, disease duration, perception of disease severity, and fear for wheelchair dependency. Country was entered as a cluster variable. RIKNO 2.0 and MSKQ were compared using paired t-tests. Due to different range of values of the sum scores of RIKNO 2.0 (0–21) and MSKQ (0–25), MSKQ-data were fitted to the range of values of RIKNO 2.0. Pearson’s correlation coefficients were used to assess concurrent validity, assuming r ≤ 0.5. Possible differences in role preferences among pwMS of different countries were analyzed using the χ2-test. General and clinical features were compared across countries using χ2-tests for categorical variables and ANOVA for continuous variables, as appropriate. To estimate sampling bias we checked if participants who finished the whole survey differed to those who discontinued after filling in demographic data using χ2-tests for categorical variables and ANOVA for continuous variables.
All p values were two tailed, and considered significant at 0.05 level. Analyses were performed using SPSS version 24.0.
Results
Out of 1939 pwMS who started the survey, 1002 completed the RIKNO 2.0 questionnaire. Participants from Estonia and the UK were <50, and thus were not analysed. Overall, 986 out of 1939 participants from the remaining seven countries (51%) did complete the RIKNO 2.0 questionnaire: completer rates ranged from 93% (Turkey) to 47% (Germany; Table 1).
Characteristics refer to completers of RIKNO 2.0 only.
General and clinical characteristics
Participants who completed the RIKNO 2.0 were on average 38.58 years old with about 7.75 years of disease duration (Table 1). As expected, about two thirds of participants were women. We found small, but significant differences in a couple of demographic characteristics between different countries (see S2 Table). Most striking patients in Turkey were the youngest. PwMS who did not complete the RIKNO 2.0 were older (mean age 40.64, p = 0.004) and fewer were currently on a DMD (64%, p = 0.29). Non completers were less often followed at a MS center (34%, p < 0.001), and were more inclined to take general risks in life (mean 6.68, p = 0.004; with 0 = risk aversive and 10 = risk inclined). In addition they showed a lower frequency of correct answers to the medical data interpretation question (72%, p = 0.008). In Italy, Spain and the Netherlands, RIKNO 2.0 scores of pwMS in (N = 339, mean 7.20, SD 3.51) and outside of a DMD decision-making process (N = 262, mean 6.92, SD 3.36) were not different (p = 0.315).
Risk knowledge
The mean number of correct answers in RIKNO 2.0 within the whole sample was 8.7 (SD 3.5) out of 21, which means that participants gave on average 41% correct answers (see Figs 1 and 2, and S3 Table for item difficulties). Differences between countries for RIKNO 2.0 scores were significant (p <0.001), with similar results for Italy, Spain, the Netherlands and Turkey, and slightly higher scores for Germany and Serbia.
Possible ranges are 0–21.
MSKQ, Multiple sclerosis knowledge questionnaire; RIKNO, Risk knowledge questionnaire in multiple sclerosis; SD, standard deviation. For easier comparability we transformed scores to a 0–100 scale.
Variables associated to risk knowledge
Variables significantly associated to RIKNO 2.0 were country (cluster variable), education, previous DMD experience, medical data interpretation ability, and fear for wheelchair dependency (see Table 2). Specifically, non-graduated pwMS provided on average 1.62 less correct answers to RIKNO 2.0 than graduates. PwMS who replied not correctly to the question on medical data interpretation had 1.31 less correct answers than those who replied correctly. PwMS with no previous DMD experience had on average about 0.87 less correct answers than those who had been treated with DMDs. Most pwMS of all countries had high ratings of fear for wheelchair dependency (S2 Table). Participants with maximum fear for wheelchair dependency had less correct answers in the RIKNO 2.0 than people with the lowest fear. No association of age with risk knowledge could be shown.
Significant values are reported in bold.
Comparison of RIKNO 2.0 and MSKQ
Within the subsample with RIKNO 2.0 and MSKQ (N = 294) adjusted mean RIKNO 2.0 score was 41.4 (SD 16.7) and mean MSKQ score was 77.6 (SD 11.8). The paired t-test showed a significant mean score difference between the inventories (mean difference = 36.2, p <0.01): participants got higher scores with the MSKQ. However, correlation between MSKQ and RIKNO 2.0 was moderate (r = 0.480, p <0.001).
Control preferences
Overall, participants who completed the eCPS (N = 364), expressed more active and collaborative role preferences than passive (Fig 3 and S2 Appendix). More than half of the German and Dutch pwMS preferred an active role (p <0.001), while half of the Italian and Serbian participants preferred a collaborative role, followed by passive and active roles.
Discussion
This survey is to our knowledge the largest investigation on risk knowledge of pwMS with most of our hypotheses supported by the results of the study.
First, overall risk knowledge was low in all the countries. Germany and Serbia showed best results, but with only about 52% correct answers. Risk knowledge is a prerequisite for informed choice [9] and it is essential for SDM. If patients do not have enough risk knowledge, they are not able to really participate in decision making processes. Thus, there seems to be a need for improved MS information material and programs to enhance DMD risk knowledge [10,22]. However, there is no standard on how to define a set of relevant risk knowledge data. The RIKNO 2.0 questionnaire presented here was originally devised more than a decade ago, with a first tool published in 2004 [5], and was further revised and updated through the AutoMS project [13,14] with input from MS experts and pwMS across Europe. This revision process was necessary to harmonize RIKNO 2.0 contents across different cultures, and to incorporate new evidence especially on DMDs.
A second finding was that MS risk knowledge varied among countries, similarly to what we found in role preferences using the eCPS [15]. The heterogeneity in risk knowledge can be at least in part due to differing recruitment strategies: In Turkey and Serbia participants were recruited during face-to-face encounters at the MS center, leading to a higher response rate. This may as well have led to the younger age of the Turkish cohort. In the Netherlands and Italy recruitment was via the National MS Society mailing list, and in Germany via the homepage of the German MS Self-Help Society. However, focusing the two centers with face-to-face recruitment one had the highest (Serbia, mean RIKNO 2.0 total score 57) and the other the lowest (Turkey, mean score 31) knowledge. Therefore a strong effect of recruitment strategy on knowledge seems unlikely. Similarly, the remaining four centers, all with remote recruitment, had variable RIKNO 2.0 scores, ranging from 58 in Germany to 36 in Spain. From these groups homogeneous in sampling approach, a geographic effect manifested, with lower risk knowledge in countries from the Mediterranean Europe (Spain, Italy, and Turkey) vs. the other (Germany, the Netherlands, and Serbia). As well the minor differences in the distribution of demographic factors cannot explain this pattern. Being within or outside of a decision making process seemed also not to influence the knowledge level. In the whole sample 50% of patients were graduated and only 60% followed at MS centers which we believe is representative for an MS cohort in the Western world and does not mirror a highly educated and high MS care integrated sample.
Patients who did not complete the RIKNO 2.0 were slightly older, less often followed at an MS centers and had lower medical data interpretation abilities. As expected, most drop-outs were generated in countries that recruited via homepages and mailing lists.
Lower medical data interpretation ability and education were associated with lower RIKNO 2.0 scores. Interestingly, previous DMD experience was associated with higher risk knowledge (p <0.01), which can be due to direct DMD experience and learning, and to an increased personal relevance of RIKNO 2.0 contents. In fact patients on a DMD might have received more risk information from their doctors than those refraining from treatments. Most participants had high-level fear for wheelchair dependency with little variation across countries, with a weak but significant negatively association with risk knowledge. It is possible that a higher wheelchair dependency fear may lead to denial and information blocking behavior leading to less up-to-date information. Therefore psychological factors need to be taken into account when studying risk knowledge and educational interventions.
Fourth, the comparison of RIKNO 2.0 and MSKQ showed expected results, too, with the two inventories being moderately correlated. They measure similar domains, but with different aims, as the MSKQ appraises general MS knowledge, while RIKNO 2.0 is a more demanding tool focused on MS treatments.
Finally, the eCPS showed different role preference distributions in the four countries, with German and Dutch pwMS having more active role preferences than pwMS from Italy and Serbia. These findings confirm and expand previous results using this scale in pwMS. [15] Hence, the difference in interaction style preferences can be due to cultural and social characteristics, or to the different health systems of these European countries. Taken together the lower knowledge level in Mediterranean countries with a lower level of autonomy preference might indicate a higher paternalistic role understanding between patients and physicians in these countries. Admittedly, different sampling methods might have also contributed to these differences. There is a need for further studies, with qualitative methods, to further investigate this important topic.
This study has some limitations. In Italy, it was necessary to have three rounds of invitation (on a random sample of 600, 1000, and 600 pwMS registered to the Italian National MS Society mailing list) to achieve the target number of participants, and for the third round the enrolment criterion of being in a DMD decision-making process was dropped. Recruitment strategies of UK and Estonia were not successful. In the UK, 183 eligible patients were offered recruitment by post, and only 19 completed it. Telephone calls with non-responders indicated that they found the questionnaire too difficult. Another limitation was that some questionnaires/inventories were not administered in all participating countries, so for example the eCPS could not be included in the RIKNO multivariate model. Difficulties encountered during the development and refinement of a risk knowledge tool have been elucidated in a recent publication [14].
Conclusions
The survey revealed an overall low MS risk knowledge level among pwMS in Europe. Since well informed decision by patients is not possible without relevant medical knowledge, these results are highly relevant, confirming the need for improvements in information provision. In addition, our findings indicate that cross-cultural differences exist not only in role preferences, but also in MS risk knowledge. Responding to the specific information needs of patients is key, and RIKNO 2.0 can be further proposed as a valid outcome measure.
Supporting information
S1 Appendix. Risk knowledge questionnaire for people with relapsing-remitting MS (RIKNO 2.0).
https://doi.org/10.1371/journal.pone.0208004.s001
(DOCX)
S2 Appendix. Electronic Control Preference Scale distribution by country.
https://doi.org/10.1371/journal.pone.0208004.s006
(DOCX)
S1 Table. Questionnaires used in each country.
https://doi.org/10.1371/journal.pone.0208004.s002
(DOCX)
S2 Table. Characteristics of participants by country.
https://doi.org/10.1371/journal.pone.0208004.s003
(DOCX)
S3 Table. Item characteristics of the RIKNO 2.0 and MSKQ.
https://doi.org/10.1371/journal.pone.0208004.s005
(DOCX)
S1 Dataset. Raw data from patients’ general and clinical characteristics, Multiple Sclerosis Knowledge Questionnaire (MSKQ), Risk knowledge questionnaire for people with relapsing-remitting MS (RIKNO 2.0), electronic Control Preference Scale (eCPS).
https://doi.org/10.1371/journal.pone.0208004.s004
(SAV)
Acknowledgments
J. Sastre-Garriga wants to acknowledge the help of Prof. Xavier Montalban, Mr. Joseph Graells from the MS Center of Catalonia (Cemcat) and Mr. Pedro Carrascal from the Spanish MS Foundation (EME).
AutoMS group investigators
AutoMS group is a group of centers studying autonomy preferences, risk knowledge and decision making performance in MS patients (AutoMS) within the European Network of Rehabilitation in MS (RIMS) Centers. Lead by C. Heesen (heesen@uke.de), Hamburg and A. Solari (alessandra.solari@istituto-besta.it), Milan.
Steering committee: C. Heesen (Institut für Neuroimmunologie und Multiple Sklerose, Universitätsklinikum Hamburg-Eppendorf, Hamburg, Germany), A. Solari (Service of Neuroepidemiology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy), J. Drulovic (Institute of Neurology, Clinical Center of Serbia, University of Belgrade, Belgrade, Serbia), A. Giordano (Service of Neuroepidemiology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy; Department of Psychology, University of Turin, Turin, Italy), J. Kasper (Faculty of Health Sciences, Department Health and Caring Sciences, The Arctic University of Norway, Tromsø, Norway; Medical Clinics, University Medical Center, Tromsø, Norway), S. Köpke (Institute for Social Medicine and Epidemiology, University of Lübeck, Lübeck, Germany), A. van Nunen (National MS-Centrum, Melsbroek, Belgium).
External advisors: L. Degner (Psychosocial Oncology and Cancer Nursing Research, University of Manitoba, Winnipeg, Canada), W. Gaissmaier (Max Planck Institute for Human Development, Berlin, Germany), C. Goss (Department of Medicine and Public Health, University of Verona, Verona, Italy). G. Fulcher, W. Longley (MS Society New South Wales, Sydney).
Other centers and investigators: ITALY- Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan: A. Solari, A. Giordano, G. Ferrari, P. Confalonieri, C. Antozzi; Dept. of Neuroscience, Imaging and Clinical Sciences, G. d'Annunzio University, Chieti-Pescara, Chieti: A. Lugaresi, E. Pietrolongo, D. Farina; Dept. of Clinical and Experimental Medicine, University of Sassari, Sassari: M. Pugliatti, V. Piscedda; Departments of Basic Medical Sciences, Neurosciences and Sense Organs, University of Bari, Bari: M. Trojano, C. Tortorella, D. Paolicelli. GERMANY—Institute for Neuroimmunology and MS Research (INIMS), University Medical Center Hamburg-Eppendorf, Hamburg: C. Heesen, J. Kasper, I. Backhus, J Poettgen, K. Fischer, K. Liethmann; Institute for Social Medicine, University of Lübeck, Lübeck: S. Köpke; Neurocure, Charite Berlin: F. Paul. BELGIUM—National MS-Centrum, Melsbroek: A. van Nunen, M. Pirard, A. Symons. ESTONIA—Department of Neurology, West-Tallinn Central Hospital, Tallinn: L. Vahter, K. Kannel. FRANCE—Department of Neurology. Purpan University Hospital, Toulouse: M. Clanet, F. Viala. SERBIA—Institute of Neurology, School of Medicine, University of Belgrade, Belgrade: J. Drulovic, T. Pekmezovic. TURKEY—Department of Neurology, Faculty of Medicine, Ataturk Training and Research Hospital, Izmir: Y. Beckmann.
References
- 1. Charles C, Gafni A, Whelan T. Shared Decision-Making in the medical encounter: What does it mean? (Or it takes at least two to tango). Soc Sci Med. 1997;44: 681–692. pmid:9032835
- 2. Charles C, Gafni A. The vexing problem of defining the meaning, role and measurement of values in treatment decision-making. J Comp Eff Res. 2014;3: 197–209. pmid:24645693
- 3. Kasper J, Légaré F, Scheibler F, Geiger F. Turning signals into meaning—'Shared decision making' meets communication theory. Health Expect. 2012;15: 3–11. pmid:21323823
- 4. Heesen C, Köpke S, Solari A, Geiger F, Kasper J. Patient autonomy in multiple sclerosis.: Possible goals and assessment strategies. J Neurol Sci. 2013;331: 2–9. pmid:23711752
- 5. Heesen C, Kasper J, Segal J, Köpke S, Mühlhauser I. Decisional role preferences, risk knowledge and information interests in patients with multiple sclerosis. Mult Scler. 2004;10: 643–650. pmid:15584489
- 6. Haynes RB, Devereaux PJ, Guyatt GH. Physicians' and patient's choices in evidence based practice: Evidence does not make decisions, people do. BMJ. 2002;324: 1350. pmid:12052789
- 7. Hoffmann TC, Montori VM, Del Mar C. The connection between evidence-based medicine and shared decision making. JAMA. 2014;312: 1295–1296. pmid:25268434
- 8. Marteau TM, Dormandy E, Michie S. A measure of informed choice. Health Expect. 2001;4: 99–108. pmid:11359540
- 9. Rummer A, Scheibler F. Informierte Entscheidung als patientenrelevanter Endpunkt. Deutsches Ärzteblatt 2016;113: 322–324. Available from: https://www.aerzteblatt.de/pdf.asp?id=175052
- 10. Köpke S, Kern S, Ziemssen T, Berghoff M, Kleiter I, Marziniak M, et al. Evidence-based patient information programme in early multiple sclerosis.: A randomised controlled trial. J Neurol Neurosurg. Psychiatry 2014;85: 411–418. pmid:24104856
- 11. Köpke S, Kasper J, Flachenecker P, et al. Patient education programme on immunotherapy in multiple sclerosis (PEPIMS).: A controlled rater-blinded study. Clin Rehabil. 2017;31: 250–261. pmid:27072153
- 12. Costello K, Kennedy P, Scanzillo J. Recognizing nonadherence on patients with multiple sclerosis and maintaining treatment adherence in the long term. Medscape J Med. 2008;10: 225. pmid:19008986
- 13. Heesen C, Kasper J, Fischer K, Köpke S, Rahn A, Backhus I, et al. Risk knowledge in relapsing multiple sclerosis (RIKNO 1.0): Development of an outcome instrument for educational interventions. PLoS One. 2015;10: e0138364. pmid:26430887
- 14. Heesen C, Pöttgen J, Rahn AC, Liethmann K, Kasper J, Vahter L, et al. What should a person with relapsing-remitting multiple sclerosis know?–Focus group and survey data of a risk knowledge questionnaire (RIKNO 2.0). Mult Scler Relat Disord. 2017;18: 186–195. pmid:29141808
- 15. Solari A, Giordano A, Kasper J, Drulovic J, van Nunen A, Vahter L, et al., on behalf of the AutoMS project. Role preferences of people with multiple sclerosis: Image-revised, computerized self-administered version of the control preference scale. PLoS One. 2013;8: e66127. pmid:23823627
- 16. Giordano A, Uccelli MM, Pucci E, Martinelli V, Borreani C, Lugaresi A, et al. The Multiple Sclerosis Knowledge Questionnaire: A self-administered instrument for recently diagnosed patients. Mult Scler. 2010;16: 100–111. pmid:19995834
- 17. Marrie RA, Goldman M. Validity of performance scales for disability assessment in multiple sclerosis. Mult Scler. 2007;13: 1176–1182. pmid:17623733
- 18. Learmonth YC, Motl RW, Sandroff BM, Pula JH, Cadavid D. Validation of patient determined disease steps (PDDS) scale scores in persons with multiple sclerosis. BMC Neurol. 2013;13: 37. pmid:23617555
- 19. Cokely ET, Galesic M, Schulz E, Ghazal S, Garcia-Retamero R. Measuring risk literacy: The Berlin Numeracy Test. Judgement and Decision Making 2012;7: 25–47. http://journal.sjdm.org/11/11808/jdm11808.pdf
- 20. Boeije HR, Janssens A. 'It might happen or it might not': how patients with multiple sclerosis explain their perception of prognostic risk. Soc Sci Med. 2004;59: 861–868. pmid:15177841
- 21. Dohmen T, Falk A, Huffman D, Sunde U, Schupp J, Wagner GG (2011) Individual Risk Attitudes: Measurement, Determinants and behavioral Consequences. J Eur Econ Assoc. June 2011;9: 522–550.
- 22. Arora NK, McHorney CA. Patient preferences for medical decision making: who really wants to participate? Med Care. 2000;38: 335–341. pmid:10718358