Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

What do patients and dermatologists prefer regarding low-risk basal cell carcinoma follow-up care? A discrete choice experiment

  • Sven van Egmond ,

    Roles Data curation, Formal analysis, Methodology, Project administration, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    s.vanegmond@erasmusmc.nl

    Affiliation Department of Dermatology, Erasmus MC Cancer Institute, Rotterdam, The Netherlands

  • Esther de Vries,

    Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Supervision, Validation, Writing – review & editing

    Affiliations Department of Clinical Epidemiology and Biostatistics, Pontificia Universidad Javeriana, Hospital San Ignacio, Bogota, Colombia, Department of Public Health, Erasmus MC University Medical Center, Rotterdam, The Netherlands

  • Loes Hollestein,

    Roles Formal analysis, Methodology, Writing – review & editing

    Affiliation Department of Dermatology, Erasmus MC Cancer Institute, Rotterdam, The Netherlands

  • Maarten Bastiaens,

    Roles Data curation, Project administration, Writing – review & editing

    Affiliation Department of Dermatology, TweeSteden Ziekenhuis, Tilburg, The Netherlands

  • Kees-Peter de Roos,

    Roles Data curation, Project administration, Writing – review & editing

    Affiliation Department of Dermatology, DermaPark, Uden, The Netherlands

  • Daniëlle Kuijpers,

    Roles Data curation, Project administration, Writing – review & editing

    Affiliation Department of Dermatology, Amphia Ziekenhuis, Breda, The Netherlands

  • Ewout Steyerberg,

    Roles Methodology, Supervision, Writing – review & editing

    Affiliations Department of Public Health, Erasmus MC University Medical Center, Rotterdam, The Netherlands, Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands

  • Marlies Wakkee,

    Roles Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Department of Dermatology, Erasmus MC Cancer Institute, Rotterdam, The Netherlands

  • Klara Mosterd,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Department of Dermatology, Maastricht University Medical Centre, Maastricht, The Netherlands

  • Tamar Nijsten,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Visualization, Writing – review & editing

    Affiliation Department of Dermatology, Erasmus MC Cancer Institute, Rotterdam, The Netherlands

  • Esther W. de Bekker-Grob

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Section of Health Technology Assessment & Erasmus Choice Modelling Centre, Erasmus School of Health Policy & Management, Erasmus University, Rotterdam, The Netherlands

Abstract

Background

Follow-up after low-risk basal cell carcinoma (BCC) is being provided more frequently than recommended by guidelines. To design an acceptable strategy to successfully reduce this ‘low-value’ care, it is important to obtain insights into the preferences of patients and dermatologists.

Objective

To determine the preferences and needs of patients and dermatologists to reduce low-risk BCC follow-up care, and the trade-offs they are willing to make.

Methods

A questionnaire including a discrete choice experiment was created, containing attributes regarding amount of follow-up, continuity of care, method of providing addition information, type of healthcare provider, duration of follow-up visits and skin examination. In total, 371 BCC patients and all Dutch dermatologists and dermatology residents (n = 620) were invited to complete the questionnaire. A panel latent class model was used for analysis.

Results

Eighty-four dermatologists and 266 BCC patients (21% and 72% response rates respectively) completed the discrete choice experiment. If the post-treatment visit was performed by the same person as treatment provider and a hand-out was provided to patients containing personalised information, the acceptance of having no additional follow-up visits (i.e. following the guidelines) would increase from 55% to 77% by patients. Female patients and older dermatologists, however, are less willing to accept the guidelines and prefer additional follow-up visits.

Limitations

The low response rate of dermatologists.

Conclusion

This discrete choice experiment revealed a feasible strategy to substantially reduce costs, while maintaining quality of care, based on the preferences and needs of BCC patients, which is supported by dermatologists.

Introduction

Basal cell carcinoma (BCC) is a subtype of keratinocyte cancer and the most common type of cancer among Caucasians [1]. The probability that a BCC metastasizes or causes death is low, but BCCs can cause significant morbidity by local spread. Most BCCs are treated by a relatively simple excision or even topical treatment for certain low-risk BCCs [2, 3].

The high and rising incidence of BCC puts healthcare systems under pressure [4]. To manage finite resources, low-value care (i.e. care which provides no or little clinical benefit to patients) should be reduced [5]. Current European and Dutch guidelines recommend to only provide annual follow-up care to high-risk BCC patients (i.e. high risk for recurrence or already treated for recurrent BCC and patients with history of multiple BCCs), because there is no evidence that increased follow-up care leads to improved health outcomes [6, 7]. The guidelines state that it is reasonable to provide one post-treatment visit for low-risk BCC patients to counsel them about sun protection measures and to stress the importance of self-monitoring for possible local recurrence and new skin cancers. Any follow-up visits after the post-treatment visit after low-risk BCC can therefore be considered as low-value care. However, a recent study shows that Dutch dermatologists still provide this “low-value follow-up care” to 83% of low-risk BCC patients [8].

Qualitative interviews with dermatologists and focus groups with BCC patients revealed the factors influencing this low-value care, such as the wishes of patients to remain in dermatological follow-up (because they experts specialised in skin care, as opposed to GPs, who are generalists) and dermatologists complying with patients wishes [9, 10]. In order to design a successful strategy to de-adopt low-value BCC follow-up care, it is important to learn how important each of these factors are to the patients and dermatologists. Therefore, this study aimed to quantify the preferences of BCC patients and dermatologists, and to determine which trade-offs they are willing to make to accept a reduction of low-risk BCC follow-up.

Methods

Study sample

BCC patients.

Dutch speaking patients, 18 years or older, presenting at the dermatologists with a lesion that was clinically suspicious of BCC or recent biopsy confirmed BCC were approached by their treating dermatologist to participate. These were patients from one university hospital (Erasmus MC), three general hospitals (Elisabeth-TweeSteden Hospital, Amphia Hospital, Bravis Hospital) and two independent sector treatment centres (DermaPark, Mohs Klinieken) in the Netherlands. Patients received an envelope containing information about the study, an informed consent form, a questionnaire which included a Discrete Choice Experiment (DCE) (S1 Appendix) and a pre-paid return envelope. All patients who agreed to participate returned a signed informed consent form to participate in the current study, which was approved by the Medical Ethical Committee of the Erasmus MC (MEC-2014-374). Patients were excluded afterwards if the pathologist concluded that the lesion was not a BCC.

Dermatologists.

All dermatologists and dermatology residents in the Netherlands (from here onward both mentioned as dermatologists) received an email with a digital link to the questionnaire containing the same DCE as the patients (S2 Appendix). Additionally, dermatologists were encouraged to complete the questionnaire during a national conference.

DCE: Attributes and levels

The DCE concept originates from mathematical psychology, but has increasingly found its way into healthcare [11]. A DCE repeatedly presents varying alternative situations to respondents and asks them to choose their most preferred alternative [12]. The DCE method assumes that each alternative can be described by their characteristics (“attributes”), that the respondent’s valuation of the alternative depends on the levels of these attributes, and that the choices are based on a latent utility function [13]. In a DCE, preferences for health outcomes and non-health outcomes can be taken into account simultaneously [14]. This makes the DCE an ideal method to measure preferences for aspects of low-risk BCC follow-up visits, and to determine how to reduce this care without trial-and-error-implementation.

In addition to a literature review,[1521] we constructed our DCE based on focus groups with BCC patients and interviews with dermatologists to carefully detect and select relevant attributes [9, 10, 13]. This ultimately led to the final determination of six attributes (Table 1).

thumbnail
Table 1. Attributes and levels of the discrete choice experiment on low-risk BCC follow-up care.

https://doi.org/10.1371/journal.pone.0249298.t001

Study design and questionnaire

Based on the six attributes and their levels, many different choice alternatives and choice tasks can be generated. It is not feasible to present all possible combinations to a respondent without creating an unreasonably long questionnaire. In order to achieve maximum efficiency from the minimum amount of ‘choice tasks’ needed (i.e. to counterbalance statistical needs and the burden for the respondent), a D-efficient design was created using Ngene software (http://www.choice-metrics.com) [22]. We took two-way interactions between the attributes ‘The additional follow-up visit(s) will be planned’ and ‘The additional follow-up visit(s) will be conducted by’ into account, based on the outcomes of the qualitative study. We created a set of 24 choice tasks (Fig 1), which was blocked [14] in two sets of twelve for BCC patients and a full set was presented to dermatologists, as we expected the sample size as well as the response rate of dermatologists to be smaller. Each choice task contained three alternatives: two alternatives containing BCC follow-up schemes and one alternative to choose ‘no additional BCC follow-up’ (i.e. following the guideline).

thumbnail
Fig 1. Choice task example of the discrete choice experiment.

https://doi.org/10.1371/journal.pone.0249298.g001

In addition, to simulate real life choices as close as possible, the corresponding real-life costs of each follow-up scenario were shown. Each attribute was explained in the survey before the choice tasks were presented. To test choice consistency, an extra choice task 13 was included, which was identical to choice task 4. Demographic questions were added to the questionnaire. The questionnaire including the DCE was pilot tested using think-aloud technique on a random group of 22 BCC patients and ten dermatologists, where they could ask for clarification when needed and to test if the length was acceptable. The DCE was clear to these patients and dermatologists and did not lead to any changes.

Sample size

The results of the pilot were used to determine that 250 BCC patients were required to complete the DCE [23]. By taking an expected response rate of 70% into account [2426], we invited 371 patients. As the response rate of physicians is notoriously low [2729], we invited all dermatologists and dermatology residents (n = 620) in the Netherlands.

Statistical analyses

The analyses were conducted by using Stata 4.2 (http://www.stata.com) and NLOGIT 5.0 (Econometric Software Inc [30]). Each choice task was considered as one observation. To take the sample size, the fact that one respondent completed 12–24 choice tasks, the model fit and our interest in preference heterogeneity into account, a panel latent class analysis (LCA) was conducted for the final analyses. An LCA determines whether patterns in preferences (i.e. latent classes of preferences) exist and provides a modelled probability for each respondent to belong in a certain class [31]. Demographic covariates retrieved from the questionnaire were linked to the probability that respondents belonged to a specific class, in order to determine the composition of the classes. Taking the smaller sample size of dermatologists into account, without demographic covariates that could be linked to specific classes, a more simplistic model (Multinomial logit with interaction terms of the demographic covariates with the attribute-levels) was conducted. We performed a sensitivity test by excluding respondents who failed the consistency test (i.e. choosing different alternatives on the identical choice tasks) from the analyses. After testing for two-way interactions and attribute linearity, the optimal latent class utility function was:

Scenario with additional follow-up visits:

Scenario without additional follow-up visits:

Where

A statistically significant coefficient of an attribute(level) shows that the attribute is important for the respondents in their decision to accept a certain BCC follow-up. The sign of the coefficient shows whether they prefer (positive sign) or disfavour (negative sign) the particular level of the attribute. The size of the coefficients indicates the relative importance (bigger equals more important).

Expected choice probability of BCC follow-up scenarios

To make DCE results more practical for policy makers, we calculated choice probabilities for several scenarios. To simulate current practice, the alternative ‘current intensive (and expensive) BCC follow-up practice’ was fixed at the following attribute levels: standard post-treatment visits performed by a different person treatment provider, extra information provided by a general handout, two additional follow-up visits in a year conducted by a dermatologist and a ten minute consultation during which the face, upper body and treated area is checked. The choice probabilities were calculated with different scenarios of ‘no BCC follow-up according to guideline’, to determine the optimal choice probability. The scenarios are based on previous qualitative studies [9, 10]. The expected choice probability scenarios are calculated on LCM results, by which the exponent of the total utility for a certain alternative was taken and divided by the exponent of utility of all alternatives in that scenario taking the class probabilities into account. The ‘current intensive BCC follow-up practice’ and ‘no BCC follow-up according guideline’ were chosen to resemble real life situations to determine which scenario without low-value follow-up visits is the most acceptable scenario by patients.

Results

Respondents’ characteristics

A total of 266 patients (72% response rate) and 131 dermatologists (21% response rate) completed and returned the questionnaire. Twelve dermatologists (9.1%) and 49 BCC patients (18%) failed the consistency test), however excluding these respondents only affected the significance due to lower sample size, therefore all respondents were included in the final analysis. The characteristics of the BCC patients and dermatologists are displayed in Table 2.

thumbnail
Table 2. BCC patients’ and dermatologists’ characteristics.

https://doi.org/10.1371/journal.pone.0249298.t003

Latent class analysis of patients and dermatologists

BCC patients.

Three latent classes of preference patterns were identified for the BCC patients, with class probabilities for class 1, 2 and 3 being 13%, 46% and 41% respectively (Table 3). The patients belonging to class 1 did not have a significant preference regarding receiving additional follow-up care. However, if they would receive additional follow-up care, they would strongly prefer this to be conducted by their general practitioner (GP). These were predominantly patients older than 65 years without a BCC in their medical history. The BCC patients belonging to class 2 had a strong preference to receive additional follow-up care. They preferred two additional follow-up visits at 6 and 12 months after treatment, conducted by a dermatologist and to have the standard post-treatment visit performed by the same person as the treatment provider. In addition, they would prefer to receive a personalised letter and preferred the follow up visits to include a total-body skin examination. The respondents with high probability to belong to this class were mainly women. The patients belonging to the third class strongly preferred no additional follow-up visits and if there would be additional follow-up, they would prefer the standard post-treatment visit performed by the same person as the treatment provider and the follow-up visit to last 15 minutes and to be conducted by their GP.

thumbnail
Table 3. Latent class analysis of BCC patients’ (n = 266) preferences regarding BCC follow-up care.

https://doi.org/10.1371/journal.pone.0249298.t004

Choice probabilities of BCC follow-up alternatives.

The choice probability of ‘No BCC follow-up according to guideline’ was 55% if the standard post-treatment visit would not be performed by the same person as the treatment provider and if patients would receive a general hand-out compared to ‘Current intensive BCC follow-up’. This choice probability of ‘No BCC follow-up according to guideline’ increased from 55% up to 77%, if the standard post-treatment visit would be performed by the same person as treatment provider and if patients were offered a personalised handout as additional information (Fig 2).

thumbnail
Fig 2. Expected patient choice probabilities of different BCC follow-up scenarios based on latent class model.

*standard post-treatment visits performed by a different person than treatment provider, extra information provided by a general handout, two additional follow-up visits in a year conducted by a dermatologist and a ten minute consultation in which the face, upper body and treated area are checked.

https://doi.org/10.1371/journal.pone.0249298.g002

Dermatologists.

Two classes could be identified in the LCA regarding dermatologists (Table 4). The dermatologists belonging to class 1 strongly preferred no additional follow-up visits (i.e. according to the guideline). This contrasts with the dermatologists belonging to class 2, who strongly preferred additional follow-up visits, which they would prefer to be conducted by a dermatologist and include a total-body skin examination. The average class probabilities were 71% for class 1 and 29% for class 2. No covariates could significantly explain the latent class probabilities for dermatologists.

thumbnail
Table 4. Latent class analysis of dermatologists’ (n = 131) preferences regarding BCC follow-up care.

https://doi.org/10.1371/journal.pone.0249298.t005

Multinomial logit with interaction terms of dermatologists

To test for interaction, the covariates age over 40 years, male gender and subspecialisation in oncology were multiplied with the strongest identifier of the classes: ‘no additional follow up’. This model demonstrated that predominantly young and male dermatologists preferred no additional follow-up for BCC patients (p = <0.01). Having a subspecialisation in oncology did not affect the preference for this attribute.

Discussion

The current study quantified the preferences and needs of patients and dermatologists to accept a reduction of low-risk BCC follow-up care. We found that a reduction would be more acceptable if the post-treatment visit were to be performed by the same person as the treatment provider and additional information would be provided by a personalised letter for patients.

The observation of a preference for personalised letter as a feasible option to reduce low-value follow-up visits is supported by the preference for personalised information which was previously expressed in focus groups with BCC patients [9]. Other studies have also shown that personalised information satisfies cancer patients more than general information, as this tells them something new and is more often relevant to them [33]. A preference for continuity of care (e.g. same healthcare provider for treatment as post-treatment visit) has also been well documented to have positive effects on indicators of quality of care, such as increased patient satisfaction, decreased hospitalisations, decreased emergency department visits and improved receipt of preventive services [34].

Mainly female patients preferred additional low-value BCC follow-up visits, conducted by a dermatologist. In contrast, predominantly male patients preferred to not receive additional follow-up, and should they get follow-up, they preferred the GP to conduct this. In contrast to studies where patients with other types of cancer preferred their follow-up care to be conducted by a medical specialist [15, 20], overall, the patients in our study preferred their GP for their follow-up care. This could be explained by the inclusion of the out-of-pocket costs in our DCE to make our scenarios as realistic as possible, which was linked to ‘type of healthcare professional’ and ‘frequency of follow-up’. In addition, recent focus groups with low-risk BCC patients showed that they perceived their BCC as a not severe type of cancer and some patients actually preferred their GP to conduct follow-up care as he or she is closer to home and easier approachable [10].

A limitation in this study is the low response rate of dermatologists. Although response rates are generally low among medical specialists (27%-68%) [2629], the 21% in the current study was even lower. This could be explained by the facts that the DCE invitation was sent through a non-personal newsletter and that it encompassed a lengthy questionnaire. Additionally, we could not offer the physicians compensation and reminders could not be sent as they responded anonymously. This low participation may have led to a selection bias, as reflected in the mean age of the respondents being 43 years, which is lower than the nationwide mean age of dermatologists and residents [35]. The current study revealed that young male dermatologists preferred no additional follow-up care, which is in accordance with influencing factors explored in interviews with dermatologists [10]. Inclusion of older dermatologists would probably shift the results to more dermatologists preferring additional follow-up care, which would emphasize the need for a de-adoption strategy.

In conclusion, these results form a solid foundation for a feasible strategy to reduce the low-value BCC follow-up care, while maintaining quality of care. This follow-up would consist of having one healthcare provider for the initial treatment as well as the standard post-treatment evaluation combined with a personalised letter for the patient with information about their diagnosis, received treatment and personalised follow-up schedule. Further research is needed to determine whether implementation of this intervention will decrease the amount of low-value follow-up visits in practice, while maintaining patient satisfaction.

References

  1. 1. Flohil SC, Koljenovic S, de Haas ER, Overbeek LI, de Vries E, Nijsten T. Cumulative risks and rates of subsequent basal cell carcinomas in the Netherlands. Br J Dermatol. 2011;165(4):874–81. Epub 2011/06/30. pmid:21711333
  2. 2. Marzuka AG, Book SE. Basal Cell Carcinoma: Pathogenesis, Epidemiology, Clinical Features, Diagnosis, Histopathology, and Management. Yale J Biol Med 2015;88(2):: 167–79. pmid:26029015
  3. 3. Verkouteren JAC, Ramdas KHR, Wakkee M, Nijsten T. Epidemiology of basal cell carcinoma: scholarly review. British Journal of Dermatology. 2017. pmid:28220485
  4. 4. Gordon LG, Rowell D. Health system costs of skin cancer and cost-effectiveness of skin cancer prevention and screening: a systematic review. European journal of cancer prevention: the official journal of the European Cancer Prevention Organisation (ECP). 2015;24(2):141–9. Epub 2014/08/05. pmid:25089375
  5. 5. Leavitt M. Medscape’s response to the Institute of Medicine Report: Crossing the quality chasm: a new health system for the 21st century. MedGenMed: Medscape general medicine. 2001;3(2):2. Epub 2001/09/11. pmid:11549951
  6. 6. Nederlandse Vereniging voor Dermatologie en Venereologie (NVDV). Evidence-based Richtlijn Basaalcelcarcinoom. Utrecht, the Netherlands: NVDV, 2014.
  7. 7. Trakatelli M, Morton C, Nagore E, Ulrich C, Del Marmol V, Peris K, et al. Update of the European guidelines for basal cell carcinoma management Developed by the Guideline Subcommittee of the European Dermatology Forum2014.
  8. 8. Wakkee M, van Egmond S, Louwman M, Bindels P, van der Lei J, Nijsten T, et al. Opportunities for improving the efficiency of keratinocyte cancer care in primary and specialist care: results from population-based Dutch cohort studies. Eur J Cancer. 2019 Aug;117:32–40. pmid:31229947
  9. 9. van Egmond S, Wakkee M, Droger M, Bastiaens MT, van Rengen A, de Roos KP, et al. Needs and preferences of patients regarding basal cell carcinoma and cutaneous squamous cell carcinoma care: a qualitative focus group study. Br J Dermatol. 2019;180(1):122–9. pmid:29927480
  10. 10. van Egmond S, Wakkee M, van Rengen A, Bastiaens MT, Nijsten T, Lugtenberg M. Factors influencing current low-value follow-up care after basal cell carcinoma and suggested strategies for de-adoption: a qualitative study. Br J Dermatol. 2018.
  11. 11. Clark MD, Determann D, Petrou S, Moro D, de Bekker-Grob EW. Discrete choice experiments in health economics: a review of the literature. Pharmacoeconomics. 2014;32(9):883–902. pmid:25005924
  12. 12. Lancaster KJ. A New Approach to Consumer Theory. Journal of Political Economy. 1966;74(2):132–57.
  13. 13. Soekhai V, de Bekker-Grob EW, Ellis AR, Vass CM. Discrete Choice Experiments in Health Economics: Past, Present and Future. Pharmacoeconomics. 2019;37(2):201–26. pmid:30392040
  14. 14. Reed Johnson F, Lancsar E, Marshall D, Kilambi V, Mühlbacher A, Regier DA, et al. Constructing Experimental Designs for Discrete-Choice Experiments: Report of the ISPOR Conjoint Analysis Experimental Design Good Research Practices Task Force. Value in Health. 2013;16(1):3–13. pmid:23337210
  15. 15. Kimman ML, Dellaert BG, Boersma LJ, Lambin P, Dirksen CD. Follow-up after treatment for breast cancer: one strategy fits all? An investigation of patient preferences using a discrete choice experiment. Acta Oncol. 2010;49(3):328–37. pmid:20148645
  16. 16. de Bock GH, Bonnema J, Zwaan RE, van de Velde CJ, Kievit J, Stiggelbout AM. Patient’s needs and preferences in routine follow-up after treatment for breast cancer. British journal of cancer. 2004;90(6):1144–50. pmid:15026793
  17. 17. Montgomery DA, Krupa K, Wilson C, Cooke TG. Patients’ expectations for follow-up in breast cancer—a preliminary, questionnaire-based study. Breast. 2008;17(4):347–52. pmid:18455404
  18. 18. Murchie P, Delaney EK, Campbell NC, Hannaford PC. GP-led melanoma follow-up: views and feelings of patient recipients. Support Care Cancer. 2010;18(2):225–33. pmid:19430819
  19. 19. Murchie P, Nicolson MC, Hannaford PC, Raja EA, Lee AJ, Campbell NC. Patient satisfaction with GP-led melanoma follow-up: a randomised controlled trial. British journal of cancer. 2010;102(10):1447–55. pmid:20461089
  20. 20. Damery S, Biswas M, Billingham L, Barton P, Al-Janabi H, Grimer R. Patient preferences for clinical follow-up after primary treatment for soft tissue sarcoma: a cross-sectional survey and discrete choice experiment. Eur J Surg Oncol. 2014;40(12):1655–61. pmid:25108811
  21. 21. Essers BA, van Helvoort-Postulart D, Prins MH, Neumann M, Dirksen CD. Does the inclusion of a cost attribute result in different preferences for the surgical treatment of primary basal cell carcinoma?: a comparison of two discrete-choice experiments. Pharmacoeconomics. 2010;28(6):507–20. pmid:20387912
  22. 22. Street DJ, Burgess L, Louviere JJ. Quick and easy choice sets: Constructing optimal and nearly optimal stated choice experiments. International Journal of Research in Marketing. 2005;22(4):459–70.
  23. 23. de Bekker-Grob EW, Donkers B, Jonker MF, Stolk EA. Sample Size Requirements for Discrete-Choice Experiments in Healthcare: a Practical Guide. Patient. 2015;8(5):373–84. pmid:25726010
  24. 24. Feiten S, Dünnebacke J, Heymanns J, Köppler H, Thomalla J, van Roye C, et al. Breast cancer morbidity: questionnaire survey of patients on the long term effects of disease and adjuvant therapy. Deutsches Arzteblatt international. 2014;111(31–32):537–44. Epub 08/04. pmid:25145512
  25. 25. Saunders CL, Elliott MN, Lyratzopoulos G, Abel GA. Do Differential Response Rates to Patient Surveys Between Organizations Lead to Unfair Performance Comparisons?: Evidence From the English Cancer Patient Experience Survey. Medical care. 2016;54(1):45–54. Epub 12/18. pmid:26595223
  26. 26. Watson V, Becker F, de Bekker-Grob E. Discrete Choice Experiment Response Rates: A Meta-analysis. Health Econ. 2017;26(6):810–7. Epub 2016/04/29. pmid:27122445
  27. 27. Cunningham CT, Quan H, Hemmelgarn B, Noseworthy T, Beck CA, Dixon E, et al. Exploring physician specialist response rates to web-based surveys. BMC medical research methodology. 2015;15:32–. pmid:25888346
  28. 28. Cummings SM, Savitz LA, Konrad TR. Reported response rates to mailed physician questionnaires. Health services research. 2001;35(6):1347–55. pmid:11221823
  29. 29. Cull WL, O’Connor KG, Sharp S, Tang S-fS. Response Rates and Response Bias for 50 Surveys of Pediatricians. Health Services Research. 2005;40(1):213–26. pmid:15663710
  30. 30. Greene W.H. Econometric Software, Inc; Plainview, NY: 2016. NLOGIT Version 5 –Reference Guide.
  31. 31. Swait J. A structural equation model of latent segmentation and product choice for cross-sectional revealed preference choice data. Journal of Retailing and Consumer Services. 1994;1(2):77–89.
  32. 32. Bech M, Gyrd-Hansen D. Effects coding in discrete choice experiments. Health Econ. 2005;14(10):1079–83. Epub 2005/04/27. pmid:15852455
  33. 33. Jones R, Pearson J, McGregor S, Cawsey AJ, Barrett A, Craig N, et al. Randomised trial of personalised computer based information for cancer patients. BMJ. 1999;319(7219):1241. pmid:10550090
  34. 34. Cabana MD, Jee SH. Does continuity of care improve patient outcomes? J Fam Pract. 2004;53(12):974–80. pmid:15581440
  35. 35. Het medische profielen boek. Zeist: Glaxo Wellcome; 1999.