Patients with medically unexplained physical symptoms (MUPS) are prevalent 25–50% in general and specialist care. Medical specialists and residents often find patients without underlying pathology difficult to deal with, whereas patients sometimes don’t feel understood. We developed an evidence-based communication training, aimed to improve specialists’ interviewing, information-giving and planning skills in MUPS consultations, and tested its effectiveness.
The intervention group in this multi-center randomized controlled trial received a 14-hour training program to which experiential learning and feedback were essential. Using techniques from Cognitive Behavioral Therapy, they were stimulated to seek interrelating factors (symptoms, cognitions, emotions, behavior, and social environment) that reinforced a patient’s symptoms. They were taught to explain MUPS understandably, reassure patients effectively and avoid unnecessary diagnostic testing. Before and after the intervention training, specialists videotaped a total of six consultations with different MUPS patients. These were evaluated to assess doctors’ MUPS-focused communicating skills using an adapted version of the Four Habit Coding Scheme on five-point Likert scales. Participants evaluated the training by self-report on three-point Likert scales. Doctors in the control group received training after completion of the study.
123 doctors (40% specialists, 60% residents) and 478 MUPS patients from 11 specialties were included; 98 doctors completed the study (80%) and 449 videotaped consultations were assessed. Trained doctors interviewed patients more effectively than untrained ones (p < 0.001), summarized information in a more patient-centered way (p = 0.001), and better explained MUPS and the role of perpetuating factors (p < 0.05). No effects on planning skills were found. On a 3-point scale the training was evaluated with 2.79.
MUPS-focused communication training increases the interviewing and information-giving skills of medical specialists. We recommend that the training is incorporated in postgraduate education for medical specialists and residents who frequently encounter patients with MUPS.
Dutch Trial Registration NTR2612
Citation: Weiland A, Blankenstein AH, Van Saase JLCM, Van der Molen HT, Jacobs ME, Abels DC, et al. (2015) Training Medical Specialists to Communicate Better with Patients with Medically Unexplained Physical Symptoms (MUPS). A Randomized, Controlled Trial. PLoS ONE 10(9): e0138342. https://doi.org/10.1371/journal.pone.0138342
Editor: D William Cameron, University of Ottawa, CANADA
Received: March 24, 2015; Accepted: August 26, 2015; Published: September 18, 2015
Copyright: © 2015 Weiland et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: Funding provided by grant 171101012 from ZonMw, www.zonmw.nl; AW, grant AFVV10-089 from Health Care Organisation CZ, CZ- Fund, www.cz.nl; AW and grant 1004-099 from Fund NutsOhra, www.fno.nl; AW. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The principal researcher AW received financial support from the sponsors for the submitted work; AW has been paid for developing and delivering the MUPS-focused training program; no other relationships or activities of the authors have influenced the submitted work. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.
Over 50% of newly referred patients to outpatient clinics experience symptoms for which the medical specialist lacks a medical explanation. Medically unexplained physical symptoms (MUPS) are considered to be a working hypothesis based on the (justified) assumption that somatic and/or psychiatric pathology is adequately excluded[2–3]. While most MUPS disappear within a few months, they can endure for more than one year, and become chronic in 20 to 30% of the patients[2, 4].
Medical specialists often find patients whose symptoms have no underlying pathology difficult to handle, and feel incompetent to find agreement with their patients on problem definition[5–7]. The fear of missing a physical disease triggers them to continue medical interventions on MUPS patients, although they achieve low health outcomes and even iatrogenic damage[8–9]. On the other hand, many patients with MUPS do not feel understood, and are offended by messages about the supposed non-somatic origins of their symptoms. They experience a lack of empathy and acceptance for their physical symptoms, and suffer as much as patients with a chronic disease[10–11]. In short, MUPS are a burden to patients as well as to health professionals.
Patient-centered communication in MUPS consultations in secondary care has been found to improve patient outcomes and decrease medical consumption. To effectively explore patients’ symptoms and inform patients about the nature of MUPS, medical specialists need specific MUPS knowledge combined with practical communication skills[14–16]. However, general communication training programs in postgraduate medical education lack the content to integrate the do’s and don’ts in MUPS communication. Furthermore, the majority of MUPS research on communication interventions is aimed at primary and mental care. We therefore developed a postgraduate training program for non-psychiatric medical specialists focused on MUPS patients and assessed its effects on their communication skills in a randomized clinical trial. The study question was: Does MUPS-focused communication training facilitate medical specialists to use effective communication in MUPS consultations more often compared to non-trained medical specialists?
Materials and Methods
Study design, participants and randomization
We designed a randomized controlled trial to evaluate the effectiveness of a communication skills training for medical specialists to improve MUPS specialist care. A total of thirteen hospitals in the Rotterdam area were invited to cooperate in this study, and six of them were able to respond to our demands and participated. In each hospital one member of the medical staff coordinated the recruitment of doctors; per hospital an electronic flyer for medical specialists and residents with information about the study was sent, and oral presentations were organized if requested.
To participate non-psychiatric medical specialists and residents had to have consultation hours, in which they encountered MUPS patients, and they had to be willing to videotape three MUPS consultations before and after the intervention phase between June 2011 and April 2014.
The medical receptionist briefly informed the patients about the videotaping of the consulting hours. All patients were informed that videotaping was voluntary; they could decide to end it at any time, with their data being deleted immediately upon their request.
The medical specialists and residents were instructed to include new and follow-up patients at the end of a consultation only when ‘physical symptoms were insufficiently explained by pathological findings’.
A team of trained research assistants supported the doctors with recording the MUPS consultations. The unmanned camera was directed at both doctor and patient. After the consultation the research assistant informed the patient about all study related procedures, including further use of the video data and completion of web-based questionnaires. To prevent patient-induced bias during the consultation, more detailed information about the scope of the study was given by the research assistant after the video consultation. A patient information letter was provided, and patients were included in the study only after written informed consent had been obtained. Upon non-participation or withdrawal, all video data were deleted by the research assistant or database administrator (RV). Patient recruitment took place from June 2011-April 2014.
After including up to three MUPS patients, medical specialists and residents were 1:1 allocated by the datacenter on a case-by-case basis to the intervention or control group, using a web-based randomization program. A minimization algorithm was used, ensuring balance within each group and overall balance, with the following stratification factors: medical center and clinical experience (medical specialist versus resident).
Approximately six months after randomization the training for the intervention group was completed, and the research assistants contacted all the specialists and residents to organize the post-measurement videotaping of MUPS consultations. For post-measurements new patients were recruited who had not participated in the pre-measurements. Doctors allocated to the intervention group were trained in MUPS communication skills, whereas doctors allocated to the control group treated patients with care as usual.
The MUPS-focused communication skills training for medical specialists and residents consisted of four sessions with intervals of four to six weeks with a total duration of 14 hours; it has been described elsewhere. The training program consisted of experiential learning, role-play and feedback as crucial elements for learning MUPS-specific communication skills. Using techniques from Cognitive Behavioral Therapy, trainers stimulated the medical specialists to explore patient’s symptoms and search for interrelating factors (symptoms, cognitions, emotions, behavior, and social environment) that reinforced patient’s symptoms. They were taught to inform and reassure patients effectively and offer plausible and understandable explanations for MUPS, reflected in a clear advice and report to the general practitioner. Homework consisted of applying the skills in their consultations, reading literature and watching their own videotaped consultations with MUPS patients prior to the training. An overview of the training program is presented in Table 1.
The training was organized in small groups (7 to 12 participants) and provided by one trainer and one assistant trainer experienced in postgraduate education and MUPS skills for medical specialists. In a special workshop the trainers were instructed (AW and AHB) about the training model and the 22 MUPS-focused communication skills, which were divided into (I) interviewing skills to explore biopsychosocial factors, (II) information-giving skills about discussing findings and explaining MUPS and (III) planning skills aimed at follow-up and making appointments. To evaluate the training program, participating doctors were requested to fill out a self-report questionnaire during the last training session on a three point scale (1 = trained MUPS-focused communication skill is not useful, 2 = moderate useful, 3 = very useful).
Outcome measures on doctors’ communication skills
The application of communication skills was measured by observation of the videotaped consultations. For the assessment we used the validated Four Habits Coding Scheme (FHCS), adjusted in a way that it measured precisely the MUPS communication skills of the training program. We pilot tested this MUPS-focused FHCS in five workshops, in which three trained psychologists (MJ, DA, NK) and the principal researcher (AW) individually assessed each time three different videotaped consultations. The videotapes were discussed. Differences in interpretations were solved by arguments until agreement had been obtained, resulting in a coherent assessment instrument. The application of the communication skills by the medical specialists and residents was rated on a five-point Likert scale. The Likert Scale is a five (or seven) point scale which is used to allow the individual to express how much they agree or disagree with a particular statement. A codebook, S3 Appendix, described every skill on different levels (1 = no or totally inadequate performance of the skill, 2 = imperfect performance, 3 = moderate performance, 4 = good performance, 5 = optimal performance of the skill). Since our Likert scale was symmetric in its categories, with 1 as the lowest score and 5 as the highest score and 3 in the middle, and with the scores 2 and 4 in the middle of “totally inadequate and moderate” and “moderate and optimal”, respectively, it would be likely that the scale would be equidistant and behave as an interval scale measurement. Three trained raters (MJ, DA, NK) blindly scored the videotaped consultations independently, which meant that they did neither have any knowledge about doctor or patient nor about the time the videotape was made (before or after the training period) and the intervention or control status of the doctor. The principal researcher randomly allocated the videotaped consultations to the raters. To obtain adequate inter-rater reliability 50 videotaped consultations were rated by all raters; 120 tapes were rated in couples of two raters to measure inter-rater reliability scores. In 6 rounds the videotaped consultations were rated. After each round, the principal researcher (AW) monitored the quality of the assessments with the raters (MJ, DA, NK), the medical specialist (JS) and the biostatistician (LA) in a workshop.
Sample size calculation and statistical analysis
To detect a 20% change (from a mean of 2.5 to 3.0, with a standard deviation of 0.8 in both groups) in consultation skills of doctors with a 5% two-sided alpha and a power of 90%, an estimated number of 55 doctors per group were needed (GPower 3.1). Allowing for 10% drop out of doctors we aimed to recruit 60 doctors per group, which meant a total number of 120 doctors.
All analyses were done (LA, JVS, AW) with IBM SPSS Statistics 21.0 i.e. PASW SPSS Statistics 21.0. Nominal variables are presented by frequencies and cross tables. Estimated marginal means and SE’s of the scale scores were calculated for both the intervention group and the control group using linear random effects ANOVA with a random intercept per doctor, thereby taking the clustering of patients per doctor into account. We also fitted this model (SPSS function MIXED with EMMEANS subcommand) to calculate and to compare the differences between pre- and post-measurements for both groups.
Medical Ethics Review and Approval
The Medical Ethics Research Committee of the Erasmus MC reviewed the study design and officially approved the study and the written informed consent procedures. The Boards of the other five participating hospitals officially agreed to participate in the study, advised by local Medical Ethics Committees. The trial was registered at the Dutch Trial Registration (NTR2612, www.trialregister.nl).
There were 159 doctors (medical specialists and residents) from eleven different specialties eligible for the study between June 2011 and April 2014; 123 of them were able to videotape consultations with MUPS patients at baseline. Sixty-two doctors were allocated to the intervention and 61 to the control group; 98 doctors (50 intervention and 48 control group) completed the study by including one or more patients on videotape (Fig 1). Twenty-five doctors dropped out of the study due to lack of consulting hours with MUPS patients during post-measurements (n = 10), job switch to another hospital (n = 8), withdrawal (n = 4) or private circumstances (n = 3). Doctor baseline demographic characteristics of each group are presented in Table 2. Years of experience has been measured as the number of years between “date of randomization” and “date of start of the education to become a specialist”.
This figure shows the amount of eligible and included doctors throughout the study accompanied by the amount of videotaped patients per doctor in pre-and post-measurements.
Videotaped consultations with MUPS patients
A total of 478 MUPS patients participated in the study between November 2011 and April 2014: 278 at baseline and 200 at follow-up. Most patients were female (63%), had an average age of 46 years (SD = 16), had an education on primary (4%), secondary (60%), tertiary level (27%) or other (9%) and visited the outpatient clinics for Internal Medicine (n = 193) or Neurology (n = 94). The included 478 patients provided 520 videotaped consultations: in 42 cases the doctor videotaped two consultations of the same patient within pre- or post-measurements. To maintain independent statistical analysis only the first one of these two consultations was used. A total of 29 videotaped consultations were unsuitable for analysis due to technical imperfections (n = 20), exclusion because patients’ symptoms were explained by a somatic disease (n = 5) or patients’ withdrawal (n = 4). The 449 videotaped consultations were assessed by three psychologists. They rated each video on all 22 items. To check the reliability of the observers during the study, we randomly selected some videos that were-randomly- assigned to two (n = 120 videos) or all three (n = 50 videos) raters. Per videotaped consultation we calculated the ICC across the two or three raters over all 22 items. The mean ICC across all videos was 0.78. Table 3 shows patient characteristics.
Trained medical specialists and residents showed a bigger increase in exploring patients’ cognitions (p < 0.001) and the impact of the symptoms on patients’ behaviors (p = 0.001), social environment (p < 0.001) and emotions (p < 0.001) than the untrained medical specialists and residents. Trained medical specialists and residents also summarized information in a more patient-centered way (p = 0.001) and told the patient more frequently about interrelating factors and MUPS (p = 0.017) than the untrained specialists and residents. No effects were found on the skills for making plans and follow-up appointments. The skills of exploring physical symptoms, acknowledging the reality of patient’s symptoms, explaining doctor’s perspective concerning symptoms and treatment options, allowing time for information to be absorbed, summarizing appointments and displaying nonverbal empathy were already reasonably apparent in both groups before randomization. Table 4 shows the effects on doctors’ MUPS communication skills.
Estimated marginal means on scale range 1–5; 1 = min., 5 = max. score. Intervention group = IG, Control group = CG, pre = pre-measurement, post = post-measurement. P-value contrast: ‘IG post-training minus IG pre-training’ compared to ‘CG post-training minus CG pre-training’
Evaluation of the training program
Medical specialists and residents appreciated the training program as very useful for daily practice. The intervention group lost 3 doctors before the training started. A total of 92 doctors received the MUPS communication training (doctors of the control group were offered the training after they finished all measurements, and 33 of them obtained the training). They evaluated the usefulness of the training, concerning exercises, skills, literature, duration and feedback, with 2.79 [CI, 2.75 to 2.83] on a three point Likert scale (with 1 as minimum and 3 as maximum score).
Despite the value of the MUPS communication skills for daily practices, medical specialists and residents experienced consultations with MUPS patients from different ethnic background as extremely difficult.
The main aim of the study was to evaluate the effectiveness of our MUPS-focused training for medical specialists on doctors’ communication skills, which to our knowledge is a novelty in secondary care. The results clearly indicate that medical specialists who had taken the training had better interviewing and information-giving communication skills in MUPS consultations than those who had not. Participants rated the training as very useful.
Comparison with literature
Our findings are in line with research in general care. Aiarzaguena et al. showed that GPs benefit from a MUPS-focused communication training program[19–20]. GPs valued two key elements: the structure, which facilitated a more comfortable relationship with MUPS patients; and the options of transferring the skills to a broader spectrum of patients with psychosocial problems. Rosendal et al. developed a brief MUPS-focused training program for GPs, which changed GPs' attitude towards patients with somatoform disorders. Rief et al. designed a one-day workshop for GPs on managing MUPS patients, in which the topics included how to communicate with MUPS patients, and when to start and stop medical examinations and treatment options. GPs valued this workshop as highly relevant to their daily practice. By stressing that postgraduate education in MUPS-focused knowledge and communication skills is both relevant and necessary in general care, these studies reinforce the importance of our results for specialist care.
Strengths and limitations
A strength of our study is the fact that our engagement of 123 doctors from six different hospitals and eleven specialties in the study enabled us to assess the effectiveness of the training in different medical settings. To reach this number of participants, we decided to switch from a single to a multi-center study design, and extended the inclusion period by a full year.
In our search for a valid instrument to assess specialists’ communication skills we chose the Four Habits Coding Scheme (FHCS) and integrated the defined 22 MUPS communication skills within this FHCS. By measuring precisely the skills that were subject of the training program, this enriched MUPS-FHCS contributed to the strength of this study. Fossli Jensen et al. assessed the effectiveness of a 20-hour training model for hospital doctors also with the Four Habits Coding Scheme, and found comparable levels of improvement of clinical communication doctors’ skills . Our training model is even shorter (14 hr) and efficient especially on exploring, which we consider to be a strength.
A further strength of the study is that our outcomes at doctors’ level were rated at the highest level of performance according to Miller. This four-level scale discerns knows (level 1), knows how (2), shows (3) and does (4). The does level refers to measurement of clinical performance in real practice.
This study also has weaknesses. One limitation concerns the average number of videotaped consultations per doctor, which was lower than we had expected. The three MUPS patients per measurement per doctor were not always achieved. Sometimes patients refused to be videotaped or didn’t show up at consulting hours. However, 449 MUPS consultations for analysis appeared to be enough to prove the effectiveness of the training.
In their consultations with patients from different ethnic backgrounds, doctors felt hampered by the lack of three prerequisites: time, professional interpreters and knowledge of cultural diversity. The doctors spoke Dutch language in the videotaped consultations. Most of today’s patients in big cities, such as Rotterdam, are culturally rooted in other countries. It may therefore be a weakness that the cultural sensitivity of the training program was not more developed. The fact that most MUPS patients are female may explain why doctors used these MUPS skills more in consultations with female patients than in those with male patients.
Our MUPS-focused communication training significantly increases the interviewing and information-giving skills of medical specialists and residents. We conclude that we have developed a feasible and effective training program that enables medical specialists and residents to improve their consultations with MUPS patients. We therefore recommend that the training model is incorporated in postgraduate education for medical specialists and residents, who often encounter such patients.
Implications for future research
Due to the presentation of their own case material during the training, medical specialists achieved greater awareness of MUPS in outpatient clinics. In some cases they noted that use of care by patients with persistent MUPS was extremely high: some patients had consulted the Emergency Department (ED) and other specialties up to 20 times in the previous three months. Future research on the prevalence and follow up of MUPS patients in the ED will help to identify patients’ needs, and indicate how MUPS care should improve in specialist care.
Future studies and training programs should reconsider the cultural and gender sensitivity of the training model, and adjust it where necessary.
S3 Appendix. Code Book for assessing MUPS videotaped consultations.
We would like to thank all the patients, research assistants, teachers, residents and medical specialists, who participated in this study, and the funding bodies ZonMw, CZ-Fund and Fund NutsOhra for their financial support.
Conceived and designed the experiments: AW AHB JvS HvdM SvD LA. Performed the experiments: AW AHB. Analyzed the data: AW JvS RV LA. Contributed reagents/materials/analysis tools: AW AHB JvS MJ DA NK RV LA. Wrote the paper: AW AHB JvS HvdM MJ DA NK SvD RV LA. Assessing the videotaped consultations: ME DA NK.
- 1. Nimnuan C, Hotopf M, Wessely S. Medically unexplained symptoms: An epidemiological study in seven specialities. J Psychosom Res. 2001;51(1):361–7. http://dx.doi.org/10.1016/S0022-3999(01)00223-9. pmid:11448704
- 2. Olde Hartman TC, Woutersen-Koch H, Van Der Horst HE. Medically unexplained symptoms: Evidence, guidelines, and beyond. Br J Gen Pract. 2013;63(617):625–6. pmid:24351464
- 3. Haller H, Cramer H, Lauche R, Dobos G. Somatoform Disorders and Medically Unexplained Symptoms in Primary Care. A Systematic Review and Meta-analysis of Prevalence. Dtsch Arztebl Int. 2015;112(16):279–87. Epub April 17. pmid:25939319
- 4. Olde Hartman TC, Borghuis M, Lucassen PL, Van de Laar FA, Speckens AE, Van Weel C. Medically unexplained symptoms, somatisation disorder and hypochondriasis: course and prognosis. A systematic review. J Psychosom Res. 2009;May;66(5):363–77. Epub 2008 Dec 16. PubMed Central PMCID: pmid:19379952 [PubMed—indexed for MEDLINE]
- 5. Carson AJ, Stone J, Warlow C, Sharpe M. Patients whom neurologists find difficult to help. J Neurol Neurosurg Psychiatry. 2004;75(12):1776–8. pmid:15548505
- 6. Siproudhis L, Delvaux M, Chaussade S, Charles F, Guyot P, Weber J, et al. [Patient-doctor relationship in the irritable bowel syndrome. Results of a French prospective study on the influence of the functional origin of the complaints]. Gastroenterol Clin Biol. 2002;26(12520201):1125–33.
- 7. Salmon P. Conflict, collusion or collaboration in consultations about medically unexplained symptoms: the need for a curriculum of medical explanation. Patient Educ Couns. 2007;67(3):246–54. Epub 2007/04/13. S0738-3991(07)00102-4 [pii] pmid:17428634.
- 8. Kouyanou K, Pither CE, Rabe-Hesketh S, Wessely S. A comparative study of iatrogenesis, medication abuse, and psychiatric morbidity in chronic pain patients with and without medically explained symptoms. Pain. 1998;76(3):417–26. http://dx.doi.org/10.1016/S0304-3959(98)00074-8. pmid:9718260
- 9. Rolfe A, Burton C. Reassurance after diagnostic testing with a low pretest probability of serious disease: Systematic review and meta-analysis. JAMA Internal Medicine. 2013;173(6):407–16. pmid:23440131
- 10. Stone J, Wojcik W, Durrance D, Carson A, Lewis S, MacKenzie L, et al. What should we say to patients with symptoms unexplained by disease? The "number needed to offend". Bmj. 2002;325(7378):1449–50. pmid:12493661.
- 11. Zonneveld L, Sprangers M, Kooiman C, van 't Spijker A, Busschbach J. Patients with unexplained physical symptoms have poorer quality of life and higher costs than other patient groups: a cross-sectional study on burden. BMC Health Services Research. 2013;13(1):520.
- 12. Burton C, McGorm K, Richardson G, Weller D, Sharpe M. Healthcare costs incurred by patients repeatedly referred to secondary medical care with medically unexplained symptoms: A cost of illness study. J Psychosom Res. 2012;72(3):242–7. http://dx.doi.org/10.1016/j.jpsychores.2011.12.009. pmid:22325706
- 13. Weiland A, Van de Kraats R, Blankenstein AH, Van Saase JLCM, Van der Molen HT, Bramer WM, et al. Encounters between medical specialists and patients with medically unexplained physical symptoms; influences of communication on patient outcomes and use of health care. A literature overview. Perspect Med Educ. 2012;1:192–206. pmid:23205344
- 14. Kroenke K. A Practical and Evidence-Based Approach to Common Symptoms. A Narrative Review. Ann Intern Med. 2014;161(8):579–86. pmid:25329205
- 15. Dutch Multidisciplinary Guideline on MUPS and somatoform disorders. Trimbos Instituut; 2010. Available at http://www.ggzrichtlijnen.nl.
- 16. Nv Dessel, Md Boeft, Wouden JCvd, Kleinstäuber M, Leone SS, Terluin B, et al. Non-pharmacological interventions for somatoform disorders and medically unexplained physical symptoms (MUPS) in adults. Cochrane database of systematic reviews (Online). 2014;11:CD011142.pub2.
- 17. Weiland A, Blankenstein AH, Willems MHA, Van Saase JLCM, Van der Molen HT, Van Dulmen AM, et al. Post-graduate education for medical specialists focused on patients with medically unexplained physical symptoms; development of a communication skills training programme. Patient Educ Couns. 2013;92(3):355–60. pmid:23906652
- 18. Krupat E, Frankel R, Stein T, Irish J. The Four Habits Coding Scheme: Validation of an instrument to assess clinicians’ communication behavior. Patient Educ Couns. 2006;62(1):38–45. pmid:15964736
- 19. Aiarzaguena J, Grandes G, Gaminde I, Salazar A, Sanchez A, Arino J. A randomized controlled clinical trial of a psychosocial and communication intervention carried out by GPs for patients with medically unexplained symptoms. Psychol Med. 2007;37(2):283–94. pmid:17164029
- 20. Aiarzaguena J, Gaminde I, Grandes G, Salazar A, Alonso I, Sánchez A. Somatisation in primary care: experiences of primary care physicians involved in a training program and in a randomised controlled trial. BMC Family Practice 2009;10(73).
- 21. Rosendal M, Bro F, Sokolowski I, Fink P, Toft T, Olesen F. A randomised controlled trial of brief training in assessment and treatment of somatisation: effects on GPs' attitudes. Family Practice. 2005;22(4):419–27. pmid:15897211
- 22. Rief W, Martin A, Rauh E, Zech T, Bender A. Evaluation of General Practitioners’ Training: How to Manage Patients With Unexplained Physical Symptoms. Psychosomatics. 2006;47(4):304–11. http://dx.doi.org/10.1176/appi.psy.47.4.304. pmid:16844888
- 23. Fossli Jensen B, Gulbrandsen P, Dahl FA, Krupat E, Frankel RM, Finset A. Effectiveness of a short course in clinical communication skills for hospital doctors: results of a crossover randomized controlled trial (ISRCTN22153332). Patient Educ Couns. 2011;84(21050695):163–9.
- 24. Miller G. The assessment of clinical skills/competence/performance. Acad Med. 1990;65((9 Suppl)):S63–7. PubMed Central PMCID: pmid:2400509