Background and Purpose
Communication with patients is a core clinical skill in medicine that can be acquired through communication skills training. Meanwhile, the importance of transfer of communication skills to the workplace has not been sufficiently studied. This study aims to assess the efficacy of a 40-hour training program designed to improve patients' satisfaction and residents' communication skills during their daily clinical rounds.
Residents were randomly assigned to the training program or to a waiting list. Patients' satisfaction was assessed with a visual analog scale after each visit. Transfer of residents' communication skills was assessed in audiotaped actual inpatient visits during a half-day clinical round. Transcripted audiotapes were analyzed using content analysis software (LaComm). Training effects were tested with Mann-Whitney tests and generalized linear Poisson regression models.
Eighty-eight residents were included. First, patients interacting with trained residents reported a higher satisfaction with residents' communication (Median = 92) compared to patients interacting with untrained residents (Median = 88) (p = .046). Second, trained residents used more assessment utterances (Relative Risk (RR) = 1.17; 95% Confidence intervals (95%CI) = 1.02–1.34; p = .023). Third, transfer was also observed when residents' training attendance was considered: residents' use of assessment utterances (RR = 1.01; 95%CI = 1.01–1.02; p = .018) and supportive utterances (RR = 0.99; 95%CI = 0.98–1.00; p = .042) (respectively 1.15 (RR), 1.08–1.23 (95%CI), p<.001 for empathy and 0.95 (RR), 0.92–0.99 (95%CI), p = .012 for reassurance) was proportional to the number of hours of training attendance.
The training program improved patients' satisfaction and allowed the transfer of residents' communication skills learning to the workplace. Transfer was directly related to training attendance but remained limited. Future studies should therefore focus on the improvement of the efficacy of communication skills training in order to ensure a more important training effect size on transfer.
Citation: Liénard A, Merckaert I, Libert Y, Bragard I, Delvaux N, Etienne A-M, et al. (2010) Transfer of Communication Skills to the Workplace during Clinical Rounds: Impact of a Program for Residents. PLoS ONE 5(8): e12426. doi:10.1371/journal.pone.0012426
Editor: Allan Cyna, Women's and Children's Hospital, Australia
Received: April 14, 2010; Accepted: August 3, 2010; Published: August 26, 2010
Copyright: © 2010 Liénard et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research program was supported by the «Fonds National de la Recherche Scientifique - Section Télévie» of Belgium (a national funding source) (www.fnrs.be). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Communication skills are recognized as one of physicians' core clinical skills. Effective communication skills are the key to achieve the three main purposes of physician–patient relationship: assessment, support and information . Effective assessment, support and information may improve patients' satisfaction  and psychological adjustment . A few studies have shown that these skills may be learned and transferred to physicians' clinical practice after a communication skills training program –. Transfer of learned skills to clinical practice has been shown to remain limited however. The importance of transfer of communication skills training to the workplace should thus be studied further.
In theory, communication skills should be acquired by physicians as early as possible, that is during undergraduate training or residency. Although communication skills training are increasingly organised for undergraduates, residency remains an appropriate period, not only to learn communication skills but also, to transfer learned communication skills to the clinical practice as residents' daily practice becomes more varied and challenging (clinical rounds and/or outpatients consultations). According to the Baldwin and Ford model , transfer depends directly on learning, and is influenced by trainees' characteristics, work environment and training program content and duration. Several communication skills training programs have been organised for residents –. Among these programs, only three controlled studies have shown efficacy in terms of transfer of learned skills to clinical practice , , : only two of these studies had been randomized , . It should be noted that the way transfer has been assessed in these studies is not optimal - only one consultation with an actual patient assessed , and only one study assessing patients' outcomes such as patients' satisfaction .
Transfer of skills by residents after a communication skills training has moreover never been assessed during clinical rounds which is an important part of residents' clinical practice. During clinical rounds, residents have short and frequent visits with inpatients and the purposes of these visits are numerous (assessment, information, support and treatment management). There is thus still a need to develop randomized controlled studies designed to assess the efficacy of this type of training in terms of transfer of learned skills to clinical practice.
The aim of this study was to assess in a randomized controlled design the impact of a communication skills training program (The Belgian Interuniversity Curriculum - Communication Skills Training (BIC-CST))  on the transfer by residents of learned skills during a half-day clinical round. Transfer was measured through the assessment of patients' satisfaction with residents' communication and through the assessment of residents' communication skills in a half-day of clinical round. First, it was hypothesized that a communication skills training would lead to a higher level of patients' satisfaction with residents' communication skills used during the visits. Second, it was hypothesized that a communication skills training would lead to an increase in residents' use of assessment and supportive skills.
The ethics committee of Jules Bordet Institute (Brussels) approved of the study. Residents and patients included in the study had to give their written informed consent.
To be included in this study, residents had to speak French and to be willing to participate in the training program and its assessment procedure. Residents had also to have worked, be working with, or be in a project working with, cancer patients (part or full time). Residents participating in another psychological training program during the assessment and training periods were excluded from the study.
Study design and assessment procedure
The efficacy of the Belgian Interuniversity Curriculum - Communication Skills Training (BIC-CST) was assessed in a study allocating residents after the first assessment time to a 40-h training program (training-group) or to a waiting list (waiting-list-group), according to a computer generated randomization list. As displayed in Figure 1, assessments were scheduled before randomization (T1) and after the training program for the training-group (T2) and 8 months after T1 for the waiting-list-group (T2). At each assessment time, the procedure included, among other, visits with actual patient during a half-day clinical round.
T1: assessments scheduled before the training program; T2: assessments 8 months after the first assessment.
The Belgian Interuniversity Curriculum - Communication Skills Training (BIC-CST) is a 40-hour training program designed for residents which includes a 30-h communication skills training module and a 10-h stress management module . Sessions were spread bimonthly over an 8-month period. The program was organized in small groups (up to 7 participants). BIC-CST was learner-centered, skills-focused, practice-oriented and tailored to residents' needs. It included a cognitive, a behavioral and a modeling component.
The communication skills training module consisted of a 17-h communication skills training focusing on two-person consultations, a 10-h communication skills training program focusing on three-person consultations (that is where a relative accompanies the patient) and lastly a 3-h session promoting integration and use of learned skills (communication and stress management). Among the 30 hours devoted to communication skills learning, a 1-h session focused on theoretical information. In the other sessions, residents were invited to practice communication skills through predefined role plays (on breaking bad news) and through role plays based on the clinical problems arising from their everyday clinical round practice (e.g. breaking bad news, end-of-life discussion, interaction with patient facing complex medical situations, patients' emotional reaction, …). Residents were given immediate feedback on the communication skills performed during role plays.
BIC-CST was specifically designed to focus on transfer of learned skills to clinical rounds. First, training sessions were scheduled bimonthly in order to allow residents sufficient time to transfer learned communication skills to their clinical practice. Second, role plays based on clinical problems brought up by the residents were scheduled to allow them to test the usefulness of learned communication skills and to facilitate their transfer to the clinical situations perceived as problematic. Third, trainers' feedback was adjusted to each resident's skill level in order to increase their self-efficacy about transfer. Finally, trainers were asked to support and encourage residents' transfer of learned communication skills to their clinical practice. At the beginning of each session they debriefed residents about their use of learned skills and encouraged them to pursue their efforts and at the end of each session they encouraged residents to test learned skills in their clinical practice. The choice of the skills taught was based on results of studies that have shown the positive impact of using specific patient-centered communication skills (such as open and open-ended question and empathy) .
Residents' attendance to the 30-hour communication skills module has been considered to analyze the training attendance effect on transfer of communication skills to clinical practice.
Actual patient visits
Transfer was assessed in actual inpatient visits during a half-day clinical round at the two assessment times. During this half-day, all residents' visits with included patient were audiotaped. To be included, patients had to be more than 18 years old, able to speak French, free of any cognitive dysfunction, alone during the visit, exempt of any medical contraindication. Different patients were studied at the two timepoints, T1 and T2. During the half-day assessment, a set of questionnaires was completed by residents and also by patients.
Communication Content Analysis
The audiotapes of the actual patient visits were transcribed and the transcripts analyzed by the LaComm software. LaComm is a French communication content analysis software. This software uses a word count strategy based on categories of words like Protan  or Linguistic Inquiry Word Count  and a word combination strategy like the General Inquirer . The aim of this software is to analyze, utterance by utterance, verbal communication used (in medicine in general and in oncology in particular) by identifying utterance types and contents.
Regarding utterance types, communication used during consultations was analyzed with the dictionaries included in the LaComm. Dictionaries are composed of words, word stems or expressions and were built on the basis of empirical knowledge derived from actual and simulated patient consultations performed by physicians , . The categories of dictionaries were adapted from the categories of the Cancer Research Campaign Workshop Evaluation Manual , , ,  and redefined according to the three-function approach of the medical consultation  by a panel of experts (Table 1). Utterances were categorized in three main types: assessment; support; and information. Regarding utterance contents, three dictionaries were constructed: medical, emotional, and social.
The content analysis software has been shown to be effective in measuring improved communication skills , . It allows analyses of verbal communications which reflect important aspects of medical interactions. It is important to underline that this software is only useful to assess training effects and is not designed for teaching.
Patients' satisfaction with residents' communication skills.
This 3-item questionnaire assesses patients' satisfaction with the medical visit. One of these items consisted of a measure of patients' satisfaction with residents' communication skills used during the medical visit. After the clinical round visits, patients rated their satisfaction level on a 10 cm visual analogue scale (VAS). A VAS was chosen here to provide a more sensitive measure of patients' satisfaction with residents' communication as ratings are not restricted to response categories . Because patients often report a high level of satisfaction , ratings responses ranged from “poorly satisfied” (0) to “extremely satisfied” (10) (Figure 2). This unbalanced response option with more positive than negative levels was chosen to provide a more sensitive measure as such response options are more likely to spread out favorable opinions and thus provide a less positively skewed score distribution .
To be considered for data analysis, residents had to attend at least one hour of communication skills training. To analyse patients' satisfaction, all visits of a half-day clinical round were considered at each assessment time. A mean score of patients' satisfaction was calculated for each resident per half-day clinical round. Differences between the training group and waiting-list group were assessed at baseline and at the second assessment time using non parametric tests for independent groups such as, the Mann-Whitney test.
To analyse the Lacomm data, one visit was selected by resident at the second assessment time according to visit duration. For each resident, the visit was selected so that its duration was the closest to the median duration of all visits. This choice was made because visit duration is a covariate of the number of communication skills used. Patient characteristics and visit characteristics at the second assessment time were compared using Student's t test and X2 tests as appropriate. Data generated from the LaComm are in counts of utterance types and contents. The LaComm data considered as the dependent variables were tested with generalized linear equation Poisson regression models according to two models: the one assessed training effects (group allocation) and the other assessed residents' training attendance effects (number of hours of attendance to the communication skills module (30 hours maximum)) using the waiting-list group as the reference group. These two models have been adjusted for the number of residents' turns of speech. All tests were two-tailed, and the alpha was set at 0.05. Analyses were performed with SPSS Version 16.0 for PC (SPSS Inc, Chicago, IL).
Resident Recruitment and Sociodemographic Data
One-hundred and thirteen residents registered to the Belgian Interuniversity Curriculum - Communication Skills Training (BIC-CST) (Figure 1). Eighty-eight residents were considered for analyses. Concerning residents' sociodemographic and socioprofessional characteristics, no statistically significant differences were found at baseline between trained residents (training-group residents) and untrained residents (waiting-list-group residents).
Trained residents were a mean of 28 years old (SD = 3 years), 67% were female, 39% lived alone. Nine residents (20%) were in their first year of residency, 12 in the second year (26%), 15 in the third year (32%), 5 in the fourth year (11%) and 5 in the fifth year (11%). Seven percent were residents in oncology (oncology, haematology and radiotherapy), 30% in gynaecology and 63% in other specialities (surgery, gastroenterology …). Five residents had attended a brief communication skills training workshop in the last year. Untrained residents were a mean of 28 years old (SD = 1.5 years), 62% were female, 24% lived alone. Seven residents (17%) were in their first year of residency, 4 in the second year (9%), 16 in the third year (38%), 10 in the fourth year (24%) and 5 in the fifth year (12%). Twenty-one percent were residents in oncology, 21% in gynaecology and 58% in other specialities. No resident had attended a brief communication skills training workshop in the last year.
Trained residents took part on average, 25 hours of the training program (SD = 8.3; Min = 8; Max = 40). They participated on average, 8 hours of the stress management skills module (SD = 2.4; Min = 3.5; Max = 10) and 17 hours of the communication skills module (SD = 6.8; Min = 3; Max = 30).
Patient recruitment Data
Concerning the recruitment procedure, 1260 patients were met by the assessable residents during the half-day clinical rounds (686 at baseline and 574 at the second assessment time). Three hundred and seventy-seven patients (30%) were ineligible for one or more reasons: Eight patients were younger than 18 years old, 75 were not fluent enough in French to complete the study, 86 presented cognitive dysfunctions, 135 were excluded for medical reasons and 79 were accompanied by a relative. One hundred and twenty-six (10%) refused to participate: 15 patients refused because of time constraints; 20 for intimacy reasons; 16 refused because of visits recording; 46 felt that they were not fit enough to complete the questionnaire and 57 refused for another reason. Seven hundred and fifty-seven (60%) were thus included in the study (390 at baseline and 367 at the second assessment time). Each resident had on average 4.5 clinical round visits (SD = 2; Min = 1; Max = 13) per half-day of assessment included in this study.
Training effects on patients' satisfaction
Four residents, three in the training-group and one in the waiting-list-group, who did not have a clinical round during the first assessment time, were not included in this analysis. For this analysis, 390 patients were included at baseline (206 for the trained group and 184 for the waiting-list group) and 341 at the second assessment (182 for the trained group and 159 for the waiting-list group). It should be recalled that a mean satisfaction level was computed including for each resident all visits of their half-day clinical round. No group differences were observed regarding clinical round visits characteristics at baseline and at the second assessment time.
Regarding patients' satisfaction, Mann-Whitney tests did not show significant differences between groups at baseline (p = .366) but showed significant differences between groups at the second assessment time (p = .047) (Table 2). Patients' satisfaction levels were higher in the training group (Median = 92; Q1–Q3 = 87–97) compared to the waiting-list group (Median = 88, Q1–Q3 = 83–95).
Training effects on residents' and patients' utterances
For the utterances analysis, one visit was selected by resident at the second assessment time according to visit duration. Patients' sociodemographic, disease and visits characteristics were reported in table 3. There was no statistically significant difference between patients met by trained and by untrained residents.
As regards residents' utterances, generalised linear Poisson regression analysis showed no training effects on residents' utterances contents but showed significant effects on residents' utterance types (table 4). At the second assessment, Poisson regression showed a significant increase in the rate of assessment utterances (RR = 1.67; p = .027) for trained residents compared with untrained residents. As regards patients' utterances, analysis showed no training effect (table 4).
Training attendance effects on residents' and patients' utterances
Training attendance effects test the impact of training according to the number of hours of attendance to the communication skills module (30-hour). As regards residents' utterances, generalised linear Poisson regression analysis did not show effects of residents' attendance to BIC-CST on their utterance contents but showed significant effects on residents' utterance types (table 4). At the second assessment, Poisson regression showed per hour of attendance a significant increase in the rate of the other type of assessments (RR = 1.01; p = .018) and of empathy (RR = 1.15; p<.001). Poisson regression showed also per hour of attendance a significant decrease in the rate of supportive utterances (total) (RR = 0.99; p = .042) and of reassurances (RR = 0.95; p = .012) and a marginally significant decrease in the rate of acknowledgments (RR = 0.99; p = .053).
There was no effect on residents' training attendance to BIC-CST on patients' utterances (table 4).
This is the first study assessing in a randomized controlled design the impact of a communication skills training program on transfer by residents of learned skills to their clinical rounds. The training program, assessed in this study, is a Belgian Interuniversity Curriculum - Communication Skills Training (BIC-CST)  designed specifically for residents. Transfer of learned skills has been assessed, on the one hand, by comparing satisfaction of patients interacting with trained and untrained residents and, on the other hand, by comparing trained and untrained residents' communication skills during a half-day of clinical round. It should be recalled at this level that the choice of a half-day clinical round has been made to allow the precise study of transfer of learned skills to the clinical practice. Results of this study show that trained residents successfully transferred learned skills to clinical rounds.
It was hypothesized that BIC-CST would lead to an increase in patients' satisfaction with residents' communication skills. Results showed that patients interacting with trained residents were more satisfied about residents' communication skills than patients interacting with untrained residents.
As regards residents' communication skills, it was hypothesized that BIC-CST would lead to an increase in residents' use of assessment and supportive skills during clinical rounds. Results showed that trained residents used about 20% more assessment utterances during their clinical round visits than untrained residents. Results showed meanwhile no statistically significant training effect on residents' use of supportive skills, although it should be noticed, that trained residents used about 16% less supportive utterances (marginally statistically significant effect). It should also be noticed that there is no training effect on residents' use of empathy.
Training attendance was heterogeneous. The heterogeneity is related mainly to residents' difficulty to attend training sessions due to their work overload. This heterogeneity has allowed to assess residents' training attendance - number of hours - effect on the transfer of skills. Results showed that residents' training attendance had an impact on residents' assessment and supportive utterances.
More precisely, trained residents used per hour of training one percent of assessment utterances more than untrained residents. For example, a resident attending all the 30 hours of the communication skills training module, will use 30% more assessment utterances than untrained residents. Moreover, per hour of training, changes were observed in trained residents' use of supportive utterances compared to untrained residents. It should be recalled that supportive utterances assessed in this study included acknowledgment (which refers to a simple general support), reassurance (which refers to generalisations and which are often premature in the context of clinical round visits) and empathy (which refers to a focused and explicit support). Results of this study show that trained residents, per hour of training, used one percent less acknowledgment, five percent less reassurance and fifteen percent more empathy, than untrained residents. These results show thus that residents' training attendance is directly related to the size of transfer.
The transfer found in this study may be considered as clinically relevant and is directly related to the number of hours of residents' training attendance. It should be recalled that clinical round visits in this study lasted only 8 minutes on average. In this context, an increase of one or two effective communication skills such as an assessment or an empathy is certainly clinically useful. The results reported in this study about the impact of the training program on patients' satisfaction support this idea.
Results of this study show that BIC-CST promotes the transfer by residents of learned skills to clinical practice. BIC-CST allows a more patient-centred communication during residents' clinical round visits and this patient-centred communication seems to lead patients to be more satisfied. It is important to underline that residents' participation to the communication training was heterogeneous. Results underline moreover that transfer is directly related to this level of residents' training attendance.
The study has some limitations. First, it should be recalled that residents' training attendance was heterogeneous. In view of results about the influence of training attendance on transfer, this heterogeneity may have influenced the overall level of the effect found in this study. Second, regarding training, pre-determine role-plays and clinical role-plays based on clinical problem brought up by the residents were often difficult situations rather than routine visits. Even if the practice of difficult situations may facilitate transfer , this choice of role-plays by residents may have had an influence on the effect size of communication skills transfer to clinical practice. Third, this study reports only the assessment of training based on a content analysis software of verbal communication. Other aspects of the resident-patient relationship (e.g. empathy based on non-verbal communication) have not been assessed.
The study of transfer of learned skills to clinical practice has become one of the most important objectives of studies assessing the efficacy of communication skills training programs. The next generation of studies designed to assess transfer should focus on the generalisation of transfer of learned skills to different specific clinical situations and on the maintenance of transfer over time. In this perspective, future studies should focus on improving the efficacy of communication skills training programs in order to ensure a more important training effect size on transfer. Studies of transfer to clinical practice should also assess, on the one hand, besides patients' satisfaction, other potential benefits for patients (patient anxiety, patient information recall, and patient compliance) and, on the other hand, besides physicians' communication skills, other physicians' outcomes (stress, burnout, self-efficacy, and satisfaction). Studies about the transfer to clinical practice should be encouraged although the cost of such initiatives is high.
Conceived and designed the experiments: IM YL IB ND AME CR DR. Performed the experiments: AL YL IB SM JM CR. Analyzed the data: AL IM JM JLS DR. Contributed reagents/materials/analysis tools: AL IM YL IB SM JM CR JLS. Wrote the paper: AL IM YL DR.
- 1. Cohen-Cole SA (1991) The medical interview: the three-function approach. St Louis: Mosby Year Book.
- 2. Ptacek JT, Ptacek JJ (2001) Patients' perceptions of receiving bad news about cancer. J Clin Oncol 19: 4160–4164.
- 3. Butow PN, Kazemi JN, Beeney LJ, Griffin AM, Dunn SM, et al. (1996) When the diagnosis is cancer: patient communication experiences and preferences. Cancer 77: 2630–2637.
- 4. Levinson W, Roter D (1993) The effects of two continuing medical education programs on communication skills of practicing primary care physicians. J Gen Intern Med 8: 318–324.
- 5. Fallowfield L, Jenkins V, Farewell V, Saul J, Duffy A, et al. (2002) Efficacy of a Cancer Research UK communication skills training model for oncologists: a randomised controlled trial. Lancet 359: 650–656.
- 6. Jenkins V, Fallowfield L (2002) Can communication skills training alter physicians' beliefs and behavior in clinics? J Clin Oncol 20: 765–769.
- 7. Razavi D, Merckaert I, Marchal S, Libert Y, Conradt S, et al. (2003) How to optimize physicians' communication skills in cancer care: results of a randomized study assessing the usefulness of posttraining consolidation workshops. J Clin Oncol 21: 3141–3149.
- 8. Baldwin TT, Ford JK (1988) Transfer of training: a review and directions for future research. Personnel Psychology 41: 63–105.
- 9. Robbins AS, Kauss DR, Heinrich R, Abrass I, Dreyer J, et al. (1979) Interpersonal skills training: evaluation in an internal medicine residency. J Med Educ 54: 885–894.
- 10. Langewitz WA, Eich P, Kiss A, Wossmer B (1998) Improving communication skills–a randomized controlled behaviorally oriented intervention study for residents in internal medicine. Psychosom Med 60: 268–276.
- 11. Smith RC, Lyles JS, Mettler J, Stoffelmayr BE, Van Egeren LF, et al. (1998) The effectiveness of intensive training for residents in interviewing. A randomized, controlled study. Ann Intern Med 128: 118–126.
- 12. Oh J, Segal R, Gordon J, Boal J, Jotkowitz A (2001) Retention and use of patient-centered interviewing skills after intensive training. Acad Med 76: 647–650.
- 13. Back AL, Arnold RM, Baile WF, Fryer-Edwards KA, Alexander SC, et al. (2007) Efficacy of communication skills training for giving bad news and discussing transitions to palliative care. Arch Intern Med 167: 453–460.
- 14. Kramer AWM, Dusman H, Tan LHC, Jansen JJM, Grol RPTM, et al. (2004) Acquisition of communication skills in postgraduate training for general practice. Medical Education 38: 158–167.
- 15. Losh DP, Mauksch LB, Arnold RW, Maresca TM, Storck MG, et al. (2005) Teaching inpatient communication skills to medical students: an innovative strategy. Acad Med 80: 118–124.
- 16. Alexander SC, Keitz SA, Sloane R, Tulsky JA (2006) A controlled trial of a short course to improve residents' communication with patients at the end of life. Acad Med 81: 1008–1012.
- 17. Bragard I, Razavi D, Marchal S, Merckaert I, Delvaux N, et al. (2006) Teaching communication and stress management skills to junior physicians dealing with cancer patients: a Belgian Interuniversity Curriculum. Support Care Cancer 1–8.
- 18. Maguire P, Faulkner A, Booth K, Elliott C, Hillier V (1996) Helping cancer patients disclose their concerns. Eur J Cancer 32A: 78–81.
- 19. Hogenraad R, Daubies C, Bestgen Y (1995) Une théorie et une méthode générale d'analyse textuelle assistée par ordinateur: le Système PROTAN (PROTocol ANalyser). Unpublished document ed. Louvain-la-Neuve: Université Catholique de Louvain, Psychology Department.
- 20. Pennebacker J, Booth R, Francis M (2007) Linguistic Inquiry and Word Count: LIWC2007 - Operator's manual. Austin: TX: LIWC.net.
- 21. Stone P, Dunphy D, Smith M, Ogilvie D (1966) The General Inquirer: A Computer Approach to Content Analysis. Cambridge: MA: MIT Press.
- 22. Delvaux N, Merckaert I, Marchal S, Libert Y, Conradt S, et al. (2005) Physicians' communication with a cancer patient and a relative: a randomized study assessing the efficacy of consolidation workshops. Cancer 103: 2397–2411.
- 23. Booth C, Maguire P (1991) Development of a rating system to assess interaction between cancer patients and health professionals. London: Report to Cancer Research Campaign. 37 p.
- 24. Delvaux N, Razavi D, Marchal S, Bredart A, Farvacques C, et al. (2004) Effects of a 105 hours psychological training program on attitudes, communication skills and occupational stress in oncology: a randomised study. British Journal of Cancer 90: 106–114.
- 25. Lienard A, Merckaert I, Libert Y, Bragard I, Delvaux N, et al. (2010) Is it possible to improve residents breaking bad news skills? A randomised study assessing the efficacy of a communication skills training program. Br J Cancer 103: 171–177.
- 26. Gibon AS, Durieux JF, Merckaert I, Delvaux N, Farvacques C, et al. (2010) Developement of the Lacomm, a French medical communication analysis software: A study assessing its sensitivity to change. Psychooncology 19: 133–134.
- 27. Oberst MT (1984) Methodology in behavioral and psychosocial cancer research. Patients' perceptions of care. Measurement of quality and satisfaction. Cancer 53: 2366–2375.
- 28. Sitzia J (1999) How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care 11: 319–328.
- 29. Bredart A, Bottomley A, Blazeby JM, Conroy T, Coens C, et al. (2005) An international prospective study of the EORTC cancer in-patient satisfaction with care measure (EORTC IN-PATSAT32). Eur J Cancer 41: 2120–2131.