13 May 2013: Zonneveld LNL, van Rood YR, Timman R, Kooiman CG, van't Spijker A, et al. (2013) Correction: Effective Group Training for Patients with Unexplained Physical Symptoms: A Randomized Controlled Trial with a Non-Randomized One-Year Follow-Up. doi: info:doi/10.1371/annotation/9cefaaa9-c367-4f2d-a927-0a0b304ae21f View correction
Although cognitive-behavioral therapy for Unexplained Physical Symptoms (UPS) is effective in secondary care, studies done in primary care produced implementation problems and conflicting results. We evaluated the effectiveness of a cognitive-behavioral group training tailored to primary care patients and provided by a secondary community mental-health service reaching out into primary care.
The effectiveness of this training was explored in a randomized controlled trial. In this trial, 162 patients with UPS classified as undifferentiated somatoform disorder or as chronic pain disorder were randomized either to the training or a waiting list. Both lasted 13 weeks. The preservation of the training's effect was analyzed in non-randomized follow-ups, for which the waiting group started the training after the waiting period. All patients attended the training were followed-up after three months and again after one year. The primary outcomes were the physical and the mental summary scales of the SF-36. Secondary outcomes were the other SF-36-scales and the SCL-90-R. The courses of the training's effects in the randomized controlled trial and the follow-ups were analyzed with linear mixed modeling. In the randomized controlled trial, the training had a significantly positive effect on the quality of life in the physical domain (Cohen's d = 0.38;p = .002), but this overall effect was not found in the mental domain. Regarding the secondary outcomes, the training resulted in reporting an improved physical (Cohen's d = 0.43;p = 0.01), emotional (Cohen's d = 0.44;p = .0.01), and social (Cohen's d = 0.36;p = 0.01) functioning, less pain and better functioning despite pain (Cohen's d = 0.51;p = <0.001), less physical symptoms (Cohen's d = −.23;p = 0.05) and less sleep difficulties (Cohen's d = −0.25;p = 0.04) than time in the waiting group. During the non-randomized follow-ups, there were no relapses.
The cognitive-behavioral group training tailored for UPS in primary care and provided by an outreaching secondary mental-health service appears to be effective and to broaden the accessibility of treatment for UPS.
TrialRegister.nl NTR1609 <rctview.asp?TC = 1609>
Citation: Zonneveld LNL, van Rood YR, Timman R, Kooiman CG, van't Spijker A, Busschbach JJV (2012) Effective Group Training for Patients with Unexplained Physical Symptoms: A Randomized Controlled Trial with a Non-Randomized One-Year Follow-Up. PLoS ONE 7(8): e42629. doi:10.1371/journal.pone.0042629
Editor: Sam Eldabe, The James Cook University Hospital, United Kingdom
Received: April 8, 2012; Accepted: July 9, 2012; Published: August 7, 2012
Copyright: © Zonneveld et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
The estimated prevalence of Unexplained Physical Symptoms (UPS) ranges from 18 to 74% in primary care , , , and from 30 to 52% in secondary care , , , . UPS is more prevalent in women than in men , , ,  and women in their forty's seem to run a higher risk , . Other demographic characteristics seemed not be associated with UPS in a consistent manner. For example, some studies found lower socioeconomic background to be associated with UPS , , while others found an association with having work and a higher education attainment . Patients with UPS attributed their physical symptoms more to physical causes than to lifestyle factors in comparison to patients with a medical diagnosis . Moreover, patients with
UPS are more reluctant than patients with mental disorders to accept a psychiatric diagnosis for their symptoms . UPS are associated with more concomitant psychological symptoms, more impaired functioning and had higher medical utilization than other patient groups , , .
Cognitive-behavioral therapy has shown to be most effective for patients with UPS. It reduces UPS and concomitant psychological symptoms, improves daily functioning, and reduces financial expenses , ,  without causing harmful effects . However, the effect of this treatment has been studied mainly in medical subspecialty clinics or mental health centers , ,  – resources that are not easily accessible to patients , either because their capacity is limited, or because patients refuse to be referred to the mental-health services , .
To make treatment for UPS more accessible to patients, general practitioners have been trained to carry out cognitive-behavioral therapy. However, only two studies have shown effect when this therapy was provided by general practitioners , ; most other studies were unable to show any conclusive effect , , , , , . Also, the transfer of this therapy by general practitioners into routine clinical practice has been hampered by practical issues at the level of the general practitioner, the patients and the treatment. At the level of general practitioners, the implementation was difficult as they hesitated to implement this treatment for UPS. In a British study , 1,934 general practitioners were invited to be trained in cognitive-behavioral therapy. Despite the promise of financial compensation, only 70 agreed to participate (3.6%). Those who did participate reported difficulties in implementing the therapy in their family practice because of, for example, the limited time available in patient-physician encounters . At patient's level, the implementation was difficult as patients hesitated to disclose psychosocial issues to their general practitioners  and were less satisfied about the quality of care from their general practitioners than patients with a medical diagnosis. For example, they felt that the general practitioner did not take them seriously and took too little time for them , . At treatment level, the implementation was difficult as general practitioners and patients had different objectives for their encounters: the former aimed to explain and alleviate symptoms, while the latter hoped to find clinician support , .
As an alternative to training general practitioners to carry out cognitive-behavioral therapy for UPS, it might be possible for professional therapists from a secondary community mental-health service to make this treatment easily accessible to primary-care patients. First, however, three problems should be resolved: the capacity of secondary care should be increased, patients' refusal to be referred to mental-health services should be reduced, and therapists' and patients' objectives for treatment encounters should be aligned.
As a secondary community mental-health service, we approached these problems as follows. First, to increase capacity, we organized group treatment instead of individual treatments. Second, to minimize patients' refusal to be referred to mental-health services, we sought close collaboration with medical services and offered treatment locally at their centers. Moreover, we used a cognitive-behavioral model which had previously achieved high acceptance in a secondary medical outpatient clinic . As the available manuals based on this model were only intended for individual treatments , , , we had to write a manual for group treatment .Third, to align the objectives of the therapists and patients, we tailored the treatment to match primary-care patients' objectives for treatment.
Our first objective was to evaluate the effectiveness of the cognitive-behavioral group training tailored to primary care patients and provided by a secondary community mental-health service reaching out into primary care. The second aim was to observe whether the effect of this group training was preserved in a one-year follow-up period. Our hypotheses were that the group training could raise the quality of life in patients with UPS, and that this effect could be preserved during the follow-up.
The study was approved by the Erasmus Medical Research Ethics Committee and was registered in the Dutch Trial Register (NTR 1609) . A detailed description of the study protocol has been published elsewhere . Patients in this study gave written informed consent.
The effectiveness of the group training was investigated in a randomized controlled trial. To this end, patients were randomized either to the training or a waiting list after they had completed the baseline measurement (T0). The second measurement (T1) was made directly after the training (13 weeks), or after the same period for those on the waiting list.
The preservation of the effect of the group training was investigated in a non-randomized one-year follow-up. To this end, patients, who had been randomized to the waiting list and had waited, started the training after their second measurement (T1). Patients, who attended the training directly after randomization or after the waiting period, were followed-up three months after the end of treatment (T2), and again one year later (T3).
General practitioners and specialists were asked to refer patients aged between 18 and 65 whose physical symptoms, according to their clinical judgment, could not be fully explained by a known medical condition.
Patients were included if they signed the informed consent, and if their UPS fulfilled the DSM-IV criteria for an undifferentiated somatoform disorder or a chronic pain disorder. To verify whether the UPS fulfilled the criteria for undifferentiated somatoform disorder or chronic pain disorder, we used the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) , a semi-structured validated interview for making the major DSM-IV Axis I diagnoses.
Patients were excluded from the study if poor language skills or handicaps such as cognitive impairment prevented them from understanding the training.
The intervention is a cognitive-behavioral therapy based on the consequences model. In Figure 1, the consequences model is drawn with the solid arrows . In the consequences model, psychological and social factors, which are commonly labeled as causes , are labeled as consequences of UPS. UPS (such as abdominal pain) in itself is seen as a stressful condition about which patients develop dysfunctional beliefs (such as ‘I have colon cancer’) that produce cognitive, behavioral, physical, and social consequences. In the short term, these consequences have beneficial effects, either by themselves (such as eating easily digestible food to recuperate), or through interaction with other consequences (such as continuing an activity to distract oneself from the abdominal pain). In the long term, however, these consequences might produce self-perpetuating vicious circles that maintain or aggravate UPS (such as eating less and less, and continuing an activity beyond one's physical limits that leads to more abdominal pain and tiredness). The objective of treatment based on the consequences model is to alleviate symptoms , , .
This model was tailored to primary-care patients. The changes resulting from this tailoring are shown in dotted lines and italics of Figure 1. They can be summarized in terms of three adjustments:
1.) Adding and starting bottom-up next to top-down.
Our first change was based upon the fact, that, in the original model, beliefs have a central role. However, the focus on thoughts might not fit the more physically orientated way of viewing and communicating of patients , , , and the need to challenge thoughts in cognitive-behavioral therapy has been questioned lately .
In our tailored version of the consequences model, we therefore enter the model bottom-up instead of top-down. Herewith, the consequences rather than the beliefs have a central role. By changing and reducing the consequences, beliefs are addressed indirectly, after which the beliefs can still be addressed directly.
2.) Aggravating instead of maintaining reactions.
Our second change was based upon the fact that, in the original model, the consequences can maintain UPS. In our view, patients might translate that as personal blame for causing the continuation of their UPS. This does not match primary-care patients' hope of finding clinician support , .
In our tailored version of the consequences model, causes are consistently labeled as unknown. The consequences therefore aggravate symptoms rather than maintain UPS. In this way, patients are relieved from blame not only for the cause and existence of UPS, but also for its persistence.
3.) Improvement of quality of life instead of symptom alleviation.
Our last change was based upon the fact that, in the original model, the treatment objective is to alleviate symptoms , , . However, primary-care patients mainly hope to find clinician support , , followed by improving daily functioning and coping with UPS .
In our tailored version of the consequences model, the treatment objective is to improve patients' quality of life not only by preventing aggravation of symptoms but also by increasing daily functioning and coping. This expands the opportunities to support patients' reactions and makes support independent of changes in UPS in itself, since its causes are explicitly labeled as unknown.
Based on this tailored cognitive-behavioral model, a manual was developed for a group training called ‘Coping with the consequences of unexplained physical symptoms’ . This training consists of 13 weekly two-hour sessions organized in local medical settings. Table 1 shows the cognitive-behavioral techniques used in each session.
The control intervention was a waiting list. The waiting period was as long as the period of the intervention.
To measure improvement in quality of life, we used the 36-item Medical Outcomes Study Short-Form General Health Survey (SF-36), a validated and reliable self-report questionnaire with 36 questions and fixed-response alternatives for assessing functional health and well-being over the past four weeks . The responses are converted into eight multi-item scales (0–100): ‘Physical functioning’, ‘Role functioning physical’, ‘Bodily pain’, ‘General health’, ‘Vitality’, ‘Social functioning’, ‘Role functioning emotional’, and ‘Mental health’. These scales can be summarized into the ‘Physical component summary’, in which the first four of the above eight scales are weighted most heavily; and into the ‘Mental component summary’, in which the last four of the above eight scales are weighted most heavily . These summaries are transformed into T-scores with a mean of 50 and standard deviation of 10. Higher scores on SF-36 scales indicate a better quality of life.
To measure the intensity of a broad range of psychological problems and psychopathology symptoms, we used the revised 90-item Symptom Checklist (SCL-90-R), a validated and reliable self-report questionnaire with 90 questions and fixed response alternatives for assessing the intensity of symptoms over the past week . The responses are summed up in eight multi-item scales: ‘Phobic anxiety’, ‘Anxiety’, ‘Depression’, ‘Somatization’, ‘Obsessive-compulsiveness’, ‘Interpersonal sensitivity’, ‘Hostility’, and ‘Sleep difficulties’. These scales can be summarized in the ‘Global severity index’. Higher scores on SCL-90 scales indicate a higher number or more severe symptoms.
Primary outcome measures were the ‘Physical component summary’ and the ‘Mental component summary’ of the SF-36. Secondary outcome measures were the individual SF-36 scales and the SCL-90-R scales.
For the SF-36, the manual provides an algorithm to compute the scale scores with a single norm for maximum tolerated percentage of missing items. In this algorithm, a SF-36-scale was only computed, if a patient had completed at least 50% of the items belonging to this SF-36 scale. If this was the case, the patient's available items belonging to the same scale were added up and the resulting sum was divided by the number of available scale items of the same patient. If the number of missing items on a SF-36 scale exceeded the 50% percentages, the data for this scale remained missing.
For the SCL-90-R, the manual provides an algorithm to compute the scales with a norm for the maximum tolerated number of missing items. For the scale ‘Sleep difficulties’, the maximum tolerated number of missing items is one; for the other scales, this maximum is two. By this, the maximum tolerated percentage of missing items of the scales ranges from 67% to 98%. We chose to set the maximum tolerated percentage of missing items for all scales on 75%. In the resulting algorithm, a SCL-90-R scale was only then computed, if a patient had completed at least 75% of the items belonging to this SCL-90-R scale. If this was the case, the patient's available items belonging to the same SCL-90-R scale were added up and the resulting sum was divided by the number of available scale items of the same patient. If the number of missing items on a SCL-90-R scale exceeded this 75% percentage, the data for this scale remained missing.
The sample size required was calculated by power analysis. For power analysis, we applied SPSS version 17 and the mixed-model ANOVA procedure described by Aberson . The repeated-measurement correlation required for the power analysis was estimated on basis of the SF-36 manual . In the manual, a two-weeks test-retest correlation of 0.80 was reported for the SF-36 summary scale ‘Mental component summary’ and 0.89 for the ‘Physical component summary’. Taking into account that a reduction of these correlations should be expected as the time period between two measurements in our study was longer and included the intervention, the correlation was estimated at 0.75. The effect size for the power analysis was estimated at 0.40 based on a review , in which the effect sizes for cognitive-behavioral treatments in UPS compared to control conditions centered around .40. These values for correlation and effect size, in combination with an alpha of 0.05 and a beta of 0.20 led to a required sample size of 51 in each group. Adjusted for a dropout of one third, this resulted in a total sample size of 153. The presented procedure to estimate the required sample size deviates from the one described in the original trial protocol , as the original power analysis did not match the intended and original statistical analysis plan.
Patients were assigned to the training or to the waiting list according to a computer generated randomization list. This randomization list was generated just before the start of the next training for enrolled patients who had completed all baseline measurements. As each 13-week training followed the previous one in quick succession and holidays accounting for the only gaps between one training and another, a randomization list was usually generated every other 13 weeks.
As the randomization list was generated after the patients were assessed for eligibility and enrolled, allocation was certainly concealed for patients and assessors.
The randomization list was generated by an investigator who had no clinical involvement in the trial, and was working in a different building than the buildings where assessment and enrollment were done.
Patients were assessed and enrolled by seven psychologists who had been trained in the SCID-I over several sessions. These psychologists were not involved in other parts of the study or patients' treatment.
Patients were assigned after enrollment according to the randomization list by a psychologist who was not involved in the generation of the randomization list, nor in the assessment and enrollment of patients. Patients were informed about their assignments by a letter posted to their home address.
Patients and trainers could not be blinded for group assignment, as the control condition was a simple waiting list. The data were imported and analyzed after patients had completed the trial.
Effectiveness of the group training.
In the randomized controlled trial the comparability of the patients' baseline-variables between patients who completed the randomized controlled trial and who dropped out were analyzed with the two-tailed t-tests for independent samples for the continuous variables, with the two-tailed Mann-Whitney U-tests for the ordinal variables and with the chi-square tests for the categorical variables. The effects of the training were analyzed with linear mixed modeling.
Preservation of the effect of the group training.
In the non-randomized, observational follow-up, the comparability of the patients' baseline-variables between patients who could be followed up and who were lost were analyzed with the two-tailed t-tests for independent samples for the continuous variables, with the two-tailed Mann-Whitney U-tests for the ordinal variables and with the chi-square tests for the categorical variables. The preservation of the effect of the training were analyzed with linear mixed modeling.
All statistical analyses were done with the significance level fixed at 0.05 (two-tailed).
Figure 2 shows the flow of patients through the study.
RCT = Randomized Controlled Trial.
Patients were recruited between February 2005 and September 2008 in general practices, in outpatient clinics at general hospitals, and by our secondary community mental-health service in and around Rotterdam, the Netherlands. The follow-up ended in December 2009; one year after the intervention group of the last randomization had completed the training.
Table 2 and Table 3 list the characteristics of the 162 randomized patients, 133 of whom (82%) provided outcome data. There were no significant differences between the 133 patients with primary endpoint outcome data and the 29 who dropped out the randomized controlled trial with regard to the following: UPS characteristics, the number of co-morbid DSM-IV axis I and axis II classifications, referrer characteristics, socio-demographic characteristics, and outcome variables.
In total, the training was conducted 20 times in four different local medical settings, with between five and nine patients per intervention (an average of six patients per intervention). The mean attended sessions in the patients who were randomly assigned to the training and provided outcome data was eleven. The minimum number of attended sessions was six.
Each of the 20 groups was led by one of six psychologists with a Master's degree, four of whom had had at least three years' post-Master's experience with group therapy and/or cognitive-behavioral therapy. To compensate for their lack of experience of the other two psychologists, they observed the developer of the manual (LZ) during a group session before jointly leading another group in their own session on the following day. (They gave only one 13-week training.) To increase treatment integrity and positive group dynamics, all psychologists familiarized themselves with the tailored consequences model and the manual's line of reasoning by going through the manual before each session under the supervision of LZ.
The statistical analyses were conducted according to the intention-to-treat principle , as the data of all patients who were randomized were included in the linear mixed modeling.
Outcomes and estimation
Effectiveness of the group training.
Table 4 shows the estimates for the effect of the training on the primary and secondary endpoints of the randomized controlled trial. The training had a significant effect on the primary outcome measure ‘Physical component summary’ (p = .002). The effect size was medium (Cohen's d = 0.38) according to Cohen's statistical guidelines . No effect of the training was found for the primary outcome measure ‘Mental component summary’. On the secondary outcome measures of the SF-36, scales in favor of the training indicating significantly better functioning were ‘Role functioning physical’ (Cohen's d = 0.43, p = .01), ‘Bodily pain’ (Cohen's d = 0.51, p = <.001), ‘Social functioning’ (Cohen's d = 0.36, p = .01), and ‘Role functioning emotional’ (Cohen's d = 0.44, p = .01). On the secondary measures of the SCL-90-R, scales in favor of the training indicating a lower number or less severe symptoms were ‘Somatization’ (Cohen's d = −0.23, p = 0.05), and ‘Sleep difficulties’ (Cohen's d = −0.25, p = .04).
Preservation of the effect of the group training.
Table 5 shows the estimates for the effects of time on the primary and secondary endpoints of the non-randomized, observational follow-up. At each time point, time did not eliminate the effects of the training. In contrary, for the primary outcome measure ‘Physical component summary’, the effect increased from Cohen's d 0.39 to 0.49 at three-months follow-up and Cohen's d was still 0.49 at one-year follow-up. A similar trend was observed for the secondary outcome measures ‘Physical functioning’ and ‘Obsessive-compulsive’.
To explore whether patients who had one-year follow-up scores differed from patients who had no one-year follow-up scores, these two groups were compared with each other with regard to the following: UPS characteristics, the number of co-morbid DSM-IV axis I classifications, referrer characteristics, socio-demographic characteristics, and outcome variables. Patient with one-year follow-up scores were significantly older (M = 46.69, SD = 10.79) and reported significantly more vitality (M = 35.58, SD = 17.56), and significantly less hostility (M = 7.99, SD = 2.68) than patients without one-year follow-up scores (age: M = 42.44, SD = 11.09, p = .02; SF-36 scale ‘Vitality’: M = 29.60, SD = 17.88, p = .04, and SCL-90 scale ‘Hostility’: M = 9.53, SD = 4.78, p = .03).
One adverse event was reported in this study. After the training, one patient reported rumination about possible death of beloved people, which tired her out. For this patient, psychotherapy was arranged, in which she engaged. Further detailed description of this patient has been published elsewhere .
The effect of a cognitive-behavioral group training on the quality of life was studied in patients with UPS. The training was based on the consequences model tailored to primary-care patients and provided by a secondary community mental-health service reaching out into the primary care. It was found to be effective at improving the physical domain of quality of life, which was the domain patients reported as most burdensome at baseline. This positive effect was preserved during the entire one-year follow-up period. These results are remarkable, as studies have shown that the prognosis of UPS becomes more unfavorable if the duration of UPS is longer , , , , or if UPS is classified as a somatoform disorder , . In our study group, the median of the duration of UPS was nine years, and UPS had been classified as undifferentiated somatoform disorder or as chronic pain disorder.
Considering these effects, further research on this training seems to be worthwhile.
The effects might differ between various subgroups within patients with UPS. Further research could explore, whether some subgroups benefit more than others. If the latter is the case, allocation and selection might improve effectiveness even more. Also, it would be interesting to explore whether the training also reduces costs by reducing medical utilization, and productivity losses due to UPS. This would make the training not only more interesting from a patient's but also from a societal's perspective.
Various terms are used for unexplained physical symptoms. Examples of other terms used for these symptoms are Medically Unexplained Physical Symptoms (MUPS), Functional Somatic Symptoms (FSS), abridged somatization, and multisomatoform disorder , , . The use of different terms and different definitions makes the communication about these symptoms between clinicians and researchers within and between disciplines difficult and reduces generalizability. This might be resolved in the revision of the American Psychiatric Association's Diagnostic and Statistical Manual for Mental Disorders (DSM). Currently, the proposed revision is to classify this symptoms as Somatic Symptom Disorder, which is defined as persistent distressing somatic symptoms in combination with excessive thoughts, feelings, and behaviors in response to these somatic symptoms . Pending this revision, we chose among all frequently used terms the term Unexplained Physical Symptoms (UPS), because this term reflects best that physical, psychological and social causes and effects are not or not easily separated from each other, and are mostly interrelated without a clear starting or finishing point. By using the term UPS, we acknowledged this interrelationships, promoted transparency in the communication to all stakeholders; patients, clinicians and researchers, and followed the recommendation for terminology on these symptoms, which includes “to remove language that is potentially pejorative to patients” .
The prevalence of having one or more co-morbid DSM-IV Axis I disorders in our study was 41%. The three most commonly comorbid DSM-IV axis I disorders were anxiety (29%), mood (15%), and somatization (15%) disorder. These prevalences are comparable with earlier findings in patients with UPS. In this patients' group, studies found prevalences of comorbid anxiety and/or depressive disorders in primary care ranging from 26%  to 54% . The prevalence of a comorbid anxiety disorder was 17% and the prevalence of a comorbid depressive disorder was also 17% . It is known , that patients with UPS have a higher rate of current mood disorder or current anxiety disorder than either healthy controls or patients with phenomenologically similar medical diseases of known organic pathology. Including patients with co-morbid DSM-IV Axis I disorders makes our results generalizable to a wider group of patients with UPS than is usually selected for scientific trials, and more similar to the patient group seen in routine clinical practice.
The prevalence of having one or more personality disorders in our study was 30%. The three most commonly personality disorders were avoidant (17.9%), obsessive compulsive (14.8%), and paranoid (11.1%) personality disorder. These prevalences are in line with earlier findings in this group of patients. Studies found prevalences of personality disorders in UPS ranging from 0% to 88.6% , , , , , , , , , . The most commonly personality disorder for patients with UPS in these studies differed between obsessive compulsive , , , , , histrionic , , avoidant , , dependent ,  and paranoid  personality disorder. Our findings on the prevalence of personality disorders were quite similar to the rates reported in the study in patients with chest pain measuring personality disorders using a self-report questionnaire. This study reported a prevalence of 39%, in which three most commonly reported personality disorders were obsessive-compulsive (23.3%), avoidant (13.8%), and paranoid (13.2%) personality disorder . Differences in prevalences of personality disorders between studies might be explained by the use of different instruments for the assessment of personality disorders, but also by the use of different definitions for unexplained physical symptoms (e.g. somatizing patients and somatization disorder). As our definition of unexplained physical symptoms was symptoms fulfilling the DSM-IV criteria for an undifferentiated somatoform disorder or a chronic pain disorder, prevalences in our study might also be slightly lower than in somatoform disorders in general, because studies ,  suggested that both undifferentiated somatoform disorder and chronic pain disorder were less frequently combined with personality pathology than the other somatoform disorders. Due to the use of validated interviews for both the classification of UPS and personality disorders and comparability of our findings with earlier findings, we believe our results to be reliable and generalizable.
The training is theory-based and elaborately described in the manual . It was conducted by six different psychologists with different experience levels at four different local medical settings. This suggests that the training is transferable to different circumstances.
Conducting the training belonged to the daily activities of the psychologists and was financed within the current reimbursement practice. By this, the training could be implemented without research funds. Kathol et al.  showed the relevance for this kind for generalizability, as most evidence-based programs integrating mental health services in primary care could not be successfully implemented after completion of the study due to the fact that research funds were not substituted within the current reimbursement practice.
The options for the study were limited by the fact that it was part of daily activities of a secondary community mental-health service. Because patients on the waiting list had to wait only 13 weeks for the group training – the same period as the training itself – the study was deprived of a control condition for the three-month and one-year follow-ups. However, our time frame of follow-up assessments was longer than the usual time frame of intervention studies for UPS that ranged from three to 12 months with a mean of six months .
Not only the length of the control condition for the influence of time and other not-intervention-related circumstances, but also the lack of a control condition for the influence of intervention-related aspects was a limitation. Because of this limitation, the measured effects could not be attributed to the specific therapeutic interventions of our training. If a control intervention group (e.g. relaxation, solely psycho-education, self help, individual treatment) had been included, it would have been possible to explore whether the training itself had supplementary effects in comparison to other interventions or individual treatment.
Another limitation of our study is that inter-rater-reliability was not calculated for the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I), which verified whether patients fulfilled the inclusion criteria for undifferentiated somatoform disorder or chronic pain disorder. This is especially regrettable, as the number of UPS classified as undifferentiated somatoform disorder was lower than the number of UPS classified as chronic pain disorder – the opposite of what was found in a study in Dutch general practices . To clarify this difference, we examined the SCID-I interviews more closely. This showed that, due to the interviewers' or patients' emphasis on pain in the presence of a broad spectrum of symptoms, syndromes such as fibromyalgia or chronic fatigue syndrome had sometimes been misclassified as chronic pain disorder. These misclassifications might have inflated the number of chronic pain disorders at the expense of undifferentiated somatoform disorder.
Not only the comparability of interviews, but also the comparability of the training's sessions in different groups was not measured. As supervision was given by the developer of the manual (LZ) before each session, treatment integrity and comparability were stimulated but they were not verified. If the group sessions had been recorded, they could have been rated by independent raters and treatment integrity could have been verified.
Randomization was used to reach comparability between the patients in the training and patients on the waiting list. Notably, this randomization resulted in an imbalance of distribution of living with or without a partner over the training and the waiting group, although this imbalance was not significant (p = .13). Nevertheless, such imbalance might have influenced the results in favor of the training, as this demographic variable could be seen as in indicator of social support and the ability to have stable relationships.
Earlier studies have found that cognitive-behavioral therapy improved physical symptoms, psychological distress, and functional status , . The effect sizes for this therapy compared to control conditions centered around .40 . Physical symptoms appeared to be the most responsive , , although in some studies for specific syndromes, such as chronic fatigue syndrome and fibromyalgia, the opposite was found, and the effect size for psychological distress was larger . Improvement of the physical symptoms could occur whether or not psychological distress was decreased . Preservation of positive effects was observed in 6-months to one-year follow-up assessments .
Our findings seemed to be consistent with these earlier studies as they showed a similar improvement of functional status and symptoms, more responsiveness of physical symptoms in comparison to psychological symptoms, and the preservation of these effects over the one-year follow-up period. The effect size of .38 in the randomized controlled trial and the effect size of .49 in the non-randomized one-year follow-up might even be considered to be relatively high, because our training was designed to be easily accessible, and, thereby, might have included more patients with higher resistance to psychological interventions.
For this, the tailoring of the consequences model for primary-care patients might have been essential. It was only after doing so that we discovered that, due to low acceptance , and no effectiveness , two previous attempts to use the original consequences model in primary care had failed. Although most patients in our study had been referred by medical services, especially by general practitioners, ‘only’ 78 of the 269 (29%) patients did not attend the first appointments (so-called ‘no shows’); this no-show figure was substantially lower than the estimated 50%–80% of patients who refuse to be referred to mental-health services . Patients also seemed to accept the training itself: 65 of the 84 who were randomized to it (77%), and 52 of the 72 who waited for it (72%) really attended the training.
By seeking close collaboration with medical centers and offering treatment at their centers, we might not only have broadened the accessibility of mental-health services for primary-care patients. As physicians rated the problems of getting mental health services for their patients twice as high as the problems of getting other specialty services , we might also have simplified the access of mental-health services for physicians.
The success rate of referrals from medical care services to the training might still be improvable. The three most common reasons for failure to seek treatment after referral are 1.) the problem has resolved, 2.) patients need to wait before treatment starts, and 3.) a lack of motivation . With regard to the first reason, it is suggested by the long duration of UPS in our patients, and also by the overall low recovery rate in patients with somatoform disorders , that the problem had not resolved. But the second reason – having to wait for treatment – was certainly an issue: those who had to wait, such as those on the waiting list, complained about it. Indeed, some could not bring themselves to wait and left the trial. Therefore, if this training is implemented in routine clinical practice, a short waiting period before treatment starts is advisable. The third reason – lack of motivation to actualize the referral – revealed another area in which there is scope for further improvement. Patients commented that their physicians had suggested that their complaints were ‘all in their heads’. In certain cases, the sense of not being taken seriously made them delay seeking treatment and made them express anger about it at their first appointment. Feeling disrespected is a factor that is known to influence un-notified no-shows .
Perhaps the number of successful referrals might be increased if physicians are trained to use the language of the tailored consequences model to explain the goals of the referral and the treatment – without having to do the cognitive-behavioral interventions themselves. Asking them to do these interventions themselves might not be as effective because of the implementation issues mentioned in the introduction, but also because of difference in education between physicians and psychologists, and the low volume of doing psychological treatment for general practitioners in comparison to psychologists. In medicine, it is a well-established fact, that outcomes raise with higher volumes .
In short, the cognitive-behavioral group training tailored for UPS in primary care and provided by an outreaching secondary mental-health service appears to be effective and to broaden the accessibility of the treatment of UPS.
Conceived and designed the experiments: LZ. Performed the experiments: LZ. Analyzed the data: RT LZ YvR CK AvtS JB. Contributed reagents/materials/analysis tools: LZ. Wrote the paper: LZ YvR RT CK AvtS JB.
- 1. Kroenke K (2003) Patients presenting with somatic complaints: epidemiology, psychiatric co-morbidity and management. International Journal of Methods in Psychiatric Research 12: 34–43. doi: 10.1002/mpr.140
- 2. De Waal MWM, Arnold IA, Eekhof JAH, Van Hemert AM (2004) Somatoform disorders in general practice: prevalence, functional impairment and comorbidity with anxiety and depressive disorders. British Journal of Psychiatry 184: 470–476. doi: 10.1192/bjp.184.6.470
- 3. Escobar JI, Waitzkin H, Silver RC, Gara M, Holman A (1998) Abridged somatization: a study in primary care. Psychosomatic Medicine 60: 466–472.
- 4. Kooiman CG, Bolk JH, Brand R, Trijsburg RW, Rooijmans HG (2000) Is alexithymia a risk factor for unexplained physical symptoms in general medical outpatients? Psychosomatic Medicine 62: 768–778.
- 5. Reid S, Wessely S, Crayford T, Hotopf M (2001) Medically unexplained symptoms in frequent attenders of secondary health care: retrospective cohort study. British Medical Journal 322: 767. doi: 10.1136/bmj.322.7289.767
- 6. Van Hemert AM, Hengeveld MW, Bolk JH, Rooijmans HGM, Vandenbroucke JP (1993) Psychiatric disorders in relation to medical illness among patients of a general medical out-patient clinic. Psychological Medicine 23: 167–173. doi: 10.1017/s0033291700038952
- 7. Nimnuan C, Hotopf M, Wessely S (2001) Medically unexplained symptoms: an epidemiological study in seven specialities. Journal of Psychosomatic Research 51: 361–367. doi: 10.1016/s0022-3999(01)00223-9
- 8. Smith GR, Monson RA, Ray DC (1986) Patients with multiple unexplained symptoms: their Characteristics, functional health, and health care utilization. Archives of Internal Medicine 146: 69–72. doi: 10.1001/archinte.146.1.69
- 9. Verhaak PFM, Meijer SA, Visser AP, Wolters G (2006) Persistent presentation of medically unexplained symptoms in general practice. Family Practice 23: 414–420. doi: 10.1093/fampra/cml016
- 10. Barsky AJ, Orav EJ, Bates DW (2005) Somatization increases medical utilization and costs independent of psychiatric and medical comorbidity. Archives of General Psychiatry 62: 903–910. doi: 10.1001/archpsyc.62.8.903
- 11. Kroenke K, Sharpe M, Sykes R (2007) Revising the classification of somatoform disorders: key questions and preliminary recommendations. Psychosomatics: Journal of Consultation Liaison Psychiatry 48: 277–285. doi: 10.1176/appi.psy.48.4.277
- 12. Dirkzwager AJE, Verhaak PFM (2007) Patients with persistent medically unexplained symptoms in general practice: characteristics and quality of care. BMC Family Practice 8: 33. doi: 10.1186/1471-2296-8-33
- 13. Kroenke K (2007) Efficacy of treatment for somatoform disorders: a review of randomized controlled trials. Psychosomatic Medicine 69: 881–888. doi: 10.1097/psy.0b013e31815b00c4
- 14. Nezu AM, Nezu CM, Lombardo ER (2001) Cognitive-behavior therapy for medically unexplained symptoms: a critical review of the treatment literature. Behavior Therapy 32: 537–583. doi: 10.1016/s0005-7894(01)80035-6
- 15. Sumathipala A (2007) What is the evidence for the efficacy of treatments for somatoform disorders? A critical review of previous intervention studies. Psychosomatic Medicine 69: 889–900. doi: 10.1097/psy.0b013e31815b5cf6
- 16. Heins MJ, Knoop H, Prins JB, Stulemeijer M, Van der Meer JWM, et al. (2010) Possible detrimental effects of cognitive behaviour therapy for chronic fatique syndrome. Psychotherapy and Psychosomatics 79: 249–256. doi: 10.1159/000315130
- 17. Raine R, Haines A, Sensky T, Hutchings A, Larkin K, et al. (2002) Systematic review of mental health interventions for patients with common somatic symptoms: can research evidence from secondary care be extrapolated to primary care? British Medical Journal 325: 1082–1092. doi: 10.1136/bmj.325.7372.1082
- 18. Allen LA, Escobar JI, Lehrer PM, Gara MA, Woolfolk RL (2002) Psychosocial treatments for multiple unexplained physical symptoms: a review of the literature. Psychosomatic Medicine 64: 939–950. doi: 10.1097/01.psy.0000024231.11538.8f
- 19. Cunningham PJ (2009) Beyond parity: primary care physicians' perspectives on access to mental health care. Health Affairs 28: w490–w501. doi: 10.1377/hlthaff.28.3.w490
- 20. Allen LA, Woolfolk RL (2010) Cognitive behavioral therapy for somatoform disorders. Psychiatric Clinics of North America 33: 579–593. doi: 10.1016/j.psc.2010.04.014
- 21. Blankenstein AH (2001) Somatising patients in general practice: reattribution, a promising approach. Amsterdam: Vrije Universiteit Amsterdam
- 22. Larisch A, Schweickhardt A, Wirsching M, Fritzsche K (2004) Psychosocial interventions for somatizing patients by the general practitioner: a randomized controlled trial. Journal of psychosomatic research 57: 507–514. doi: 10.1016/j.jpsychores.2004.04.372
- 23. Sumathipala A, Siribaddana S, Abeysingha MRN, De Silva P, Dewey M, et al. (2008) Cognitive behavioural therapy v. structured care for medically unexplained symptoms: randomised controlled trial. The British Journal of Psychiatry 193: 51–59. doi: 10.1192/bjp.bp.107.043190
- 24. Morriss R, Dowrick C, Salmon P, Peters S, Dunn G, et al. (2007) Cluster randomised controlled trial of training practices in reattribution for medically unexplained symptoms. British Journal of Psychiatry 191: 536–542. doi: 10.1192/bjp.bp.107.040683
- 25. Aiarzaguena JM, Grandes G, Gaminde I, Salazar A, Sánchez Á, et al. (2007) A randomized controlled clinical trial of a psychosocial and communication intervention carried out by GPs for patients with medically unexplained symptoms. Psychological Medicine 37: 283–294. doi: 10.1017/s0033291706009536
- 26. Toft T, Rosendal M, Ørnbøl E, Olesen F, Frostholm L, et al. (2010) Training general practitioners in the treatment of functional somatic symptoms: effects on patient health in a cluster-randomised controlled trial (the Functional Illness in Primary Care Study). Psychotherapy and Psychosomatics 79: 227–237. doi: 10.1159/000313691
- 27. Arnold IA, De Waal MWM, Eekhof JAH, Assendelft WJJ, Spinhoven P, et al. (2009) Medically unexplained physical symptoms in primary care: a controlled study on the effectiveness of cognitive-behavioral treatment by the family physician. Psychosomatics 50: 515–524. doi: 10.1016/s0033-3182(09)70845-x
- 28. Rosendal M, Olesen F, Fink P, Toft T, Sokolowski I, et al. (2007) A randomized controlled trial of brief training in the assessment and treatment of somatization in primary care: effects on patient outcome. General Hospital Psychiatry 29: 364–373. doi: 10.1016/j.genhosppsych.2007.03.005
- 29. Salmon P, Peters S, Clifford R, Iredale W, Gask L, et al. (2007) Why do General Practitioners decline training to improve management of medically unexplained symptoms? Journal of General Internal Medicine 22: 565–571. doi: 10.1007/s11606-006-0094-z
- 30. Dowrick C, Gask L, Hughes JG, Charles-Jones H, Hogg JA, et al. (2008) General practitioners' views on reattribution for patients with medically unexplained symptoms: a questionnaire and qualitative study. BMC Family Practice 9: 46. doi: 10.1186/1471-2296-9-46
- 31. Peters S, Rogers A, Salmon P, Gask L, Dowrick C, et al. (2008) What do patients choose to tell their doctors? Qualitative analysis of potential barriers to reattributing medically unexplained symptoms. Journal of General Internal Medicine 24: 443–449. doi: 10.1007/s11606-008-0872-x
- 32. Deale A, Wessely S (2001) Patients' perceptions of medical care in chronic fatigue syndrome. Social Science and Medicine 52: 1859–1864. doi: 10.1016/s0277-9536(00)00302-6
- 33. Nordin TA, Hartz AJ, Noyes R, Anderson MC, Rosenbaum ME, et al. (2006) Empirically identified goals for the management of unexplained symptoms. Family Medicine 38: 476–482.
- 34. Speckens AEM, Van Hemert AM, Bolk JH, Hawton KE, Rooijmans HGM (1995) The acceptability of psychological treatment in patients with medically unexplained physical symptoms. Journal of Psychosomatic Research 7: 855–863. doi: 10.1016/0022-3999(95)00024-9
- 35. Van Rood YR, Ter Kuile MM, Speckens AEM (2001) Ongedifferentieerde somatoforme stoornis. In: Spinhoven P, Bouman TK, Hoogduin CAL, editors. Behandelingsstrategieën bij somatoforme stoornissen. Houten/Diegem: Bohn Stafleu Van Loghum. 17–40.
- 36. Van Rood Y, Visser S (2008) Principes van cognitieve gedragstherapie in de ggz. In: Van der Feltz-Cornelis C, Van der Horst H, editors. Handboek somatisatie: lichamelijk onverklaarde klachten in de eerste en tweede lijn. 2 ed.Utrecht: De Tijdstroom. 269–289.
- 37. Speckens AEM, Spinhoven P, Van Rood YR (1999) Protocollaire behandeling van patiënten met onverklaarde lichamelijke klachten: cognitieve gedragstherapie. In: Keijsers GPJ, Van Minnen A, Hoogduin CAL, editors. Protocollaire behandelingen in de ambulante geestelijke gezondheidszorg 2.Houten/Diegem: Bohn Stafleu Van Loghum. 199–236.
- 38. Zonneveld LNL (2005) Draaiboek ‘Omgaan met de gevolgen van onverklaarde lichamelijke klachten’. Vlaardingen/Rotterdam: Riagg Rijnmond/Erasmus MC Department of Medical Psychology and Psychotherapy.
- 39. Zonneveld LNL (2009) Group training for patients with unexplained physical symptoms. Nederlands Trial Register doi: 10.1186/1471-2458-9-251
- 40. Zonneveld LNL, Van 't Spijker A, Passchier J, Van Busschbach JJ, Duivenvoorden HJ (2009) The effectiveness of a training for patients with unexplained physical symptoms: protocol of a cognitive behavioral group training and randomized controlled trial. BMC Public Health 9: 251. doi: 10.1186/1471-2458-9-251
- 41. First MB, Spitzer RL, Gibbon M, Williams JBW (1999) Structured clinical interview for DSM-IV axis I disorders. Van Groenesteijn MAC, Akkerhuis GW, Kupka RW, Schneider N, Nolen WA, translator. Amsterdam: Harcourt Test Publishers.
- 42. Speckens AEM, Spinhoven P, Hawton KE, Bolk JH, Van Hemert AM (1996) Cognitive behavioural therapy for medically unexplained physical symptoms: a pilot study. Behavioural and Cognitive Psychotherapy 24: 1–16. doi: 10.1017/s1352465800016799
- 43. Sharpe M, Peveler R, Mayou RA (1992) The psychological treatment of patients with functional somatic symptoms: a practical guide. Journal of Psychosomatic Research 515–529. doi: 10.1016/0022-3999(92)90037-3
- 44. Peeters FPML, Bayer H (1999) ‘No show’ for initial screening at a community mental health centre: rate, reasons and further help-seeking. Social Psychiatry and Psychiatric Epidemiology 34: 323–327. doi: 10.1007/s001270050151
- 45. Longmore RJ, Worrell M (2007) Do we need to challenge thoughts in cognitive behavior therapy? Clinical Psychology Review 27: 173–187. doi: 10.1016/j.cpr.2006.08.001
- 46. Ware JE, Snow KK, Kosinski M, Gandek B (1993) SF-36 Health Survey: manual and interpretation Guide. Boston, MA: New England Medical Center, The Health Institute.
- 47. Ware JE, Kosinski M, Keller SD (1994) SF-36 Physical and Mental Health Summary Scales: a user's Manual. Boston, MA: New England Medical Center, The Health Institute.
- 48. Arrindell WA, Ettema JHM (2003) SCL-90/symptom checklist: handleiding bij een multidimensionele psychopathologie-indicator. Lisse: Swets Test Publishers.
- 49. Aberson CL (2010) Applied power analysis for the behavioral sciences. New York: Routledge.
- 50. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, et al. (2010) CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. British Medical Journal 340: c869. doi: 10.1136/bmj.c869
- 51. Cohen J (1992) A power primer. Psychological Bulletin 112: 155–159. doi: 10.1037//0033-2909.112.1.155
- 52. Zonneveld LNL, Duivenvoorden HJ, Passchier J, Van't Spijker A (2010) Tailoring a cognitive behavioural model for unexplained physical symptoms to patient's perspective: a bottom-up approach. Clinical Psychology and Psychotherapy 17: 528–535. doi: 10.1002/cpp.685
- 53. Jackson JL, Passamonti M (2005) The outcomes among patients presenting in primary care with a physical symptom at 5 years. Journal of General Internal Medicine 20: 1032–1037. doi: 10.1111/j.1525-1497.2005.0241.x
- 54. Kooiman CG, Bolk JH, Rooijmans HGM, Trijsburg RW (2004) Alexithymia does not predict the persistence of medically unexplained physical symptoms. Psychosomatic Medicine 66: 224–232. doi: 10.1097/01.psy.0000116714.38868.06
- 55. Speckens AEM, Van Hemert AM, Bolk JH, Rooijmans HGM, Hengeveld MW (1996) Unexplained physical symptoms: outcome, utilization of medical care and associated factors. Psychological Medicine 26: 745–752. doi: 10.1017/s0033291700037764
- 56. Arnold IA, De Waal MWM, Eekhof JAH, Van Hemert AM (2006) Somatoform disorder in primary care: course and the need for cognitive-behavioral treatment. Psychosomatics 47: 498–503. doi: 10.1176/appi.psy.47.6.498
- 57. Fink P, Rosendal M (2008) Recent developments in the understanding and management of functional somatic symptoms in primary care. Current Opinion in Psychiatry 21: 182–188. doi: 10.1097/yco.0b013e3282f51254
- 58. APA (2012) DSM-5 Web site. Arlington, VA: American Psychiatric Association.
- 59. Löwe B, Spitzer RL, Williams JBW, Mussell M, Schellberg D, et al. (2008) Depression, anxiety and somatization in primary care: syndrome overlap and functional impairment. General Hospital Psychiatry 30: 191–199. doi: 10.1016/j.genhosppsych.2008.01.001
- 60. Henningsen P, Zimmermann T, Sattel H (2003) Medically unexplained physical symptoms, anxiety, and depression: a meta-analytic review. Psychosomatic Medicine 65: 528–533. doi: 10.1097/01.psy.0000075977.90337.e7
- 61. Noyes R, Langbehn DR, Happel RL, Stout LR, Muller BA, et al. (2001) Personality dysfunction among somatizing patients. Psychosomatics 42: 320–329. doi: 10.1176/appi.psy.42.4.320
- 62. Garyfallos G, Adamopoulou A, Karastergiou A, Voikli M, Ikonomidis N, et al. (1999) Somatoform disorders: comorbidity with other DSM-III-R psychiatric diagnoses in Greece. Comprehensive Psychiatry 40: 299–307. doi: 10.1016/s0010-440x(99)90131-1
- 63. Leibbrand R, Hiller W, Fichter MM (1999) Effect of comorbid anxiety, depressive, and personality disorders on treatment outcome of somatoform disorders. Comprehensive Psychiatry 40: 203–209. doi: 10.1016/s0010-440x(99)90004-4
- 64. Katon WJ, Ries RK, Kleinman A (1984) Part II: a prospective DSM-III study of 100 consecutive somatization patients. Comprehensive Psychiatry 25: 305–314. doi: 10.1016/0010-440x(84)90063-4
- 65. Uguz F, Engin B, Yilmaz E (2008) Axis I and Axis II diagnoses in patients with chronic idiopathic urticaria. Journal of Psychosomatic Research 64: 225–229. doi: 10.1016/j.jpsychores.2007.08.006
- 66. Garcia-Campayo J, Alda M, Sobradiel N, Olivan B, Pascual A (2007) Personality disorders in somatization disorder patients: a controlled study in Spain. Journal of Psychosomatic Research 62: 675–680. doi: 10.1016/j.jpsychores.2006.12.023
- 67. Maina G, Albert U, Gandolfo S, Vitalucci A, Bogetto F (2005) Personality disorders in patients with burning mouth syndrome. Journal of Personality Disorders 19: 84–93. doi: 10.1521/pedi.184.108.40.206182
- 68. Henderson M, Tannock C (2004) Objective assessment of personality disorder in chronic fatigue syndrome. Journal of Psychosomatic Research 56: 251–254. doi: 10.1016/s0022-3999(03)00571-3
- 69. Dammen T, Ekeberg Ø, Arnesen H, Friis S (2000) Personality profiles in patients referred for chest pain: investigation with emphasis on panic disorder patients. Psychosomatics 41: 269–276. doi: 10.1176/appi.psy.41.3.269
- 70. Rost KM, Akins RN, Brown FW, Smith GR (1992) The comorbidity of DSM-III-R personality disorders in somatization disorder. General Hospital Psychiatry 14: 322–326. doi: 10.1016/0163-8343(92)90066-j
- 71. Bornstein RF, Gold SH (2008) Comorbidity of personality disorders and somatization disorder: a meta-analytic review. Journal of Psychopathology and Behavioral Assessment 30: 154–161. doi: 10.1007/s10862-007-9052-2
- 72. Kathol RG, Butler M, McAlpine DD, Kane RL (2010) Barriers to physical and mental condition integrated service delivery. Psychosomatic Medicine 72: 511–518. doi: 10.1097/psy.0b013e3181e2c4a0
- 73. Kroenke K, Swindle R (2000) Cognitive-behavioral therapy for somatization and symptom syndromes: a critical review of controlled clinical trials. Psychotherapy and psychosomatics 69: 205–215. doi: 10.1159/000012395
- 74. Arnold IA, Speckens AEM, Van Hemert AM (2004) Medically unexplained physical symptoms: the feasibility of group cognitive-behavioural therapy in primary care. Journal of Psychosomatic Research 57: 517–520. doi: 10.1016/j.jpsychores.2004.04.369
- 75. Lacy NL, Paulman A, Reuter MD, Lovejoy B (2004) Why we don't come: patient perceptions on no-shows. Annals of family medicine 2: 541–545. doi: 10.1370/afm.123
- 76. Halm EA, Lee C, Chassin MR (2002) Is volume related to outcome in health care? A systematic review and methodologic critique of the literature. Annals of Internal Medicine 137: 511–520. doi: 10.7326/0003-4819-137-6-200209170-00012