Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Economic evaluation of multidisciplinary rehabilitation treatment versus cognitive behavioural therapy for patients with chronic fatigue syndrome: A randomized controlled trial

  • Desirée Vos-Vromans ,

    Contributed equally to this work with: Desirée Vos-Vromans, Silvia Evers, Ivan Huijnen, André Knottnerus, Rob Smeets

    d.vos@revant.nl

    Affiliation Revant Rehabilitation Centres, Breda, The Netherlands

  • Silvia Evers ,

    Contributed equally to this work with: Desirée Vos-Vromans, Silvia Evers, Ivan Huijnen, André Knottnerus, Rob Smeets

    Affiliations Department of Health Services Research, Research School CAPHRI Maastricht University, Maastricht, The Netherlands, Trimbos Institute, National Institute of Mental Health and Addiction, Utrecht, The Netherlands

  • Ivan Huijnen ,

    Contributed equally to this work with: Desirée Vos-Vromans, Silvia Evers, Ivan Huijnen, André Knottnerus, Rob Smeets

    Affiliations Department of Rehabilitation Medicine, Research School CAPHRI Maastricht University, Maastricht, The Netherlands, Department of Rehabilitation Medicine, Academic Hospital Maastricht, Maastricht, The Netherlands, Adelante Centre of Expertise in Rehabilitation and Audiology, Hoensbroek, The Netherlands

  • Albère Köke ,

    ‡ These authors also contributed equally to this work.

    Affiliation Adelante Centre of Expertise in Rehabilitation and Audiology, Hoensbroek, The Netherlands

  • Minou Hitters ,

    ‡ These authors also contributed equally to this work.

    Affiliation Libra Rehabilitation and Audiology, Eindhoven, The Netherlands

  • Nieke Rijnders ,

    ‡ These authors also contributed equally to this work.

    Affiliation Revant Rehabilitation Centres, Breda, The Netherlands

  • Menno Pont ,

    ‡ These authors also contributed equally to this work.

    Affiliation Reade Centre of Rheumatology and Rehabilitation, Amsterdam, The Netherlands

  • André Knottnerus ,

    Contributed equally to this work with: Desirée Vos-Vromans, Silvia Evers, Ivan Huijnen, André Knottnerus, Rob Smeets

    Affiliation Department of General Practice, Research School CAPHRI Maastricht University, Maastricht, The Netherlands

  • Rob Smeets

    Contributed equally to this work with: Desirée Vos-Vromans, Silvia Evers, Ivan Huijnen, André Knottnerus, Rob Smeets

    Affiliations Department of Rehabilitation Medicine, Research School CAPHRI Maastricht University, Maastricht, The Netherlands, Department of Rehabilitation Medicine, Academic Hospital Maastricht, Maastricht, The Netherlands, Libra Rehabilitation and Audiology, Eindhoven, The Netherlands

Abstract

Background

A multi-centre RCT has shown that multidisciplinary rehabilitation treatment (MRT) is more effective in reducing fatigue over the long-term in comparison with cognitive behavioural therapy (CBT) for patients with chronic fatigue syndrome (CFS), but evidence on its cost-effectiveness is lacking.

Aim

To compare the cost-effectiveness of MRT versus CBT for patients with CFS from a societal perspective.

Methods

A multi-centre randomized controlled trial comparing MRT with CBT was conducted among 122 patients with CFS diagnosed using the 1994 criteria of the Centers for Disease Control and Prevention and aged between 18 and 60 years. The societal costs (healthcare costs, patient and family costs, and costs for loss of productivity), fatigue severity, quality of life, quality-adjusted life-year (QALY), and cost-effectiveness ratios (ICERs) were measured over a follow-up period of one year. The main outcome of the cost-effectiveness analysis was fatigue measured by the Checklist Individual Strength (CIS). The main outcome of the cost-utility analysis was the QALY based on the EuroQol-5D-3L utilities. Sensitivity analyses were performed, and uncertainty was calculated using the cost-effectiveness acceptability curves and cost-effectiveness planes.

Results

The data of 109 patients (57 MRT and 52 CBT) were analyzed. MRT was significantly more effective in reducing fatigue at 52 weeks. The mean difference in QALY between the treatments was not significant (0.09, 95% CI: -0.02 to 0.19). The total societal costs were significantly higher for patients allocated to MRT (a difference of €5,389, 95% CI: 2,488 to 8,091). MRT has a high probability of being the most cost effective, using fatigue as the primary outcome. The ICER is €856 per unit of the CIS fatigue subscale. The results of the cost-utility analysis, using the QALY, indicate that the CBT had a higher likelihood of being more cost-effective.

Conclusions

The probability of being more cost-effective is higher for MRT when using fatigue as primary outcome variable. Using QALY as the primary outcome, CBT has the highest probability of being more cost-effective.

Trial registration

ISRCTN77567702.

Introduction

Chronic fatigue syndrome (CFS) is defined as medically unexplained disabling fatigue that persists for more than six months, often leading to decreased quality of life, restrictions in personal and social activities and a limited ability to work [1,2]. The prevalence of CFS is estimated between 0.2–2.6% worldwide [3]. However, the burden of CFS to society has been measured only in a few countries. In the United States, the annual direct total costs per patient were estimated to be between $2,342 and $8,675 depending on the sample used [4,5]. Annual total losses of productivity per patient in the US were estimated at $20,000 [6]. In another study, based on a sample in the United Kingdom, annual productivity losses per patient were estimated at £22,684 [7]. In the Netherlands annual costs for the healthcare of patients with unexplained physical symptoms, including CFS, were estimated at €3,123 per patient [8]. These costs, together with annual work-related costs and paid substitution for doing domestic tasks were estimated at €6,815 per patient [8]. Although this study involved patients with a variety of unexplained physical symptoms, it provides an indication of the high economic burden and the need to investigate new treatments and their benefits for the patient and society. One commonly used treatment with evidence supporting its effectiveness and cost-effectiveness is cognitive behavioural therapy (CBT) [9]. Previous studies showed that CBT is a cost-effective treatment when compared with guided support groups [10,11], specialist medical care or adaptive pacing therapy [10,12]. QALY is a commonly used summary measure of health-related quality of life, taking account of both quality and quantity of life. One QALY equates to living one year in perfect health. When fatigue is the primary outcome, CBT is equally cost-effective as counseling [13] and more cost-effective in comparison with guided support groups or a natural course group [11]. To further improve effectiveness, it has been advocated to investigate multidisciplinary treatments that include CBT in combination with other interventions [9]. In response to this recommendation a multidisciplinary rehabilitation treatment (MRT) was developed and studied in a randomized controlled trial (RCT), comparing MRT with CBT [14]. The results of that trial revealed that one year after start of treatment, MRT was more effective in reducing the severity of fatigue, in comparison with CBT (P = 0.02) [14]. No statistically significant differences in quality of life were found between MRT and CBT. Studies investigating the cost-effectiveness of MRT for patients with CFS are scarce. The only study investigating the cost-effectiveness of a rehabilitation treatment is the Fatigue Intervention by Nurses Evaluation (FINE) trial [15]. This trial compared a rehabilitation treatment with supportive listening and treatment as usual. The rehabilitation treatment in the FINE trial was a mono-disciplinary treatment with other treatment modalities as provided in MRT. Results of the FINE trial indicated that pragmatic rehabilitation was not cost-effective when looking at the costs per QALY measured by the EuroQol-5D-3L (EQ-5D-3L). The rehabilitation treatment studied in the FINE trial was different and not comparable to MRT, making it difficult to generalize the results of the FINE trial to all rehabilitation treatments. The need to study the cost-effectiveness remained. Therefor as an integral part of the RCT, the cost-effectiveness was analyzed. The aim of the present study is to report the cost-effectiveness and cost-utility from a societal perspective comparing MRT and CBT. For the cost-utility the QALY, generated from the standard Dutch version of the EQ-5D-L, was used. The EQ-5D-3L, which is a generic measure, assesses five domains of the quality of life, with only three scoring levels. Recently, in studies of patients with chronic illnesses in which fatigue is a common complaint, the use of disease-specific outcome measures in addition to generic measures is advised, since the generic measures might not be sensitive enough to measure change after treatment [1618]. To provide a more disease-specific outcome, the fatigue severity measured by the Checklist Individual Strength (CIS) [19], subscale fatigue and quality of life measured with the Short-Form 36 (SF-36) [20] were included. Studies regarding the cost-effectiveness of MRT or MRT in comparison with CBT have never been done. The aim of the present study is to report the cost-effectiveness and cost-utility from a societal perspective comparing MRT and CBT in terms of reduction in fatigue and gain in health-related quality of life and gains in QALYs over one year. It is hypothesised that MRT is more cost-effective and shows a higher cost-utility compared with CBT [14].

Methods

Study design and participants

This multi-centre, two-arm RCT was registered in the ISRCTN database (Trial Registration Number: ISRCTN77567702). A detailed description of the design of the trial has been published elsewhere [21]. The S1 File represents the design of the trial. Patients referred to four rehabilitation centres (secondary healthcare) in the Netherlands: the Revant Rehabilitation Centres (location Breda), Libra Rehabilitation and Audiology in Eindhoven, Reade Centre for Rheumatology and Rehabilitation in Amsterdam and Adelante Rehabilitation Centre in Hoensbroek between December 2008 and January 2011 were invited to participate if they met the US Centers for Disease Control and Prevention (CDC-94) criteria for CFS [1]. Other inclusion criteria were: a CIS fatigue subscale score of 40 or more [22,23], willingness to participate in a treatment aimed at changing behaviour, age between 18 and 60 years, and comprehension of written and verbal Dutch. Patients were excluded if they suffered from a medical condition explaining the presence of chronic fatigue, had a psychiatric or depressive disorder, dementia, anorexia, bulimia nervosa, alcohol and/or drug abuse, a body mass index of 45 or more, or were pregnant. Patients who had already received CBT or MRT for CFS in the past, or had to travel more than one hour to the nearest participating rehabilitation centre, were also excluded. Outcomes were assessed at baseline, 4, 14, 26 weeks (directly after end of treatment) and 52 weeks after start of treatment. After baseline, patients were randomized to CBT or MRT. An economic evaluation study consisting of a cost-effectiveness analysis (primary outcome: fatigue) and a cost-utility analysis (primary outcome: QALY) was embedded in the RCT. All patients provided written informed consent. The Research Ethics Committee of Rotterdam, TWOR (reference 2008/22) approved the study on 27 November 2008. The CONSORT and CHEERS checklists of the trial are listed in S2 and S3 Files.

Interventions

In MRT, a consultant in rehabilitation medicine, social worker, psychologist, physical therapist and occupational therapist worked as an interdisciplinary team together with the patient for 6 months. The protocol prescribed a total of 44.5 face-to-face contact hours. Gradual reactivation, pacing, mindfulness, body awareness therapy, normalising sleep-wake rhythm and social reintegration were combined with CBT and tailored to the individual needs and goals of the patient.

CBT is a psychotherapeutic approach in which elements of behavioural and cognitive therapy approaches are incorporated to change behavioural and cognitive factors, which are assumed to perpetuate the symptoms of CFS [24]. CBT was delivered by a psychologist or cognitive behavioural therapist. The protocol of CBT prescribed a total of 16 face-to-face contact hours during 6 months. Both treatments aimed at decreasing the severity of fatigue and increasing quality of life. Treatments have been described earlier [14].

Outcome measures

Effects.

For the cost-effectiveness analysis, the primary outcome is fatigue severity, which was measured by the CIS fatigue subscale (CIS fatigue; score ranging from 8–56, lower scores indicate less fatigue) [19]. In the cost-effectiveness analyses the CIS fatigue scores were recoded: a higher score indicates a more positive effect (less fatigue). In using the CIS fatigue subscale, there are different methods for defining improvement. One is to change the CIS score to a dichotomous variable of improvement (CIS improvement). A score lower than 35 on the CIS fatigue subscale was labelled as improved [25]. A higher score was labelled as not improved.

For the utility analysis, QALYs were generated from the standard Dutch version of the EQ-5D-3L [26]. The EQ-5D-3L contains five dimensions of health-related quality of life: mobility, self-care, daily activities, pain/discomfort and depression/anxiety. Each dimension can be rated on one of three levels: no problem, some problems and major problems. The five dimensions were aggregated into a health state. Utility values were calculated for these health states, using preferences elicited from a general population from the UK, the so-called Dolan algorithm [27]. Utilities were calculated for every assessment. The accrual of QALYs from baseline to the 52 week follow-up was calculated using the area under the curve, assuming a linear change between each available time point.

As a secondary outcome for the cost-effectiveness and cost-utility analyses, health-related quality of life was measured by the SF-36 [20]. The SF-36 has 8 subscales which were combined in two summary scores; the mental (MCS) score and the physical component summary score (PCS). The outcomes at the 52 week follow-up were used in the cost-effectiveness analysis. To measure the opinion of the patient regarding his/her improvement, the patient was asked to fill in the Improvement and satisfaction questionnaire (EET). Question 4 of the EET: “Is there a difference in your daily activities now compared to your situation before treatment started”, was used in the sensitivity analysis to give an indication of the extent to which a patient feels he or she has improved [14].

Costs.

Costs from a societal perspective were registered from baseline until 52 weeks after baseline. These costs included healthcare costs, patient and family costs, and costs coming from productivity losses. Healthcare costs included costs for all healthcare services including costs for the interventions and costs for all medication (including over the counter medication). Patient and family costs included travelling costs to all healthcare institutions, parking costs for the visits to the hospital and domestic help which would be normally done by the patient her/himself and unpaid informal care provided by family or other unpaid people. Productivity losses were measured by costs of absenteeism of work. Table 1 shows the categories identified. The Trimbos/iMTA questionnaire for Costs associated with Psychiatric Illness (TiC-P) was used to measure the costs of healthcare, patient and family and productivity losses [28]. TiC-P, part I, a questionnaire on absence from work, informal care and domestic help, was filled in every month. TiC-P, part II, a questionnaire on healthcare costs was filled in every three months.

The valuation of healthcare costs and the patient and family costs was based on the updated Dutch manual for cost analysis in healthcare research [29,30]. Costs were indexed to the year 2012 by means of the consumer price indexes of the Dutch Central Bureau of Statistics. For care for which no costs-guidelines were available, estimations of the costs were made based on the real costs or on population-based estimates from literature. Table 1 shows the costs per identified category. Medication costs were based on the tariffs from the Dutch College of Health Insurance (www.medicijnkosten.nl). Treatment hours for MRT and CBT were registered by the therapist and the consultant in rehabilitation medicine after each treatment session. The duration of the treatment sessions was added up and costs calculated using the Dutch diagnosis-dependent treatment combination for cost-pricing the interventions (www.dbconderhoud.nl). Following this procedure, the following costs per treatment category were used: 0–2 hours of outpatient rehabilitation treatment €200, 2–6 hours of treatment €539, 6–18 hours €1,364, 18–49 hours €3,557, 49–129 hours €8,620, 129–299 hours €19,392, 299 hours and more €37,268.

To value the travelling costs, the number of visits to the healthcare services was multiplied by the mean distance and then multiplied by the costs per kilometre [29]. An assumption of 26.4 kilometres was made for the mean distance to a rehabilitation centre. This assumption is based on the ratio between number of hospitals divided by the number of rehabilitation centres in the Netherlands, multiplied by the mean distance between a hospital and a patient’s home.

Every month the patient reported the days lost from work due to fatigue as well as his/her wages (TiC-P, part II). Following the human capital approach, the total hours of absenteeism was multiplied by the hourly wages and afterwards multiplied by a factor of 0.8. The 0.8 factor is a correction because productivity in the Netherlands decreases by a factor of 0.8 as working hours decrease due to absenteeism [29]. The national mean age and gender-specific wages were used when the patient preferred not to fill in his/her wages.

Statistical methods

An intention-to-treat analysis was used, which means the data of all patients initially assigned to a treatment were analysed, regardless of whether or not they completed or received the treatment. Patients were included in the cost-effectiveness analysis if they filled in 75% of all 16 TiC-P questionnaires: otherwise they were excluded from the analyses. Any remaining missing values in the TiC-P questionnaires were imputed by using the last observation carried forward. If variables from the previous time period were missing, the last observation carried backward was used. If variables were missing in every monthly or 3-monthly questionnaire of a participant, the averages of the analysed participants were used.

Effectiveness analysis.

Baseline differences between CBT and MRT of the primary and secondary outcomes were calculated using t-tests. The longitudinal effect of MRT versus CBT on the outcomes was assessed using linear mixed models, fit using restricted maximum likelihood [14]. Along with treatment allocation, time (in weeks from baseline), and interaction of time by treatment allocation, rehabilitation centre was included as a fixed factor, because randomization was stratified by centre. Choice of the best-fitting covariance structure, i.e. structure of variances over different time-points and correlations between time-points, was based on Akaike’s Information Criterion. Two-sided P-values smaller than or equal to 0.05 were considered statistically significant. No missing outcome data were imputed for these linear mixed models, instead the likelihood approach was used. Analyses were performed using SPSS Statistics for Windows (version 20.0; IBM Corp., Armonk, NY, USA.).

Cost-effectiveness analysis.

The costs from a societal perspective during the follow-up period of 52 weeks were cumulated and the total costs from the two intervention groups were compared by the non-parametric bootstrapping method with 95% confidence intervals in percentiles [31]. Base-case cost-effectiveness and cost-utility analyses and sensitivity analyses were done. In the base-case analysis, the cost-effectiveness was performed by relating the mean total costs to the severity of fatigue and quality of life at 52 weeks. Severity of fatigue and quality of life are adjusted for baseline values. Costs are the total costs from baseline until 52 weeks follow-up. A cost-utility analysis was performed by relating the mean total costs to the mean health utility (QALY) scores of both groups. The costs per QALY of both treatments were compared. The incremental cost-effectiveness ratio (ICER) was determined on the basis of incremental costs and the effects of the MRT in comparison with CBT. The cost-effectiveness ratio presented the costs per unit of outcome and the cost-utility ratio focused on the incremental cost per QALY gained. The robustness of the ICER was checked by non-parametric bootstrapping to quantify the uncertainty around the ICER. The bootstrapped cost-effectiveness ratios were subsequently plotted in a cost-effectiveness plane. The choice of treatment depends on the maximum amount of money society is prepared to pay for a gain in effectiveness, which is called the ceiling ratio. In the Netherlands, no explicit ceiling ratio or ICER threshold value is defined, but the Council of Public Health and Health Care advised using a ceiling ratio for the QALY related to the burden of disease [32]. The burden of disease ranges from ‘0’, indicating no burden of disease, to a score of ‘1’, indicating a maximum burden of disease. Although the exact burden of disease for patients with CFS is unknown, NICE guidelines for the treatment of CFS declare the burden of disease to be comparable with other chronic conditions such as multiple sclerosis and rheumatoid arthritis [33]. A more recent study [8] showed that the burden of disease among patients with unexplained physical symptoms, including CFS, is high and comparable with major depression and cancer. A report issued in 1998 from the National Institute for Public Health and the Environment (RIVM) [34] describes the burden of disease for different illnesses: for example, the burden of disease for multiple sclerosis is between 0.33 and 0.67, which is comparable with moderate to severe depression (burden of disease 0.35–0.76). Since the exact burden of disease of CFS is unknown, the burden is estimated to be between 0.33 and 0.76. Following the report “Zinnige en duurzame zorg” (“Sensible and sustainable care”) from the Council of Public Health and Health Care [32], the estimated willingness to pay for treatment for patients with CFS lies between €27,000 to €60,000 for one QALY. The bootstrapped ICERs were depicted in cost-effectiveness and cost-utility acceptability curves showing the probability that MRT is cost-effective while using a range of ceiling ratios. Costs, cost-effectiveness, cost-utility and sensitivity analyses were carried out using Microsoft Office Excel 2003.

Sensitivity analysis.

Finally, different sensitivity analyses were performed to demonstrate the robustness of our base-case findings. Sensitivity analyses were performed by varying different parameters on which assumptions were made. The following sensitivity analyses were performed: (1a-b) Costs were calculated using the friction cost method instead of the human capital approach and (2a-b) costs were calculated from a healthcare perspective instead of a societal perspective. During the base-case analysis it was noticed that as patients had to fill in their hours of absence while reintegrating or working part-time due to their illness, inconsistencies were found within the answers. Assumptions had to be made in order to calculate the correct hours of absence. The estimated minimum hours of absence was used in the base-case analysis. The estimated maximum hours of absence was used in sensitivity analysis (3a-b). To analyse whether results of the base case analyses regarding the disease-specific outcome were the same using another outcome, sensitivity analyses 4 and 5 were performed. In sensitivity analysis 4, an overall improvement score was used. Improvement was measured by the Improvement and satisfaction questionnaire (EET), question 4 “Is there a difference in your daily activities now compared to your situation before treatment started? (‘1’ = improved and ‘0’ = not improved) [14]. (5) In the base case the incremental costs per unit of outcome on the CIS fatigue subscale were calculated. Since a 1-point improvement is not considered to be a clinically significant improvement, a sensitivity analysis was performed in which the improvement was calculated using the CIS fatigue subscale as dichotomous variable of improvement. Previous studies [23,25] used the CIS cut-off score of 35 to measure clinically significant improvement [35]. Finally, a sensitivity analysis (6) was performed using the Dutch algorithm instead of the UK algorithm to calculate the QALY.

Results

122 participants were included in the trial and completed the baseline assessment (Fig 1). Of these 122, 62 participants were randomised to MRT and 60 to CBT. The treatment effects of the 122 patients included have been described previously in the study of Vos-Vromans et al. [14]. Less than 75% of the questionnaires of the TiC-P were available from 13 patients (5 MRT and 8 CBT) and were therefore excluded from further analysis (Fig 1). 109 patients (57 MRT and 52 CBT) remained in the analysis. Of 1,744 questionnaires, 17 were incomplete or missing and were imputed (4 TiC-P part I, 13 TiC-P part II) using the above-mentioned method of imputation. Patient characteristics at baseline in the MRT group did not significantly differ from those in the CBT group. Table 2 shows the baseline characteristics of all participants stratified according to their intervention group.

thumbnail
Fig 1. CONSORT flow diagram.

CFS = chronic fatigue syndrome, CIS = Checklist Individual Strength, MRT = Multidisciplinary rehabilitation treatment, CBT = Cognitive behavioural therapy, BMI = Body Mass Index, TiC-P = Trimbos/iMTA questionnaire for Costs associated with Psychiatric Illness.

https://doi.org/10.1371/journal.pone.0177260.g001

Differences in effects between MRT versus CBT

Table 3 shows the treatment effect of MRT versus CBT. The estimated effect of MRT in comparison with CBT is -6.48 (95% CI: -11.54 to -1.42). At 52 weeks fatigue is significantly lower in patients from the MRT group in comparison with CBT. The estimated effect of MRT in comparison with CBT on quality of life is 3.53 (95% CI: -0.67 to 7.74) and 1.36 (95% CI: -2.28 to 5.00) for the PCS and MCS, respectively. The estimated effect for the QALY is 0.09 (95% CI: -0.02 to 0.19).

Differences in costs between MRT versus CBT

The mean costs per treatment group are presented in Table 4. Healthcare costs are significantly higher for the MRT group compared to the CBT group (difference €5,681, 95% CI: €4,632 to €6,793). Patient and family costs are not significantly different between MRT and CBT (difference -€1,457, 95% CI: -€3,470 to €146). As part of the productivity costs is due to absenteeism, patients were able to fill in questions regarding loss of productivity while at work. During analyses it was noticed that it was not always clear to the patient whether or not to fill in this part of the questionnaire, making this part less reliable. Therefore loss of productivity while at work was excluded from analysis. Productivity costs due to absenteeism are not significantly different between the MRT and CBT groups (difference €1,263, 95% CI: €-667 to €3,146). The total societal costs are significantly higher for patients allocated to MRT in comparison with CBT (difference €5,389, 95% CI: €2,488 to €8,091).

Cost-effectiveness and cost-utility from a societal perspective

Figs 2 and 3 present the cost-effectiveness acceptability curves of the base-case cost-effectiveness and cost-utility analysis. In the cost-effectiveness analysis, the slope of the MRT acceptability curves for fatigue and quality of life are steep and increase instantly to a 94–99% likelihood of being a more cost-effective option from a societal perspective. The ICER is €856 per unit of the CIS fatigue subscale, meaning that the costs for improvement on the CIS fatigue subscale are low. For the SF-36 PCS and MCS the ICER is €1,505 and €6,416, respectively. In the cost-utility analysis, considering a threshold of €27,000 per QALY, MRT has a 5% likelihood of being more cost-effective from a societal perspective. When changing the threshold to €60,000, MRT has a 29% likelihood of being more cost-effective. The ICER is €11,8074 per QALY, meaning that the costs per QALY gained are high. Table 5 shows the cost-effectiveness and cost-utility results with the different ICER values. Cost-effectiveness and cost-utility planes are shown in Figs 4 and 5. The x axis represents the incremental level of effectiveness of the outcome and the y axis represents the additional total costs. Both figures show a higher additional effect and higher additional total costs of MRT versus CBT.

thumbnail
Fig 2. Acceptability curves of the cost-effectiveness (outcome CIS fatigue and SF-36) at 52 weeks follow-up.

SA = Sensitivity analysis, CEA = Cost-effectiveness analysis, CIS = Checklist Individual Strength, SF-36 = Short-form 36, PCS = Physical component summary score, MCS = Mental component summary score.

https://doi.org/10.1371/journal.pone.0177260.g002

thumbnail
Fig 3. Acceptability curves of cost-utility (QALY) at 52 weeks follow-up.

SA = Sensitivity analysis, CUA = Cost-utility analysis, QALY = Quality-adjusted life-year.

https://doi.org/10.1371/journal.pone.0177260.g003

thumbnail
Fig 4. Cost-effectiveness plane (primary outcome: CIS fatigue).

CIS = Checklist Individual Strength.

https://doi.org/10.1371/journal.pone.0177260.g004

thumbnail
Fig 5. Cost-utility plane (primary outcome: QALY).

QALY = Quality-adjusted life-year.

https://doi.org/10.1371/journal.pone.0177260.g005

thumbnail
Table 5. Mean total costs and group differences at 52 weeks after baseline (N = 109).

https://doi.org/10.1371/journal.pone.0177260.t005

Sensitivity analyses

Table 5 shows the mean costs per treatment group for the different costs and effect scenarios used in the base-case and sensitivity analyses. In all scenarios, MRT has the highest mean costs. Only small differences exist between the different methods of costing, except for the friction method. Using the friction method for costing productivity losses, the costs in both treatment groups decreased: 26% in MRT and 22% in CBT, respectively. Varying the cost or QALY outcome parameters revealed similar results for the base-case and sensitivity analyses. In the utility analysis CBT is still the most favourable treatment and in the cost-effectiveness analysis the MRT is the most favourable treatment. As shown in Figs 2 and 3, the sensitivity analyses did not have a large impact on the results of the cost-utility acceptability curves. When looking at the different scales for improvement (sensitivity analyses 4 and 5) (Fig 6), the probability of MRT being more cost-effective is higher in comparison with CBT. Since we do not know exactly how much society is willing to pay for an improved patient, the probability of MRT being cost-effective is unknown.

thumbnail
Fig 6. Acceptability curves (sensitivity analysis) of cost-effectiveness (outcome improvement on CIS and EET) at 52 weeks follow-up.

SA4 = Sensitivity analysis 4, EET = Improvement and satisfaction questionnaire, question 4 “Is there a difference in your daily activities now, CIS = Checklist Individual Strength.

https://doi.org/10.1371/journal.pone.0177260.g006

Discussion

As a part of the RCT studying the difference in effectiveness of MRT compared to CBT, an economic evaluation was executed to assess the difference in cost-effectiveness and cost-utility between MRT and CBT. To our knowledge, an economic study comparing CBT and MRT has never been done. Due to limited resources and the high demands on healthcare, economic evaluations have an important role in decisionmaking and health policy. Policy makers need to make decisions on how to optimize the allocation of available resources; accordingly, this study is important for policy makers as well as for patients, physicians and therapists.

MRT is more likely to be cost-effective in regard to the disease-specific outcomes fatigue severity and the physical and mental components of health-related quality of life. CBT is more likely to be cost-effective when QALYs are the outcome of interest.

Cost-effectiveness and cost-utility

Cost-effectiveness was analysed from a societal perspective over a period of 52 weeks after baseline. Societal costs, which were mainly dominated by the costs of the intervention, were significantly higher in the MRT group in comparison with the CBT group. While MRT was associated with statistically significant improvements in disease-specific health status, this was not reflected in generic health status. The incremental effect of MRT was higher for fatigue and quality of life measured by the SF-36 and lower for the QALY. This led to contradictory results in the cost-effective and cost-utility analyses. In all cost-effectiveness base-case and sensitivity analyses, MRT was the most efficient strategy for treating patients with CFS. In all cost-utility analyses, CBT turned out to be the most cost-efficient strategy for treatment. The latter results were also found in studies comparing CBT with other treatments or with a natural course group [10,11,36]. Due to higher costs for the MRT intervention together with similar effects on the QALY, the incremental costs for a QALY are much higher for MRT in comparison with CBT. The results of the cost-effectiveness analysis are different from the results of the cost-utility analysis. The question arises whether our findings reflect an absence of a clinically significant treatment effect or, alternatively, a lack of sensitivity of the generic quality of life measures to detect a clinically meaningful improvement in patients with CFS. Differences between generic health-related quality of life measures and disease-specific measures have been discussed in previous research [3739]. In patients who are chronically ill, treatments like MRT often focus on improving autonomy and the patient’s participation in society. Neither of these domains is not included in the EQ-5D-3L. Future studies should assess the extent to which differences in the EQ-5D-3L following treatment reconcile with improvements in disease-specific measurements for patients with CFS after treatment. In addition, as van Leeuwen et al. stated in their study in 2015 [40], the Adult Social Care Outcomes Toolkit and the ICEpop CAPability might also be valuable outcome measures in economic evaluations of care interventions because they are at least as reliable as the EQ-5D-3L and are associated with aspects of quality of life broader than health, for example occupation, dignity, control over daily life and the ability to ‘do’ and ‘be’ the things that are important in life [40].

Looking at the cost-effectiveness of treatment and considering improvement as the main outcome measure, cost-effectiveness increases in comparison with using the QALY in these analyses. But these criteria for improvement are based mainly on statistical methods and not on the patient’s own opinion. For further research, it is recommended that improvement be evaluated based on domains that are important for the individual patient and also to obtain insight into what society is willing to pay for an improved patient with CFS in order to facilitate cost-effectiveness analysis of treatments. During the process of deciding how resources are to be allocated, it is important to take into account both disease-specific and generic health status measurements, as an underestimation of the treatment effect might occur using only generic measurements.

Implementation of treatment

Based on the differences between the results of the cost-utility and cost-effectiveness analyses, discussion will occur regarding whether MRT should be implemented in other rehabilitation centres. The results of a multi-centre RCT [14] showed that, quality of life increases and fatigue decreases in both CBT and MRT. But over time MRT is more effective in decreasing fatigue compared with CBT. During the decisionmaking process regarding which treatment a patient will receive, this long-term effect is probably more important to the patient and the clinician than the fact that one of the two treatments has lower societal costs. Increasing the cost-effectiveness is important for clinicians and patients. Regarding this, it might be worthwhile to take other components into account when deciding to implement MRT as a potential treatment for patients with CFS in the Netherlands. The scarcity of effective treatments for patients with CFS and patient preferences are relevant issues when making healthcare decisions. At this moment there is a scarcity of effective treatments for patients with CFS [41], which might stimulate the implementation of MRT. Preferences of the patient should also be taken into account when making a healthcare decision. In this trial significantly more patients from the MRT group would recommend the treatment to others in comparison with patients from the CBT group [14], which might give an impression of the preferences of treatment for patients with CFS. Further research is needed on this topic. Another point which should be taken into account is the fact that costs for the MRT were probably overestimated since treatment was new. Costs for MRT might decrease as this treatment is executed more routinely and therapists are better skilled at treating patients more effectively. In a post-hoc analysis the first patients in the MRT group had significantly more contact hours compared to the patients who were included later in the trial. In CBT such development was not found. Additionally, costs of both interventions might become lower when therapists are able to decrease the number of sessions needed to achieve a patient’s personal goal or when specific interventions are not needed to achieve a patient’s goal. In clinical practice this is already the case, but due to the treatment protocols in this trial, in which a minimum number of hours of treatment were prescribed, this was not an option.

Future research

In the MRT and CBT interventions the societal costs are dominated by the costs for the intervention. Future research is needed to study how the interventions can be more cost-effective. It might be possible to offer parts of these interventions in groups of patients instead of to individuals, which will decrease costs of treatment. Another option to decrease the costs of MRT is to offer the patient fewer interventions or the same interventions less frequently, or to provide interventions in web-based programmes [42]. Whether the effect of treatment remains similar should be evaluated in future studies. Since productivity costs are highest in the MRT group, it is also worthwhile paying more attention to returning to work. In CBT returning to work is part of the protocol. In MRT returning to work is included in the treatment only if it is part of the patient’s personal goal. If not, returning to work is not part of the MRT procedure. In order to decrease the costs from a societal perspective, making ‘returning to work’ a fixed part of the MRT protocol is useful, despite the fact that it might not be a personal goal of the patient. Whether this changes the cost-effectiveness of treatment needs to be evaluated in future research.

Strengths and limitations

This trial has a number of strengths; in particular, internal validity is high due to randomization and concealed allocation procedures, a priori trial registration, intention to treat analysis and pre-specification of primary outcomes and analytic methods. However, data used in our analyses were derived from a single RCT, presenting a potential limitation to the generalizability of our findings. Furthermore, as only patients who were specifically referred for a treatment in secondary care were included, makes the results highly generalizable to daily care of patients with CFS. On the other hand, as 37 patients did not meet the CDC-94 criteria of CFS and were excluded before randomization, 54 patients were unwilling to participate in the trial, and the data of only 109 patient was used in the analysis should be taken into account when generalizing the results to the total population of patients with fatigue as a main complaint who are referred to secondary healthcare. In clinical practice CDC-94 criteria are not always used in deciding to treat patients in a rehabilitation centre. Furthermore, some patients were unwilling to participate in the trial, which can be seen as selection bias.

Other strengths are that we were able to recruit the intended number of patients based on the power analyses and the overall dropout rate was rather low, and several sensitivity analyses proved that the results are rather robust. Furthermore, all care-providers were well trained and overall the participating treatments centres showed similar treatment results.

However, there are some other limitations: First, we relied on self-reported information regarding healthcare, productivity losses and patient-family costs. There may be issues of accuracy with this approach, but it was largely unavoidable, given the impossibility of registering otherwise. Moreover, as these measurements were similar in both groups, these issues did not affect comparability. Other studies have shown that the method used is acceptable [43,44]. Second, the loss of productivity while being at work was not taken into account. Future studies should include loss of productivity while at work by using the TiC-P with an extra instruction to the patient on how and when to fill in this part of the questionnaire. Third, for some patients we had to impute data of the TiC-P, which can have influenced our results. Finally, the costs and effects were measured only during a period of 52 weeks. It is possible the costs and effects change after 52 weeks. This might lead to other conclusions regarding cost-effectiveness. For future research it would be interesting to perform the study over a longer period after ending the interventions.

Clinical implication

Although MRT is at long term more effective in reducing fatigue compared with CBT, the cost-effectiveness and cost-utility show mixed results making it difficult to provide clinical implications. More research is needed. It is a challenge for clinicians to improve and evaluate study how the interventions resulting in a less costly but at least equally effective treatment in order to improve the cost-effectiveness of both treatments.

Conclusion

Using fatigue severity as primary outcome for cost-effectiveness, MRT is more likely to be cost-effective in comparison with CBT. Considering the QALY, a generic quality of life measure, CBT is more cost-effective than MRT. To further improve the interpretation of cost-effectiveness analysis of treatments in patients with CFS it is important to clearly define criteria for improvement and how much money society is willing to pay for an improved patient.

Acknowledgments

We thank all the patients who took part in the trial and all the healthcare professionals, support staff and management of the participating rehabilitation centres. In particular we thank the research assistants Helmi van Hirtum, Arianne Vreugdenhil, Liesbeth van Tilborg, Lisette Kesteloo, Tonnie Dohmen, Annie Janssen, Petra de Jong, Ria Kusters and Aukje Andringa. We also thank the consultants in rehabilitation medicine Roelof Pol, Paul van Gorcom and Bas Bevaart and physician assistant Bettina Zwart.

Author Contributions

  1. Conceptualization: DVV SE IH A. Knottnerus RS.
  2. Data curation: DVV RS IH.
  3. Formal analysis: DVV IH SE RS A. Knottnerus.
  4. Funding acquisition: DVV RS A. Knottnerus.
  5. Investigation: DVV RS IH A. Köke MH NR MP.
  6. Methodology: DVV SE IH A. Knottnerus RS.
  7. Project administration: DVV.
  8. Resources: DVV RS A. Köke MH NR MP.
  9. Software: DVV IH SE.
  10. Supervision: DVV RS A. Knottnerus.
  11. Validation: DVV IH SE A. Knottnerus, RS.
  12. Visualization: DVV IH RS SE.
  13. Writing – original draft: DVV IH SE.
  14. Writing – review & editing: DVV RS IH A. Köke MH NR MP A. Knottnerus SE.

References

  1. 1. Fukuda K, Straus SE, Hickie I, Sharpe MC, Dobbins JG, Komaroff A (1994) The chronic fatigue syndrome: a comprehensive approach to its definition and study. International Chronic Fatigue Syndrome Study Group. Ann Intern Med 121: 953–959. pmid:7978722
  2. 2. Committee on the diagnostic criteria for myalgic encephalomyelites/chronic fatigue syndrome, Board on the health of Select populations, Institute of Medicine (2015) Beyond Myalgic Encephalomyelites/ Chronic Fatigue syndrome: Redefining an illness. www.nap.edu/download/19012
  3. 3. Prins JB, van der Meer JW, Bleijenberg G (2006) Chronic fatigue syndrome. Lancet 367: 346–355. pmid:16443043
  4. 4. Lin JM, Resch SC, Brimmer DJ, Johnson A, Kennedy S, Burstein N, et al. (2011) The economic impact of chronic fatigue syndrome in Georgia: direct and indirect costs. Cost Eff Resour Alloc 9: 1. pmid:21251294
  5. 5. Jason LA, Benton MC, Valentine L, Johnson A, Torres-Harding S (2008) The economic impact of ME/CFS: individual and societal costs. Dyn Med 7: 6. pmid:18397528
  6. 6. Reynolds KJ, Vernon SD, Bouchery E, Reeves WC (2004) The economic impact of chronic fatigue syndrome. Cost Eff Resour Alloc 2: 4. pmid:15210053
  7. 7. Collin SM, Crawley E, May MT, Sterne JA, Hollingworth W (2011) The impact of CFS/ME on employment and productivity in the UK: a cross-sectional study based on the CFS/ME national outcomes database. BMC Health Serv Res 11: 217. pmid:21923897
  8. 8. Zonneveld LN, Sprangers MA, Kooiman CG, van 't Spijker SA, Busschbach JJ (2013) Patients with unexplained physical symptoms have poorer quality of life and higher costs than other patient groups: a cross-sectional study on burden. BMC Health Serv Res 13: 520. pmid:24344899
  9. 9. Price JR, Mitchell E, Tidy E, Hunot V (2008) Cognitive behaviour therapy for chronic fatigue syndrome in adults. Cochrane Database Syst Rev CD001027.
  10. 10. O'Dowd H, Gladwell P, Rogers CA, Hollinghurst S, Gregory A (2006) Cognitive behavioural therapy in chronic fatigue syndrome: a randomised controlled trial of an outpatient group programme. Health Technol Assess 10: iii–x, 1. 97-41-08 [pii].
  11. 11. Severens JL, Prins JB, van der Wilt GJ, van der Meer JW, Bleijenberg G (2004) Cost-effectiveness of cognitive behaviour therapy for patients with chronic fatigue syndrome. QJM 97: 153–161. pmid:14976272
  12. 12. McCrone P, Sharpe M, Chalder T, Knapp M, Johnson AL, Goldsmith KA, et al. (2012) Adaptive pacing, cognitive behaviour therapy, graded exercise, and specialist medical care for chronic fatigue syndrome: a cost-effectiveness analysis. PLoS One 7: e40808. pmid:22870204
  13. 13. Chisholm D, Godfrey E, Ridsdale L, Chalder T, King M, Seed P, et al. (2001) Chronic fatigue in general practice: economic evaluation of counselling versus cognitive behaviour therapy. Br J Gen Pract 51: 15–18. pmid:11271867
  14. 14. Vos-Vromans DC, Smeets RJ, Huijnen IP, Köke AJ, Hitters WM, Rijnders LJ, et al. (2016) Multidisciplinary rehabilitation treatment versus cognitive behavioural therapy for patients with chronic fatigue syndrome: a randomized controlled trial. J Intern Med 279: 268–282. pmid:26306716
  15. 15. Richardson G, Epstein D, Chew-Graham C, Dowrick C, Bentall RP, Morriss RK, et al. (2013) Cost-effectiveness of supported self-management for CFS/ME patients in primary care. BMC Fam Pract 14: 12. pmid:23327355
  16. 16. Gillespie P, O'Shea E, Casey D, Murphy K, Devane D, Cooney A, et al. (2013) The cost-effectiveness of a structured education pulmonary rehabilitation programme for chronic obstructive pulmonary disease in primary care: the PRINCE cluster randomised trial. BMJ Open 3: e003479. pmid:24282243
  17. 17. Brazier J, Connell J, Papaioannou D, Mukuria C, Mulhern B, Peasgood T, et al. (2014) A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technol Assess 18: vii–xxv, 1.
  18. 18. Thomas S, Thomas PW, Kersten P, Jones R, Green C, Nock A, et al. (2013) A pragmatic parallel arm multi-centre randomised controlled trial to assess the effectiveness and cost-effectiveness of a group-based fatigue management programme (FACETS) for people with multiple sclerosis. J Neurol Neurosurg Psychiatry 84: 1092–1099. pmid:23695501
  19. 19. Vercoulen J.H.M.M., Alberts M, Bleijenberg G (1999) [The Checklist Individual Strength (CIS)]. Gedragstherapie 32: 31–36.
  20. 20. Aaronson NK, Muller M, Cohen PD, Essink-Bot ML, Fekkes M, Sanderman R, et al. (1998) Translation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations. J Clin Epidemiol 51: 1055–1068. S0895-4356(98)00097-3 [pii]. pmid:9817123
  21. 21. Vos-Vromans DC, Smeets RJ, Rijnders LJ, Gorrissen RR, Pont M, Köke AJ, et al. (2012) Cognitive behavioural therapy versus multidisciplinary rehabilitation treatment for patients with chronic fatigue syndrome: study protocol for a randomized controlled trial (FatiGo). Trials 13: 71. pmid:22647321
  22. 22. Vercoulen JH, Swanink CM, Fennis JF, Galama JM, van der Meer JW, Bleijenberg G (1994) Dimensional assessment of chronic fatigue syndrome. J Psychosom Res 38: 383–392. pmid:7965927
  23. 23. Prins JB, Bleijenberg G, Bazelmans E, Elving LD, de Boo TM, Severens JL, et al. (2001) Cognitive behaviour therapy for chronic fatigue syndrome: a multicentre randomised controlled trial. Lancet 357: 841–847. pmid:11265953
  24. 24. Vercoulen JH, Swanink CM, Galama JM, Fennis JF, Jongen PJ, Hommes OR, et al. (1998) The persistence of fatigue in chronic fatigue syndrome and multiple sclerosis: development of a model. J Psychosom Res 45: 507–517. S0022399998000233 [pii]. pmid:9859853
  25. 25. Torenbeek M, Mes CA, van Liere MJ, Schreurs KM, ter Meer R, Kortleven GC, et al. (2006) [Favourable results of a rehabilitation programme with cognitive behavioural therapy and graded physical activity in patients with the chronic-fatigue syndrome]. Ned Tijdschr Geneeskd 150: 2088–2094. pmid:17036861
  26. 26. Group EuroQol (1990) EuroQol—a new facility for the measurement of health-related quality of life. Health Policy 16: 199–208. pmid:10109801
  27. 27. Dolan P (1997) Modeling valuations for EuroQol health states. Med Care 35: 1095–1108. pmid:9366889
  28. 28. Hakkaart-van Roijen L. (1-5-2007) Manual Trimbos/iMTA questionnaire for costs associated with psychiatric illness (in Dutch). Rotterdam. www.bmg.eur.nl/english/imta/publications/questionnaires_manuals/
  29. 29. Hakkaart-van Roijen L, Tan SS, and Bouwmans CAM (2010) Handleiding voor kostenonderzoek: Methoden en standaard kostprijzen voor economische evaluaties in de gezondheidszorg. Rotterdam. http://docplayer.nl/6361834-Handleiding-voor-kostenonderzoek-methoden-en-standaard-kostprijzen-voor-economische-evaluaties-in-de-gezondheidszorg.html
  30. 30. Tan SS, Bouwmans CA, Rutten FF, Hakkaart-van RL (2012) Update of the Dutch Manual for Costing in Economic Evaluations. Int J Technol Assess Health Care 28: 152–158. pmid:22559757
  31. 31. Briggs AH, Wonderling D.E., Mooney C.Z. (1997) Pulling cost-effectiveness analysis by bootstraps: a non-parametric approach to confidence interval estimation. Health Econ 6: 327–340. pmid:9285227
  32. 32. Council of Public Health and Health Care in the Netherlands (2006) Zinnige en duurzame zorg ['Sensible and sustainable care']. www.raadrvs.nl/uploads/docs/Advies_-_Zinnige_en_duurzame_zorg.pdf
  33. 33. National Institute for Health and Care Excellence (NICE) (2007) Chronic fatigue syndrome/ myalgic encephalomyelitis (or encephalopathy): Diagnosis and management of CFS/ME in adults an children. www.nice.org.uk/guidance/Cg53
  34. 34. Melse JM, Essink-Bot ML, Kramers PG, Hoeymans N (2000) A national burden of disease calculation: Dutch disability-adjusted life-years. Dutch Burden of Disease Group. Am J Public Health 90: 1241–1247. pmid:10937004
  35. 35. Tummers M, Knoop H, van Dam A, Bleijenberg G (2013) Moderators of the treatment response to guided self-instruction for chronic fatigue syndrome. J Psychosom Res 74: 373–377. pmid:23597323
  36. 36. McCrone P, Ridsdale L, Darbishire L, Seed P (2004) Cost-effectiveness of cognitive behavioural therapy, graded exercise and usual care for patients with chronic fatigue in primary care. Psychol Med 34: 991–999. pmid:15554570
  37. 37. Brazier J, Fitzpatrick R (2002) Measures of health-related quality of life in an imperfect world: a comment on Dowie. Health Econ 11: 17–19. 10.1002/hec.669 [pii]. pmid:11788977
  38. 38. Dowie J (2002) Decision validity should determine whether a generic or condition-specific HRQOL measure is used in health care decisions. Health Econ 11: 1–8. 10.1002/hec.667 [pii]. pmid:11788974
  39. 39. Feeny D (2002) Commentary on Jack Dowie, "Decision validity should determine whether a generic or condition-specific HRQOL measure is used in health care decisions". Health Econ 11: 13–16. 10.1002/hec.670 [pii]. pmid:11788976
  40. 40. Van Leeuwen KM, Jansen AP, Muntinga ME, Bosmans JE, Westerman MJ, van Tulder MW, et al. (2015) Exploration of the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults. BMC Health Serv Res 15: 201. pmid:25976227
  41. 41. Health Council of the Netherlands. (2005) Chronic fatigue syndrome. The Hague. www.gezondheidsraad.nl/nl/taak-werkwijze/werkterrein/optimale-gezondheidszorg/het-chronische-vermoeidheidssyndroom
  42. 42. Janse A, Worm-Smeitink M, Bussel-Lagarde J, Bleijenberg G, Nikolaus S, Knoop H (2015) Testing the efficacy of web-based cognitive behavioural therapy for adult patients with chronic fatigue syndrome (CBIT): study protocol for a randomized controlled trial. BMC Neurol 15: 137. pmid:26264735
  43. 43. Patel A, Rendu A, Moran P, Leese M, Mann A, Knapp M (2005) A comparison of two methods of collecting economic data in primary care. Fam Pract 22: 323–327. pmid:15824056
  44. 44. Goldberg RW, Seybolt DC, Lehman A (2002) Reliable self-report of health service use by individuals with serious mental illness. Psychiatr Serv 53: 879–881. pmid:12096173