Computer-based interventions target improvement of physical and emotional functioning in patients with chronic pain and functional somatic syndromes. However, it is unclear to what extent which interventions work and for whom. This systematic review and meta-analysis (registered at PROSPERO, 2016: CRD42016050839) assesses efficacy relative to passive and active control conditions, and explores patient and intervention factors. Controlled studies were identified from MEDLINE, EMBASE, PsychInfo, Web of Science, and Cochrane Library. Pooled standardized mean differences by comparison type, and somatic symptom, health-related quality of life, functional interference, catastrophizing, and depression outcomes were calculated at post-treatment and at 6 or more months follow-up. Risk of bias was assessed. Sub-group analyses were performed by patient and intervention characteristics when heterogeneous outcomes were observed. Maximally, 30 out of 46 eligible studies and 3,387 participants were included per meta-analysis. Mostly, internet-based cognitive behavioral therapies were identified. Significantly higher patient reported outcomes were found in comparisons with passive control groups (standardized mean differences ranged between -.41 and -.18), but not in comparisons with active control groups (SMD = -.26 - -.14). For some outcomes, significant heterogeneity related to patient and intervention characteristics. To conclude, there is a minority of good quality evidence for small positive average effects of computer-based (cognitive) behavior change interventions, similar to traditional modes. These effects may be sustainable. Indications were found as of which interventions work better or more consistently across outcomes for which patients. Future process analyses are recommended in the aim of better understanding individual chances of clinically relevant outcomes.
Citation: Vugts MAP, Joosen MCW, van der Geer JE, Zedlitz AMEE, Vrijhoef HJM (2018) The effectiveness of various computer-based interventions for patients with chronic pain or functional somatic syndromes: A systematic review and meta-analysis. PLoS ONE 13(5): e0196467. https://doi.org/10.1371/journal.pone.0196467
Editor: JianJun Yang, Southeast University Zhongda Hospital, CHINA
Received: July 13, 2017; Accepted: April 15, 2018; Published: May 16, 2018
Copyright: © 2018 Vugts et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All replication data files are available from the DataverseNL database (accession number hdl:10411/QTFYEV).
Funding: Ciran sponsored the research and had no role in study design, data collection and analysis, preparation of the manuscript, or decision to publish. No grant numbers are available.
Competing interests: As an employee of Ciran, M.A.P. Vugts was provided time and occasion to conduct this research by way of agreement at Tranzo, Scientific Center for Care and Welfare, Tilburg University. The terms of this arrangement have been reviewed and approved by Tranzo in accordance with its policy on objectivity in research. H.J.M. Vrijhoef reports personal fees from Ciran during the conduct of the study. M.C.J. Joosen, J.E. van der Geer, and A.M.E. Zedlitz have no conflicts of interest to declare. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.
Computer-based interventions (CBIs) may be a particularly accessible means for improving health outcomes in patients with chronic pain (CP) or functional somatic syndromes (FSS) [1, 2]. CP is diagnosed in individuals seeking health care for pain symptoms that persist beyond a usual 3- to 6-month duration of organic recovery . FSS are defined by functional disturbances and chronic somatic symptoms without a satisfactory explanation by organ pathology or disease . The difference between CP and FSS is the “mandatory” presence of disturbing pain symptoms in CP that can accompany a disease (i.e., arthritis) and does not need to be present for the diagnosis of FSS (i.e., chronic fatigue syndrome, tinnitus). However, there is a vast overlap between CP and FSS. Both conditions cover a variety of bodily symptoms and involve organic systems, and several diagnoses fall under both definitions (i.e., fibromyalgia, chronic low back pain, and irritable bowel syndrome [IBS]) [4, 5]. Furthermore, evidence supports bio-psychosocial management strategies based on a stepped-care approach for both CP and FSS [4, 6]. Efficacious interventions for reducing experienced symptoms and functional interference, in order of increasing intensity, include conservative medical treatment, physical therapy, psychotherapy, or multidisciplinary rehabilitation in primary or specialized care settings [4, 6, 7]. Herein, CBIs could offer independent patient access to stand-alone programs or complementary elements for further-reaching, stronger, or more enduring effects by increasing independent engagement and/or preventing relapse [8, 9].
Research and development of CBIs is motivated by the large burden of these disorders that are due to a high prevalence (e.g., 20–30% for CP [10, 11], 1–3% for chronic fatigue syndrome , and 10–15% for tinnitus ), co-morbid psychological distress, loss of productivity, absence of strongly effective medical treatment, and limited access to specialized health care [3, 4, 11]. CBIs may involve the use of the Internet , interactive voice response , mobile/smart phone applications , CD-ROM/DVD, or handheld computers as a delivery route .
Previous systematic reviews and meta-analyses investigated the impact of CBIs across populations with chronic disease or mental health problems, including CP and FSS conditions [2, 14, 17–33]. Internet-delivered cognitive behavioral therapy (CBT) is effective compared to waiting-list or usual care conditions and may be equivalent to traditional (face-to-face) delivery formats [14, 18, 34]. This was suggested for CP patients specifically in a systematic review and meta-analysis by Buhrman et al.  that included 22 randomized controlled trials (RCTs) (five were published by the first author). Applied Internet-based CBT was described in narratives and modest effect size estimates were found for patients’ reported pain intensity (Hedges’ g = -.33), functional interference or disability (g = -.39), catastrophizing (g = -.49), and depression (g = -.26), which replicated earlier meta-analytic findings . A study on the impact of self-help modalities (including CBIs) in patients with IBS found medium sized effects on somatic symptoms (standardized mean difference [SMD] = -.72), and a large effect on quality of life (SMD = -.84) that did not differ between computer-based or face-to-face formats . Conclusions on the internal and external validity of these findings were drawn with caution due to a limited amount of high-quality randomized clinical trials (RCTs). It was suggested that future studies should focus more on methodological uniformity and quality, outcomes at long-term follow-up, direct one-to-one comparisons with various active treatments, and/or extended variety in participants and treatment settings [18, 24, 26].
Furthermore, there are knowledge gaps with regard to what works for whom, and when [34–40]. It remains unclear if CBI effects vary by intervention, patient (e.g., demographics), and context factors (e.g., the degree to which e-health trials resemble routine applications) [14, 15, 41, 42]. To meet the presumed potential of CBIs, developers and (clinical and policy) decision makers yet require knowledge about which CBIs will be effective for which patients with CP or FSS in actual health care settings [28, 43, 44]. Process analyses embedded in clinical trials can offer the best evidence on these matters and can be complemented with meta-analytic tests [40, 45]. Statistically significant moderators of outcome improvement were found in CP patients after Internet-delivered CBT in comparison with controls, but there was no consistent moderating factor across outcome domains . Several studies suggested similar degrees of CBI effectiveness across sub-populations, but participant (self) selection could have restricted the observed amount of patient variation [35, 36, 38, 39]. Two meta-analyses, comprising a diversity of self-management interventions and patients with musculoskeletal pain, explored moderators of program effectiveness [34, 37]. One found that professional guidance and psychological components were associated with better outcomes . The other one showed stronger effects in older participants but guarded against definite conclusions based on a limited amount of data .
In order to aid decision makers in choosing the appropriate intervention strategy for specific populations and individuals, and to aid CBI developers in constructing effective interventions, the objectives of this meta-analysis were to establish the efficacy of CBIs and to elucidate patient and intervention characteristics. In light of ongoing accumulation of empirical data and the possibility of pooling the results from CBI effect studies for the largely homogeneous conditions of CP and FSS, the questions of this study where thus: (1) To what extent do CBIs result in better health outcomes after treatment and at follow-up experienced by patients with CP or FSS as compared to passive control conditions (i.e. waiting-list, usual or standard care, discussion boards, or standard patient information) and active treatment conditions?; (2) What are the characteristics of patients for whom computer-based interventions are most and least effective?; and (3) What are the characteristics of the most and least effective computer-based interventions? Based on existing evidence about CBIs, general positive effects, but no specific moderating patient or intervention factors were expected.
These objectives include consideration of the strength of evidence that depends on methodological threats to internal and external validity . Important health outcomes for CP and FSS are patient-reported somatic symptom intensity, health related quality of life (HRQOL), functional interference (or disability, handicap, impact, or disturbance of activities due to somatic symptoms), catastrophizing (or acceptance, self-efficacy, or any other targeted cognitive process of outcome improvement) , and depression (as a commonly reported aspect of emotional distress) .
The Cochrane Handbook of systematic reviews of interventions  was used to prepare the study protocol which was preregistered at PROSPERO (2016:CRD42016050839). Reporting was then guided by the PRISMA statement .
Inclusion and exclusion criteria
Study inclusion and exclusion were based on: patient (P), intervention (I), comparison (C), outcome (O), and study type (S) criteria (PICOS) . Eligible studies focused on adult participants (17–67 years of age) with a CP or a FSS condition. CP or FSS was identified through case-finding (with valid diagnostic instruments) or clinician assessment (either during the study or before, as a basis for self-reference). This included somatic symptom disorders and medically unexplained physical symptoms (MUPS). Eligible studies investigated a computer-based intervention; in comparison with one or more control conditions of any kind (passive or active); for its effects on relevant health outcomes; in a RCT, quasi-experiment, or mixed-method study. Measurements were taken at baseline and post-intervention and/or at follow-up. CBIs are defined as programs that require patient contributions by using a computer platform for direct access to personally relevant information and support in behavioral change and/or decision-making for health issues .
Studies were excluded: (1) if patient eligibility focused specifically on pediatric or geriatric populations, factitious disorders, a specific organic disease (e.g., migraine, multiple sclerosis, osteoarthritis) or psychiatric illness as a complication thereof, hypochondriasis , or individuals who did not report chronic somatic symptoms (e.g., individuals at risk targeted in primary prevention); (2) if experimental programs were not CBIs (e.g., if a program did not target patients themselves, was designed to be used exclusively with professional assistance, regarded participants as passive recipients, or only provided a means for distant communication with care providers); (3) if outcomes other than relevant health outcomes were prioritized (i.e., feasibility or technology acceptance), or narrow focus on somatic symptom outcomes (the only type of outcome reported); and (4) if study types were non-empirical, fully qualitative, uncontrolled, or not published as a full-bodied article in a peer-reviewed scientific journal.
On June 16th and July 1st, 2016, MEDLINE, EMBASE, PsychINFO, Cochrane Central Register of Controlled Trials (CENTRAL), and Web of Science were searched for relevant studies published since January 1990 without language constraints. Search terms relating to the patient populations [51, 52], computer-based and behavioral interventions [49, 53], and study types  from previously published Cochrane reviews were listed using the Boolean operator ‘or’ and combined using the Boolean operator ‘and’. The search string was adapted for usage across bibliographic databases with available interfaces. The full search strategy for EMBASE is added in Table A in S1 Appendix. As additional methods to obtain an exhaustive set of peer-reviewed and published journal articles, references of previous systematic reviews and meta-analyses on related topics were checked [2, 14, 17–20, 22–29, 31, 32, 34, 54–57], and backward and forward citations of eligible studies were checked in Web of Science . Grey literature was not searched.
A two-step selection protocol had been piloted, used, and refined. First, potentially eligible studies were identified by titles and/or abstract screenings. Two authors (MV and HV or MJ) independently screened half of the studies. After comparison, discussions revealed that none of the authors had excluded potentially eligible articles. Thus, MV screened the remaining half. Second, MV and MJ independently assessed the final full-text assessment of all potentially eligible titles, and discrepancies were resolved by discussions involving HV. Each study with relevant outcome data was eligible for meta-analysis.
Data extraction and management
A data-extraction form was composed, piloted, and discussed a priori. General and patient items were extracted by MV and checked by AZ. Relevant items for generalizability to routine applications according to the CONSORT statement for E-health  were among these general items: year of publication, setting (by continent), type of control group, methods of recruitment (“open” or “closed” population, participant screening methods), participant compensation, type of human involvement, and use of prompts/reminders. Patient items were (baseline) average age, proportion of females, the duration of symptoms, education level (proportion that completed tertiary education), employment, sick leave, depression, and somatic symptom intensity.
Intervention duration, compliance, and characteristics were independently extracted by MV and JG. Disagreements were resolved after discussion with AZ. Theoretical basis, mode of delivery and behavior change techniques (BCTs) were classified based on intervention descriptions using the uniform taxonomies from Webb et al. . Accordingly, the 11 items on use of theory were clustered into three categories: referencing to underpinning theory, targeting of relevant theoretical constructs, and selecting recipients or tailoring interventions. The 11 items on mode of delivery were clustered into automated functions, communicative functions, and supplementary modes. For classifying BCTs, we used the updated Behavior Change Technique Taxonomy version 1 (BCTTv1) [25, 60]. This is a hierarchically structured taxonomy of 93 distinct techniques that are grouped into 16 categories such as “goals and planning” and “social support”. Both coders were trained in the accurate application of the BCTTv1.
Two authors (MV and JG) extracted and double-checked all outcome information, including the administered self-assessment instruments, means, standard deviations, and sample-sizes for two “time points”: post-treatment and/or 6 months or more at follow-up. If multiple measures were available for the same outcome category, the following measures were preferred: visual analogue or numerical rating scales of pain intensity (current) for somatic symptom intensity, HRQOL total scores (general subjective health or mental health composite subscales if totals were not reported), (pain) interference for functional interference (otherwise disability, handicap, or disease impact), and catastrophizing (or acceptance/self-efficacy). Standard errors were converted into standard deviations. Baseline values were imputed for missing standard deviations for outcomes post-treatment or at follow-up (i.e., if only change scores were reported).
Risk of bias rating
Quality assessment of the studies was performed by MV and JG based on the 13 risks of bias criteria recommended by the Cochrane Collaboration Back Review group . Discussions with HV enhanced the objectivity and consistency of this assessment. The columns of Table B in S1 Appendix detail the 13 criteria. Subsequently, the 13 criteria were combined into seven major categories of the general Cochrane risk of bias tool: selection bias, attrition bias, reporting bias, performance bias, incomplete data extraction bias, detection bias, and other risks . Methodological limitations that pose a general threat for this type of intervention studies (lack of blinding) were ruled out in this categorization. A category was scored “high risk” if high risk was scored for one or more underlying criteria, assuming that a single source of risk could bias the results of a trial completely . “Low risk” was scored if all underlying criteria were “low risk”.
Determining the efficacy of computer-based interventions
To estimate CBI outcome levels against controls, pooled effect sizes were calculated by using the Review Manager Software package (RevMan 5.3) [45, 64]. Comparisons were categorized as CBI versus passive controls (e.g., “waiting-list”, “usual/standard care”); or CBI versus active controls (e.g., same content in face-to-face format). Outcome data were inserted such that negative numbers represented lessening of symptoms and overall that lower numbers represent more favorable outcomes for intervention group participants. If a comparison had to be chosen from multiple relevant options within a study (with multiple CBIs), the newest and/or most elaborate CBIs (i.e., “third-wave” CBT, or with more BCTs and/or delivery modes) were designated as experimental, while the simplest and most traditional interventions were chosen as controls. Twenty primary meta-analyses were performed for the two comparison types and five outcome categories by the two time-points.
For each meta-analysis, RevMan operations were set for inverse variance methods of estimating random effects on the basis of standardized differences between intervention and control group means (SMDs), anticipating on heterogeneous estimates in continuous outcomes and the use of different questionnaire instruments across studies. Chi-squared tests indicated if there was significant heterogeneity of SMDs across studies (cut-point: p < .05), and the I2 statistic indicated the extent to which heterogeneity affected the pooled result. Applicable thresholds for (rough) interpretations of I2, with 0% to 40% as potentially unimportant, 30% to 60% as modest, 50% to 90% as substantial and 75% to 100% as considerable heterogeneity were conservatively applied . Funnel-plots were visually inspected for indications of publication bias. Further analyses, by calculating SMDs, on risk of bias sensitivity were performed only for studies that were assessed low risk of bias for each category. Hereto, it was also checked if study level sources of risk were similar on the outcome level (i.e., if unbalanced baseline group scores were a risk for a particular outcome). Similar sensitivity analyses were conducted based on source of recruitment (“open” versus “closed”) to explore effects by differences in health care settings .
Determining patient and intervention characteristics of effective computer-based interventions
Per meta-analysis with statistically significant and “potentially important” heterogeneity, two sub-sets of studies were created: one for the 25% highest study group differences (SMDs) and one for the 25% lowest SMDs. Within each set, patient and intervention characteristics (potential effect modifiers) were described by a summery statistic (count, proportion, or mean). To reduce the number of plausible sub-group analyses, characteristics were deemed ‘distinctive’ and tested (χ2) if they differed substantially between the two sets, and/or from expected values (within sets of all studies or comparison types). Analyses were only conducted if 10 or more studies were available for analysis . Study level associations (Chi-square tests, Kendall’s Tau, or Pearson correlations) were calculated between intervention and patient factors to examine potential confounding of modifiers (using SPSS 22).
Search and study selection procedures are summarized in the PRISMA flow-diagram (Fig 1). In total, 4,963 unique hits were identified from the databases. Twenty additional studies were found in the citation networks of eligible studies or references of systematic reviews or meta-analyses on related topics. After tentative steps of title and abstract screening, 158 studies remained, nine of which were short reports or conference abstracts. Therefore, 149 full-bodied peer-reviewed articles were assessed full-text on the alleged inclusion and exclusion criteria. The final set consisted of 46 eligible studies (k) [9, 16, 65–108].
Over time an increase in eligible publications was found. Whereas in the period 2000–2007 only zero to one article per year had been published, this number rose to six to seven per year in the years 2013–2015. Of the included studies, only one study was not an RCT. Thirty-seven studies compared a CBI with a passive control condition (waiting-list, k = 14, usual or standard care, k = 9, message/discussion board, k = 8, provision of information, k = 6), whilst 16 studies compared a CBI with an active control condition (a simpler version of the same CBI, k = 9, active treatment without the additional CBI, k = 3, or face-to-face CBT group, k = 4). Six studies had multiple arms including comparisons with passive as well as active conditions. Three studies (two passive and one active comparisons) did not contain sufficient information for extracting means and standard deviations. Twenty-nine studies were based in Europe, 13 in the US, three in Australia, and one in Asia. In 28 studies, participants were recruited from a general “open” population (e.g., web-site enrollment) and screened for eligibility using web-forms (k = 13), additional telephone interviews (k = 8), or face-to-face interviews (k = 6). Seventeen studies recruited exclusively from “closed” clinical or work settings. Seven studies recruited from open as well as closed populations, and one did not report recruitment source. Most studies explicitly selected participants with the ability to use the required computer technology, including the Internet (k = 32), touch key telephone (k = 1), or smartphone (k = 1). More implicit selection procedures were present in 12 studies, of which three studies used a run-in period. In six studies, monetary compensation was provided for study participation. About 60% of the included subjects completed the interventions (proportion on average was .59, SD = .23, range = .21–1, k = 31). Table C in S1 Appendix contains an overview of the questionnaire instruments for which data were extracted across outcome categories.
Patient conditions targeted by CBIs were mixed chronic pain (k = 15), chronic (low) back pain (k = 6), chronic widespread pain/fibromyalgia (k = 6), mixed or tension headache (k = 3), IBS (k = 7), chronic fatigue (k = 1), interstitial cystitis (k = 1), non-cardiac chest pain (k = 1), and tinnitus (k = 6). Participants were on average 45.4 years of age (SD = 5.2, k = 44). Average proportions of patient characteristics showed that 71% of the participants were female (SD = .22, k = 45), 42% had completed tertiary education (SD = .16, k = 25), 67% were employed (SD = .19, k = 21), and 36% were on sick leave (SD = .27, k = 15). Somatic symptoms prior to treatment were reported for a mean duration of 115 months (SD = 31, k = 26), and studies that reported HADS depression at baseline (k = 14) generally found no indication of depressive disorders (mean = 6.7, SD = 1.3).
Experimental CBIs had an average duration of 10.5 weeks (range = 3–52, SD = 8.9) and were mostly (k = 30) guided by one or more health professionals (mode = 1, median = 3, range = 1–16; master’s level psychologists, k = 12; clinically trained, k = 14). Most studies made use of prompts or reminders (k = 31) that were sent occasionally depending on compliance (k = 21) and/or scheduled automatically (k = 13). Behaviors mostly targeted by CBIs included exercise, sleep hygiene, relaxation, and leisure activities.
Theoretical basis and use of theory.
Table D in S1 Appendix presents the complete coding results for use of theory (1). To summarize, CBT approaches prevailed (k = 33) across the studies that mentioned or referred to a theory about relationships among relevant concepts (item 1, k = 39). Sixteen studies explicitly described their approach as CBT. Seven studies specifically mentioned third-wave CBT approaches, including Acceptance and Commitment Therapy (ACT) and mindfulness-based therapies. Others mentioned a combination of CBT with third-wave (k = 6) or other conceptualizations (k = 4). The remaining studies either referred to the empowerment model (k = 3) or a model constructed by the author (k = 3). Targeted constructs from the theory were mentioned as a predictor of behavior (k = 11) and/or for selection of intervention techniques (k = 21). Theory or predictors were rarely used to select recipients for the intervention (k = 1) or tailor the intervention to recipients (k = 1). Explicit descriptions of links between techniques and relevant constructs were identified in 19 studies.
Behavioral change techniques.
Fig 2 summarizes for how many studies certain BCTs were coded by each comparison. Table D in S1 Appendix (2) fully describes the study and comparison level coding results after listing the precise interpretations of the coders of the 93 BCTs across the 16 categories. Techniques implied by the description of ‘relaxation’ or ‘meditation’ were coded most often (k = 31–37). Those techniques included the codes of performance instructions (BCT code 4.1), demonstration (6.1), prompting practice and rehearsal (8.1), and reduction of negative emotions (11.2). Therefore, these were the most prevalently coded BCTs. Body changes (12.6) was coded as implied by the description of relaxation (k = 25), but not of meditation. Intervention descriptions often mentioned that change support was delivered by trained professionals over the internet (k = 27). Herein the BCTs unspecified social support (3.1) and credible source (9.1) were coded. When CBT approaches were described along with a specification of a treatment rationale that induced coding 4.2 and 5.1; clarifying relationships of behaviors with antecedents and their health consequences. Descriptions of cognitive restructuring or defusion led to coding 13.2; the framing or re-framing perspectives on behavior to change cognitions or emotions about it. Other regularly coded techniques (k > = 10) were self-monitoring of behavior (2.4), problem solving (1.2), outcome goal setting (1.3), exposure (7.7), and setting and performing graded tasks (8.7).
Mode of delivery.
Table D in S1 Appendix also contains complete coding results for use of theory (3). It shows that studies described various automated functions of their CBIs, including tailored feedback based on individual progress monitoring (k = 37, 76.1%), an enriched information environment (k = 25, 52.2%), and/or automated follow-up messages (k = 32, 67.4%). Less often, interventions descriptions mentioned (two-way) communicative functions, such as communicating with an advisor through scheduled contact (k = 24), access to an advisor for advice (k = 4), and/or peer-to-peer access (k = 11). Most studies mentioned the Internet (k = 41), followed by e-mail (k = 31), telephone (k = 12), and SMS (k = 7) as supplementary modes.
Risk of bias
As presented in Table 1, none of the 46 studies were coded low risk of bias within all categories. Selection bias was coded low in 11 studies, meeting the three criteria of random sequence generation, concealment of allocations, and group similarity at baseline. Ten studies were assessed as low risk, while 25 studies were assessed as high risk of attrition bias. Thirty-four studies were classified as having an unclear risk of reporting bias through selective outcome reporting, because a study protocol was either not available or registered after the study was completed. For performance bias, 12 studies scored high risk and 18 studies low risk, which depended on differences in compliance and co-interventions between groups. Only one study scored high risk for detection bias. Four studies were assessed as high risk of bias due to incomplete reporting and analysis according to group allocation, because findings differed between intention-to-treat and complete case analyses. This was unclear if no results of intention-to-treat analyses were reported (k = 11). Table B in S1 Appendix elaborates on the reasons authors agreed upon for assigning high, low, or uncertain risk by criteria.
Multiple meta-analyses were conducted for assessing the 20 direct effects of CBIs, which is too much for presenting each here in full detail. Tables F-Y, and Figs A-AB in S1 Appendix contains full information on the direct effect estimates numbered per comparison, outcome type, and time of measurement (passive = 1., active = 2.; and .1 = symptom intensity post treatment, .2 = HRQOL, .3 = functional interference, .4 = catastrophizing, and .5 = depression, .6 - .10 = same subsequent outcomes at follow-up of 6 months or longer). For each estimate, information is given on the SMD pooled for all eligible studies with its 95% confidence interval and heterogeneity statistics (I2, P-value). Furthermore, the same statistics are presented for sub-sets of studies with low risk across sources of bias, and for study sets that recruited patients from open or closed populations (sensitivity analyses). In addition, forest plots (providing detailed study level outcome information in a single overview) and funnel plots (visualizing study estimates relative to their sample sizes for detecting potential publication bias) are presented. Table 2 presents (per comparison, outcome type, and time of assessment) the pooled SMDs, appurtenant confidence intervals, and heterogeneity statistics and references to the 25% sub-sets of studies with highest and lowest SMDs. In the text, a factual summary is given, mentioning key information that is in S1 Appendix and not in Table 2.
Computer-based interventions versus passive controls.
After treatment, observed differences between CBI and control group means (SMDs) were significant and small- to medium-sized, ranging from -.18 for depression to -.41 for catastrophizing. For functional interference, somatic symptom intensity, and HRQOL heterogeneous estimates between studies were found (in the range for classification as ‘modest’ to ‘substantial’), which could be further explored to its sources. Sub-group analyses of study sub-sets by risks of bias only showed significantly stronger (SMD = -.49 - -.53) functional interference outcomes after CBI versus controls in trials with low risk due to attrition (χ2 = 7.97, p < .01) and performance (χ2 = 5.10, p = .02). Inspection of funnel plots, most clearly those for (post treatment) somatic symptom intensity and HRQOL, showed a lack of observations at the bottom-right corner (small studies with negative effect estimates) unlike the bottom-left corner (small studies with positive estimates).
At 6 or more months after treatment, small significant effect sizes (SMD = -.18 -—.32) were maintained for all outcomes except for HRQOL (k = 1). There were too few studies available (1 < k < 6) for sensitivity analyses on follow-up results.
Computer-based interventions versus active controls.
In comparisons of CBIs with active control groups, small positive significant outcome differences (SMD = -.15 - -.26) were only found for catastrophizing and functional interference outcomes after treatment. For both estimates, the between study heterogeneity estimate (I2) was in the range of ‘not important’. Within this comparison type, there were only enough data (k = 10) to observe that the estimated effect on catastrophizing was significant and positive (SMD = -.33, 95% CI = [-.49, -.17]) within the sub-set of studies assessed with low risk of selection bias (k = 5). At follow-up, no significant differences between CBI and active controls were observed (3 < k < 6, SMD = -.04 - -.031). Significant heterogeneity in the range of ‘modest’ or ‘substantial’ was observed for symptom intensity and HRQOL at both times of assessment, and for functional interference and depression at follow-up. Only for symptom intensity at post there were enough studies (k = 11) for further exploration of sources of heterogeneity. For depression, heterogeneity was accompanied by an apparently outlying observation from a small study . Further, researchers have not noticed anything unusual in the funnel plots of the smaller numbers of studies within this comparison.
Patient characteristics of effective computer-based interventions.
Table Z in S1 Appendix presents results of the first (intermediate) step in exploring patient and intervention factors. Herein 6 table columns represent study sets: studies with passive and active comparison types and studies with the 25% highest and 25% lowest effect sizes (SMDs) within meta-analyses with sufficient studies (k = 10) and significant heterogeneity (somatic symptoms at post and follow-up, and HRQOL and functional interference at post). Rows list control conditions and characteristics of patients and interventions. Cells contain corresponding statistics. Table AA in S1 Appendix completely presents the 42 sub-group analyses that were chosen to be conducted, along with their corresponding sub-group operationalization and test statistics (χ2, P-value, and I2). A full overview of associations between study characteristics is available upon the author’s request. Here, significant findings are mentioned.
Between the 8 different sub-groups by patient conditions, different SMDs were seen for somatic symptoms after CBIs in comparison with passive controls (χ2 = 15.62, p = .03). When comparing only the sub-group of IBS studies (k = 6) with mixed CP studies (k = 12) within the same meta-analysis, higher estimates are observed after also excluding one study on IBS patients with outlying (negative) results (k = 17, χ2 = 9.60, p < .01; Fig 3) . For studies with a relatively lower average participant age (< 42.5 years), higher estimates were seen (at post) for somatic symptoms and HRQOL (χ2 = 11.45–15.11, p < .01). Estimated effects on somatic symptoms (at post) were higher in study sub-groups with higher average proportions of female study participants (3 groups split by 2/3 and 4/5, k = 29, χ2 = 9.19, p < .01), or with a higher proportion of participants with a completed tertiary education (2 groups split by 40%, k = 17, χ2 = 5.46, p = .02). Estimated CBI effects on functional interference (after treatment, versus passive controls) were higher for a subset of studies (k = 4) with higher depression scores at baseline (Hospital Anxiety and Depression Scale > 7) (k = 11, χ2 = 5.32, p = .02), and a subset (k = 3) with more than 50% absenteeism among study participants (k = 11, χ2 = 3.73, p = .05). Finally, even without removal of a statistical outlier , estimates for a sub-group of studies (k = 19) with explicit participant computer literacy selection criteria were lower than for studies (k = 10) with unclear or implicit criteria (k = 29, χ2 = 4.79, p = .03).
Intervention characteristics of effective computer-based interventions.
Efficacy estimates also varied by several sub-groups of intervention characteristics. Differences in SMD’s by the 4 types of passive control groups were found for somatic symptom, HRQOL, and functional interference outcomes at post treatment (χ2 = 12.79–22.73, p = < .005. Fig 4). More specifically, efficacy estimates of studies on comparisons of CBIs with care as usual (SMD = -.04 - -.17) instead of waiting list controls (SMD = -.79 - -.43) were smaller (14 < k < 21, χ2 = 10.78–11.06, p = < .001). Furthermore, differences of SMDs in functional interference outcomes were found by the presence of guidance or its levels of professionalism (k = 30, χ2 = 9.84, p = .02). Effects were generally small when guidance was absent (k = 11, SMD = -.24), larger at master’s level (k = 7, SMD = -.38), and largest at clinical level (k = 11, SMD = -.49; χ2 = 9.84, p = .02). Post treatment SMDs in HRQOL for the sub-group of studies that reported the used of theory for the selection of intervention techniques (k = 7, SMD = -.62) versus the studies that did not (k = 7, SMD = -.08) were relatively higher (k = 14, χ2 = 5.79, p = 0.02). For studies for which “exposure” (7.7) was coded versus those for which it was not, SMD’s in (post-treatment) somatic symptom (SMD = -.67 versus -.26) and functional interference (SMD = -.50 versus -.28) were higher (χ2 = 3.72–6.26, p = < .05). For somatic symptom outcomes, it also appeared that higher SMDs between CBI and (both passive and active) controls were higher for sub-groups of studies that reported fewer (subsequently less than 5 or 2) rather than more modes of delivery (χ2 = 5.11–6.34, p = < .04). SMDs in somatic symptom outcomes (at post) were higher (SMD = -.52 versus -.18) in studies reporting a 50% or higher CBI completion rate (k = 20, χ2 = 4.55, p = .03). Completion rate, on its turn, was associated with the use of occasional (instead of absent or scheduled) reminders (one-way ANOVA: F = 3.06, p = .045).
SE = Standard Error, SMD = Standardized Mean Difference. Comments: The meta-analysis presented here included the results for active comparisons (not the passive ones) from Trompetter et al. (2015) and Dear et al. (2015) to avoid double entries. Online discussion was facilitated for control group participants while being on a waiting list for receiving the experimental CBI.
Summary of evidence
This study questioned (1) the short and long-term efficacy of CBIs compared with passive and active controls for (self-reported) outcomes in patients with CP or FSS, as well as (2) patient and (3) intervention factors by which efficacy is high versus low. Generally, small effects were found when CBI was compared to passive controls. But when CBI was compared to active control groups, no significant differences in treatment effects were found. Small levels of efficacy were maintained for 6 months or longer. Strength of evidence varied by follow-up terms and type of comparison groups. Additionally, explorative analyses provided several (interdependent) possible patient and intervention characteristics that showed marked differences in treatment effects.
First, regarding efficacy, a small positive average effect of CBI is found in comparison with passive controls across all outcomes at post-treatment (i.e. somatic symptom intensity, HRQOL, functional interference, catastrophizing, and depression). CBIs predominantly included typical contents of CBT. This agrees with the up-to-medium sized effects observed in previous meta-analyses on the efficacy of Internet CBT in populations with CP [1, 14] and mental or chronic somatic symptoms at large [22, 32, 110, 111]. Additional meta-analytic evidence is presented (except for HRQOL) in support of the hypothesis that CBI efficacy is retained for 6 months or longer. This strengthens the previous suggestion that CBI effects would last at least up to three months . Moreover, similar meta-analytic results were previously found for depression . Our meta-analyses do not suggest that CBIs have additional effects when complementing (during or after) face-to-face delivered multidisciplinary programs (k = 3), or when substituting traditional (group) formats of CBT (k = 4). These findings concur with previous studies that suggested equivalence between computer- or group-based CBT across psychiatric and chronic somatic disorders [14, 18, 34]. In sum, CBIs offering complementary behavioral change content have, on average, small and prolonged effects on self-reported health in patients with CP or FSS.
Secondly, this study explored characteristics of patients with CP or FSS for whom CBIs are most and least effective. Different characteristics of patients included in studies were sometimes associated with significantly higher or lower CBI effects on somatic symptom, HRQOL, and functional interference outcomes. Even though effect estimates (i.e., for somatic symptom outcomes) could not be considered equal across different CP and FSS diagnoses, no particular diagnosis stood out. Unfortunately, the number of studies per diagnosis was too small to perform 1 on 1 comparisons between all diagnoses (all k < 5 except IBS; k = 6). For IBS, effect estimates were relatively high (medium sized), but one study had a deviating low effect, so that a difference with other diagnostic groups cannot be suggested on statistic grounds. This study by Everitt et al. (2013) differed from other IBS studies (but not from other included studies) by setting (“closed”) patient factors (higher age and lower education level), intervention factors (lower compliance), and risk of bias criteria (low risk of reporting bias) . It was also the only study that tested combinations of CBI and drug treatments that, according to the authors, could have affected patient expectations. Mechanisms of heterogeneous effects of IBS (self) management interventions have been largely unclear [36, 112]. Future research should clarify whether distinctive CBI efficacy has to do with differentiating characteristics of IBS, or other differences in interventions studied, patients, and/or context.
Exploration of other patient factors of CBI efficacy resulted in positive findings by demographics and health status. More favorable post-treatment somatic symptoms and HRQOL outcomes of CBI versus passive controls were observed for adult patient samples with a relatively lower (adult) age. Previous studies (process- and meta-analyses) of CBIs or self-help also found more favorable outcomes in relatively younger patients with chronic somatic or psychiatric conditions (for somatic symptoms and HRQOL [96, 113], and for functional interference, cognition, and depression [37, 39, 40]). Thus, several powerful studies have now suggested (subtly) better effects of CBI in patients of relatively young adult age. Furthermore, this study found higher estimates of average CBI efficacy for somatic symptom intensity by higher proportions of females and highly educated patients, and for functional interference by initial depressed mood (mean HADS > 7) and sick leave (> 50% of the sample). Higher efficacy estimates and proportions of highly educated patients came with absent reporting of explicit eligibility criteria for computer literacy. Authors of included trials expressed their uncertainty about whether outcomes were influenced by their methods of participant inclusion and could only refer to a single trial with depressed patients to contest this [88, 114]. Some previous studies also reported better HRQOL outcomes by gender , and better depression and/or functional interference outcomes by higher education, depression, and disability [35, 37, 39, 113]. In all, this and previous studies have been inconsistent about the significance, but consistent about the characteristics of CP or FSS patients for whom CBIs are more or less effective. This should not be seen as a reason to offer CBI only to certain patients, because effect sizes are significant for several outcomes in any sub-group. Rather, sensitivity to individual differences in responding may help to achieve the full potential of CBI in practice.
Third, explorations provided insight into characteristics by which CBI is most or least effective. Overall, this study shows that experimental CBIs were quite similar in terms of theoretical basis, behavioral change techniques, and delivery modes. Some aspects that varied between CBIs, including the use of theory for selecting intervention techniques, exposure techniques, and a limited amount of delivery modes were associated with relatively higher effects. Efficacy estimates in this study are relatively high for included studies that referred to third-wave CBT-models (Mindfulness and Acceptance Commitment Therapy) (i.e., for functional interference), but there was no statistically significant moderation effect by different theoretical (CBT) models mentioned. A previous study on the efficacy of face-to-face delivered third-wave therapies in CP suggested that it is a good alternative rather than superior to ‘‘traditional” CBT models . This applies to CBI as well. Furthermore, efficacy estimates for functional interference increased with the presence and level of training of care providers. The importance of professional guidance was stressed before in reviews on CBI for health conditions and depression, and self-help for chronic back pain [34, 110, 116]. Efficacy in somatic symptom outcomes was raised by compliance, which appeared to increase with occasional reminders. Therefore, proficient guidance and compliance feedback may improve efficacy for some outcomes. No significant moderation was found by intervention duration, but efficacy seems highest in studies with a program duration of 7 to 10 weeks. Previous meta-analyses were inconsistent in this regard [32, 34, 117]. It seems reasonable to expect that users need substantial time to process contents that are relevant to them and are likely to lose interest when a program takes too long to complete . Such differences would inform decision makers, clinicians, and developers about design qualities by which CBIs are comparatively efficacious or plausibly equivalent to active intervention through conventional means (face-to-face), i.e. if inaccessible or too costly.
Strengths and limitations
Study limitations were, first, that grey literature had not been searched and authors were not contacted for missing data. Thereby, a risk has been taken that relevant (negative) results are neglected. Secondly, moderator analyses were explorative and intended to inform hypotheses formulation. Since there were statistically significant associations between computer-literacy selection criteria, age, education level, IBS-diagnosis and reporting of 'exposure' techniques, it should be emphasized that subgroup analyses are not suitable for unraveling (spurious) relationships amongst (heterogeneous) outcomes and its factors. These exploratory analyses also overlooked sensitivity by risk of bias and did not enable to control factors for one another (as in meta-regression). Third, the performance of sensitivity analyses by extracted information about generalizability is not a well-established procedure. It is hindered by the novelty of reporting standards for E-health (since 2011) . Because of understandable limitations in reporting at this time, authors agreed that converting reporting items (e.g. participant compensation, co-interventions, numbers and research engagement of providers) to classifications was too ambiguous. Nonetheless, this study has several particular strengths. An extensive search strategy was used, creating a good chance that found studies are exhaustive with regard to eligible full-bodied, peer-reviewed, and published articles. The pooling of outcomes for multiple “overlapping” adult patient conditions increased the number of included studies and meta-analytic power. Classification of intervention content with uniform and empirically supported taxonomies was applied in a consistent, transparent, and independent way on the basis of intervention descriptions in study articles and research protocols [59, 60]. Finally, this is the first study in the field, by knowledge of the authors that included meta-analyses by independent assessment of risk of bias criteria, behavioral intervention content, and relevant items for generalizability.
It is due to these strengths that plenty of information is provided on outcome-level strengths and weaknesses. Regarding our first research question, strength of evidence for short-term CBI outcomes in comparison with passive controls is supported by the robustness of sensitivity analyses across most sources of bias risk. Nonetheless, studies of low risk of bias were minorities across criteria. Concerns for placebo effects also remain , because blinding of participants and staff are generally impractical, and different effect estimates were found by variety in control group interventions and their credibility as attentional placebos. Furthermore, inspected funnel plots did not fully contradict risk of reporting and/or publication bias. This was seen in a previous meta-analysis on self-help for MUPS, but not in meta-analyses on Internet CBT for CP [1, 118]. Therefore, explanations for funnel plot shapes could also be found in other methodological factors, such as the scale of CBI deployment (studies from the United States were typically larger scaled, less often professionally guided and reported relatively lower functional interference outcomes than European studies) [1, 45, 118]. Evidence for internal validity should be considered weak for longer follow-up terms or active comparison groups, because sensitivity analyses were undermined by the scarcity of high quality studies. Indications that a significant degree of effectiveness might be less certain when CBIs are offered to patients in closed clinical or work setting do not contribute to external validation (in routine deployment).
Regarding the second and third research question, important patient and/or intervention factors may be omitted that primary studies did not measure or measured by using different instruments (e.g., previous observations of better effects by higher levels of initial somatic symptoms and self-efficacy could not be replicated [36, 39, 113, 119]). In addition, the use of taxonomies for coding behavioral intervention content could only have led to valid data in so far as accurate descriptions were available. Moreover, findings on relationships between CBI content and outcomes are limited by lacking information about fidelity, despite that standardized delivery is considered to be an important strength of CBI [107, 120, 121]. Overall, the evidence for patient and intervention factors of the heterogeneous efficiency of CBI in some outcomes remains weak.
In general there is a minority of decent quality information in support of a small positive average effect of CBI compared to passive control conditions on relevant (subjective) outcomes in patients with CP or FSS. There is weaker evidence that effects of CBIs last for 6 months or longer and similar to 'traditional' active treatment conditions. Evidence on CBIs complementary to active treatments are to scarce and diverse to draw conclusions. Therefore, the clinical relevance of CBI effects is generally limited for many individual patients with CP or FSS. Moreover, no certainty can be given that effects are generalizable to patients receiving CBIs in work or clinical settings.
Furthermore, there are indications that CBIs that facilitate compliance and “exposure” through specific delivery methods and expert guidance work best for relatively young, highly educated female patients with depressed mood choosing CBIs. However, which of these interdependent patient and intervention factors is decisive (and why) is not clear. More evidence is needed in support of indications that effects on other outcomes (symptom intensity, quality of life, and functional interference) can vary in consistency and strength, depending on whether interventions include theory-based change techniques, “behavioral exposure” specifically, or guidance by (schooled) professionals, or depending on whether (self-selecting) patients are younger, female, highly educated, absent from work, and/or experience more depressed mood. CBIs may not be more or less effective for emotional functioning (catastrophizing and depressed mood outcomes) with certain intervention or patient characteristics. More in-depth explanation is needed to better understand these factors across settings. On the basis of such information, clinicians and policy makers can improve decisions concerning CBIs in development, tailoring, quality assessment, and allocation to patients. Ideally, individual patients who are offered a CBI in regular patient care will get better chances of experiencing clinically relevant outcomes.
Ideally, the efforts of this study are continued by enrichment and refinement of the extracted data for updates. This could be done by collecting information firsthand from authors on intervention factors in compliance with the standard taxonomies and reporting guidelines. Tweaking the search string for improving balance between sensitivity and length would also be helpful. A network meta-analysis of the data could also provide more insight into the relative effectiveness of CBIs in relation to alternatives and each other. However, most progress may be achieved with additional primary studies and embedded process analyses. Future trials should focus on methodological quality, select common measurement instruments, investigate and report completely on selection processes during the recruitment stage, consider more information about patients related to self-selection (e.g. socio-economic status, self-efficacy in general or for using computers), include follow-up terms of at least 6 months, compare active interventions 1-on-1 (i.e., Internet CBT with vs. without exposure techniques), report intervention features and fidelity transparently and uniform. Finally, research should better explain under which conditions individual patients with CP or FSS have a better chance of achieving clinically relevant benefit from behavioral change through CBI than small average group effects imply.
S1 Appendix. Additional details on methods and results.
- 1. Buhrman M, Gordh T, Andersson G. Internet interventions for chronic pain including headache: A systematic review. Internet Interventions. 2016;4(1): 17–34.
- 2. Hedman E, Ljotsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Review of Pharmacoeconomics & Outcomes Research. 2012;12(6): 745–764.
- 3. Gatchel RJ, Peng YB, Peters ML, Fuchs PN, Turk DC. The biopsychosocial approach to chronic pain: scientific advances and future directions. Psychological bulletin. 2007;133(4): 581. pmid:17592957
- 4. Henningsen P, Zipfel S, Herzog W. Management of functional somatic syndromes. The Lancet. 2007;369(9565): 946–955.
- 5. Treede R-D, Rief W, Barke A, Aziz Q, Bennett MI, Benoliel R, et al. A classification of chronic pain for ICD-11. Pain. 2015;156(6): 1003–1007. pmid:25844555
- 6. van der Feltz-Cornelis CM, Hoedeman R, Keuter EJ, Swinkels JA. Presentation of the Multidisciplinary Guideline Medically Unexplained Physical Symptoms (MUPS) and Somatoform Disorder in the Netherlands: disease management according to risk profiles. Journal of psychosomatic research. 2012;72(2): 168–169. pmid:22281461
- 7. Mayou R, Farmer A. Functional somatic symptoms and syndromes. British Medical Journal. 2002;325(7358): 265. pmid:12153926
- 8. Ehde DM, Dillworth TM, Turner JA. Cognitive-behavioral therapy for individuals with chronic pain: Efficacy, innovations, and directions for research. American Psychologist. 2014;69(2): 153–166. pmid:24547801
- 9. Naylor MR, Keefe FJ, Brigidi B, Naud S, Helzer JE. Therapeutic Interactive Voice Response for chronic pain reduction and relapse prevention. Pain. 2008;134(3): 335–345. pmid:18178011
- 10. Johannes CB, Le TK, Zhou X, Johnston JA, Dworkin RH. The prevalence of chronic pain in United States adults: results of an Internet-based survey. The Journal of Pain. 2010;11(11): 1230–1239. pmid:20797916
- 11. Breivik H, Collett B, Ventafridda V, Cohen R, Gallacher D. Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment. European journal of pain. 2006;10(4): 287. pmid:16095934
- 12. Johnston S, Brenu EW, Staines D, Marshall-Gradisnik S. The prevalence of chronic fatigue syndrome/myalgic encephalomyelitis: a meta-analysis. Clin Epidemiol. 2013;5(1): 105–110.
- 13. Langguth B, Kreuzer PM, Kleinjung T, De Ridder D. Tinnitus: causes and clinical management. The Lancet Neurology. 2013;12(9): 920–930. pmid:23948178
- 14. Eccleston C, Fisher E, Craig L, Duggan GB, Rosser BA, Keogh E. Psychological therapies (Internet‐delivered) for the management of chronic pain in adults. The Cochrane Library. 2014.
- 15. Lalloo C, Jibb LA, Rivera J, Agarwal A, Stinson JN. “There’sa pain App for that”: Review of patient-targeted smartphone applications for pain management. The Clinical journal of pain. 2015;31(6): 557–563. pmid:25370138
- 16. Oerlemans S, van Cranenburgh O, Herremans P-J, Spreeuwenberg P, van Dulmen S. Intervening on cognitions and behavior in irritable bowel syndrome: A feasibility trial using PDAs. Journal of Psychosomatic Research. 2011;70(3): 267–277. pmid:21334498
- 17. Beatty L, Lambert S. A systematic review of internet-based self-help therapeutic interventions to improve distress and disease-control among adults with chronic health conditions. Clinical Psychology Review. 33(4): 609–622. pmid:23603521
- 18. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet‐based vs. face‐to‐face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta‐analysis. World Psychiatry. 2014;13(3): 288–295. pmid:25273302
- 19. Anne van Gils M, Schoevers RA, Bonvanie IJ, Gelauff JM, Roest AM, Rosmalen JG. Self-Help for Medically Unexplained Symptoms: A Systematic Review and Meta-Analysis. 2016;78(6): 728–739.
- 20. Bender JL, Radhakrishnan A, Diorio C, Englesakis M, Jadad AR. Can pain be managed through the Internet? A systematic review of randomized controlled trials. PAIN®. 2011;152(8): 1740–1750.
- 21. Boyers D, McNamee P, Clarke A, Jones D, Martin D, Schofield P, et al. Cost-effectiveness of self-management methods for the treatment of chronic pain in an aging adult population: A systematic review of the literature. The Clinical Journal of Pain. 2013;29(4): 366–375. pmid:23042472
- 22. Brown M, Glendenning AC, Hoon AE, John A. Effectiveness of Web-Delivered Acceptance and Commitment Therapy in Relation to Mental Health and Well-Being: A Systematic Review and Meta-Analysis. Journal of Medical Internet Research. 2016;18(8): e221. pmid:27558740
- 23. Buhrman M, Gordh T, Andersson G. Internet interventions for chronic pain including headache: A systematic review. Internet Interventions. 2016;4: 17–34.
- 24. Garg S, Garg D, Turin TC, Chowdhury MFU. Web-Based Interventions for Chronic Back Pain: A Systematic Review. Journal of Medical Internet Research. 2016;18(7): e139. pmid:27460413
- 25. Greenwell K, Sereda M, Coulson N, El Refaie A, Hoare DJ. A systematic review of techniques and effects of self-help interventions for tinnitus: Application of taxonomies from health psychology. International journal of audiology. 2016;55 Suppl 3: 1–11. pmid:27146036
- 26. Heapy AA, Higgins DM, Cervone D, Wandner L, Fenton BT, Kerns RD. A Systematic Review of Technology-assisted Self-Management Interventions for Chronic Pain. The Clinical journal of pain. 2015;31(6): 470–492. pmid:25411862
- 27. Liegl G, Plessen CY, Leitner A, Boeckle M, Pieh C. Guided self-help interventions for irritable bowel syndrome: a systematic review and meta-analysis. European journal of gastroenterology & hepatology. 2015;27(10): 1209–1221.
- 28. McCombie A, Gearry R, Andrews J, Mikocka-Walus A, Mulder R. Computerised cognitive behavioural therapy for psychological distress in patients with physical illnesses: a systematic review. Journal of Clinical Psychology in Medical Settings. 2015;22(1): 20–44. pmid:25666485
- 29. Mikocka-Walus A. Utilization and efficacy of internet-based eHealth technology in gastroenterology: A systematic review. Scandinavian Journal of Gastroenterology. 2014;49(4): 387–408. pmid:24494974
- 30. Nyenhuis N, Golm D, Kröner-Herwig B. A systematic review and meta-analysis on the efficacy of self-help interventions in tinnitus. Cognitive Behaviour Therapy. 2013;42(2): 159–169. pmid:23777192
- 31. Spijkerman M, Pots W, Bohlmeijer E. Effectiveness of online mindfulness-based interventions in improving mental health: A review and meta-analysis of randomised controlled trials. Clinical psychology review. 2016;45: 102–114. pmid:27111302
- 32. van Beugen S, Ferwerda M, Hoeve D, Rovers MM, Spillekom-van Koulil S, van Middendorp H, et al. Internet-Based Cognitive Behavioral Therapy for Patients With Chronic Somatic Conditions: A Meta-Analytic Review. Journal of Medical Internet Research. 2014;16(3): 251–265. pmid:24675372
- 33. Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, et al. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. The Journal of Pain. 2008;9(2): 105–121. pmid:18055266
- 34. Carnes D, Homer KE, Miles CL, Pincus T, Underwood M, Rahman A, et al. Effective delivery styles and content for self-management interventions for chronic musculoskeletal pain: a systematic literature review. The Clinical journal of pain. 2012;28(4): 344–354. pmid:22001667
- 35. Pots WT, Trompetter HR, Schreurs KM, Bohlmeijer ET. How and for whom does web-based acceptance and commitment therapy work? Mediation and moderation analyses of web-based ACT for depressive symptoms. BMC psychiatry. 2016;16(1): 158.
- 36. Ljotsson B, Lindfors P, Lackner JM, Gronberg K, Molin K, Noren J, et al. Prediction of symptomatic improvement after exposure-based treatment for irritable bowel syndrome. BMC gastroenterology. 2013;13(1): 160. pmid:24245807
- 37. Miles CL, Pincus T, Carnes D, Homer KE, Taylor SJ, Bremner SA, et al. Can we identify how programmes aimed at promoting self-management in musculoskeletal pain work and who benefits? A systematic review of sub-group analysis within RCTs. European journal of pain. 2011;15(8): 775.e11. pmid:21354838
- 38. DasMahapatra P, Chiauzzi E, Pujol LM, Los C, Trudeau KJ. Mediators and moderators of chronic pain outcomes in an online self-management program. The Clinical journal of pain. 2015;31(5): 404. pmid:24918473
- 39. Dear B, Gandy M, Karin E, Ricciardi T, Langman N, Staples L, et al. The Pain Course: exploring predictors of clinical response to an Internet-delivered pain management program. Pain. 2016;157(10): 2257–22568. pmid:27257857
- 40. Grist R, Cavanagh K. Computerised cognitive behavioural therapy for common mental health disorders, what works, for whom under what circumstances? A systematic review and meta-analysis. Journal of Contemporary Psychotherapy. 2013;43(4): 243–251.
- 41. Mair FS, May C, O'Donnell C, Finch T, Sullivan F, Murray E. Factors that promote or inhibit the implementation of e-health systems: an explanatory systematic review. Bulletin of the World Health Organization. 2012;90(5): 357–364. pmid:22589569
- 42. Waller R, Gilbody S. Barriers to the uptake of computerized cognitive behavioural therapy: a systematic review of the quantitative and qualitative evidence. Psychological medicine. 2009;39(05): 705–712.
- 43. Eccleston C. Can ‘ehealth’ technology deliver on its promise of pain management for all? Pain. 2011;152(8): 1701–1702. pmid:21612868
- 44. Rini C, Porter LS, Somers TJ, McKee DC, Keefe FJ. Retaining critical therapeutic elements of behavioral interventions translated for delivery via the Internet: recommendations and an example using pain coping skills training. Journal of medical Internet research. 2014;16(12): e245. pmid:25532216
- 45. Higgins JP, Green S. Cochrane handbook for systematic reviews of interventions: John Wiley & Sons; 2011.
- 46. Eysenbach G, Group C-E. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. Journal of medical Internet research. 2011;13(4): e126. pmid:22209829
- 47. Smeets RJ, Vlaeyen JW, Kester AD, Knottnerus JA. Reduction of pain catastrophizing mediates the outcome of both physical and cognitive-behavioral treatment in chronic low back pain. The Journal of Pain. 2006;7(4): 261–271. pmid:16618470
- 48. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS med. 2009;6(7): e1000097. pmid:19621072
- 49. Bailey JV, Murray E, Rait G, Mercer CH, Morris RW, Peacock R, et al. Interactive computer‐based interventions for sexual health promotion. The Cochrane Library. 2010.
- 50. Rief W, Martin A. How to use the new DSM-5 somatic symptom disorder diagnosis in research and practice: a critical evaluation and a proposal for modifications. Annual Review of Clinical Psychology. 2014;10: 339–367. pmid:24387234
- 51. Hoedeman R, Blankenstein AH, van der Feltz‐Cornelis CM, Krol B, Stewart R, Groothoff JW. Consultation letters for medically unexplained physical symptoms in primary care. The Cochrane Library. 2010. pmid:21154369
- 52. Rosendal M, Blankenstein AH, Morriss R, Fink P, Sharpe M, Burton C. Enhanced care by generalists for functional somatic symptoms and disorders in primary care. The Cochrane Library. 2013.
- 53. Martlew J, Pulman J, Marson AG. Psychological and behavioural treatments for adults with non‐epileptic attack disorder. The Cochrane Library. 2014. pmid:24519702
- 54. Ljotsson B, Lindefors N. Cognitive behavior therapy via the Internet: A systematic review of applications, clinical efficacy and cost-effectiveness. Expert Review of Pharmacoeconomics and Outcomes Research. 2012;12(6): 745–764. pmid:23252357
- 55. Richmond H, Hall AM, Copsey B, Hansen Z, Williamson E, Hoxey-Thomas N, et al. The effectiveness of cognitive behavioural treatment for non-specific low back pain: a systematic review and meta-analysis. Plos One. 2015;10(8): e0134192. pmid:26244668
- 56. Pajak R, Lackner J, Kamboj SK. A systematic review of minimal-contact psychological treatments for symptom management in Irritable Bowel Syndrome. Journal of Psychosomatic Research. 2013;75(2):103–112. pmid:23915765
- 57. Cavanagh K, Strauss C, Forder L, Jones F. Can mindfulness and acceptance be learnt by self-help?: A systematic review and meta-analysis of mindfulness and acceptance-based self-help interventions. Clinical psychology review. 2014;34(2): 118–129. pmid:24487343
- 58. Kulkarni AV, Aziz B, Shams I, Busse JW. Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. Jama. 2009;302(10): 1092–1096. pmid:19738094
- 59. Webb T, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. Journal of medical Internet research. 2010;12(1): e4. pmid:20164043
- 60. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Annals of behavioral medicine. 2013;46(1): 81–95. pmid:23512568
- 61. Van Tulder M, Furlan A, Bombardier C, Bouter L, Group EBotCCBR. Updated method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group. Spine. 2003;28(12): 1290–1299. pmid:12811274
- 62. Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343: d5928. pmid:22008217
- 63. Berger VW, Alperson SY. A general framework for the evaluation of clinical trial quality. Reviews on recent clinical trials. 2009;4(2): 79–88. pmid:19463104
- 64. Deeks JJ, Higgins JP. Statistical algorithms in review manager 5. Statistical Methods Group of The Cochrane Collaboration. 2010:1–11.
- 65. Abbott J-AM, Kaldo V, Klein B, Austin D, Hamilton C, Piterman L, et al. A cluster randomised trial of an internet-based intervention program for tinnitus distress in an industrial setting. Cognitive Behaviour Therapy. 2009;38(3): 162–173. pmid:19675959
- 66. Andersson G, Lundström P, Ström L. Internet-Based Treatment of Headache: Does Telephone Contact Add Anything? Headache: The Journal of Head and Face Pain. 2003;43(4): 353–361.
- 67. Andersson G, Strömgren T, Ström L, Lyttkens L. Randomized controlled trial of Internet-based cognitive behavior therapy for distress associated with tinnitus. Psychosomatic Medicine. 2002;64(5): 810–816. pmid:12271112
- 68. Brattberg G. Internet-based rehabilitation for individuals with chronic pain and burnout: a randomized trial. International Journal of Rehabilitation Research. 2006;29(3): 221–227. pmid:16900043
- 69. Buhrman M, Fältenhag S, Ström L, Andersson G. Controlled trial of Internet-based treatment with telephone support for chronic back pain. PAIN®. 2004;111(3): 368–377. pmid:15363881
- 70. Buhrman M, Fredriksson A, Edström G, Shafiei D, Tärnqvist C, Ljótsson B, et al. Guided internet‐delivered cognitive behavioural therapy for chronic pain patients who have residual symptoms after rehabilitation treatment: Randomized controlled trial. European Journal of Pain. 2013;17(5): 753–765. pmid:23139021
- 71. Buhrman M, Nilsson-Ihrfeldt E, Jannert M, Ström L, Andersson G. Guided internet-based cognitive behavioural treatment for chronic back pain reduces pain catastrophizing: a randomized controlled trial. Journal of rehabilitation medicine. 2011; 43(6): 500–505. pmid:21533329
- 72. Buhrman M, Skoglund A, Husell J, Bergström K, Gordh T, Hursti T, et al. Guided internet-delivered acceptance and commitment therapy for chronic pain patients: A randomized controlled trial. Behaviour Research and Therapy. 2013;51(6):307–315. pmid:23548250
- 73. Buhrman M, Syk M, Burvall O, Hartig T, Gordh T, Andersson G. Individualized guided Internet-delivered cognitive-behavior therapy for chronic pain patients with comorbid depression and anxiety: A randomized controlled trial. The Clinical Journal of Pain. 2015;31(6): 504–516. pmid:25380222
- 74. Camerini L, Schulz PJ. Effects of functional interactivity on patients’ knowledge, empowerment, and health outcomes: An experimental model-driven evaluation of a web-based intervention. Journal of Medical Internet Research. 2012;14(4): 60–75. pmid:22810046
- 75. Carpenter KM, Stoner SA, Mundt JM, Stoelb B. An on-line self-help CBT intervention for chronic lower back pain. The Clinical Journal of Pain. 2012;28(1): 14–22. pmid:21681084
- 76. Chiauzzi E, Pujol LA, Wood M, Bond K, Black R, Yiu E, et al. painACTION-Back Pain: A self-management website for people with chronic back pain. Pain Medicine. 2010;11(7): 1044–1058. pmid:20545873
- 77. Davis MC, Zautra AJ. An online mindfulness intervention targeting socioemotional regulation in fibromyalgia: Results of a randomized controlled trial. Annals of Behavioral Medicine. 2013;46(3): 273–284. pmid:23670111
- 78. de Boer MJ, Versteegen GJ, Vermeulen KM, Sanderman R, Struys MMRF. A randomized controlled trial of an internet‐based cognitive–behavioural intervention for non‐specific chronic pain: An effectiveness and cost‐effectiveness study. European Journal of Pain. 2014;18(10): 1440–1451. pmid:24777973
- 79. Dear BF, Gandy M, Karin E, Staples LG, Johnston L, Fogliati VJ, et al. The Pain Course: a randomised controlled trial examining an internet-delivered pain management program when provided with different levels of clinician support. PAIN®. 2015;156(10): 1920–1935. pmid:26039902
- 80. Dear BF, Titov N, Perry KN, Johnston L, Wootton BM, Terides MD, et al. The Pain Course: A randomised controlled trial of a clinician-guided Internet-delivered cognitive behaviour therapy program for managing chronic pain and emotional well-being. PAIN®. 2013;154(6): 942–950.
- 81. Devineni T, Blanchard EB. A randomized controlled trial of an Internet-based treatment for chronic headache. Behaviour Research and Therapy. 2005;43(3): 277–292. pmid:15680926
- 82. Dowd H, Hogan MJ, McGuire BE, Davis MC, Sarma KM, Fish RA, et al. Comparison of an online mindfulness-based cognitive therapy intervention with online pain management psychoeducation: A randomized controlled study. The Clinical Journal of Pain. 2015;31(6): 517–527. pmid:25565584
- 83. Everitt H, Moss-Morris R, Sibelli A, Tapp L, Coleman N, Yardley L, et al. Management of irritable bowel syndrome in primary care: The results of an exploratory randomised controlled trial of mebeverine, methylcellulose, placebo and a self-management website. BMC gastroenterology. 2013;13(1): e68. pmid:23602047
- 84. Hesser H, Gustafsson T, Lundén C, Henrikson O, Fattahi K, Johnsson E, et al. A randomized controlled trial of internet-delivered cognitive behavior therapy and acceptance and commitment therapy in the treatment of tinnitus. Journal of Consulting and Clinical Psychology. 2012;80(4): 649–661. pmid:22250855
- 85. Hunt MG, Ertel E, Coello JA, Rodriguez L. Empirical support for a self-help treatment for IBS. Cognitive Therapy and Research. 2015;39(2): 215–227.
- 86. Hunt MG, Moshier S, Milonova M. Brief cognitive-behavioral internet therapy for irritable bowel syndrome. Behaviour Research and Therapy. 2009;47(9): 797–802. pmid:19570525
- 87. Janse A, Wiborg JF, Bleijenberg G, Tummers M, Knoop H. The efficacy of guided self-instruction for patients with idiopathic chronic fatigue: A randomized controlled trial. Journal of Consulting and Clinical Psychology. 2016;84(5): 377–388. pmid:26950098
- 88. Jasper K, Weise C, Conrad I, Andersson G, Hiller W, Kleinstäuber M. Internet-based guided self-help versus group cognitive behavioral therapy for chronic tinnitus: A randomized controlled trial. Psychotherapy and Psychosomatics. 2014;83(4): 234–246. pmid:24970708
- 89. Kaldo V, Levin S, Widarsson J, Buhrman M, Larsen H-C, Andersson G. Internet versus group cognitive-behavioral treatment of distress associated with tinnitus: A randomized controlled trial. Behavior Therapy. 2008;39(4): 348–359. pmid:19027431
- 90. Krein SL, Kadri R, Hughes M, Kerr EA, Piette JD, Holleman R, et al. Pedometer-based internet-mediated intervention for adults with chronic low back pain: Randomized controlled trial. Journal of Medical Internet Research. 2013;15(8): 41–54. pmid:23969029
- 91. Kristjánsdóttir ÓB, Fors EA, Eide E, Finset A, Stensrud TL, van Dulmen S, et al. A smartphone-based intervention with diaries and therapist-feedback to reduce catastrophizing and increase functioning in women with chronic widespread pain: Randomized controlled trial. Journal of Medical Internet Research. 2013;15(1): 125–146. pmid:23291270
- 92. Lee MH, Wu HC, Lin JY, Tan TH, Chan PC, Chen YF. Development and evaluation of an E-health system to care for patients with bladder pain syndrome/interstitial cystitis. International journal of urology: official journal of the Japanese Urological Association. 2014;21: 62–68.
- 93. Ljotsson B, Andersson G, Andersson E, Hedman E, Lindfors P, Andreewitch S, et al. Acceptability, effectiveness, and cost-effectiveness of internet-based exposure treatment for irritable bowel syndrome in a clinical sample: A randomized controlled trial. BMC gastroenterology. 2011;11: e110. pmid:21992655
- 94. Ljótsson B, Falk L, Vesterlund AW, Hedman E, Lindfors P, Rück C, et al. Internet-delivered exposure and mindfulness based therapy for irritable bowel syndrome: A randomized controlled trial. Behaviour Research and Therapy. 2010;48(6): 531–539. pmid:20362976
- 95. Ljotsson B, Hedman E, Andersson E, Hesser H, Lindfors P, Hursti T, et al. Internet-delivered exposure-based treatment vs. Stress management for irritable bowel syndrome: A randomized trial. American journal of gastroenterology. 2011;106(8): 1481–1491. pmid:21537360
- 96. Lorig KR, Ritter PL, Laurent DD, Plant K. The internet-based arthritis self-management program: a one-year randomized trial for patients with arthritis or fibromyalgia. Arthritis Care & Research. 2008;59(7): 1009–1017.
- 97. Menga G, Ing S, Khan O, Dupre B, Dornelles AC, Alarakhia A, et al. Fibromyalgia: can online cognitive behavioral therapy help? Ochsner J. 2014;14(3): 343–349. pmid:25249800
- 98. Moessner M, Aufdermauer N, Baier C, Göbel H, Kuhnt O, Neubauer E, et al. Wirksamkeit eines Internet-gestützten Nachsorgeangebots für Patienten mit chronischen Rückenschmerzen. = Efficacy of an internet-delivered aftercare program for patients with chronic back pain. PPmP: Psychotherapie Psychosomatik Medizinische Psychologie. 2014;64(2): 47–53. pmid:24101036
- 99. Mourad G, Stromberg A, Jonsbu E, Gustafsson M, Johansson P, Jaarsma T. Guided Internet-delivered cognitive behavioural therapy in patients with non-cardiac chest pain: a pilot randomized controlled study. Trials. 2016;17: e352.
- 100. Riva S, Camerini AL, Allam A, Schulz PJ. Interactive sections of an Internet-based intervention increase empowerment of chronic back pain patients: randomized controlled trial. Journal of medical Internet research. 2014;16(8): e180. pmid:25119374
- 101. Ruehlman LS, Karoly P, Enders C. A randomized controlled evaluation of an online chronic pain self management program. PAIN®. 2012;153(2): 319–330. pmid:22133450
- 102. Schulz PJ, Rubinell S, Hartung U. An internet-based approach to enhance self-managementof chronic low back pain in the italian-speaking population of Switzerland: results from a pilot study. International journal of public health. 2007;52(5): 286–294. pmid:18030944
- 103. Ström L, Pettersson R, Andersson G. A controlled trial of self-help treatment of recurrent headache conducted via the Internet. Journal of Consulting and Clinical Psychology. 2000;68(4): 722–727. pmid:10965647
- 104. Trompetter HR, Bohlmeijer ET, Veehof MM, Schreurs KMG. Internet-based guided self-help intervention for chronic pain based on Acceptance and Commitment Therapy: A randomized controlled trial. Journal of Behavioral Medicine. 2015;38(1): 66–80. pmid:24923259
- 105. Vallejo MA, Ortega J, Rivera J, Comeche MI, Vallejo-Slocker L. Internet versus face-to-face group cognitive-behavioral therapy for fibromyalgia: A randomized control trial. Journal of Psychiatric Research. 2015;68: 106–113. pmid:26228408
- 106. Weise C, Kleinstauber M, Andersson G. Internet-Delivered Cognitive-Behavior Therapy for Tinnitus: A Randomized Controlled Trial. Psychosomatic Medicine. 2016;78(4): 501–510. pmid:26867083
- 107. Williams DA, Kuper D, Segar M, Mohan N, Sheth M, Clauw DJ. Internet-enhanced management of fibromyalgia: A randomized controlled trial. PAIN®. 2010;151(3): 694–702. pmid:20855168
- 108. Wilson M, Roll JM, Corbett C, Barbosa-Leiker C. Empowering patients with persistent pain using an internet-based self-management program. Pain Management Nursing. 2015;16(4): 503–514. pmid:26088940
- 109. Brattberg G. Internet-based rehabilitation for individuals with chronic pain and burnout II: a long-term follow-up. International Journal of Rehabilitation Research. 2007;30(3): 231–234. pmid:17762769
- 110. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clinical psychology review. 2012;32(4): 329–342. pmid:22466510
- 111. Ebert DD, Zarski A-C, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. Plos One. 2015;10(3): e0119895. pmid:25786025
- 112. Lackner JM, Jaccard J, Krasner SS, Katz LA, Gudleski GD, Blanchard EB. How does cognitive behavior therapy for irritable bowel syndrome work? A mediational analysis of a randomized clinical trial. Gastroenterology. 2007;133(2): 433–444. pmid:17681164
- 113. Ritter PL, Lee J, Lorig K. Moderators of chronic disease self-management programs: who benefits? Chronic illness. 2011;7(2): 162–172. pmid:21357642
- 114. Donkin L, Hickie I, Christensen H, Naismith S, Neal B, Cockayne N, et al. Sampling bias in an internet treatment trial for depression. Translational psychiatry. 2012;2(10): e174.
- 115. Veehof MM, Oskam M-J, Schreurs KM, Bohlmeijer ET. Acceptance-based interventions for the treatment of chronic pain: a systematic review and meta-analysis. PAIN®. 2011;152(3): 533–542.
- 116. Schubart JR, Stuckey HL, Ganeshamoorthy A, Sciamanna CN. Chronic health conditions and internet behavioral interventions: a review of factors to enhance user engagement. Computers, Informatics, Nursing. 2011;29(2): 81–92. pmid:21164337
- 117. Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The Benefit of Web-and Computer-Based Interventions for Stress: A Systematic Review and Meta-Analysis. Journal of medical Internet research. 2017;19(2): e32. pmid:28213341
- 118. Macea DD, Gajos K, Calil YAD, Fregni F. The efficacy of web-based cognitive behavioral interventions for chronic pain: A systematic review and meta-analysis. The Journal of Pain. 2010;11(10): 917–929. pmid:20650691
- 119. Turner JA, Holtzman S, Mancl L. Mediators, moderators, and predictors of therapeutic change in cognitive–behavioral therapy for chronic pain. PAIN®. 2007;127(3): 276–286.
- 120. Shafran R, Clark D, Fairburn C, Arntz A, Barlow D, Ehlers A, et al. Mind the gap: Improving the dissemination of CBT. Behaviour research and therapy. 2009;47(11): 902–909. pmid:19664756
- 121. Andrews G, Williams AD. Up-scaling clinician assisted internet cognitive behavioural therapy (iCBT) for depression: A model for dissemination into primary care. Clinical psychology review. 2015;41: 40–48. pmid:25043445