Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A randomized waitlist-controlled trial comparing detached mindfulness and cognitive restructuring in obsessive-compulsive disorder

  • Christian Rupp ,

    Contributed equally to this work with: Christian Rupp, Charlotte Jürgens

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Institute of Psychology, Westfälische Wilhelms-University Münster, Fliednerstrasse 21, Münster, Germany, Christoph-Dornier-Stiftung, Schorlemerstrasse 26, Münster, Germany

  • Charlotte Jürgens ,

    Contributed equally to this work with: Christian Rupp, Charlotte Jürgens

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Institute of Psychology, Westfälische Wilhelms-University Münster, Fliednerstrasse 21, Münster, Germany, Christoph-Dornier-Stiftung, Schorlemerstrasse 26, Münster, Germany

  • Philipp Doebler,

    Roles Formal analysis, Software, Writing – review & editing

    Affiliation Department of Statistics, TU Dortmund University, Dortmund, Germany

  • Fabian Andor,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision

    Affiliation Christoph-Dornier-Stiftung, Schorlemerstrasse 26, Münster, Germany

  • Ulrike Buhlmann

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    ulrike.buhlmann@wwu.de

    Affiliation Institute of Psychology, Westfälische Wilhelms-University Münster, Fliednerstrasse 21, Münster, Germany

Abstract

Objective

Whereas research has demonstrated the efficacy of cognitive restructuring (CR) for obsessive-compulsive disorder (OCD), little is known about the efficacy of specific metacognitive interventions such as detached mindfulness (DM). Therefore, this study compared the efficacy of CR and DM as stand-alone interventions.

Design

We conducted a randomized waitlist-controlled trial. n = 43 participants were randomly assigned to either DM or CR. Out of those participants, n = 21 participants had been previously assigned to a two-week waitlist condition.

Materials and methods

In both conditions, treatment comprised four double sessions within two weeks. Assessment took place at baseline (Pre1), after treatment (Post) and four weeks after the end of treatment (FU). There was a second baseline assessment (Pre2) in the waitlist group. Independent evaluators were blinded concerning the active condition. Adherence and competence ratings for the two therapists were obtained from an independent rater.

Results

40 patients completed the treatment. Two patients dropped out because of exacerbated depression. There were no further adverse events. Both CR and DM were shown to be superior to waitlist and equally effective at reducing OCD symptoms from pre to post assessment as measured with the Y-BOCS (CR: d = 1.67, DM: d = 1.55). In each of the two treatment conditions, eight patients (40%) exhibited a clinical significant change at post assessment.

Conclusions

The results of this clinical trial suggest the potential efficacy of DM as a stand-alone intervention for OCD, however, our findings need to be interpreted with caution. Results indicate that both CR and DM should be considered as possible alternative treatments for OCD, whereas the working mechanisms of DM have yet to be elucidated.

Introduction

According to DSM-5, obsessive-compulsive disorder (OCD) is defined by intrusive and unwanted thoughts, images or urges (from now on referred to as obsessive thoughts or obsessions) and/or repetitive overt behaviors or mental acts used to reduce fear or distress caused by the above-named intrusive mental event [1]. Concerning treatment guidelines [2], cognitive behavioral therapy comprising exposure and response prevention (ERP), i. e., confronting patients with triggering stimuli while encouraging them to refrain from compulsions, as well as psychopharmacological treatment with selective serotonin reuptake inhibitors are considered as gold standard in treating OCD. However, around 30% of the patients treated with cognitive behavioral therapy either do not respond to this treatment [3] or decline the stressful and demanding exposure interventions. Moreover, around 20% of patients drop out of therapy [4], so that it seems crucial to further improve current treatments and to promote the development of alternative treatments.

Metacognitive therapy

Wells and Matthews [5] developed the Self-Regulatory Executive Function (S-REF) model of psychological disorders, which accentuates the role of metacognition in psychological disorders. Regarding OCD, the metacognitive model [6] emphasizes the meaning of dysfunctional metacognitive beliefs in the development and maintenance of OCD. Most importantly, it assumes that obsessive thoughts activate metacognitive beliefs concerning the meaning of thoughts, such as the assumption that thoughts represent or have an impact on reality (referred to as Thought-Action-Fusion, Thought-Object-Fusion and Thought-Event-Fusion, respectively). Based on these fusion-beliefs, obsessive thoughts are perceived as threatening, thus activating negative emotions (e.g., fear, guilt, distress) as well as metacognitive thoughts about the need to perform rituals or to engage in thought suppression. These rituals then serve to reduce the perceived threat, while internal metacognitive criteria about stop signals serve as reference when to end the rituals.

Metacognitive therapy (MCT) of OCD based on the model mentioned above focuses on challenging metacognitive beliefs, whereas it explicitly does not include questioning of thought content. Instead, MCT comprises techniques such as detached mindfulness (DM), exposure and response commission and Socratic questioning of metacognitive beliefs. According to Wells [6], DM is a key technique in treating OCD as it offers an overall new approach to dealing with intrusive thoughts. Wells and Matthews [5] described DM as a technique to develop meta-consciousness, i. e., a state of mind in which the self and cognitive events are separated from one another. While in this state, the person is aware of his or her thoughts only being mental events–which s/he learns to solely observe in a passive way.

Efficacy of complex MCT treatment programs for OCD has been proven in a number of trials with, however, comparably small sample sizes [710]. However, only a few studies have examined the efficacy of single treatment components of MCT.

Wahl et al. [11] compared the efficacy of a mindfulness-based strategy with a distraction strategy during brief exposure to obsessive thoughts in a sample of 30 OCD patients. Significant decreases in anxiety and urge to neutralize between time of experimental manipulation and to post assessment were only found in the mindfulness-based strategy group. Firouzabadi and Shareh [12] examined the efficacy of DM in a single case study treating an OCD patient. The treatment led to a 26-point-decrease in Y-BOCS score from pre- to follow-up-assessment. Ludvik and Boschen [13] compared the efficacy of DM, cognitive restructuring (CR) and a control task (reading an unrelated scientific article) in reducing experimentally induced memory distrust and urge to check in a sample of 65 undergraduate students. Compared with the control task, participants in the control group were significantly more likely to check than participants receiving DM or CR, whereas only DM led to a significant improvement in memory confidence at post-test. However, the experimental manipulation in this study cannot be compared to an actual treatment since it was delivered in the form of a written instruction and was limited to one single occasion.

As MCT focuses on changing one’s relationship to one’s own thoughts and since DM embodies a direct way of training this new way of dealing with mental events such as intrusive thoughts, it is expected to lead to a reduction in OCD symptoms according to the metacognitive model. Thus, it seems essential to examine the efficacy of DM as a stand-alone intervention in the treatment of OCD.

Cognitive restructuring

In contrast to MCT, the cognitive models of OCD proposed by Salkovskis [14, 15] and Rachman [16] emphasize the impact of distorted cognitions in the development and maintenance of OCD. Both authors suggest that not the intrusions themselves but rather the meaning attached to them (referred to as “automatic thoughts” by Salkovskis and as “misinterpretations” by Rachman) are responsible for negative emotional consequences—such as when interpreting having the intrusion as proof for being a “bad person”. Evidence for this assumption comes, for example, from studies in which non-clinical samples were shown to report intrusions without being distressed [17, 18]. Salkovskis [14] suggested that these automatic thoughts are caused by specific individual beliefs about being personally responsible for harm, beliefs that having thoughts about an action is the same as accomplishing an action as well as beliefs about the need to control thoughts. Similar distortions have been described by the Obsessive Compulsive Cognitions Working Group (OCCWG) [19] who, in addition to Salkovskis, also list perfectionism, intolerance for uncertainty and overestimation of threat as relevant cognitive distortions in OCD.

Built on the cognitive model, which emphasizes that dysfunctional cognitions in response to intrusions constitute the maintaining factor in OCD, cognitive restructuring (CR) of OCD targets distorted cognitions/appraisals of obsessive thoughts primarily by using Socratic questioning. Thus, unlike DM, which teaches patients to passively observe and disassociate themselves from their intrusions while refraining from any sort of conceptual processing, CR provides patients with an active strategy of dealing with obsessive thoughts by questioning the appraisals attached to them. As such, DM and CR can be regarded as two entirely different approaches to the same problem.

Efficacy of CR in the treatment of OCD has been shown in a number of trials, of which, however, the majority comprised behavioral experiments, which can be considered as having some overlap with exposure tasks because they involve confronting patients with triggering stimuli (such as locking the door without checking if it is locked in checking-related OCD) while encouraging them to refrain from compulsions. Whereas ERP would traditionally highlight that over time, feelings of fear, disgust and tension decrease (which is often referred to as habituation), behavioral experiments within a CR approach would emphasize that a certain cognition has been contradicted (e. g., because the expected burglary did not occur).

The studies by Wilhelm et al. [20, 21] and Belloch et al. [22] all demonstrate the efficacy of complex cognitive treatment programs including behavioral experiments over several weeks. According to meta-analyses [4, 23, 24], CR proves to be an effective method for treating OCD—for lack of any significant differences concerning treatment efficacy of CR vs. ERP. Various other studies have investigated the efficacy of CR as compared to ERP, most of which showed no considerable differences concerning efficacy [25, 26], with one study suggesting ERP to be superior to CR in terms of recovery rates [27] and one showing the opposite result [28]. It should be noted in this context that the only one of the above-named studies whose protocol did not include behavioral experiments was the one effectiveness study by Belloch et al. [29], so that there is little evidence for the efficacy of “purely Beckian” cognitive restructuring excluding this element. Finally, a number of meta-analyses [4, 23, 24], arrive at the conclusion that CR proves to be an effective method for treating OCD.

Given the two seemingly contradictory strategies for treating OCD, the main goal of our study was to examine the efficacy of 1) teaching patients a passively observing relation to one’s own thoughts (i. e., DM) on the one hand and 2) leading them to actively question distorted appraisals and beliefs (i. e., CR) on the other hand. Since the efficacy of CR for OCD, often being compared with ERP, has been widely demonstrated (with most protocols, however, involving behavioral experiments), we regarded CR as the more established treatment approach that we decided to compare with DM, which represents a more recent and conceptually fresh take on treating OCD. In either case, our interest was to elucidate the efficacy of both approaches as stand-alone interventions, which is why we compared a purely “Beckian” form of CR with the specific intervention of DM.

Materials and methods

Study design

The study protocol for this clinical trial was registered at ClinicalTrials.gov under the ID NCT03002753 and the title “Dealing With Intrusive Thoughts in OCD—a Comparison of Detached Mindfulness and Cognitive Restructuring”(Protocol ID: CDS-MS-JR-2016, URL: https://clinicaltrials.gov/ct2/results?cond=&term=NCT03002753&cntry=&state=&city=&dist=). The design of the study can be best described as a randomized delayed-intervention controlled trial with an underlying parallel design concerning the two active conditions (CR/DM). Participants randomized to the non-waitlist (NWL) group started their treatment at the beginning of the week following initial assessment (Pre1) whereas participants randomized to the waitlist control group (WL) started treatment with a delay of two weeks.

The study protocol was reviewed and approved of by the ethics committee of the Department of Psychology and Sport Science at the University of Münster, Germany (approval number: 2016-37-UB). All participants provided written informed consent after the study procedure had been fully explained. The study was conducted between January 2017 (start of data collection) and July 2018 (end of data collection), whereas recruitment began in December 2016 and was completed in June 2017. The last follow-up assessment marking the end of the active phase of the study was on July 12, 2018.

Power analysis

Sample size was estimated on the basis of an a priori conducted power analysis. Importantly, we were not interested in finding differences between the two treatment conditions concerning efficacy. Thus, power analysis focused on the sample size required to find pre to post treatment effects in each of the two treatment groups. Based on the literature reviewed above it was difficult to estimate the expected effect size f for a short-term but intense stand-alone intervention of DM or CT in a clinical sample. We arrived at an estimate for f ranging from 0.25 to 0.40 for a between-within-interaction in a 2x2 repeated measures ANOVA (which corresponds to a Cohen’s d of 0.5 and 0.8, respectively). Given an α level of 0.05, a power of β = 0.90 and a correlation between the two assessment points (labeled T1 and T2, respectively) of r = 0.5, the corresponding total sample size ranged from 46 to 20 participants. We originally planned to recruit a total of 60 participants, reduced the targeted sample size to a total of 40 participants in March 2017 due to recruitment difficulties.

Procedure

Participants were recruited via postings in social media including German OCD awareness online platforms as well as via posters in university buildings and flyers distributed in surrounding psychiatric, neurologic and dermatologic practices and outpatient departments as well as in local physicians’ practices and pharmacies. Recruitment also involved repeated advertisements in local newspapers and emails to local psychotherapists. Additionally, some patients were recruited via the psychotherapeutic outpatient department at the University of Münster, which offers a weekly consultation hour for patients who, if suitable, are proposed to participate in a clinical study in order to bypass the waiting time for a regular CBT treatment.

All data were collected at the psychotherapeutic outpatient department of the Christoph-Dornier-Foundation in Münster. Participants received € 30 each for the completion of both pre- and post-assessment as well as € 40 for completing follow-up (FU) assessment. Moreover, participants in the WL were paid additional € 20 for their participation in a second pre-assessment (Pre2). Beyond that, participants received an additional amount of € 80 to € 100 for filling in questionnaires of a smartphone-based ecological momentary assessment (EMA) study that was run prior to the first treatment session and directly after the last treatment session. Results of the EMA study will be reported elsewhere.

Assessment

A two-step assessment was conducted to check inclusion/exclusion criteria. The first step involved a phone screening that was conducted by a graduate student research assistant. Second, participants meeting the criteria of the phone screening were invited to an assessment session (Pre1) which was conducted by one of six independent study evaluators. All evaluators were Master level psychologists currently participating in an advanced training to become a cognitive behavioral psychotherapist. They received special training in diagnosing OCD by the investigators. The evaluators were blind with regard to the treatment condition of the patient (DM vs. CR). Contrary to the protocol registered at clinicaltrials.gov, however, the evaluators could not be blinded in terms of whether the patient was in the WL or the NWL condition due to aspects concerning the organization of the study process. Participants were blinded in a way that they were not told about the contents of the other treatment condition until FU assessment in order to avoid any unintended mixing of treatment strategies.

In sum, all participants underwent three assessments, i. e. Pre1, Post, and FU. Apart from that, the participants who were assigned to the WL condition during the first randomization received an additional assessment referred to as Pre2. The time span between Pre1 and Post (in the NWL group), between Pre1 and Pre2 (in the WL group) and between Pre2 and Post (in the WL group), respectively, was two weeks. The time span between Post and FU assessment was 4 weeks. Fig 1 is a a CONSORT flow diagram giving an overview of the study process and the assessment points.

thumbnail
Fig 1. CONSORT flowchart describing the study process and participant flow.

The reasons for exclusion after Pre1 assessment were as follows: OCD at subclinical level (n = 5), other than OCD being the primary diagnosis (n = 2), therapy focusing on OCD within the past 12 months (n = 2), history of psychosis (n = 1), recent change of medication (n = 1), acute Borderline Personality Disorder (n = 1), declined because experienced study protocol as too stressful (n = 1). Abbreviations: CR = cognitive restructuring, DM = detached mindfulness.

https://doi.org/10.1371/journal.pone.0213895.g001

Pre1 assessment comprised about three hours and included, among others, the administration of the German versions of the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) [30] as well as the German version of Y-BOCS [31]. The level of premorbid intelligence was assessed by the Multiple-choice vocabulary intelligence test (MWT) [32]. Information about demographic variables as well as previous pharmacological or psychotherapeutic treatments was collected. At the end of the Pre 1 assessment, participants filled in a number of questionnaires, most of which they additionally filled in prior to each treatment session to obtain process measures. Among these questionnaires was the German version of the Beck Depression Inventory-Revised (BDI-II) [33] measuring the intensity of depressive symptoms.

The primary outcome measure was the Y-BOCS total score (items 1–10). The primary outcome measure was assessed at three (NWL) or four (WL) time points. Baseline measures were collected during Pre1 assessment and, in the WL group, additionally during Pre2 assessment. Post assessment was conducted directly after the last treatment session. FU assessment was conducted 4 weeks after the end of the treatment. During the follow-up period no additional treatment was provided, but participants were told and encouraged to further practice the techniques they had learned in therapy.

Inclusion and exclusion criteria

Inclusion criteria comprised a current primary diagnosis of OCD according to DSM-5 [1], based, however, on the German version of the SCID-I [30] complemented by additional questions to confirm the DSM-5 diagnosis. Further requirements comprised a minimum total Y-BOCS score of 16, a minimum age of 18 years, fluent German language skills and a minimum IQ of 80. Exclusion criteria included current suicidality or suicidal behavior within the past six months, a current or lifetime diagnosis of bipolar and psychotic disorder, a current addictive disorder and a current borderline personality disorder. Also, participants were excluded if they were currently undergoing cognitive-behavioral therapy focusing on OCD or if they had undergone such treatment in the past 12 months. For patients under medication, it was required that the dose was stable for at least eight weeks prior to Pre1 assessment. Patients not meeting these criteria were told to contact the investigators when their medication had been stable for at least eight weeks. Similarly, patients withdrawing from medication had to be at least eight weeks off their prior medication before entering the study.

Randomization

Based on the total Y-BOCS score and the total score from the BDI-II [33] at baseline (Pre1) as well as age and sex, participants were randomized to either WL or NWL by minimization conducted with MinimPy program 0.3 [34] using default settings. Either following Pre1 (NWL) or following Pre2 assessment (WL), participants were once more randomly allocated to the treatment group (CR/DM) using the same minimization procedure as described above. Allocation ratio was 1:1 for both randomizations. Whereas for NWL, this second randomization was based on the Pre1 scores of Y-BOCS and BDI-II, the Pre2 scores were used for the WL. Randomization was conducted by a graduate student research assistant.

Treatment

Treatment in both conditions (DM/CR) comprised four sessions delivered within two weeks. Both therapists were Master level psychologists at an advanced stage of their clinical CBT licensing training. Supervision was provided by the fourth author (F. A.) and both therapists received special training in delivering DM and CR in the context of OCD prior to the start of the study. Participants were randomly assigned to one of the two therapists (C. R., C. J.).

Treatment consisted of two sessions per week, with a minimum of one day in-between the two weekly sessions. Each session lasted 100 min. The two treatment protocols were manualized by the first two authors drawing on the guidelines by Wilhelm and Steketee [35] for the CR group and those by Wells [6] for the DM group, respectively. The German study manuals can be provided upon request.

Based on the suggestions by the OCCWG, the CR procedure proposed by Wilhelm and Steketee [35] focuses on six cognitive domains, which are overimportance of thoughts, control of thoughts, overestimation of danger, desire for certainty, responsibility, and perfectionism. As overimportance of thoughts refers to thought action fusion and control of thoughts contains beliefs about the need to control thoughts—which both are parts of metacognitive models of OCD—these domains were explicitly excluded from the CR manual in order to avoid an overlap with metacognitive aspects and strategies. Similarly, the DM manual did not feature any references to a conceptual way of dealing with cognitions.

Adherence and competence ratings

All treatment sessions were videotaped. For adherence and competence ratings, four complete treatments from each therapist (two DM and two CR, each) were randomly selected and then rated by an independent Master level psychologist using a list of items all employing a 5-point Likert scale, with 5 indexing the best score. The rater was at an advanced stage of his CBT licensing training and was not otherwise involved in the study. The rater had received training concerning both CR and DM prior to rating the video material.

Cognitive restructuring

The first session of the CR condition consisted of psychoeducation about characteristics of OCD (e. g., the fact that obsessive thoughts are ubiquitous and therefore do not constitute the actual problem) and comprised the development of an individual cognitive model based on the model of Salkovskis [14, 15]. Focusing on the patient’s individual obsessive-compulsive symptoms, the model was designed to explain the disorder’s maintenance via the distorted appraisals of intrusions, which should therefore be questioned and altered. During the second session typical cognitive distortions occurring in OCD were explained (overestimation of danger, desire for certainty, responsibility and perfectionism) and strategies to question and modify these appraisals were provided and trained, drawing from Socratic questioning and logical and hedonistic strategies of disputation. Depending on the appraisal at hand, this would for instance include techniques such as multiplication of probabilities, distribution of responsibility, cost-benefit analysis, etc., whereas the whole process of questioning was recorded in writing. Prior to and after each questioning phase, the patient was asked to rate his/her level of conviction concerning the original appraisal. Additionally, s/he was encouraged to develop an alternative cognition and to practice this new cognition in everyday life. During the third session and the first part of the fourth session, these strategies were further trained. The last part of the fourth session consisted of summarizing the new knowledge and the techniques the patient had acquired during therapy. Homework during therapeutic sessions comprised monitoring and documenting obsessive thoughts and dysfunctional appraisals as well as engaging in the active questioning of the latter and practicing alternative cognitions in everyday life.

Detached mindfulness

The first session of the DM condition comprised the same psychoeducation as in the CR treatment. Afterwards, therapist and patient developed an individual metacognitive model of the patient’s obsessive-compulsive symptoms (based on Wells [6]), explaining the maintenance of the disorder via the mechanism of assigning intrusive thoughts too much importance and meaning. That is, in contrast to the CR condition, patients were taught that it is about their general attitude towards their obsessions, not about any specific appraisals in response to their obsessions. During the second session, therapist and patient developed a list of the most prominent obsessions, rating each obsession’s frequency and its level of distress. This was followed by introducing the strategy of DM using different examples and metaphors and finally by training DM applying the suggestions by Wells [6]. Training DM usually involved the patients closing their eyes and following the therapist’s standardized suggestive instructions to visualize an obsession, to dissociate oneself from the obsession and to switch to a mode of passive observing instead of active interaction. Each training unit was designed to comprise five to ten minutes. The third session and the first part of the fourth session consisted of further DM training. The last part of the fourth session was identical to the CR condition. Homework between therapeutic sessions comprised monitoring and documenting obsessive thoughts (only between sessions 1 and 2) and exercising DM several times per day. Patients were instructed to practice DM on the obsessions previously included in their list and to then increasingly apply DM to all kinds of triggering thoughts they encountered in everyday life.

Process measures

Prior to each treatment session, participants completed a number of questionnaires used as process measure that were presented on a tablet computer using a web-based online-survey software (www.unipark.de). Except for the results of the German version of the BDI-II [33], results of these process measures will be reported in a separate article.

Homework ratings

During each session, homework compliance was rated by the therapist on a 7-point rating scale ranging from 1 (no homework implemented) to 7 (homework done exactly as the patient was told). The first ratings were obtained in the second session, referring to homework set in the first session.

Data analysis

Data were analyzed using the R package ez [36] and IBM SPSS Statistics (SPSS) 25.0. Comparability of groups at baseline was analyzed by calculating independent t-tests for continuous variables and χ2-test for categorical variables. In order to evaluate the efficacy of treatments, a 2x2x2 mixed ANOVA was run with the between-subjects factors waitlist (WL/NWL) and treatment condition (CR/DM) and the within-subjects factor time coding whether measurements were taken at T1 or T2: In both groups, T1 referred to Pre1 data, however, T2 referred to Pre2 data in the WL group and to Post data in the NWL group, thus separating effects of time and treatment resp. waitlist. Please note that (a) this mixed ANOVA does not use the Post assessment data from participants in the waitlist group, avoiding some implicit assumptions and complexities of linear mixed models [37], and that (b) the definition of time points therefore differs between WL and NWL groups. Please also note that (c) the F-test of the waitlist×time interaction tests the global treatment effect [38]. The use of the R package ez involved the computation of the generalized eta squared statistic () in order to display the amount of explained variance [39].

The calculation of effect sizes (Cohen’s d) was based on the complete data set including the Post data from WL participants, which was based on the a priori assumption of time not exhibiting a considerable main effect. Due to this assumption, Pre2 data were not used in the calculation of effect sizes. As the standard deviation of the outcome variable could be influenced by treatment resp. follow-up, Becker [40] recommends to use the value at the first time point. Three effect sizes (Pre1-Post, Post-FU, and Pre1-FU) were calculated for each treatment condition as follows, using pooled standard deviations (SDPre1: 3.385; SDPost: 5.789) instead of separate standard deviations for CR and DM (X = mean Y-BOCS score, SD = standard deviation): d1 = , d2 = , d3 = . Confidence intervals for Cohen’s d were calculated using the formula provided by Hedges and Olkin [41].

Moreover, in order to display the amount of improvement, clinically significant change was assessed as proposed by Jacobson and Truax [42]. It was defined by a combination of two criteria: (I) reliable improvement: , with x1 representing a person’s Y-BOCS score at Pre1 assessment, x2 referring to a person’s Y-BOCS score at Post assessment, and Sdiff denoting being the standard error of difference scores (based on the internal consistency of the German version of the Y-BOCS (r = .80) as reported by Jacobsen et al. [43]. Based on our calculations, a decrease of 5 points or more on the Y-BOCS indicated was used as an index of reliable improvement. (II) recovery criterion: a = M1−2*SD1, with M1 representing the mean Y-BOCS score of the sample at Pre1 assessment and SD1 referring to the corresponding standard deviation. A post assessment Y-BOCS score of a = 17.9 or less indicated recovery. A reliable change was presumed if participants displayed a post-assessment Y-BOCS score of 17.9 or less (recovery criterion) and a minimal Pre1-Post change of 5 -points on the Y-BOCS (reliable improvement criterion).

Results

Sample description

The recruitment process and participant flow is displayed in Fig 1. As you can see from the flowchart, three participants dropped out after randomization, two of which because of exacerbated depression and one due to physical health issues. Apart from this, there were no further adverse events or unintended side effects in any of the groups. Apart from the participants who dropped out, there was one missing data set of a CR participant concerning the process measures at FU assessment, which was due to a malfunctioning of the tablet used for data collection. There were no further missing data.

Regarding the three dropouts, an intention-to-treat (ITT) analysis was carried out under a missing at random (MAR) assumption employing multiple imputation by chained equations using predictive mean matching for the three missing continuous outcomes at T2 [44]. There were no substantial differences in any of the p-values of the repeated measures ANOVA in any of the 25 imputed datasets. Thus, the analyses described below are based on the completer sample (n = 40). By contrast, the report of the sample characteristics (Table 1) is based on the intent-to-treat (ITT) sample (n = 43).

thumbnail
Table 1. Demographic and clinical characteristics at Pre1 assessment (intention-to-treat sample).

https://doi.org/10.1371/journal.pone.0213895.t001

Table 1 gives an overview of clinical and demographic characteristics along with between-group comparisons. We did not find any significant differences between WL and NWL and neither between CR and DM concerning any of the variables displayed (all p’s > .05). Y-BOCS and BDI-II data for the different assessment points across groups (completer sample) are presented in Table 2.

thumbnail
Table 2. Y-BOCS data, BDI-II data, and Cohen’s d (completer sample).

https://doi.org/10.1371/journal.pone.0213895.t002

Homework ratings

The results of the homework ratings can be retrieved from Table 3.

Efficacy of treatment

Mixed ANOVA.

The mixed 2x2x2 ANOVA used the Y-BOCS score as dependent variable since this was the a priori-defined outcome measure. The results of the mixed ANOVA are displayed in Table 4, whereas mean Y-BOCS-scores are displayed in Fig 2. The significant main effect for time (p < .001) indicates a global change in mean Y-BOCS scores across all combinations of waitlist and treatment conditions, while the non-significant main effects for waitlist and treatment conditions as well as the non-significant interaction of these two factors are interpreted as no difference at T1 (= Pre1), as expected by randomization and confirmed by Fig 2. The significant waitlist x time interaction (p = 0.001) indicates that mean Y-BOCS scores change from T1 to T2 when treatment is immediate (see upper panel of Fig 2), while the non-significant treatment condition x time and waitlist x treatment condition x time interactions correspond to parallel mean Y-BOCS score changes (see upper panel of Fig 2) for both treatment types, i. e., no change for waiting participants (see lower panel of Fig 2). In sum, the results are in line with our hypotheses, indicating no considerable effect of the time spent waiting in the waitlist condition and showing both treatment conditions to be similarly effective.

thumbnail
Fig 2. Line graph showing the results of the mixed ANOVA with 95% confidence intervals.

The upper graph visualizes the results from the non-waitlist group of completers (total n = 20; CR: n = 11; DM: n = 9), whereas the lower graph displays the results from the waitlist group of completers (total n = 20; CR: n = 9; DM: n = 11). In both graphs, T1 refers to the Pre1 assessment. In the upper graph, T2 refers to the Post assessment, whereas in the lower graph, T2 refers to the Pre2 assessment, thus separating the effects of time and treatment. Abbreviations: CR = cognitive restructuring, DM = detached mindfulness.

https://doi.org/10.1371/journal.pone.0213895.g002

Effect sizes.

As one can see from Table 2, we found large Pre to Post effect sizes concerning the Y-BOCS score for both treatment conditions, with a non-significant trends towards symptom severity even further decreasing between Post and FU assessment.

Clinical significant change.

At Post assessment, a clinical significant change based on the criteria described above was evident in 8 (40%) patients from the DM group and in 8 (40%) patients from the CR group–based on the Y-BOCS score.

Adherence and competence ratings

Across sessions and therapists, the mean adherence ratings were 4.78 (SD = 0.11) in the CR condition and 4.99 in the DM condition (SD = 0.02). Also across sessions and therapist, mean competence ratings were 4.70 (SD = 0.11) in the CR condition and 4.67 (SD = 0.05) in the DM condition.

Discussion

Our results demonstrate that, in line with our expectations, both treatment conditions were superior to the waitlist condition concerning clinical improvement on the gold standard Y-BOCS. As the interaction effect for time and waitlist indicates, there was a significant symptom reduction in both treatment conditions relative to the WL condition. Regarding the effect sizes in both treatment conditions (DM: d = 1.55, CR: d = 1.67) and the fact that in both conditions, 40% of the patients exhibited a clinical significant change, our results are promising, especially in the light of the short treatment period. As such, our results confirm and extend the findings of Firouzabadi and Shareh [12], Ludvik and Boschen [13] and Wahl et al. [11] suggesting the efficacy of DM when intensely delivered as a stand-alone intervention in a clinical sample and under randomized controlled conditions. Also, the results concerning BDI-II point to a slight reduction of depressive symptoms across time (from Pre1 to Post to FU) in both the DM and the CR condition.

Moreover, it is worth mentioning that our findings concerning effect sizes and percentage of patients exhibiting a clinical significant change are not as different from those by Fisher and Wells [7], Rees and van Koesveld [8], Shareh et al. [9] and Simons et al. [10] as one might expect taking into account that treatment in those studies comprised between 10 and 20 weekly sessions and a large variety of metacognitive interventions beyond DM. In sum, our findings concerning the CM condition confirm the theoretical assumptions of the model put forward by Wells [6] and underline the crucial role of altering patients’ attitudes towards their inner events in reducing OCD symptoms.

Also with regard to the CR condition, our results contribute to the issue of whether behavioral experiments are necessary for making CR for OCD effective. Since we designed the CR condition analogously to the DM condition by limiting treatment to the purely Beckian elements, i. e., questioning of thoughts and beliefs and developing alternative cognitions, our findings offer the possibility of isolating those cognitive principles from the exposure-associated confounds of behavioral experiments, demonstrating that even within a very limited time frame, cognitive restructuring can lead to clinical significant change. Hence, the findings for the CR condition correspond to and extend those by Belloch et al. [29] showing that CR excluding behavioral experiment can also lead to considerable effect sizes in the treatment of OCD. Finally, our results further confirm the cognitive models of OCD developed by Salkovskis [14, 15] and Rachman [16].

However, this study only partly addressed the question which working mechanisms underlie the detached mindfulness technique and to what extent the two treatment conditions share common working mechanisms. The results concerning process measures of cognition and metacognition collected in this study will be reported elsewhere. Yet, our clinical experience while delivering treatment in the DM condition raised some hypotheses concerning underlying working mechanisms beyond those proposed by Wells [6]. Based on the observation that several patients reported heightened and decreasing feelings of distress and tension while applying DM to their obsessions, future research should focus on the question to what extent DM is actually similar to in sensu exposure, sharing, e. g., the working mechanisms of habituation, fear extinction, inhibitory learning and expectancy violation [4547]. Moreover, future research should address the question whether DM can also be compared to a relaxation-based coping skill, since a large number of participants also reported experiencing the DM technique as relaxing and pleasant. Conceptually, this would place DM close to systematic desensitization [48]. What is yet to be investigated is the effectiveness of DM when applied in a non-randomized, uncontrolled clinical setting, since generalizability and external validity of our findings is clearly limited by factors such as the manualized treatment procedure and the short and intense treatment setting.

Besides, we would like to emphasize the conceptual overlap between DM and mindful-acceptance-based techniques, e.g., cognitive defusion, which form an important part of Acceptance and Commitment Therapy (ACT) [49]. To date, however, there are no studies on the efficacy of specific elements of ACT, whereas the efficacy of complex ACT treatment protocols has been demonstrated for OCD, e. g., [50]. Indeed, our results suggest that other techniques aiming at increasing a person’s distance to his or her thoughts, such as cognitive defusion, might also be effective as stand-alone techniques. Further research should therefore examine the relevance of these single treatment components within mindful-acceptance based therapies such as ACT to further clarify its relevance in the treatment of OCD.

All in all, this study exhibits a number of strengths. First, this trial was, to our knowledge, the first examining the efficacy of detached mindfulness as a stand-alone intervention, while comparing it to a purely cognitive treatment condition excluding any confounding elements such as behavioral experiments. Second, our sample can be regarded as representative of the clinical population with regard to e. g., symptom severity, disorder persistence, comorbidity, age and percentage of males/females, which are factors enhancing external validity. Third, adherence to the detailed protocol was ensured and shown to be very high in both conditions, just as competence ratings yielded very high scores, indicating a high quality of treatment. Fourth, our findings are useful for clinicians in a way that two interventions other than exposure and response prevention were shown to actually reduce OCD symptoms–including compulsions as measured with the Y-BOCS–without targeting the reduction of compulsions in the first place. We therefore would suggest to consider both DM and CR as strategies to pave the way for subsequent exposure treatment since they arguably mean less stress for the patient, thus having a lower risk of being refused.

Yet, the interpretation of our results is limited by various factors. First, the sample size was comparably small, so that statistical power was insufficient with regard to finding efficacy differences between the two treatment conditions, which, however, was not the goal of the study. It is a common phenomenon in psychotherapy outcome research that two active conditions are similarly effective, e. g. [51], however, the interpretation of our results is limited in a way that of course, they do not allow any conclusions concerning superiority or non-inferiority due to power issues. Second, the clinicians in charge of the diagnostic assessment were, due to organizational reasons, only blinded concerning the treatment condition, but not with regard to whether the participant was in the WL or in the NWL condition. Therefore, a certain bias towards the assumption of symptom improvement cannot be ruled out. Third, our study lacked a placebo condition, which is why the amount of change due to unspecific working mechanisms such as a good working alliance or gaining insight, e. g., [52], cannot be quantified. Similarly, both treatment conditions comprised psychoeducation and the development of an idiosyncratic maintenance model, which probably added to the treatment’s efficacy, as well. Fourth, it has to be taken into account that the treatment was delivered by only two therapists (i. e. the first two authors), which reduces the generalizability of our results. Last, our results are limited by the fact that, due to the FU time frame only comprising four weeks for organizational reasons, we are unable to make any statements about long-term efficacy.

Conclusions

In sum, we were able to show that two conceptually very different treatment concepts relying on the intense training of a single technique within a limited time frame were effective at reducing OCD symptoms. As such, this study adds to the development of alternative effective treatment strategies for OCD. Taking all limitations into account, this study was the first to suggest that DM as a stand-alone intervention may be similarly effective as cognitive restructuring in treating OCD within a limited amount of time. However, future research is urgently needed to replicate our results, possibly in a larger sample, to address the underlying working mechanisms and to elucidate to what extent DM shares working mechanisms with other interventions such as ERP, relaxation and cognitive restructuring.

Supporting information

S1 File. CONSORT checklist.

This checklist gives information on how this publication complies with the CONSORT guidelines.

https://doi.org/10.1371/journal.pone.0213895.s001

(DOC)

S2 File. Main data set.

This Excel data set contains data on all variables relevant for the results reported in this publication.

https://doi.org/10.1371/journal.pone.0213895.s002

(XLSX)

S3 File. Adherence and competence ratings (DM).

This Excel data set contains all adherence and competence ratings for the detached mindfulness condition.

https://doi.org/10.1371/journal.pone.0213895.s003

(XLSX)

S4 File. Adherence and competence ratings (CR).

This Excel data set contains all adherence and competence ratings for the cognitive restructuring condition.

https://doi.org/10.1371/journal.pone.0213895.s004

(XLSX)

S5 File. Study protocol (Original).

This document includes the original German study protocol that was approved of by the ethics committee.

https://doi.org/10.1371/journal.pone.0213895.s005

(DOCX)

S6 File. Study protocol (English translation).

This document includes the English translation of the original German study protocol that was approved of by the ethics committee.

https://doi.org/10.1371/journal.pone.0213895.s006

(DOCX)

Acknowledgments

The researchers thank Christine Wiese, Franziska Fey, Laura Thomas, Victoria Surina, Laura Nohr, Tina Dusend, and Sebastian Schauenberg for their commitment and contribution to this study.

References

  1. 1. American Psychiatric Association. Statistical Manual of Mental Disorders (DSM-5). 5th ed. Arlington, VA: American Psychiatric Association; 2013.
  2. 2. National Institute for Health and Clinical Excellence. Obsessive compulsive disorder: Core interventions in the treatment of obsessive-compulsive disorder and body dysmorphic disorder. National Clinical Practice Guideline Number 31. Leicester, London: The British Psychological Society and The Royal College of Psychiatrists; 2006.
  3. 3. Schruers K, Koning K, Luermans J, Haack MJ, Griez E. Obsessive-compulsive disorder: a critical review of therapeutic perspectives. Acta Psychiatr Scand. 2005; 111: 261–271. pmid:15740462
  4. 4. Öst L, Havnen A, Hansen B, Kvale G. Cognitive behavioral treatments of obsessive-compulsive disorder. A systematic review and meta-analysis of studies published 1993–2014. Clin Psychol Rev. 2015; 40: 156–169. pmid:26117062
  5. 5. Wells A, Matthews G. Attention and emotion: A clinical perspective. Hove, UK: Erlbaum; 1994.
  6. 6. Wells A. [Metacognitive Therapy for Anxiety and Depression]. Weinheim: Beltz; 2011.
  7. 7. Fisher PL, Wells A. Metacognitive therapy for obsessive-compulsive disorder: A case series. J Behav Ther Exp Psychiatry. 2008; 39: 117–132. pmid:17418090
  8. 8. Rees CS, van Koesveld KE. An open trial of group metacognitive therapy for obsessive-compulsive disorder. J Behav Ther Exp Psychiatry. 2008; 39: 451–458. pmid:18295186
  9. 9. Shareh H, Gharraee B, Atef-Vahid MK, Eftekhar M. Metacognitive Therapy (MCT), Fluvoxamine, and Combined Treatment in Improving Obsessive-Compulsive, Depressive and Anxiety Symptoms in Patients with Obsessive-Compulsive Disorder (OCD). Iran J Psychiatry Behav Sci. 2010; 4: 17–25.
  10. 10. Simons M, Schneider S, Herpertz-Dahlmann B. Metacognitive Therapy versus Exposure and Response Prevention for Pediatric Obsessive-Compulsive Disorder. A Case Series with Randomized Allocation. Psychother Psychosom. 2006; 75: 257–264. pmid:16785776
  11. 11. Wahl K, Huelle JO, Zurowski B, Kordon A. Managing Obsessive Thoughts During Brief Exposure: An Experimental Study Comparing Mindfulness-Based Strategies and Distraction in Obsessive–Compulsive Disorder. Cognit Ther Res. 2013; 37: 752–761.
  12. 12. Firouzabadi A, Shareh H. Effectiveness of Detached Mindfulness Techniques in Treating a Case of Obsessive Compulsive Disorder. Advances in Cognitive Science. 2009; 11: 1–7.
  13. 13. Ludvik D, Boschen MJ. Cognitive restructuring and detached mindfulness: Comparative impact on a compulsive checking task. J Obsessive Compuls Relat Disord. 2015; 5: 8–15.
  14. 14. Salkovskis PM. Obsessional-compulsive problems: A cognitive-behavioural analysis. Behav Res Ther. 1985; 23: 571–583. pmid:4051930
  15. 15. Salkovskis PM. Understanding and treating obsessive-compulsive disorder. Behav Res Ther. 1999; 37: S29–S52. pmid:10402695
  16. 16. Rachman S. A Cognitive Theory of Obsessions. In: Sanavio E, editor. Behavior and Cognitive Therapy Today. Oxford: Pergamon; 1998. pp. 209–22.
  17. 17. Freeston MH, Ladouceur R, Thibodeau N, Gagnon F. Cognitive intrusions in a non-clinical population. I. Response style, subjective experience, and appraisal. Behav Res Ther. 1991; 29: 585–597. pmid:1759957
  18. 18. Salkovskis PM, Harrison J. Abnormal and normal obsessions—a replication. Behav Res Ther. 1984; 22: 549–552. pmid:6508704
  19. 19. Obsessive Compulsive Cognitions Working Group. Cognitive assessment of obsessive-compulsive disorder. Behav Res Ther. 1997; 35: 667–681. pmid:9193129
  20. 20. Wilhelm S, Steketee G, Reilly-Harrington NA, Deckersbach T, Buhlmann U, Baer L. Effectiveness of Cognitive Therapy for Obsessive-Compulsive Disorder: An Open Trial. J Cogn Psychother. 2005; 19: 173–179.
  21. 21. Wilhelm S, Steketee G, Fama JM, Buhlmann U, Teachman BA, Golan E. Modular Cognitive Therapy for Obesssive-Compulsive Disorder: A Wait-List Controlled Trial. J Cogn Psychother. 2009; 23: 294–305. pmid:21072138
  22. 22. Belloch A, Cabedo E, Carrió C, Larsson C. Cognitive therapy for autogenous and reactive obsessions: Clinical and cognitive outcomes at post-treatment and 1-year follow-up. J Anxiety Disord. 2010; 24: 573–580. pmid:20418053
  23. 23. Rosa-Alcázar AI, Sánchez-Meca J, Gómez-Conesa A, Marín-Martínez F. Psychological treatment of obsessive-compulsive disorder: A meta-analysis. Clin Psychol Rev. 2008; 28: 1310–1325. pmid:18701199
  24. 24. van Balkom AJ, van Oppen P, Vermeulen AW, van Dyck R, Nauta MC, Vorst HC. A meta-analysis on the treatment of obsessive compulsive disorder: A comparison of antidepressants, behavior, and cognitive therapy. Clin Psychol Rev. 1994; 14: 359–381.
  25. 25. Anholt GE, Kempe P, de Haan E, van Oppen P, Cath DC, Smit JHet al. Cognitive versus Behavior Therapy: Processes of Change in the Treatment of Obsessive-Compulsive Disorder. Psychother Psychosom. 2008; 77: 38–42. pmid:18087206
  26. 26. Cottraux J, Note I, Yao SN, Lafont S, Note B, Mollard E et al. A Randomized Controlled Trial of Cognitive Therapy versus Intensive Behavior Therapy in Obsessive Compulsive Disorder. Psychother Psychosom. 2001; 70: 288–297. pmid:11598428
  27. 27. Emmelkamp PMG, Visser S, Hoekstra RJ. Cognitive Therapy vs Exposure in Vivo in the Treatment of Obsessive-Compulsives. Cognit Ther Res. 1988; 12: 103–114.
  28. 28. van Oppen P, de Haan E, van Balkom AJ, Spinhoven P, Hoogduin K, van Dyck R. Cognitive therapy and exposure in vivo in the treatment of obsessive compulsive disorder. Behav Res Ther. 1995; 33: 379–390. pmid:7755525
  29. 29. Belloch A, Cabedo E, Carrió C. Empirically Grounded Clinical Interventions: Cognitive Versus Behaviour Therapy in the Individual Treatment of Obsessive-Compulsive Disorder: Changes in Cognitions and Clinically Significant Outcomes at Post-Treatment and One-Year Follow-Up. Behav Cogn Psychother. 2008; 36: 521–540.
  30. 30. Wittchen HU, Zaudig M, Fydrich T. [SCID. Structured Clinical Interview for DSM-IV]. Göttingen: Hogrefe; 1997.
  31. 31. Hand I, Büttner-Westphal H. [The Yale-Brown Obsessive-Compulsive Scale (Y-BOCS): A semistructured interview for assessing severity of compulsive cognitions and behavior]. Verhaltenstherapie. 1991; 1: 223–225.
  32. 32. Lehrl S. [Multiple choice vocabulary intelligence test MWT-B]. 6th ed. Balingen: Spitta; 2015.
  33. 33. Hautzinger M, Keller F, Kühner C. [Beck Depression Inventory (BDI-II). Revision]. Frankfurt/Main: Harcourt Test Service; 2006.
  34. 34. Saghaei M. MinimPy Program 0.3 [software]. 2010–2011. Available from: http://minimpy.sourceforge.net.
  35. 35. Wilhelm S, Steketee GS. Cognitive Therapy for Obsessive-Compulsive Disorder: A Guide for Professionals. Oakland, CA: New Harbinger Publications, Inc.; 2006.
  36. 36. Lawrence MA. ez: Easy Analysis and Visualization of Factorial Experiments. R package version 4.4.-0. [software]. 2016. Available from: https://CRAN.R-project.org/package=ez.
  37. 37. Gueorguieva R, Krystal JH. Move over ANOVA: progress in analyzing repeated-measures data andits reflection in papers published in the Archives of General Psychiatry. Arch Gen Psychiatry. 2004; 61: 310–317. pmid:14993119
  38. 38. Huck SW, McLean RA. Using a repeated measures ANOVA to analyze the data from a pretest-posttest design: A potentially confusing task. Psychol Bull. 1975; 82: 511–518.
  39. 39. Olejnik S, Algina J. Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs. Psychol Methods. 2003; 8: 434–447. pmid:14664681
  40. 40. Becker BJ. Synthesizing standardized mean-change measures. Br J Math Stat Psychol. 1988; 41: 257–278.
  41. 41. Hedge LV, Olkin I. Statistical methods for meta-analysis. Orlando, FL: Academic Press Inc.; 2014.
  42. 42. Jacobson NS, Truax P. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991; 59: 12–19. pmid:2002127
  43. 43. Jacobsen D, Kloss M, Fricke S, Hand I, Moritz S. [Reliability of the German Version of the Yale-Brown Obsessive Compulsive Scale]. Verhaltenstherapie. 2003; 13: 111–113.
  44. 44. van Buuren S, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011; 45.
  45. 45. Craske MG, Treanor M, Conway CC, Zbozinek T, Vervliet B. Maximizing exposure therapy: An inhibitory learning approach. Behav Res Ther. 2014; 58: 10–23. pmid:24864005
  46. 46. Jacoby RJ, Abramowitz JS. Inhibitory learning approaches to exposure therapy: A critical review and translation to obsessive-compulsive disorder. Clin Psychol Rev. 2016; 49: 28–40. pmid:27521505
  47. 47. Rupp C, Doebler P, Ehring T, Vossbeck-Elsebusch AN. Emotional Processing Theory Put to Test: A Meta-Analysis on the Association Between Process and Outcome Measures in Exposure Therapy. Clin Psychol Psychother. 2017; 24: 697–711. pmid:27561691
  48. 48. Wolpe J. Psychotherapy by Reciprocal Inhibition. Cond Reflex. 1968; 3: 234–240. pmid:5712667
  49. 49. Hayes SC, Luoma JB, Bond FW, Masuda A, Lillis J. Acceptance and commitment therapy: Model, processes and outcomes. Behav Res Ther. 2006; 44: 1–25. pmid:16300724
  50. 50. Twohig MP, Hayes SC, Plumb JC, Pruitt LD, Collins AB, Hazlett-Stevens H et al. A randomized clinical trial of acceptance and commitment therapy versus progressive relaxation training for obsessive-compulsive disorder. J Consult Clin Psychol. 2010; 78: 705–716. pmid:20873905
  51. 51. Luborsky L, Rosenthal R, Diguer L, Andrusyna TP, Berman JS, Levitt JT et al. The Dodo Bird Verdict Is Alive and Well-Mostly. Clin Psychol Sci Pract. 2002; 9: 2–12.
  52. 52. Lambert MJ. The efficacy and effectiveness of psychotherapy. In: Lambert MJ, editor. Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change. 6th ed. Hoboken, NJ: Wiley; 2013. pp. 139–193.