Figures
Abstract
Background
Obsessive-compulsive disorder (OCD) is a disabling anxiety disorder, but most individuals delay seeking treatment. Internet-based cognitive behavioural therapy (iCBT) is an innovative service delivery method that may help to improve access to care, but the acceptability to consumers of such programs has not yet been established.
Methodology
People with symptoms of OCD were invited to complete an online survey enquiring about demographic characteristics, symptom severity, and acceptability of Internet-based treatment. Demographic and symptom severity data were compared with people with OCD identified in a national epidemiological survey and with a sample of patients with OCD from a specialist outpatient anxiety clinic.
Participants
129 volunteers to an online Internet survey, 135 patients at a specialist anxiety disorders outpatient clinic, and 297 cases identified in a national epidemiological survey.
Main Measures
Demographic characteristics, and severity of symptoms as measured by the Kessler 10-Item scale, the 12-item World Health Organisation Disability Assessment Schedule - Second Edition and the Yale Brown Obsessive Compulsive Scale - Self Report Version.
Principal Findings
The Internet sample was similar demographically but reported more severe symptoms than the comparison groups, although had similar severity of symptoms of OCD compared with other clinical samples reported in the literature. Participants reported Internet-based treatment for OCD would be highly acceptable.
Conclusions
Internet-based treatment may reduce barriers to accessing treatment to people with OCD. Individuals in this study were similar demographically to other samples and had similar severity of symptoms as those identified in other clinical samples, suggesting that Internet-based treatment using techniques employed in face-to-face treatment may be effective in this group. Internet-based treatments for OCD need to be developed and evaluated.
Citation: Wootton BM, Titov N, Dear BF, Spence J, Kemp A (2011) The Acceptability of Internet-Based Treatment and Characteristics of an Adult Sample with Obsessive Compulsive Disorder: An Internet Survey. PLoS ONE 6(6): e20548. https://doi.org/10.1371/journal.pone.0020548
Editor: Antonio Verdejo García, University of Granada, Spain
Received: February 10, 2011; Accepted: May 4, 2011; Published: June 3, 2011
Copyright: © 2011 Wootton et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: No current external funding sources for this study.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Obsessive-compulsive disorder (OCD) is an anxiety disorder characterized by intrusive, unwanted and ego-dystonic obsessions and/or compulsions. It has a 12-month prevalence of 2% [1], is highly co-morbid with other psychiatric disorders, and results in considerable disability [2]. Obsessive-compulsive disorder can be treated successfully with cognitive behavioural treatment (CBT), particularly exposure with response prevention [3], [4], [5], [6].
Despite the disability associated with symptoms, most individuals with OCD delay seeking treatment for at least 10 years from onset of symptoms [7]. Barriers to treatment seeking in this population are similar to those relevant to other anxiety disorders, and include the direct and indirect costs of treatment, the limited number of mental health professionals skilled in the treatment of anxiety disorders, and stigma [8], [9], [10]. Stigma and shame about symptoms are particularly relevant to subgroups of people with OCD who experience obsessions characterized by sexual, religious, or aggressive themes. Unfortunately, less than half of those with OCD who seek treatment receive an evidence-based intervention [11], [12]. Interventions that can improve access to evidence-based treatments for people with OCD are urgently required.
A recent innovative approach that may improve access to evidence-based care for people with anxiety disorders is the use of Internet-based cognitive behavioral therapy (iCBT) programs. iCBT involves the administration of highly structured online lessons that present the same information and skills typically taught in face-to-face CBT, often with telephone-based or email support from a trained support person or clinician [13]. The results of recent meta-analyses of iCBT and computerised CBT indicate that these treatments produce superior effect sizes over control conditions for several anxiety disorders [14], [15], but presently there is limited evidence for the efficacy of Internet-based treatment or computerized treatments specifically for OCD [5], [16], [17], [18].
While clinical effectiveness is important, the acceptability of iCBT is an additional criterion likely to affect implementation. Acceptability refers to the degree that patients, clinicians or others are comfortable or at ease with a service and are willing to use it [19]. Clinician attitudes towards Internet or computer-based treatments are still largely neutral [20], [21], [22] or unfavorable [23]. However, the data emerging from clinical trials and online surveys indicates iCBT for anxiety and depressive disorders appears to be more acceptable to consumers [22], [24], [25] and that consumers appear willing to try Internet-based psychotherapy [22], [26]. Nevertheless, there is limited research regarding the acceptability of such interventions specifically for treating OCD.
The aims of the present study were to: 1) Examine the acceptability of Internet-based treatment for OCD to a sample of Australian adults with OCD who completed an Internet-based survey, and; 2) Compare the characteristics of respondents to the Internet survey with a sample of people with OCD who had sought face-to-face treatment at a specialist outpatient clinic and a sample of people with OCD identified in a national survey. This information will help determine whether there is demand for iCBT programs from people with OCD. Based on recent results of a similar comparison of people with anxiety and depressive disorders [27], it was expected that the Internet sample would have more severe symptoms than those identified in the national survey, but similarly severe symptoms to those attending an outpatient clinic. It was also expected that respondents to the Internet survey would rate Internet delivered treatment for OCD as an acceptable treatment option.
Methods
Participants
Three groups of people with symptoms of OCD were compared. Participants in all three groups were at least 18 years of age, and either met diagnostic criteria for OCD determined by a standardized diagnostic interview or were likely to meet criteria based on their scores on an OCD-specific diagnostic screening questionnaire. Across all three groups the diagnosis of OCD need not have been their principal diagnosis.
The Internet Survey group (IS) comprised respondents to an Internet survey developed for this study (see details below). This sample (n = 129) was restricted to people who were over the age of 18, were living in Australia and reported OCD symptoms that were of at least moderate severity, meeting criteria for a probable diagnosis of OCD based on a score of ≥16 on the Yale Brown Obsessive Compulsive Scale - Self Report (YBOCS-SR) [28], [29].
The second group comprised patients in an existing database from the Anxiety Disorders Clinic, St Vincent's Hospital, Sydney, Australia (ADC Group; ADC), a specialist outpatient clinic. The sample consisted of 135 individuals who received face-to-face treatment for OCD between 2005 and 2010. A diagnosis of OCD was assigned using the Computerized Composite International Diagnostic Interview 2.1 (CIDI 2.1) [30].
The third group comprised 297 individuals meeting criteria for a diagnosis of OCD identified in the 2007 Australian National Survey of Mental Health and Wellbeing. This survey was conducted by the Australian Bureau of Statistics between August and December 2007 [1] (National Survey Group; NS), included 8841 Australian residents aged 16–85 years (response rate of 60%) and derived data on lifetime mental disorders using the CIDI 3.0 [31]. We selected an unweighted subsample of respondents who met DSM-IV diagnostic criteria for lifetime OCD and who reported having symptoms in the last 12 months.
Internet Survey Design, Development and Administration
The Internet-administered survey was developed as an “open” survey, using a convenience sampling method. Visitors to the VirtualClinic website (www.virtualclinic.org.au), a research website operated by the University of New South Wales and St Vincent's Hospital, were invited to participate. Participation was voluntary.
The questionnaire comprised 3 sections. Section 1 enquired about demographics. Section 2 included questionnaires measuring symptoms of OCD, psychological distress, and disability (see below). Section 3 enquired about the perceived advantages, perceived disadvantages, and acceptability of Internet treatment of OCD. Questions about advantages and disadvantages of Internet treatment were based on questions used in similar surveys and research [22], [24], [25]. Acceptability of Internet-based treatment was determined with the following questions, which utilized Likert-type answers: Do you think that therapy for OCD delivered via the Internet would be effective? (5 point scale ranging from symptoms will get a lot worse to symptoms will get a lot better), and; “If you were seeking treatment would you try treatment for OCD delivered via the Internet?” (4 point scale ranging from definitely would to definitely would not).
All participants received items in the same order and were able to change responses before submitting the survey. The questions and functionality of the survey was pilot tested on two occasions with a small non-clinical convenience sample of mental health clinicians (n = 5) and lay people (n = 5). The aim of the piloting was to examine comprehension, interpretability and functionality. Piloting was conducted in a two stage process and questions were subsequently modified after each stage. No formal analyses of internal reliability or validity were conducted.
This study was approved by the Human Research Ethics Advisory Committees of the University of New South Wales and St Vincent's Hospital, New South Wales, Australia. All participants were provided information about the study and completed a consent form before beginning the survey. No incentives were offered for participating, but respondents were invited to contact the investigator to request a copy of the final results. IP addresses of participants' computers were used to prevent users from repeating the survey. The survey took an average 15 minutes to complete and data from the IS group was collected between May and October 2010 (22 weeks).
Internet Survey Measures
The following measures were administered online during the Internet survey:
Yale Brown Obsessive Compulsive Scale, Self Report; YBOCS-SR [28].
The YBOCS-SR is a 10-item questionnaire that measures the severity of OCD symptoms independently of the type of obsessions and compulsions the individual experiences. Each item is measured on a 5-point scale, with 0 indicating no symptoms and 4 extreme symptoms. The range for the total YBOCS-SR is 0–40, with higher scores indicating greater severity of OCD symptoms. The self-report scale has high internal consistency [10], [32], [33], [34] and the internal consistency in the current study was high (Cronbachs alpha = .72). Using a cut off of 16, the sensitivity of the YBOC-SR is excellent and ranges from 94–100% [29], [34]. Scores on the YBOCS-SR are only available for the Internet Group.
The Kessler 10 (K-10) [35].
The K-10 is a brief self-report measure of non-specific psychological distress. Scores are rated on a 5-point Likert scale and higher scores indicate higher distress. Scores are summed and range from 10 to 50. The scale has excellent internal consistency with a Cronbach's alpha of 0.92 [35]. The internal consistency in this study was excellent (Cronbachs alpha = .91). Scores on the K-10 are available for all three groups.
World Health Organization Disability Assessment Schedule II (WHODAS-II) [36].
The WHODAS-II is a measure of general functioning and disability. The WHODAS-II is measured on a 5-point Likert scale (1–5) and total scores range from 12 to 60 with higher scores indicating higher levels of disability. The WHODAS-II has a reported internal consistency of 0.86 and high test-retest reliability [37]. The internal consistency (Cronbach's alpha) in this study was .91. Scores on the WHODAS-II are available for all three groups.
The comparator groups were also administered the K-10 and WHODAS-II. The NS group were administered these questionnaires via a trained interviewer, whilst the ADC group were administered the questionnaires in paper and pencil format.
Survey Response Rates and Analysis
Participant flow can be seen in Figure 1. Three hundred and five respondents logged into the survey, of these 236 began the survey. One hundred and four respondents were excluded because they did not complete the YBOCS-SR or scored less than 16 on the YBOCS-SR, and three individuals were excluded because they were less than 18 years of age. The resultant sample was 129 participants who reported at least moderate symptoms of OCD and were eligible for analysis in the IS group.
Analysis Plan
Differences between samples in categorical demographic variables were assessed using chi-square tests, while mean differences in age and the symptom severity scales were assessed using one-way ANOVAs. Post-hoc tests were conducted using chi-square tests for categorical variables and independent t-tests with adjustments for multiple comparisons were employed for analyses involving continuous variables. Participants with missing data were omitted from specific analyses where the missing values occurred. Analyses were performed using the Statistical Package for Social Sciences (SPSS) version 18.0 for Windows [38].
Results
Comparison of Demographic and Symptom Severity across Groups
Table 1 shows the demographic and severity data for each group. The mean age for respondents in the IS group was 34.3 (SD = 12.2), compared to 32.0 (SD = 9.8) for the ADC and 40.7 (SD = 15.5) for the NS groups. The p-value was adjusted for multiple comparisons and set at 0.016 to reduce the rate of Type I errors. There was a significant difference in age between groups (F(2,560) = 22.6, p<0.001), with those in the NS group being significantly older than those in the other groups, but no difference between the ADC and the IS groups. There was a significant difference between groups in gender (χ2(2, N = 561) = 11.3, p = 0.003), with more males in the ADC than in the IS and NS groups. A significant difference between groups was also found on educational achievement (χ2 (6, N = 540) = 62.8, p<0.001) with those in the ADC group more likely to have achieved a diploma or degree than either of the other groups. The IS group was also more likely to have achieved a higher level of qualification than the NS group. There was no significant difference between groups in marital status (χ2 (6, N = 561) = 11.5, p = 0.740) or employment rates (χ2 (2, N = 535) = 1.8, p = 0.404).
With respect to symptom severity, one-way ANOVAs revealed significant differences across the three groups on both the K-10 (F(2,550) = 122.0, p<0.001) and the WHODAS-II (F(2,549) = 84.7, p<0.001). Post-hoc analyses revealed that the K-10 scores of the IS group were significantly higher than both the ADC and NS groups, while the ADC had significantly higher K-10 scores than the NS group. Post-hoc analyses revealed that the IS group had significantly higher scores on WHODAS-II than the ADC and NS groups, while the ADC had significantly higher scores than the NS group. On the YBOCS-SR, which was administered only to the IS group, 78/128 (61%) of participants scored in the moderate range of symptoms, 46/128 (36%) in the severe range, and 4/128 (3%) in the extremely severe range.
Internet Group: Acceptability of Internet Based Treatments for OCD
Respondents were asked to select which options from a list of potential advantages and disadvantages were important in their potential use or rejection of Internet therapy (Tables 2 and 3). The most commonly reported advantages for using Internet-based treatment were those related to convenience. Of the 116 respondents, 78 (67%) reported time saving and 73 (63%) reported no need to travel to appointments as the main advantages to Internet-based treatment. Other primary reasons included reduced costs 70/116 (60%) and increased privacy 65/116 (56%). Disadvantages of using Internet-based treatments were rarely endorsed. Of the 116 respondents, 11 (10%) reported preferring face-to-face treatment, 10 (9%) reported they perceived their problems to be too severe for Internet based-treatment, and 9 (8%) reported concerns about the lack of face-to-face contact, not being able to communicate ideas online, and Internet treatment not seeming real.
In response to the question: Do you think therapy via the Internet would be effective? 25/116 (22%) indicated that believed their symptoms would get a lot better; 68/116 (59%) indicated that their symptoms would get a little bit better; 19/116 (16%) indicated that there would be no change in their symptoms; 2/116 (2%) reported that their symptoms would get a little worse; and 2/116 (2%) reported they thought their symptoms would get a lot worse. When asked if they would be willing to try Internet therapy (If you were seeking treatment would you try treatment for OCD delivered via the Internet?) 61/116 (53%) of the IS participants indicated that they definitely would, 38/116 (33%) indicated they possibly would, 15/116 (13%) indicated that they maybe would and 2/116 (2%) indicated that they definitely would not use Internet therapy.
Discussion
The aims of the present study were to examine the acceptability of Internet-based treatment to a sample of Australian adults with OCD and to compare the characteristics of that sample with two other groups of people with OCD. All participants met diagnostic criteria for OCD during structured diagnostic assessments or were likely to meet criteria based on a psychometrically established cut-off on a measure of OCD symptom severity.
Comparison of Demographic Characteristics and Symptom Severity
Respondents to the Internet survey with OCD were similar in their marital status and employment levels as the national and outpatient samples. The outpatient sample had the highest level of education, followed by the Internet sample and then the national sample. A similar pattern was found for age; the outpatient sample was youngest, followed by the Internet sample, and then the national sample. The only demographic characteristic on which the Internet sample differed from the other groups was gender, with the Internet sample being comprised of more females. We conclude that the Internet sample are generally representative of the wider population of those with OCD, albeit slightly younger and with a slightly greater proportion of females.
Consistent with the results of a previous comparison of an Internet sample with an outpatient and a national sample [27], the Internet sample and outpatient sample in the present study had significantly greater levels of psychological distress and disability than people in the national sample. Moreover, the severity of OCD symptoms in the Internet sample, as measured the YBOCS-SR (M = 22.71; SD = 4.7), was similar to those reported in face-to-face clinical samples (M = 22.50–26.00) [32], [39], [40]. For example, the YBOCS scores observed in this sample were similar to those reported for patients starting the BT STEPS program [17]. These results indicate that the Internet sample had non-trivial symptoms and are comparable to those who seek face-to-face treatment.
Acceptability of Internet Treatment for OCD
Overall, respondents to the Internet survey endorsed Internet treatment for OCD as an acceptable form of treatment. This is consistent with other recent studies indicating consumers are prepared to try Internet treatment for anxiety and depression [22], [26] although to our knowledge, this is the first study to enquire specifically from people with OCD.
Ninety-eight percent of respondents indicated that they would definitely, possibly or maybe try Internet-based treatment for OCD. More than 50% of respondents endorsed reasons associated with convenience, reduced costs, and privacy and anonymity as potential advantages of using Internet-based treatment. Potential disadvantages of Internet-based treatment included preferring face-to-face treatment, perceiving one's problems as being too severe and concerns about the lack of non-verbal communication. However, these disadvantages were reported by less than 10% of the sample.
Limitations
The main limitation of this study was the use of a convenience sample of Internet users who were visiting a clinical research website. It is likely this sample had a pre-existing favourable impression of Internet treatments, and would be expected to find such an approach acceptable. However, the demographic similarities between the Internet and national samples provides some indication that Internet treatment programs for OCD may be attractive to a more general sample. Secondly, while used for pragmatic reasons, the use of different methods for determining probable OCD diagnoses or caseness across the samples used represents a potential limitation. Nevertheless the CIDI-auto, CIDI and the use of a cut-score (i.e. >16) on the YBOC-SR are widely recognised as reliable indicators of caseness and frequently used within the literature [29], [34]. Thirdly, it is possible that respondents were not fully aware of what Internet therapy involved when answering questions about the acceptability of such treatments for OCD, and lastly, the methods of recruitment and delivery of questionnaires differed across the groups, which may introduce a level of bias to the results.
Conclusions
Australian respondents to an Internet survey were demographically similar to those identified in a national survey and had symptoms as severe as those identified in other clinical samples. This suggests that Internet-based treatment using techniques used in face-to-face treatment may be effective in an Internet sample. Respondents to the survey reported they were willing to try Internet-based treatment. These data are of interest to policy makers, funding bodies, and developers of iCBT programs. While there are iCBT programs for other anxiety disorders there is a dearth of such programs for OCD. To date BT-STEPS [5], [16]–[17] is the only program that has aimed at treating OCD via a computer and, although producing promising results, more research is needed concerning online programs for OCD with the potential of increasing patient access. The results of this survey provide preliminary evidence for demand and acceptability of iCBT programs for OCD.
Author Contributions
Conceived and designed the experiments: BMW NT BFD JS. Performed the experiments: BMW. Analyzed the data: BMW NT. Contributed reagents/materials/analysis tools: AK. Wrote the paper: BMW NT BFD.
References
- 1.
Australian Bureau of Statistics (2007) National Survey of Mental Health and Wellbeing: Summary of Results. 4326.0. Australian Bureau of Statistics.
- 2. Crino R, Slade T, Andrews G (2005) The changing prevalence and severity of obsessive-compulsive disorder criteria from DSM-III to DSM-IV. American Journal of Psychiatry 162: 876–882.
- 3. Rosa-Alcázar AI, Sánchez-Meca J, Gómez-Conesa A, Marín-Martínez F (2008) Psychological treatment of obsessive-compulsive disorder: A meta-analysis. Clinical Psychology Review 28: 1310–1325.
- 4. Abramowitz JS (1996) Variants of exposure and response prevention in the treatment of obsessive-compulsive disorder: A meta-analysis. Behavior Therapy 27: 583–600.
- 5. Griest JH, Marks IM, Baer L, Parkin JR, Manzo PA, et al. (1998) Self-treatment for obsessive compulsive disorder using a manual and a computerized telephone interview: A U.S.-U.K. study. MD Computing 15: 149–157.
- 6. Gava I, Barbui C, Aguglia E, Carlino D, Churchill R, et al. (2009) Psychological treatments versus treatment as usual for obsessive compulsive disorder (OCD) (Review). The Cochrane Library 2009:
- 7. Foa EB, Liebowitz MR, Kozak MJ, Davies S, Campeas R, et al. (2005) Randomized, placebo-controlled trial of exposure and ritual prevention, clomipramine, and their combination in the treatment of obsessive-compulsive disorder. American Journal of Psychiatry 162: 151–161.
- 8. Baer L, Minichiello WE (2008) Reasons for inadequate utilization of cognitive-behavioral therapy for obsessive-compulsive disorder. Journal of Clinical Psychiatry 69: 676.
- 9. Goodwin R, Koenen KC, Hellman F, Guardino M, Struening E (2002) Helpseeking and access to mental health treatment for obsessive-compulsive disorder. Acta Psychiatrica Scandinavica 106: 143–149.
- 10. Marques L, LeBlanc NJ, Wegarden HM, Timpano KR, Jenike M, et al. (2010) Barriers to treatment and service utilization in an internet sample of individuals with obsessive-compulsive symptoms. Depression and Anxiety 27: 470–475.
- 11. Blanco C, Olfson M, Stein DJ, Simpson HB, Gameroff MJ, et al. (2006) Treatment of obsessive-compulsive disorder by U.S. psychiatrists. Journal of Clinical Psychiatry 67: 946–951.
- 12. Mancebo MC, Eisen JL, Pinto A, Greenberg BD, Dyck IR, et al. (2006) The Brown Longitudinal Obsessive Compulsive Study: Treatments received and patient impressions of improvement. Journal of Clinical Psychiatry 67: 1713–1720.
- 13. Titov N (2007) Status of computerized cognitive behavioural therapy for adults. Australian and New Zealand Journal of Psychiatry 41: 95–114.
- 14. Cuijpers P, Marks IM, van Straten A, Cavanagh K, Gega L, et al. (2009) Computer-aided psychotherapy for anxiety disorders: A meta-analytic review. Cognitive Behaviour Therapy 38: 66–82.
- 15. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N (2010) Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS One 5:
- 16. Bachofen M, Nakagawa A, Marks IM, Park JM, Greist JH, et al. (1999) Home self-assessment and self-treatment of obsessive-compulsive disorder using a manual and a computer-conducted telephone interview: Replication of a U.K.-U.S. study. Journal of Clinical Psychiatry 60: 545–549.
- 17. Griest JH, Marks IM, Baer L, Kobak KA, Wenzel KW, et al. (2002) Behavior therapy for obsessive-compulsive disorder guided by a computer or by a clinician compared with relaxation as a control. Journal of Clinical Psychiatry 63: 138–145.
- 18. Kenwright M, Marks I, Graham C, Franses A, Mataix-Cols D (2005) Brief scheduled phone support from a clinician to enhance computer-aided self-help for obsessive-compulsive disorder: Randomized controlled trial. Journal of Clinical Psychology 61: 1499–1508.
- 19.
Rush B, Scott RE (2004) Approved Telehealth Outcome Indicator Guidelines: Quality, Access, Acceptability and Cost. Calgary Health Telematics Unit, University of Calgary.
- 20. Wangberg SC, Gammon D, Spitznogle K (2007) In the eyes of the beholder: Exploring psychologists' attitudes towards and use of e-therapy in Norway. Cyberpsychology and Behavior 10: 418–423.
- 21. Whitfield G, Williams C (2004) If the evidence is so good - Why doesn't anyone use them? A national survey of the use of computerized cognitive behaviour therapy. Behavioural and Cognitive Psychotherapy 32: 57–65.
- 22. Gun SY, Titov N, Andrews G (2011) Acceptability of Internet-based education and treatment of anxiety and depression. Australasian Psychiatry. In Press.
- 23. Wells M, Mitchell KJ, Finkelhor D, Becker-Blease KA (2007) Online mental health treatment: Concerns and considerations. Cyberpsychology and Behavior 10: 453–459.
- 24. Perini S, Titov N, Andrews G (2008) The climate sadness program of Internet-based treatment for depression: A pilot study. E-Journal of Applied Psychology 4: 18–24.
- 25. Aydos L, Titov N, Andrews G (2009) Shyness 5: the clinical effectiveness of Internet-based clinician-assisted treatment of social phobia. Australasian Psychiatry 17: 488–492.
- 26. Klein B, Cook S (2010) Preferences for e-mental health services amongst an online Australian sample. Electronic Journal of Applied Psychology 6: 27–38.
- 27. Titov N, Andrews G, Kemp A, Robinson E (2010) Characteristics of adults with anxiety or depression treated at an internet clinic: Comparison with a national survey and an outpatient clinic. PLoS One 5:
- 28.
Baer L (1991) Getting control. Overcoming your obsessions and compulsions. Middlesex: Penguin Books.
- 29. Rosenfeld R, Dar R, Anderson D, Kobak KA, Greist JH (1992) A Computer-Administered Version of the Yale-Brown Obsessive-Compulsive Scale. Psychological Assessment 4: 329–332.
- 30.
World Health Organization (1997) CIDI-Auto Version 2.1: Administrator's guide and reference. Training and Reference Centre for WHO CIDI: Sydney.
- 31.
World Health Organization (2006) WHO Composite International Diagnostic Interview (WHO-CIDI 3.0) Study Materials. January 2006 version.
- 32. Federici A, Summerfeldt L, Harrington JL, McCabe RE, Purdon CL, et al. (2010) Consistency between self-report and clinician-administered versions of the Yale-Brown Obsessive-Compulsive Scale. Journal of Anxiety Disorders 24: 729–733.
- 33. Olaffson RP, Snorrason I, Smari J (2010) Yale-Brown Obsessive Compulsive Scale: Psychometric Properties of the Self-Report version in a student sample. Journal of Psychopathology and Behavioral Assessment 32: 226–235.
- 34. Steketee G, Frost R, Bogart K (1996) The YALE-BROWN obsessive compulsive scale: Interview versus self-report. Behaviour Research and Therapy 34: 675–684.
- 35. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, et al. (2002) Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychological Medicine 32: 959–976.
- 36.
World Health Organisation (2009) World Health Organisation Disability Assessment Schedule, 2nd Edition.
- 37. Ustun TB, Chatterji S, Kostanjsek N, Rehm J, Kennedy C, et al. (2010) Developing the world health organization disability assessment schedule 2.0. Bulletin of the World Health Organisation 88: 815–823.
- 38.
SPSS 18 for Windows. 18.0.0 ed. Chicago: SPSS Inc.
- 39. Houghton S, Saxon D, Bradburn M, Ricketts T, Hardy G (2010) The effectiveness of routinely delivered cognitive behavioural therapy for obsessive-compulsive disorder: A benchmarking study. British Journal of Clinical Psychology 49: 473–489.
- 40. Van Oppen P, Van Balkom AJLM, Smit JH, Schuurmans J, Van Dyck R, et al. (2010) Does the therapy manual or the therapist matter most in treatment of obsessive-compulsive disorder? A randomized controlled trial of exposure with response or ritual prevention in 118 patients. Journal of Clinical Psychiatry 71: 1158–1.