There is concern that people seeking treatment over the Internet for anxiety or depressive disorders may not resemble the general population or have less severe disorders than patients attending outpatient clinics or cases identified in community surveys. Thus the response to treatment in Internet based trials might not generalize.
We reviewed the characteristics of applicants to an Australian Internet-based treatment clinic for anxiety and depression, and compared this sample with people from a national epidemiological survey and a sample of patients at a specialist outpatient anxiety and depression clinic. Participants included 774 volunteers to an Internet clinic, 454 patients at a specialist anxiety disorders outpatient clinic, and 627 cases identified in a national epidemiological survey. Main measures included demographic characteristics, and severity of symptoms as measured by the Kessler 10-Item scale (K-10), the 12-item World Health Organisation Disability Assessment Schedule second edition (WHODAS-II), the Penn State Worry Questionnaire (PSWQ), the Body Sensations Questionnaire (BSQ), the Automatic Cognitions Questionnaire (ACQ), the Social Interaction Anxiety Scale (SIAS) and the Social Phobia Scale (SPS).
The severity of symptoms of participants attending the two clinics was similar, and both clinic samples were more severe than cases in the epidemiological survey. The Internet clinic and national samples were older and comprised more females than those attending the outpatient clinic. The Internet clinic sample were more likely to be married than the other samples. The Internet clinic and outpatient clinic samples had higher levels of educational qualifications than the national sample, but employment status was similar across groups.
The Internet clinic sample have disorders as severe as those attending an outpatient clinic, but with demographic characteristics more consistent with the national sample. These data indicate that the benefits of Internet treatment could apply to the wider population.
Citation: Titov N, Andrews G, Kemp A, Robinson E (2010) Characteristics of Adults with Anxiety or Depression Treated at an Internet Clinic: Comparison with a National Survey and an Outpatient Clinic. PLoS ONE 5(5): e10885. doi:10.1371/journal.pone.0010885
Editor: Tadafumi Kato, RIKEN Brain Science Institution, Japan
Received: January 6, 2010; Accepted: February 12, 2010; Published: May 28, 2010
Copyright: © 2010 Titov et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was investigator initiated. It was funded by departmental funds from the Clinical Research Unit for Anxiety and Depression (CRUfAD), University of New South Wales and St Vincent's Hospital, Sydney, Australia. CRUfAD is a not-for-profit entity (www.crufad.org and www.virtualclinic.org.au) that has existed for 30 years and regularly conducts studies such as this. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Anxiety and depression are common mental disorders annually affecting approximately 20% of the adult population –. Over a 12 month period less than 40% of these people report seeking treatment from a health professional, with only a small percentage seeking treatment from a psychologist or psychiatrist.
One strategy for reducing barriers to treatment involves the development of Internet-based treatment programs for common mental disorders . Such programs are based on cognitive behavioural therapy (CBT), are highly structured, and comprise online lessons, homework assignments, and regular communication with a therapist via email, telephone, or online forum . The treatment efficacy or effectiveness of Internet-based CBT (ICBT) programs has been demonstrated for depression –, panic disorder –, generalized anxiety disorder (GAD) –, and social phobia –. Typically, the benefits of ICBT with clinician-guidance is superior to self-guided programs, but on a public health scale self-guided programs are likely to be helpful, and both types are cost-effective relative to face-to-face treatment . ICBT may reduce direct and indirect costs of treatment and increase access for people unable to find a local therapist, those unable to attend treatment during usual working hours, and those concerned about stigma . The core question is “are people who seek Internet treatment different to people who seek face-to-face treatment or different to the average person in the population with the same disorder?”
The encouraging results from studies evaluating ICBT have triggered a rapid increase in “Internet clinics” (services providing ICBT or similar programs): For example, within the last 6 months at least 4 Internet clinics have begun operating in Australia. Given the medium, it is expected that Internet clinics will appeal mainly to younger people, however, little is known about the demographic characteristics of people who participate in online treatment. Such data are essential for determining the appeal and likely uptake of ICBT by different demographic groups, and will inform both decisions about the applicability of this form of treatment to a wider population, and how such services can be integrated with existing mental health services.
The present study reports the demographic characteristics and disorder severity of three groups of people: Participants at an Internet clinic operated at St Vincent's Hospital, Sydney; patients attending a specialist outpatient anxiety disorders clinic operated by the same hospital; and cases identified in a national epidemiological survey.
This study was approved by the St Vincent's Hospital Human Research Ethics Committee. All participants provided written informed consent.
The first group (the Internet clinic; IC group) comprised all participants in ICBT programs at the VirtualClinic (www.virtualclinic.org.au), treated between January 2008 and October 2009 (n = 774). The VirtualClinic is a joint venture between St Vincent's Hospital, Sydney, and the University of New South Wales. All participants had a DSM-IV  diagnosis of major depression, GAD, panic disorder, or social phobia confirmed via a structured diagnostic telephone interview using either the MINI 5.0.0  or the CIDI 3.0 .
The second group comprised patients at a specialist Anxiety Disorders Clinic (the ADC group), operated by the Clinical Research Unit for Anxiety and Depression (CRUfAD), the same research and clinical team that manages the VirtualClinic at St Vincent's Hospital in Sydney, Australia. All people for whom data was available who had participated in group or individual treatment programs for GAD, panic disorder, or social phobia from January 2004 to March 2009, and who were over 18 years of age were included (n = 454). Diagnosis for ADC group participants was confirmed via a face-to-face interview with an experienced Consultant Psychiatrist or Clinical Psychologist.
The third group comprised respondents to the 2007 Australian National Mental Health Survey, a national epidemiological survey (the NS group), conducted by the Australian Bureau of Statistics between August and December 2007 to determine the prevalence of common mental disorders across Australia . This survey included 8841 Australian residents aged 16–85 years (response rate of 60%) and derived data on lifetime mental disorders using the CIDI 3.0. We selected a subsample (unweighted) of respondents who met DSM-IV diagnostic criteria for lifetime depression, GAD, panic disorder, or social phobia and who reported having symptoms of that disorder in the last 12 months. In order to increase comparability with the clinic samples, if they had more than one disorder assessed in the survey, they were only included if they had chosen one of these four disorders as being the one that troubled them the most (n = 627). To maximise sample size, this subsample included respondents who reported seeking treatment (n = 324) as well as those who did not seek treatment (n = 303). Analyses confirmed that these two groups were similar on most of the variables examined in this study, except that those who sought treatment had significantly higher World Health Organisation Disability Assessment Schedule second edition (WHODAS-II)  scores (t = −2.5, p<0.05) and were more likely to have used the Internet for seeking mental health information or help (t = 44.8, p<0.001).
Data was obtained as part of the treatment of the two clinic groups and was de-identified before being accessed. Data on the survey participants was obtained from a de-identified unit record file supplied by the Australian Bureau of Statistics. Approval for the study was obtained from the Human Research Ethics Committee of St Vincent's Hospital. All participants provided written informed consent.
Demographic variables available for each group included age, gender, marital status, highest educational qualification, and employment status. Information about use of the Internet for mental health help or information was available for both the IC and NS groups. Kessler 10-item scores (K-10) , a measure of psychological distress, and the WHODAS-II scores, a general measure of disability, were available for all three groups. For people in the IC and ADC groups, the same disorder specific measures are reported when available, obtained at pre-treatment assessment. For people with a primary diagnosis of GAD the available measure was the Penn State Worry Questionnaire (PSWQ) , for those with panic disorder the measures included the Body Sensations Questionnaire (BSQ)  and the Agoraphobic Cognitions Questionnaire (ACQ) , and for those with social phobia the available measures were the Social Interaction Anxiety Scale (SIAS) and Social Phobia Scale (SPS) .
Differences between samples in the categorical demographic variables were assessed using chi-square tests, while mean differences in age and the symptom severity scales were assessed using one-way ANOVAs. Post-hoc tests were conducted using chi-square tests for categorical variables and t-tests for continuous variables. Logistic regression analyses and ANCOVAs were used with the categorical and continuous variables, respectively, to investigate whether the results differed after controlling for age. Participants with missing data were omitted from specific analyses where the missing values occurred. Analyses were performed using the Statistical Package for Social Sciences (SPSS) version 17·0 for Windows , and the SAS-callable SUDAAN software package .
The IC sample was recruited between January 2008 and October 2009; the ADC sample was recruited between January 2004 and May 2009; and the NS sample was recruited between August and December 2007.
Demographic characteristics of people in the 3 samples are displayed in Table 1.
The mean age of people in the IC (43.0 years) and NS (42.0 years) samples was significantly greater than those in the ADC sample (32.8 years) (F = 96.8, p<0.001). More than 40% of the IC and NS samples were over the age of 44, compared to 11% of the ADC sample.
There were more females in the IC (66%) and NS (64%) samples than in the ADC sample (52%) (X2 = 26.4, p<0.001).
There were significant differences in marital status between samples (X2 = 191.0, p<0.001): More people in the ADC sample were likely to be single compared to the NS sample who, in turn, were more likely to be single than those in the IC sample.
Highest Educational Qualification.
There were significant differences in educational qualifications between samples: The IC and ADC samples had more people with higher qualifications than the NS sample (X2 = 99.2, p<0.001).
No differences were observed in employment status (X2 = 2.3, p = ns) across groups.
Use of the Internet for Mental Health Help/Information.
The IC sample (61%) was more likely than the NS (25%) sample to report using the Internet for accessing information or help about mental health (X2 = 180.2, p<0.001). This question was not asked of the ADC group.
Disorder scores of people in the 3 samples are included in Table 2.
Significant differences in distress were found between samples (F = 330.9, p<0.001): Post-hoc tests revealed the ADC sample (33.2) had significantly higher K-10 scores than the IC sample (26.1) who, in turn, had significantly higher K-10 scores than the NS sample (21.1).
Significant differences in disability were found between samples (F = 164.0, p<0.001): Post-hoc tests revealed the IC sample (14.7) had significantly higher WHODAS-II scores than the ADC sample (12.1) who, in turn, had significantly higher WHODAS-II scores than the NS sample (7.0).
Generalized Anxiety Disorder.
No difference was found in pre-treatment PSWQ scores between the IC and ADC samples (F = 1.1, p = ns). This measure was not administered to the NS group.
The ADC sample had significantly greater SPS scores than the IC sample (F = 13.1, p<0.001). No difference was found in pre-treatment SIAS scores (F = 0.5, p = ns). This measure was not administered to the NS group.
No difference was found in pre-treatment BSQ and ACQ scores between the IC and ADC samples (F = 1.6–2.3, p = ns). This measure was not administered to the NS group.
Effect of Age.
All analyses were repeated controlling for age, but no differences were found in the pattern of results described above.
Does the Internet group differ in terms of demographic characteristics? The Internet group were of similar age and gender distribution to the national sample, more likely to be married and more likely to have higher qualifications, but as likely to be employed. Compared to the clinic sample, the Internet group were older, less likely to be male, less likely to be married but equally well educated and as likely to be employed. We conclude that the Internet group are largely representative of the wider population of those with anxiety and depression.
Does the Internet group differ in terms of disorder severity? The national sample had the lowest distress and disability scores. The Internet group was less distressed but more disabled than the clinic group. People who apply for Internet treatment do not have mild variants of anxiety and depressive disorders. The Internet groups' panic, social phobia and generalized anxiety scores were comparable to the clinic group. We conclude that the Internet group have symptom severity scores comparable to those who seek face-to-face treatment.
The data from the National Survey reflect people with anxiety and depression in the Australian population and the measures used are valid. Similar measures were also used in the two clinic groups, and validated clinical measures were used to determine illness severity.
The number of participants was substantial but these findings require replication. The patients in the outpatient clinic reflect the catchment area from where they are drawn and samples from other clinics could have different demographic characteristics. The Internet clinic sample represent the people who applied for treatment during the first two years that the clinic operated. They may not prove to be representative of people who apply for Internet therapy.
Applicants to an Internet clinic were similar in age, gender and employment status to those identified by a national epidemiological survey as meeting diagnostic criteria for anxiety or depressive disorders in the Australian community. The severity of distress, disability and disorder symptoms of the Internet sample was greater than that of the national sample but was similar to people attending a specialist outpatient treatment facility. These data have implications for policy makers and funding bodies. People seeking online treatment have substantial disorders and are not necessarily young and technologically sophisticated. They may represent a population who are mature, have a long history of illness experience, are motivated to seek and participate in treatment, but have had difficulty accessing traditional outpatient clinics.
Conceived and designed the experiments: NT. Analyzed the data: NT AK. Wrote the paper: NT GA AK ER.
- 1. Kessler RC, Chiu WT, Demler O, Walters EE (2005) Prevalence, severity, and comorbidity of 12-month DSM-IV Disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 62: 617–627.
- 2. Andrews G, Henderson S, Hall W (2001) Prevalence, comorbidity, disability and service utilisation. Br J Psychiatry 178: 145–153.
- 3. Wells JE, Oakley Browne MA, Scott KM, McGee MA, Baxter J, et al. (2006) Te Rau Hinengaro: the New Zealand Mental Health Survey: overview of methods and findings. Aust N Z J Psychiatry 40: 835–844.
- 4. Marks I, Cavanagh K, Gega L (2007) Hands-on help: Computer-aided psychotherapy. New York: Psychology Press Taylor and Francis. 223 p.
- 5. Titov N (2007) Status of computerized cognitive behavioural therapy for adults. Aust N Z J Psychiatry 41: 95–114.
- 6. Andersson G, Bergstrom J, Hollandare F, Carlbring P, Kaldo V, et al. (2005) Internet-based self-help for depression: randomized controlled trial. Br J Psychiatry 187: 456–461.
- 7. Perini S, Titov N, Andrews G (2009) Clinician-assisted Internet-based treatment is effective for depression: randomised controlled trial. Aust N Z J Psychiatry 43: 571–578.
- 8. Titov N, Andrews G, Davies M, McIntyre K, Robinson E, et al. (2010) Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLos ONE. In press.
- 9. Carlbring P, Nilsson-Ihrfelt E, Waara J, Kollenstama C, Buhrmana C, et al. (2005) Treatment of panic disorder: live therapy vs. self-help via the Internet. Behav Res Ther 43: 1321–1333.
- 10. Klein B, Richards JC, Austin DW (2006) Efficacy of Internet therapy for panic disorder. J Behav Ther Exp Psychiatry 37: 213–238.
- 11. Kiropoulos LA, Klein B, Austin DW, Gilson K, Pier C, et al. (2008) Is internet-based CBT for panic disorder and agoraphobia as effective as face-to-face CBT? J Anxiety Disord 22: 1273–1284.
- 12. Shandley K, Austin DW, Klein B, Pier C, Schattner P, et al. (2008) Therapist-assisted, Internet-based treatment for panic disorder: can general practitioners achieve comparable patient outcomes to psychologists? J Med Internet Res 10(2): e14.
- 13. Titov N, Andrews G, Robinson E, Schwencke G, Johnston L, et al. (2009) Clinician-assisted Internet-based treatment is effective for generalized anxiety disorder: randomized controlled trial. Aust N Z J Psychiatry 43: 905–912.
- 14. Robinson E, Titov N, Andrews G, McIntyre K, Schwencke G, et al. (2010) Internet treatment for generalized anxiety disorder: a randomized controlled trial comparing clinician vs. technician assistance. PLos ONE. In press.
- 15. Berger T, Hohl E, Caspar F (2009) Internet-based treatment for social phobia: a randomized controlled trial. J Clin Psychol 65: 1–15.
- 16. Titov N, Andrews G, Schwencke G, Drobny J, Einstein D (2008) Shyness 1: a randomized controlled trial of an internet-based treatment for social phobia. Aust N Z J Psychiatry 42: 585–594.
- 17. Titov N, Andrews G, Schwencke G (2008) Shyness 2: treating social phobia online: replication and extension. Aust N Z J Psychiatry 42: 595–605.
- 18. Titov N, Andrews G, Choi I, Schwencke G, Mahoney A (2008) Shyness 3: randomized controlled trial of guided versus unguided Internet-based CBT for social phobia. Aust N Z J Psychiatry 42: 1030–1040.
- 19. Titov N, Andrews G, Johnston L, Schwencke G, Choi I (2009) Shyness programme: longer term benefits, cost-effectiveness, and acceptability. Aust N Z J Psychiatry 43: 36–44.
- 20. Titov N, Andrews G, Choi I, Schwencke G, Johnston L (2009) Randomized controlled trial of web-based treatment of social phobia without clinician guidance. Aust N Z J Psychiatry 2009 43: 913–919.
- 21. Titov N, Andrews G, Schwencke G, Solley K, Johnston L, et al. (2009) An RCT comparing two types of support on severity of symptoms for people completing Internet-based cognitive behavior therapy for social phobia. Aust N Z J Psychiatry 43: 920–926.
- 22. Andersson G, Carlbring P, Holmstrom A, Sparthan E, Furmark T, et al. (2006) Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomised controlled trial. J Consult Clin Psychol 74: 677–686.
- 23. Carlbring P, Gunnarsdóttir M, Hedensjö L, Andersson G, Ekselius L, et al. (2007) Treatment of social phobia: randomised trial of internet-delivered cognitive-behavioural therapy with telephone support. Br J Psychiatry 190: 123–128.
- 24. Marks I, Cavanagh K (2009) Computer-aided psychological treatments: evolving issues. Annu Rev Clin Psychol 5: 121–141.
- 25. American Psychiatric Association (2000) Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision. Washington, DC: American Psychiatric Association.
- 26. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, et al. (1998) The Mini-International Neuropsychiatric Interview (M.I.N.I.): the Development and Validation of a Structured Diagnostic Psychiatric Interview for DSM-IV and ICD-10. J Clin Psychiatry 59(S20): 22–33.
- 27. Kessler RC, Ustun TB (2004) The World Mental Health (WMH) survey initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). Int J Methods Psychiatr Res 13: 93–121.
- 28. Australian Bureau of Statistics (2008) National Survey of Mental Health and Wellbeing 2007: summary of Results. Released 10/23/2008. Available: http://www.ausstats.abs.gov.au/ausstats/subscriber.nsf/0/6AE6DA447F985FC2CA2574EA00122BD6/File/43260_2007.pdf. Accessed 2009 Dec 15.
- 29. World Health Organization.World Health Organization Disability Assessment Schedule, 2nd ed. Available: http://www.who.int/icidh/whodas/. Accessed 2009 Dec 18.
- 30. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, et al. (2002) Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 32: 959–976.
- 31. Meyer TJ, Miller ML, Metzger RL, Borkovec TD (1990) Development and validation of the Penn State Worry Questionnaire. Behav Res Ther 28: 487–495.
- 32. Chambless DL, Caputo GC, Bright P, Gallagher R (1984) Assessment of fear in agoraphobics: the Body Sensations Questionnaire and the Agoraphobic Cognitions Questionnaire. J Consult Clin Psychol 52: 1090–1097.
- 33. Mattick RP, Clarke JC (1998) Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behav Res Ther 36: 455–470.
- 34. SPSS 17 for Windows, Rel. 17.0.0. 2008. Chicago: SPSS Inc.
- 35. SUDAAN for Windows, Rel 10.0.1. 2008. North Carolina: RTI International.