Background and Aims
Cognitive behavioral group therapy (CBGT) is an effective, well-established, but not widely available treatment for social anxiety disorder (SAD). Internet-based cognitive behavior therapy (ICBT) has the potential to increase availability and facilitate dissemination of therapeutic services for SAD. However, ICBT for SAD has not been directly compared with in-person treatments such as CBGT and few studies investigating ICBT have been conducted in clinical settings. Our aim was to investigate if ICBT is at least as effective as CBGT for SAD when treatments are delivered in a psychiatric setting.
We conducted a randomized controlled non-inferiority trial with allocation to ICBT (n = 64) or CBGT (n = 62) with blinded assessment immediately following treatment and six months post-treatment. Participants were 126 individuals with SAD who received CBGT or ICBT for a duration of 15 weeks. The Liebowitz Social Anxiety Scale (LSAS) was the main outcome measure. The following non-inferiority margin was set: following treatment, the lower bound of the 95 % confidence interval (CI) of the mean difference between groups should be less than 10 LSAS-points.
Both groups made large improvements. At follow-up, 41 (64%) participants in the ICBT group were classified as responders (95% CI, 52%–76%). In the CBGT group, 28 participants (45%) responded to the treatment (95% CI, 33%–58%). At post-treatment and follow-up respectively, the 95 % CI of the LSAS mean difference was 0.68–17.66 (Cohen’s d between group = 0.41) and −2.51–15.69 (Cohen’s d between group = 0.36) favoring ICBT, which was well within the non-inferiority margin. Mixed effects models analyses showed no significant interaction effect for LSAS, indicating similar improvement across treatments (F = 1.58; df = 2, 219; p = .21).
ICBT delivered in a psychiatric setting can be as effective as CBGT in the treatment of SAD and could be used to increase availability to CBT.
Citation: Hedman E, Andersson G, Ljótsson B, Andersson E, Rück C, Mörtberg E, et al. (2011) Internet-Based Cognitive Behavior Therapy vs. Cognitive Behavioral Group Therapy for Social Anxiety Disorder: A Randomized Controlled Non-inferiority Trial. PLoS ONE 6(3): e18001. https://doi.org/10.1371/journal.pone.0018001
Editor: Antonio Verdejo García, University of Granada, Spain
Received: December 11, 2010; Accepted: February 17, 2011; Published: March 25, 2011
Copyright: © 2011 Hedman et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by research grants from Stockholm County Council (Nils Lindefors) and the Bror Gadelius Fund (Erik Hedman). The main funding organization (Stockholm County Council) is a public institution and neither of the funding organizations had any role in the design and conduct of the study; in the collection, management, and analysis of the data; or in the preparation, review and approval of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Social anxiety disorder (SAD), or social phobia, is characterized by a persistent and debilitating fear of being evaluated by others. SAD typically has an early onset , runs a chronic course , is one of the most prevalent anxiety disorder in the western world , and is associated with functional impairment . Cognitive behavioral group therapy (CBGT) for SAD has proven to be effective in several randomized controlled trials (RCTs) over the last 20 years. Results have shown that CBGT is superior to psychological  and pill placebo and that it can be as effective as pharmacological treatment with SSRIs , making it the most established psychological treatment for SAD , . However, CBGT is available to only a few due to a lack of trained therapists . While individually administered CBT has demonstrated large effects  and might be more efficacious than CBGT , , this treatment format is even more dependent on the availability of trained therapists.
More recently, guided Internet-based CBT (ICBT) has shown promising results in RCTs conducted by three independent research groups , , , , , . The treatment entails the same components as conventional CBT, such as exposure to feared situations, but is delivered over the Internet with therapist contact via an online messaging system resembling e-mail . Evidence has shown that improvements made during ICBT are persistent . ICBT has some important advantages over live treatment. First, it is not restricted in time or to a specific geographic location (i.e., patients as well as therapists can work with the treatment at any time or place they wish). Second, since ICBT demands less therapist time, ICBT therapists can treat significantly more patients than possible with CBGT , . Consequently, ICBT has the potential to dramatically increase availability of CBT.
Although ICBT for SAD has demonstrated effects in line with CBGT, the current evidence holds a number of limitations. There has been no comparison to conventional CBT, such as CBGT, and most studies have relied solely on self-report instruments as measures of treatment outcome. In addition, most studies have been conducted in university settings, which might have a different impact on treatment experience and outcome compared to receiving care at a psychiatric clinic. Although one study has indicated that the characteristics of Internet clinic patients could be similar to those of outpatient clinics , the research field would benefit from a trial conducted in a psychiatric context. Finally, diagnostic procedures may be more clinically valid when conducted in a clinical setting. This has not been the case in the previous studies where only telephone interviews or self-report have been used.
In summary, more empirical evidence is needed before ICBT can be validly employed in a psychiatric context. As CBGT is an effective gold standard treatment appropriate for use as a benchmark , the necessary evidence to validate ICBT is to demonstrate non-inferiority (i.e., equal efficacy) to CBGT . The aim of the present study was to determine whether ICBT is as effective as CBGT for patients with SAD when administered in a psychiatric setting. We hypothesized that ICBT would be at least as effective as CBGT in reducing social anxiety. We also predicted that the two treatments would be equal on secondary outcome measures of depressive symptoms, general anxiety, quality of life, and global functioning.
The protocol for this trial and supporting CONSORT checklist are available as supporting information; see Checklist S1 and Protocol S1. This was a non-inferiority trial within the context of a parallel group study with unrestricted randomisation in 1∶1 ratio conducted in Sweden. Outcome assessors were blind to treatment status.
Recruitment and selection
Recruitment for the study took place between 2007 and 2009. Participants were recruited by referral from primary care physicians and psychiatrists, and by self-referral to the psychiatric clinic at the Karolinska University Hospital in Stockholm, Sweden. Information about the treatment and the study was published on the official web page of the clinic (www.internetpsykiatri.se). There were no advertisements in newspapers or other media. The study protocol was approved by the Regional Ethical Review Board in Stockholm (Karolinska Institutet) and written informed consent was obtained from all participants after a detailed description of the study had been given.
To be eligible for inclusion potential participants had to meet the following criteria: (a) fulfill the DSM-IV  criteria of social anxiety disorder as assessed using the Structured Clinical Interview for DSM-IV axis I disorders (SCID-I) , (b) agree to undergo no other psychological treatment for the duration of the study, (c) have no history of CBT for the last four years, (d) have constant dosage two months prior to treatment of any prescribed medication for anxiety or depression and agree to keep dosage constant throughout the study, (e) have a primary diagnosis of SAD as assessed by the interviewing psychiatrist (individuals with comorbid disorders according to the Mini International Neuropsychiatric Interview (MINI)  were not excluded), (f) not currently meet the diagnostic criteria for substance abuse (g) have no history of psychosis or bipolar disorder, (h) not score >20 on the Montgomery Åsberg Depression Rating Scale-self report (MADRS-S) , (j) if criteria for major depression were met, have a score of less than 4 of 6 on the suicide ideation item of MADRS-S, and (k) not meet criteria for any personality disorders within cluster A (e.g. paranoid personality disorder) or B (e.g. antisocial personality disorder), which could interfere with the therapeutic process in group therapy.
During the first stage of the recruitment process, potential participants were asked to complete the Social Phobia Screening Questionnaire (SPSQ) , MADRS-S, the Alcohol Use Disorders Identification Test (AUDIT) , and the Drug User Disorders Identification Test (DUDIT) . In the second stage, participants were invited to attend an interview with a psychiatrist at the Karolinska University Hospital to confirm the SAD diagnosis and establish whether they met the remaining inclusion criteria (b-k). The psychiatrists conducting the assessments had more than 10 years of experience working with structured diagnostic interviews and had undergone extensive training in the use of the primary outcome measure, as well as of the SCID and the MINI. Two hundred thirty applicants completed the screening questionnaires and underwent the interview. Of those, 126 met all 10 inclusion criteria. Figure 1 shows the participant flow throughout the trial. Demographic information for participants is presented in Table 1.
Abbreviations: ICBT, Internet-based cognitive behavior therapy; CBGT, Cognitive behavioral group therapy; SAD, Social anxiety disorder; Received, completed at least 5 modules (ICBT) or 5 sessions (CBGT).
The primary outcome measure was the clinician administrated Liebowitz Social Anxiety Scale (LSAS) , . The LSAS has good psychometric properties including high internal consistency (Cronbach’s α = .96) and high test-retest reliability over one week (r = .97) , . The self-report version of LSAS (LSAS-SR)  was used as a complement during the treatment phase The LSAS-SR has a high internal consistency (Cronbach’s α = .95) as well as a high 12-week test-retest reliability (r = .83) , . The Social Phobia Scale (SPS)  and the Social Interaction Anxiety Scale (SIAS)  were also administered to assess a broader spectrum of social anxiety symptoms. Both scales have good psychometric properties .
General anxiety, anxiety sensitivity, depression and quality of life.
The Beck Anxiety Inventory (BAI)  and the Anxiety Sensitivity Index (ASI)  were used to assess general anxiety and anxiety sensitivity. The Montgomery Åsberg Depression Rating Scale-self report (MADRS-S)  was used to measure depressive symptoms. Finally, the Quality of Life Inventory (QOLI)  was used to assess quality of life. The BAI, ASI, MADRS-S and the QOLI have all demonstrated good psychometric properties.
Diagnostic assessment, global functioning and improvement.
Psychiatric diagnoses were established using the SCID-I-Research version (RV) , the SCID-II , and the MINI . The SCID-I-RV was used to assess SAD since it has the advantage of providing information in greater detail than the MINI (which was not used to assess criteria for SAD) and has high inter-rater reliability . To assess avoidant personality disorder, we used SCID-II, which has very good inter-rater reliability . The MINI was used to assess axis I disorders other than SAD . Assessors used the Global Assessment of Functioning Scale (GAF)  to measure global functioning and the Clinical Global Impression Improvement Scale (CGI-I)  to measure global improvement.
Assessment of treatment credibility and treatment preference.
A treatment credibility scale comprising five items was administered to determine whether participants viewed the two treatments as equally credible . Prior to randomization participants were asked to state their treatment preference (ICBT or CBGT).
Administration format of self-report measures
We used an Internet application to administer the LSAS-SR, SIAS, SPS, BAI, MADRS-S, and the QOLI. Internet and paper-and-pencil administrations of these measures have been shown to possess equivalent psychometric properties .
Assessment points and randomization.
Assessments, including diagnostic interviews, were conducted before treatment (i.e., pre-treatment), immediately after treatment (i.e., post-treatment), and six months after treatment (i.e., follow-up). During treatment, the LSAS-SR and the suicide ideation item of MADRS-S were administered on a weekly basis. Participants assessed treatment credibility after one week of treatment. The randomization procedure involved two external persons not involved in the study; one provided randomization data and the other monitored that no manipulation of treatment allocation was performed by the research group. A true random number service (http://www.random.org) was used to ensure randomization. The random sequence was generated after inclusion of participants to ensure that assignment of intervention was concealed from assessing psychiatrists and researchers of the study. Participants were allocated to CBGT or ICBT in a 1∶1 ratio using simple randomization with no restrictions or matching. To ensure the integrity of the blinding procedure, participants were instructed not to mention which treatment they had received during the post-treatment and follow-up interviews. After completing the interviews, the assessing psychiatrists guessed allocation status for each participant.
Monitoring of treatment integrity.
Treatment integrity of CBGT was ensured in three ways. First, we used a detailed treatment manual . Second, group therapists received supervision throughout the trial by a licensed psychotherapist specialized in CBT for SAD. Third, all sessions were audio recorded and a random sample of 5 sessions was audited by a clinical psychologist with more than 10 years of experience in treating SAD with CBT. Using the Therapist Adherence Scale (TAS) developed by the originators of CBGT , all reviewed sessions were judged to have been conducted in accordance with the treatment manual. The average TAS score of the reviewed session was 4.5 (SD = 0.5) on a 1 (ineffective) to 5 (extremely effective) scale. Due to the fixed nature of ICBT and the limited role of the therapist, no measure of treatment integrity was taken for ICBT. However, all therapists who provided the guidance of ICBT received supervision from a clinical psychologist throughout the trial and all therapists had previous experience of that treatment format.
Internet-based cognitive behavior therapy (ICBT).
The ICBT employed in this study was based on the treatment developed by Andersson and coworkers, and has been validated by several randomized controlled trials , , . The treatment followed a CBT-model, developed for individual therapy, that stresses the importance of avoidance and safety behaviors as well as misinterpretations of social events and internal focus as maintaining factors of SAD . A vital part of the treatment was the gradual access to internet-based self-help text comprising 15 text modules, each covering a specific theme (e.g., exposure or cognitive restructuring) completed with a homework component. The modules provided the participants with the same knowledge and tools as conventional individual CBT for SAD.
The duration of ICBT was 15 weeks and throughout this period the patient had access to a therapist via an online secure messaging system. The role of the therapist was mainly to provide feedback regarding home work and to grant access to the treatment modules. However, the patient could contact the therapist at any time and expect a reply within 24 hours during week days. Patients and therapists had no face-to-face or telephone contact during the treatment. The general instruction to the internet therapists was to have the ambition to restrict time spent on each patient to less than 10 minutes per week. This time frame was judged possible as most messages to patients are very brief entailing the core feed-back that the homework was successfully completed and the next treatment module is accessible. The therapists conducting ICBT were eight psychologists with one to four years of experience in delivering CBT via the internet.
Cognitive behavioral group therapy (CBGT).
This treatment comprised an initial individual session followed by 14 group sessions over 15 weeks. The individual session prepared the participant to begin group treatment sessions and included a rationale for group treatment. Each group session was 2.5 hours long, including a 15 minute break. Groups were lead by two therapists and had six to seven participants. The CBGT followed the protocol developed by Heimberg and Becker  with the addition of two group sessions. The first two group sessions (i.e., Sessions 2–3) were aimed at teaching participants the role and components of anxiety and how to identify and challenge negative automatic thoughts. Sessions 4–14 focused primarily on individually tailored in-session exposure in combination with cognitive restructuring. Prior to exposure exercises, participants identified and disputed negative automatic thoughts, developed rational alternatives, and behavioral goals were set. Following the exposure exercises, additional cognitive restructuring was conducted and goal attainment was reviewed. Participants were also given homework to continue exposure exercises in the same fashion in their home environment. Session 14–15 were devoted to assessing the progress of the participant and setting goals for the future. A detailed plan was created for each participant to ensure that goals and methods to achieve them were clear. The therapists facilitating the CBGT sessions were six clinical psychologists with 2 to15 years experience in treating patients with SAD using CBT.
Statistical analyses were conducted using PASW version 18.0 (SPSS inc., Chicago). The non-inferiority margin of the primary outcome measure LSAS was set at Δ10 points, which was based on clinical judgment and a review of the evidence of CBGT compared to credible control conditions for SAD. Meta-analytic reviews, adopting random-effects models, have estimated the lower bound of the 95% confidence interval (CI) of the between group effect size to 0.39 (Hedges’g) . Assuming a standard variance of LSAS scores in our sample, this supported the use of 10 LSAS points as a non-inferiority margin. Test criterion for non-inferiority was that the lower bound of the 95% CI of the mean difference should fall within Δ. With 95% probability, the mean difference between ICBT and CGBT had to be smaller than 10 LSAS points. As this was a non-inferiority trial, this criterion did not apply for the upper bound of the CI, meaning that the CI could exceed 10 LSAS points if in favor of ICBT. For the other continuous measures, the non-inferiority margin was set at Δ Cohen’s d = 0.5. Test criterion for non-inferiority for these measures was that the lower bound of the 95% CI of between group effect sizes should fall within this range. This criterion was judged acceptable as it has been proposed that an effect size of 0.5 marks the border between a mild and moderate effect . Thus, this criterion meant that mild effects up to the border of moderate effects were acceptable.
Main outcome continuous variables were analyzed using a linear mixed effects model because of its superior qualities regarding missing data as well as in reducing the risk of committing type I errors . We employed the restricted maximum likelihood method assuming a compound symmetry model as covariance structure since it provided the best model in an information criteria comparison. T-tests were used to compare treatment credibility ratings and χ2 tests to assess nominal scale variables. Wilcoxon tests and Mann-Whitney U tests were used to analyze outcomes on ordinal scale variables. To estimate rates of responders, we used the clinical significant improvement criteria as suggested by Jacobson and Truax on the primary outcome measure . The criteria for clinical significant improvement was to have a score below 43.3 (closer to healthy population than to SAD population  and the reliable change criterion was established using the test-retest reliability coefficient of .97 . Cohen’s d based on pooled standard deviations was used to calculate effect sizes. The sample size was considered satisfactory since power calculations showed that there was a chance slightly lower than 80% to detect a difference, given the non-inferiority criteria used and an alpha-level of .05. The main analyses were conducted in accordance to intention-to-treat principle, i.e. all available assessment data was analyzed in accordance to how participants were randomized. This meant that participants were encouraged to provide assessment data regardless of treatment adherence. On the CGI-I scale, missing values were replaced with “no change”. As a complement, the social anxiety measures were also analyzed based on the sample of completers only. There were no significant differences between the groups on the outcome measures at baseline (t (1, 124) = 0.02–1.38, p = .17–.98).
Loss of data is presented in Figure 1.
Effect sizes and non-inferiority
Within group effect sizes on the primary outcome measure LSAS were large for both treatments. At post-treatment and six month follow-up respectively, the 95 % CI of the mean difference between the groups on LSAS score was 0.68–17.66 and −2.5–15.69, favoring ICBT. This was well within the non-inferiority margin of 10 LSAS points for the lower bound. Analysis of the other continuous measures showed that all lower bounds of 95% CIs for between group effect sizes fell well within the non-inferiority margin of d = 0.5 effect sizes. As stated above, Table 2 provides within and between group effect sizes on continuous outcome measures.
Treatment effectiveness - primary outcome measure (LSAS)
At post-treatment, 35 (55%) of the participants (95% CI, 42.5%–66.9%) in the ICBT group were classified as responders according to the Jacobson and Truax criteria  compared to 21 participants (34%) in the CBGT group (95% CI, 22.1%–45.7%). At six-month follow-up, the corresponding number was 41 (64%) in the ICBT group (95% CI, 52.3%–75.8%) and 28 (45%) in the CBGT group (95% CI, 32.8%–57.6%). Mixed effects model analysis showed a significant effect of time, indicating improvement in both treatment groups (F = 179.06; df = 1,219; p<.001). There was no significant interaction of group and time for the primary outcome measure LSAS, indicating similar improvement across groups (F = 1.58; df = 2, 219; p = .21). As illustrated in Figure 2, there were continuous within group improvements throughout the trial on the LSAS-SR in both conditions. The means (SDs) on the LSAS-SR at pre, post and follow-up respectively were 65.0 (23.6), 41.1 (21.5), 38.7 (23.1) for the ICBT group and 73.9 (21.5), 52.2 (25.5), 50.0 (24.9) for the CBGT group. There was no significant interaction of group and time for the LSAS-SR (F = 0.25; df = 2, 243; p = .77). Table 2 provides within and between group effect sizes on measures of social anxiety, depression, general anxiety, quality of life and anxiety sensitivity.
Abbreviations: ICBT, Internet-based cognitive behavior therapy; CBGT, Cognitive behavioral group therapy; LSAS, Liebowitz Social Anxiety Scale; -SR, Self-report; CA, Clinician administered; Pre, Before treatment; Post, Post-treatment; 6MFU, Six months after treatment.
Treatment effectiveness - secondary outcome measures
There was a significant effect of time on both the SIAS and SPS (F = 80.95 −83.39; df = 2, p<.001). Mixed effects model analysis showed no significant interaction of group and time for these variables (F = 0.30–0.48; df = 2, 244; p = .62–.74).
Depression, general anxiety, anxiety sensitivity and quality of life.
There was a significant effect of time on MADRS-S, BAI, ASI and QOLI (F = 17.26–52.30; df = 2, 227–245; p<.001). Analysis using mixed effects model yielded no significant interaction of group and time for these variables (F = 0.26–1.30; df = 2, 227–245; p = .28–.77).
Clinician administrated measures of global improvement and functioning.
At post-treatment, 42 participants (66%) in the ICBT group were classified as very much improved or much improved according to the CGI-I (95% CI, 59.1%–81.5%). In the CBGT group, the corresponding number of participants was 34 (55%) as assessed using the CGI-I (95% CI, 42.5%–67.2%). Wilcoxon tests showed that participants who had received ICBT were further improved at follow-up according to the CGI-I (Z = 2.33, p<.02), but CBGT participants were not (Z = 1.50, p = .14). Mann-Whitney U-test showed no significant difference between ICBT and CGBT at post-treatment (p = .08.). However, at six-month follow-up, participants receiving ICBT were significantly more improved on the CGI-I (p<.01). Figure 3 displays CGI-I scores at post-treatment and follow-up. The means (SDs) on the GAF at pre, post and follow-up respectively were 57.3 (9.8), 66.8 (10.0), 70.4 (11.3) for the CBGT group and 59.5 (6.4), 69.7 (10.8), 74.5 (11.6) for the ICBT group. Using a mixed effects model approach, no significant interaction of time and treatment group was found on the GAF (F = 0.354; df = 2, 225; p = .59).
Psychiatric diagnosis at each assessment point.
Following treatment, 18 (31 %) participants who had received ICBT no longer met diagnostic criteria for SAD (28 % if considering dropouts as non-responders). The corresponding number for participants who underwent CBGT was 12 (23 %; 19 % if considering dropouts non-responders). At follow-up, 25 (46%) participants who had received ICBT (41% if considering dropouts non-responders) and 21 (40%) receiving CBGT (34% if considering dropouts non-responders) no longer met diagnostic criteria for SAD. At post-treatment and six month follow-up there was no significant difference in the prevalence of SAD between groups (χ2 = 037–1.33, df = 1, p = .25–.55).
Credibility ratings after one week of treatment showed that participants in both groups rated their respective treatment as credible. Out of a possible total of 50, the average scores were 34.0 (SD = 9.03) and 33.8 (SD = 10.6) for ICBT and CGBT, respectively. There was no significant difference in treatment credibility between treatment groups (t (1, 110) = 0.07, p = .95).
Assessment of blinding and treatment preference
In four instances the blinding was broken. On two occasions participants accidentally mentioned their treatment allocation status to the assessor, and in other two occasions it was deemed necessary to break the blinding because of the need to assess increased depressive symptoms during treatment. As shown in Table 3, there was no significant association between assessors’ guess and actual treatment allocation (χ2 = 0.27, df = 1, p = .61), indicating successful blinding.
Prior to randomization participants were asked to state their treatment preference. Of 126 participants, 68 (54%) preferred ICBT and 58 (46%) CBGT. There was no difference between groups in terms of proportion of participants that received the preferred treatment (χ2 = 0.77, df = 1, p = .38).
In CBGT, the average number of attended sessions per participant was 9.40 (SD = 4.87) out of a possible total of 15. Fifty participants in CBGT (81%) attended at least five sessions and 17 (27%) attended all sessions. The average number of completed modules in ICBT was 9.33 (SD = 4.95) of 15. Fifty-one participants in ICBT (80%) completed at least 5 modules and 19 (29.7%) completed all modules. Important to note is that the main components of the treatments had been introduced at week 5.
Evaluation of therapist resources required for each treatment
On average, therapists delivering ICBT spent 5.5 minutes (SD = 3.6) weekly per patient. The corresponding amount of time in CBGT was 50 minutes (2.5 h sessions with two therapists and 6 patients). Taking nonattendance into consideration, this number would have been even higher. ICBT therapists sent 17.4 messages to each patient on average, i.e. 1.2 weekly per patient.
Intention-to-treat vs. treatment exposed analysis
Analysis including only those exposed to treatment (at least five sessions or modules) yielded results equal to the intention-to-treat analysis on continuous outcome measures of social anxiety, indicating that between group effects in the latter were not moderated by completion status. There was a significant effect of time on all three measures (F = 90.52 -188.67; df = 2, 188–198; p<.001). Mixed effects models analysis showed no significant interaction effect of time and treatment group on the LSAS (F = 1.78; df = 2, 188; p = .17), nor on the SIAS and the SPS (F = 0.32–0.43; df = 2, 198; p = .66–.73).
The present study is the first to demonstrate that ICBT can be as effective as CBGT in the treatment of SAD. Both treatments demonstrated large within group effect sizes on measures of social anxiety and general anxiety. The confidence interval of mean differences of the primary outcome measure fell well within the non-inferiority margin and between-group effect sizes were small but consistently favoring ICBT on the social anxiety measures. There was also a large proportion of participants who were classified as much improved or very much improved at post-treatment and follow-up in both treatment groups. The indication that the ICBT group was slightly more improved on the CGI-I should be interpreted cautiously as effects were small and no alpha-level corrections were set. The follow-up assessment indicated that treatment gains were sustained on all measures. These results indicate that ICBT can be an effective treatment for patients with SAD when delivered in a regular psychiatric setting.
In trials assessing non-inferiority it is essential that the effect of the gold standard treatment is as effective as in previous trials. This was the case in the present study, where CBGT yielded effects in line with trials conducted by its originators . Moreover, treatment effects for ICBT were equivalent to those reported in previous controlled trials , , , , . These are strengths of the present study. As reduced therapist time is an important element of ICBT, a key finding in this study is that ICBT reduced therapist time per treated patient by 90% compared to CBGT. As previously stated, individual CBT developed by Clark and Wells (1995) may be even more effective than CBGT. It could therefore be argued that Clark’s individual cognitive therapy should be the benchmark against which ICBT is contrasted. However, as CBGT has been evaluated in more trials and is more established, we decided to use CBGT as the benchmark treatment.
Overall, we interpret the results of the present study as indicating that a substantial proportion of persons with SAD respond well to ICBT. However, for those who do not respond to ICBT, an intensified treatment such as individual face-to-face CBT might be superior. Thus, we view ICBT as a complement (not a substitute) to conventional CBT that could facilitate the dissemination of CBT and improve healthcare resource allocation. When results are interpreted it is also important to bear in mind that that the non-inferiority margin allowed for up to a moderate effect between treatments. However, this margin was judged as clinically valid, and again, if ICBT is to be used as a complement, the usefulness of employing very narrow non-inferiority margins is limited.
There are several limitations that warrant mention and could provide venues for future research. First, there was no randomization to an active placebo condition, which raises the issue of misinterpreting regression to the mean as indicative of two effective treatments. However, given the chronicity demonstrated by SAD , high proportions of spontaneous remission is improbable. In addition, meta-analytic evidence suggests CBT for anxiety disorders tends to be more effective than placebo . A second limitation concerns patient preferences. It is likely that participants in our trial were willing to receive either ICBT or CBGT, which may not be representative for persons with SAD in the general population. It may be that internet treatment is preferred over group treatment. Despite the observation that persons with SAD are frequent internet users , this has not yet been studied. Third, the current study did not include long-term follow-up and, as such, it cannot be determined if the effects of the CBGT and ICBTs protocol for SAD are enduring over durations longer than six months. However, previous studies of CBGT  and ICBT suggest that the results may be enduring . The adherence rate also deserves mentioning. Eighty percent of the participants completed at least the first five weeks of therapy and were thereby exposed to the main components of the treatment, although significantly fewer completed all sessions or modules. Still, we find that having completed five weeks is an important threshold as preliminary analyses of outcome predictors have shown that completing at least five weeks is associated with better outcome, whereas completing all sessions or modules seems to yield little additional effect. As for CBGT, this adherence rate is comparable to that of a recently conducted large scale RCT where 35% of CBGT participants discontinued treatment . Finally, we did not assess treatment satisfaction in the present study. However, data from regular care of the Internet clinic where this study was conducted suggest high satisfaction with treatment as the average score on the Client Satisfaction Questionnaire  is 3.18 (SD = 0.57) using a scale range of 1–4.
In spite of these limitations, we conclude that ICBT may be at least as effective as CBGT, and that it is feasible to conduct ICBT for SAD in a psychiatric setting. As ICBT requires much less resources than conventional CBT, it could be the most promising means to increase the availability of CBT for persons affected by SAD.
Additional contributions: We wish to express our great appreciation of the important work done by the following persons; Monica Hellberg (BA) for providing aid in collecting the data; Anna-Clara Hellstadius for reviewing group sessions; Sara Rydh (MS), Kerstin Blom (MS) and Jan Bergström (PhD) for conducting group therapy; Gordon Asmundson (PhD) and Mathew Fetzner (BA) for giving comments on the manuscript; Karin Hyland (MD), Carl Granfors (MD), Anne-Christine Fredman (MD), Sergej Andréewitch (MD) and Diana Radu (MD, PhD) for psychiatric assessments.
Conceived and designed the experiments: EH GA BL EA CR EM NL. Analyzed the data: EH GA BL EA CR EM NL. Wrote the paper: EH GA BL EA CR EM NL.
- 1. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, et al. (2005) Lifetime Prevalence and Age-of-Onset Distributions of DSM-IV Disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 62: 593–602.RC KesslerP. BerglundO. DemlerR. JinKR Merikangas2005Lifetime Prevalence and Age-of-Onset Distributions of DSM-IV Disorders in the National Comorbidity Survey Replication.Arch Gen Psychiatry62593602
- 2. Reich J, Goldenberg I, Vasile R, Goisman R, Keller M (1994) A prospective follow-along study of the course of social phobia. Psychiatry Res 54: 249–258.J. ReichI. GoldenbergR. VasileR. GoismanM. Keller1994A prospective follow-along study of the course of social phobia.Psychiatry Res54249258
- 3. Ruscio AM, Brown TA, Chiu WT, Sareen J, Stein MB, et al. (2008) Social fears and social phobia in the USA: results from the National Comorbidity Survey Replication. Psychol Med 38: 15–28.AM RuscioTA BrownWT ChiuJ. SareenMB Stein2008Social fears and social phobia in the USA: results from the National Comorbidity Survey Replication.Psychol Med381528
- 4. Schneier FR, Heckelman LR, Garfinkel R, Campeas R, Fallon BA, et al. (1994) Functional impairment in social phobia. J Clin Psychiatry 55: 322–331.FR SchneierLR HeckelmanR. GarfinkelR. CampeasBA Fallon1994Functional impairment in social phobia.J Clin Psychiatry55322331
- 5. Heimberg RG, Dodge CS, Hope DA, Kennedy CR, Zollo LJ, et al. (1990) Cognitive behavioral group treatment for social phobia: Comparison with a credible placebo control. Cognitive Ther Res 14: 1–23.RG HeimbergCS DodgeDA HopeCR KennedyLJ Zollo1990Cognitive behavioral group treatment for social phobia: Comparison with a credible placebo control.Cognitive Ther Res14123
- 6. Heimberg RG (2002) Cognitive-behavioral therapy for social anxiety disorder: current status and future directions. Biol Psychiatry 51: 101–108.RG Heimberg2002Cognitive-behavioral therapy for social anxiety disorder: current status and future directions.Biol Psychiatry51101108
- 7. Jorstad-Stein EC, Heimberg RG (2009) Social phobia: an update on treatment. Psychiatr Clin North Am 32: 641–663.EC Jorstad-SteinRG Heimberg2009Social phobia: an update on treatment.Psychiatr Clin North Am32641663
- 8. Ponniah K, Hollon SD (2008) Empirically supported psychological interventions for social phobia in adults: a qualitative review of randomized controlled trials. Psychol Med 38: 3–14.K. PonniahSD Hollon2008Empirically supported psychological interventions for social phobia in adults: a qualitative review of randomized controlled trials.Psychol Med38314
- 9. Shapiro DA, Cavanagh K, Lomas H (2003) Geographic inequity in the availability of cognitive behavioural therapy in England and Wales. Behav Cogn Psychother 31: 185–192.DA ShapiroK. CavanaghH. Lomas2003Geographic inequity in the availability of cognitive behavioural therapy in England and Wales.Behav Cogn Psychother31185192
- 10. Clark DM, Ehlers A, McManus F, Hackmann A, Fennell M, et al. (2003) Cognitive therapy versus fluoxetine in generalized social phobia: a randomized placebo-controlled trial. J Consult Clin Psychol 71: 1058–1067.DM ClarkA. EhlersF. McManusA. HackmannM. Fennell2003Cognitive therapy versus fluoxetine in generalized social phobia: a randomized placebo-controlled trial.J Consult Clin Psychol7110581067
- 11. Stangier U, Heidenreich T, Peitz M, Lauterbach W, Clark DM (2003) Cognitive therapy for social phobia: individual versus group treatment. Behav Res Ther 41: 991–1007.U. StangierT. HeidenreichM. PeitzW. LauterbachDM Clark2003Cognitive therapy for social phobia: individual versus group treatment.Behav Res Ther419911007
- 12. Mörtberg E, Clark DM, Sundin O, Aberg Wistedt A (2007) Intensive group cognitive treatment and individual cognitive therapy versus treatment as usual in social phobia: a randomized controlled trial. Acta Psychiatr Scand 115: 142–154.E. MörtbergDM ClarkO. SundinA. Aberg Wistedt2007Intensive group cognitive treatment and individual cognitive therapy versus treatment as usual in social phobia: a randomized controlled trial.Acta Psychiatr Scand115142154
- 13. Carlbring P, Gunnarsdottir M, Hedensjo L, Andersson G, Ekselius L, et al. (2007) Treatment of social phobia: randomised trial of internet-delivered cognitive-behavioural therapy with telephone support. Br J Psychiatry 190: 123–128.P. CarlbringM. GunnarsdottirL. HedensjoG. AnderssonL. Ekselius2007Treatment of social phobia: randomised trial of internet-delivered cognitive-behavioural therapy with telephone support.Br J Psychiatry190123128
- 14. Andersson G, Carlbring P, Holmstrom A, Sparthan E, Furmark T, et al. (2006) Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomized controlled trial. J Consult Clin Psychol 74: 677–686.G. AnderssonP. CarlbringA. HolmstromE. SparthanT. Furmark2006Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomized controlled trial.J Consult Clin Psychol74677686
- 15. Tillfors M, Carlbring P, Furmark T, Lewenhaupt S, Spak M, et al. (2008) Treating university students with social phobia and public speaking fears: Internet delivered self-help with or without live group exposure sessions. Depress Anxiety 25: 708–717.M. TillforsP. CarlbringT. FurmarkS. LewenhauptM. Spak2008Treating university students with social phobia and public speaking fears: Internet delivered self-help with or without live group exposure sessions.Depress Anxiety25708717
- 16. Furmark T, Carlbring P, Hedman E, Sonnenstein A, Clevberger P, et al. (2009) Guided and unguided self-help for social anxiety disorder: randomised controlled trial. Br J Psychiatry 195: 440–447.T. FurmarkP. CarlbringE. HedmanA. SonnensteinP. Clevberger2009Guided and unguided self-help for social anxiety disorder: randomised controlled trial.Br J Psychiatry195440447
- 17. Berger T, Hohl E, Caspar F (2009) Internet-based treatment for social phobia: a randomized controlled trial. J Clin Psychol 65: 1021–1035.T. BergerE. HohlF. Caspar2009Internet-based treatment for social phobia: a randomized controlled trial.J Clin Psychol6510211035
- 18. Titov N, Andrews G, Schwencke G, Drobny J, Einstein D (2008) Shyness 1: distance treatment of social phobia over the Internet. Aust N Z J Psychiatry 42: 585–594.N. TitovG. AndrewsG. SchwenckeJ. DrobnyD. Einstein2008Shyness 1: distance treatment of social phobia over the Internet.Aust N Z J Psychiatry42585594
- 19. Carlbring P, Nordgren LB, Furmark T, Andersson G (2009) Long-term outcome of Internet-delivered cognitive-behavioural therapy for social phobia: a 30-month follow-up. Behav Res Ther 47: 848–850.P. CarlbringLB NordgrenT. FurmarkG. Andersson2009Long-term outcome of Internet-delivered cognitive-behavioural therapy for social phobia: a 30-month follow-up.Behav Res Ther47848850
- 20. Andersson G (2009) Using the Internet to provide cognitive behaviour therapy. Behav Res Ther 47: 175–180.G. Andersson2009Using the Internet to provide cognitive behaviour therapy.Behav Res Ther47175180
- 21. Barak A, Klein B, Proudfoot JG (2009) Defining internet-supported therapeutic interventions. Ann Behav Med 38: 4–17.A. BarakB. KleinJG Proudfoot2009Defining internet-supported therapeutic interventions.Ann Behav Med38417
- 22. Titov N, Andrews G, Kemp A, Robinson E (2010) Characteristics of adults with anxiety or depression treated at an internet clinic: comparison with a national survey and an outpatient clinic. PLoS ONE 5: e10885.N. TitovG. AndrewsA. KempE. Robinson2010Characteristics of adults with anxiety or depression treated at an internet clinic: comparison with a national survey and an outpatient clinic.PLoS ONE5e10885
- 23. Hunsley J, Lee CM (2007) Research-Informed Benchmarks for Psychological Treatments: Efficacy Studies, Effectiveness Studies, and Beyond. Prof Psychol-Res Pr 38: 21–33.J. HunsleyCM Lee2007Research-Informed Benchmarks for Psychological Treatments: Efficacy Studies, Effectiveness Studies, and Beyond.Prof Psychol-Res Pr382133
- 24. McAlister FA, Sackett DL (2001) Active-control equivalence trials and antihypertensive agents. Am J Med 111: 553–558.FA McAlisterDL Sackett2001Active-control equivalence trials and antihypertensive agents.Am J Med111553558
- 25. (2000) Diagnostic and statistical manual of mental disorders: DSM-IV-TR. Washington, DC: American Psychiatric Association. 943 p.2000Diagnostic and statistical manual of mental disorders: DSM-IV-TR.Washington, DCAmerican Psychiatric Associationxxxvii943
- 26. First MB, Spitzer RL, Gibbon M, Williams JBW, editors. (2002) Structured clinical interview for DSM-IV-TR axis I Disorders, research version, patient edition. New York: Biometrics Research, New York State Psychiatric Institute. MB FirstRL SpitzerM. GibbonJBW Williams2002Structured clinical interview for DSM-IV-TR axis I Disorders, research version, patient edition.New YorkBiometrics Research, New York State Psychiatric Institute
- 27. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, et al. (1998) The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 59: Suppl 2022–33.DV SheehanY. LecrubierKH SheehanP. AmorimJ. Janavs1998The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10.J Clin Psychiatry59Suppl 202233
- 28. Svanborg P, Åsberg M (1994) A new self-rating scale for depression and anxiety states based on the Comprehensive Psychopathological Rating Scale. Acta Psychiatr Scand 89: 21–28.P. SvanborgM. Åsberg1994A new self-rating scale for depression and anxiety states based on the Comprehensive Psychopathological Rating Scale.Acta Psychiatr Scand892128
- 29. Furmark T, Tillfors M, Everz P, Marteinsdottir I, Gefvert O, et al. (1999) Social phobia in the general population: prevalence and sociodemographic profile. Soc Psychiatry Psychiatr Epidemiol 34: 416–424.T. FurmarkM. TillforsP. EverzI. MarteinsdottirO. Gefvert1999Social phobia in the general population: prevalence and sociodemographic profile.Soc Psychiatry Psychiatr Epidemiol34416424
- 30. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M (1993) Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption. Addiction 88: 791–804.JB SaundersOG AaslandTF BaborJR de la FuenteM. Grant1993Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption.Addiction88791804
- 31. Berman AH, Bergman H, Palmstierna T, Schlyter F (2005) Evaluation of the Drug Use Disorders Identification Test (DUDIT) in criminal justice and detoxification settings and in a Swedish population sample. Eur Addict Res 11: 22–31.AH BermanH. BergmanT. PalmstiernaF. Schlyter2005Evaluation of the Drug Use Disorders Identification Test (DUDIT) in criminal justice and detoxification settings and in a Swedish population sample.Eur Addict Res112231
- 32. Heimberg RG, Horner KJ, Juster HR, Safren SA, Brown EJ, et al. (1999) Psychometric properties of the Liebowitz Social Anxiety Scale. Psychol Med 29: 199–212.RG HeimbergKJ HornerHR JusterSA SafrenEJ Brown1999Psychometric properties of the Liebowitz Social Anxiety Scale.Psychol Med29199212
- 33. Liebowitz MR (1987) Social phobia. Mod Probl Pharmacopsychiatry 22: 141–173.MR Liebowitz1987Social phobia.Mod Probl Pharmacopsychiatry22141173
- 34. Soykan C, Ozguven HD, Gencoz T (2003) Liebowitz Social Anxiety Scale: the Turkish version. Psychol Rep 93: 1059–1069.C. SoykanHD OzguvenT. Gencoz2003Liebowitz Social Anxiety Scale: the Turkish version.Psychol Rep9310591069
- 35. Baker SL, Heinrichs N, Kim H-J, Hofmann SG (2002) The Liebowitz Social Anxiety Scale as a self-report instrument: a preliminary psychometric analysis. Behav Res Ther 40: 701–715.SL BakerN. HeinrichsH-J KimSG Hofmann2002The Liebowitz Social Anxiety Scale as a self-report instrument: a preliminary psychometric analysis.Behav Res Ther40701715
- 36. Mattick RP, Clarke JC (1998) Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behav Res Ther 36: 455–470.RP MattickJC Clarke1998Development and validation of measures of social phobia scrutiny fear and social interaction anxiety.Behav Res Ther36455470
- 37. Beck AT, Epstein N, Brown G, Steer RA (1988) An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol 56: 893–897.AT BeckN. EpsteinG. BrownRA Steer1988An inventory for measuring clinical anxiety: psychometric properties.J Consult Clin Psychol56893897
- 38. Reiss S, Peterson RA, Gursky DM, McNally RJ (1986) Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behav Res Ther 24: 1–8.S. ReissRA PetersonDM GurskyRJ McNally1986Anxiety sensitivity, anxiety frequency and the prediction of fearfulness.Behav Res Ther2418
- 39. Frisch MB, Cornell J, Villanueva M, Retzlaff PJ (1992) Clinical validation of the Quality of Life Inventory. A measure of life satisfaction for use in treatment planning and outcome assessment. Psychol Assess 4: 92–101.MB FrischJ. CornellM. VillanuevaPJ Retzlaff1992Clinical validation of the Quality of Life Inventory. A measure of life satisfaction for use in treatment planning and outcome assessment.Psychol Assess492101
- 40. First MB, Gibbon M, Spitzer RL, Williams JBW, Benjamin LS (1997) Structured Clinical Interview for DSM-IV Axis II Personality Disorders, (SCID-II). WashingtonD.C.: American Psychiatric Press, Inc. MB FirstM. GibbonRL SpitzerJBW WilliamsLS Benjamin1997Structured Clinical Interview for DSM-IV Axis II Personality Disorders, (SCID-II).WashingtonD.C.American Psychiatric Press, Inc
- 41. Zanarini MC, Frankenburg FR (2001) Attainment and maintenance of reliability of axis I and II disorders over the course of a longitudinal study. Compr Psychiatry 42: 369–374.MC ZanariniFR Frankenburg2001Attainment and maintenance of reliability of axis I and II disorders over the course of a longitudinal study.Compr Psychiatry42369374
- 42. Maffei C, Fossati A, Agostoni I, Barraco A, Bagnato M, et al. (1997) Interrater reliability and internal consistency of the structured clinical interview for DSM-IV axis II personality disorders (SCID-II), version 2.0. J Pers Disord 11: 279–284.C. MaffeiA. FossatiI. AgostoniA. BarracoM. Bagnato1997Interrater reliability and internal consistency of the structured clinical interview for DSM-IV axis II personality disorders (SCID-II), version 2.0.J Pers Disord11279284
- 43. Guy W, editor. (1976) Clinical Global Impressions. Rockville: US Department of Health and Human services. W. Guy1976Clinical Global Impressions.RockvilleUS Department of Health and Human services
- 44. Borkovec TD, Nau SD (1972) Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry 3: 257–260.TD BorkovecSD Nau1972Credibility of analogue therapy rationales.J Behav Ther Exp Psychiatry3257260
- 45. Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, et al. (2010) Internet administration of self-report measures commonly used in research on social anxiety disorder: A psychometric evaluation. Computers in Human Behavior 26: 736–740.E. HedmanB. LjótssonC. RückT. FurmarkP. Carlbring2010Internet administration of self-report measures commonly used in research on social anxiety disorder: A psychometric evaluation.Computers in Human Behavior26736740
- 46. Heimberg RG, Becker RE (2002) Cognitive-behavioral group therapy for social phobia. Basic mechanisms and clinical strategies. New York: Guilford Press. RG HeimbergRE Becker2002Cognitive-behavioral group therapy for social phobia.Basic mechanisms and clinical strategiesNew YorkGuilford Press
- 47. Ledley DR, Heimberg RG, Hope DA, Hayes SA, Zaider TI, et al. (2009) Efficacy of a Manualized and Workbook-Driven Individual Treatment for Social Anxiety Disorder. Behav Ther 40: 414–424.DR LedleyRG HeimbergDA HopeSA HayesTI Zaider2009Efficacy of a Manualized and Workbook-Driven Individual Treatment for Social Anxiety Disorder.Behav Ther40414424
- 48. Clark DM, Wells A (1995) A cognitive model of social phobia. In: Heimberg RG, Leibowitz M, Hope DA, Schneider FR, editors. Social phobia: Diagnosis, assessment and treatment. New York: Guilford press. pp. 63–93.DM ClarkA. Wells1995A cognitive model of social phobia.RG HeimbergM. LeibowitzDA HopeFR SchneiderSocial phobia: Diagnosis, assessment and treatmentNew YorkGuilford press6393
- 49. Hofmann SG, Smits JA (2008) Cognitive-behavioral therapy for adult anxiety disorders: a meta-analysis of randomized placebo-controlled trials. J Clin Psychiatry 69: 621–632.SG HofmannJA Smits2008Cognitive-behavioral therapy for adult anxiety disorders: a meta-analysis of randomized placebo-controlled trials.J Clin Psychiatry69621632
- 50. Clark-Carter D (1997) Doing quantitative psychological research- from design to report. East Sussex: Psychology Press. D. Clark-Carter1997Doing quantitative psychological research- from design to report.East SussexPsychology Press
- 51. Gueorguieva R, Krystal JH (2004) Move over ANOVA: progress in analyzing repeated-measures data and its reflection in papers published in the Archives of General Psychiatry. Arch Gen Psychiatry 61: 310–317.R. GueorguievaJH Krystal2004Move over ANOVA: progress in analyzing repeated-measures data and its reflection in papers published in the Archives of General Psychiatry.Arch Gen Psychiatry61310317
- 52. Jacobson NS, Truax P (1991) Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 59: 12–19.NS JacobsonP. Truax1991Clinical significance: A statistical approach to defining meaningful change in psychotherapy research.J Consult Clin Psychol591219
- 53. Fresco DM, Coles ME, Heimberg RG, Liebowitz MR, Hami S, et al. (2001) The Liebowitz Social Anxiety Scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychol Med 31: 1025–1035.DM FrescoME ColesRG HeimbergMR LiebowitzS. Hami2001The Liebowitz Social Anxiety Scale: a comparison of the psychometric properties of self-report and clinician-administered formats.Psychol Med3110251035
- 54. Heimberg RG, Liebowitz MR, Hope DA, Schneier FR, Holt CS, et al. (1998) Cognitive behavioral group therapy vs phenelzine therapy for social phobia: 12-week outcome. Arch Gen Psychiatry 55: 1133–1141.RG HeimbergMR LiebowitzDA HopeFR SchneierCS Holt1998Cognitive behavioral group therapy vs phenelzine therapy for social phobia: 12-week outcome.Arch Gen Psychiatry5511331141
- 55. Yonkers KA, Bruce SE, Dyck IR, Keller MB (2003) Chronicity, relapse, and illness - course of panic disorder, social phobia, and generalized anxiety disorder: Findings in men and women from 8 years of follow-up. Depress Anxiety 17: 173–179.KA YonkersSE BruceIR DyckMB Keller2003Chronicity, relapse, and illness - course of panic disorder, social phobia, and generalized anxiety disorder: Findings in men and women from 8 years of follow-up.Depress Anxiety17173179
- 56. Erwin BA, Turk CL, Heimberg RG, Fresco DM, Hantula DA (2004) The Internet: home to a severe population of individuals with social anxiety disorder? J Anxiety Disord 18: 629–646.BA ErwinCL TurkRG HeimbergDM FrescoDA Hantula2004The Internet: home to a severe population of individuals with social anxiety disorder?J Anxiety Disord18629646
- 57. Heimberg RG, Salzman DG, Holt CS, Blendell KA (1993) Cognitive-behavioral group treatment for social phobia: Effectiveness at five-year followup. Cognitive Ther Res 17: 325–339.RG HeimbergDG SalzmanCS HoltKA Blendell1993Cognitive-behavioral group treatment for social phobia: Effectiveness at five-year followup.Cognitive Ther Res17325339
- 58. Blanco C, Heimberg RG, Schneier FR, Fresco DM, Chen H, et al. (2010) A Placebo-Controlled Trial of Phenelzine, Cognitive Behavioral Group Therapy, and Their Combination for Social Anxiety Disorder. Arch Gen Psychiatry 67: 286–295.C. BlancoRG HeimbergFR SchneierDM FrescoH. Chen2010A Placebo-Controlled Trial of Phenelzine, Cognitive Behavioral Group Therapy, and Their Combination for Social Anxiety Disorder.Arch Gen Psychiatry67286295
- 59. Attkisson CC, Zwick R (1982) The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann 5: 233–237.CC AttkissonR. Zwick1982The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome.Eval Program Plann5233237