Alcohol misuse ranks within the top ten health conditions with the highest global burden of disease. Low-intensity, Internet interventions for curbing adult alcohol misuse have been shown effective. Few meta-analyses have been carried out, however, and they have involved small numbers of studies, lacked indicators of drinking within low risk guidelines, and examined the effectiveness of unguided self-help only. We therefore conducted a more thorough meta-analysis that included both guided and unguided interventions.
Systematic literature searches were performed up to September 2013. Primary outcome was the mean level of alcohol consumption and drinking within low risk guidelines for alcohol consumption at post-treatment.
We selected 16 randomised controlled trials (with 23 comparisons and 5,612 participants) for inclusion. Results, showed a small but significant overall effect size in favour of Internet interventions (g = 0.20, 95% CI: 0.13–0.27, p<.001). Participants in Internet interventions drunk on average 22 grams of ethanol less than controls and were significantly more likely to be adhering to low-risk drinking guidelines at post-treatment (RD 0.13, 95% CI: 0.09–0.17, p<.001). Subgroup analyses revealed no significant differences in potential moderators for the outcome of alcohol consumption, although there was a near-significant difference between comparisons with waitlist control and those with assessment-only or alcohol information control conditions (p = .056).
Internet interventions are effective in reducing adult alcohol consumption and inducing alcohol users to adhere to guidelines for low-risk drinking. This effect is small but from a public health point of view this may warrant large scale implementation at low cost of Internet interventions for adult alcohol misuse. Moderator analyses with sufficient power are, however, needed in order to assess the robustness of these overall results and to assess whether these interventions may impact on subgroups with different levels of success.
Citation: Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. (2014) Effectiveness of Guided and Unguided Low-Intensity Internet Interventions for Adult Alcohol Misuse: A Meta-Analysis. PLoS ONE 9(6): e99912. https://doi.org/10.1371/journal.pone.0099912
Editor: Robert Stewart, Institute of Psychiatry, United Kingdom
Received: March 20, 2014; Accepted: May 19, 2014; Published: June 17, 2014
Copyright: © 2014 Riper et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that all data underlying the findings are fully available without restriction. All data are included within the paper.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
The Global Burden of Disease Study 2010 from the World Health Organization has documented a growing health burden from Alcohol Use Disorders (AUDs) over the past two decades among adults in both developed and developing societies , . The health burden increases further if the whole spectrum of alcohol misuse  is taken into account, whereby people consume alcohol in excess of the low-risk drinking guidelines but do not meet AUD criteria , , . They include people who engage in hazardous alcohol use – and who may thereby develop physical, psychological and social problems in the short term and alcohol dependency and serious or fatal illness later on – or harmful alcohol use, meaning that they are already experiencing such problems . This mounting health burden is due not just to population growth or ageing, but also to an absolute increase in alcohol consumption by adults , . It affects both traditional groups of drinkers and newer groups such as women  and the elderly . The risks of problem drinking multiply with every increment in alcohol consumption or every heavier drinking pattern , . Estimates reveal that eight out of ten adults who drink too much alcohol lack professional help; if they do receive it, that is often at a very late stage in their drinking career . Studies also show that whilst a high number of people who misuse alcohol do desire help, they prefer it outside conventional health care settings . Public health strategies to curb alcohol misuse therefore have considerable room for improvement. One particular enhancement could lie in an expanded availability of brief, low-intensity Internet interventions for use both in and beyond the primary care sector , .
Conventional (that is, non-Internet) Screening and Brief Interventions (SBIs) have been evaluated mostly in their delivery to non–alcohol-dependent, non–treatment-seeking adults whose alcohol misuse was identified in opportunistic health screening in primary care. Numerous meta-analyses and systematic reviews have convincingly shown the clinical effectiveness of SBIs in reducing alcohol consumption in comparison to non-intervention controls. The results of all these studies have recently been synthesised in studies by Jonas and colleagues , , and these in turn by Moyer in her 2013 update to the United States Preventive Services Task Force’s earlier recommendation statement on screening and brief interventions in primary care for alcohol misuse . Overall, the results show significant effect sizes in the small to moderate range for low-intensity interventions in comparison to control conditions in terms of average decreases in alcohol consumption , , . Cost-effectiveness studies, albeit limited in number, also report promising results –. Effectiveness studies on the reduction of alcohol consumption through SBIs provided in other settings such as general hospitals, emergency departments or work environments have been inconclusive –.
Providing Internet self-help interventions both in primary care and directly to people in the community appears a promising strategy to overcome the gap between the high number of people that misuse alcohol and the low number that actually receive or seek help in primary care . Studies on web-based self-help interventions for adult problem drinking show that (1) the interventions are mostly of an unguided nature and are delivered as stand-alone procedures directly to participants in the community, and to a far lesser extent via primary care, clinical or employment settings , ; (2) they largely reach first-time help seekers (with rates varying from 80% to 90% , ); (3) people who misuse alcohol take up these services on a much wider scale than the available brief, low-intensity face-to-face interventions in primary care settings , ; and (4) people differ in whether they desire additional help from professionals . Studies have also shown such unguided interventions to be effective in reducing adult alcohol misuse as compared to no-intervention control conditions. A 2011 meta-analysis by Riper and colleagues  found a small but significant effect size of g = 0.39 (95% CI: 0.23–0.56) for unguided self-help interventions via the Internet. Numbers needed to treat (NNT = 5) were comparable to those for face-to-face brief interventions in primary care settings . Small effect sizes also emerged in meta-analyses on various health promotion interventions, including alcohol use , . Few cost-effectiveness studies are available, but they indicate potential economic gain from Internet-based interventions for adult alcohol misuse .
The number of eligible randomised controlled trials on web-based interventions for alcohol misuse was rather limited in these systematic reviews and meta-analyses. The Riper meta-analysis , for example, identified only 7 eligible randomised controlled trials. This sharply contrasts with meta-analyses assessing the clinical and cost-effectiveness of Internet interventions for depression or anxiety. For example, Richards and Richardson  were able to include 19 RCTs on depression in their 2012 meta-analysis. For these disorders, overall evidence is accumulating that guided interventions generally lead to a greater reduction of depressive or anxiety symptoms than unguided interventions ,  and that guided Internet interventions are as effective as face to face interventions .
Recently, the numbers of published randomised controlled trials on Internet-based interventions for alcohol misuse has increased, including some that evaluate therapist-led self-help interventions , . We therefore decided to conduct this meta-analysis. We investigated the overall effectiveness of alcohol interventions in comparison to no-intervention controls and, if possible in terms of alcohol consumption reduction, drinking within the guidelines for low risk drinking and actual amounts reduced. We then examined whether certain study characteristics, such as the guided or unguided design of interventions, affected the primary outcome measure of alcohol consumption. To the best of our knowledge, this is the first meta-analysis that includes both guided and unguided Internet interventions to address problematic alcohol consumption among adults.
Identification of Studies
We conducted literature searches up to September 2013 in the following bibliographic databases: MEDLINE, PsycINFO, Science Citation Index Expanded, Social Sciences Citation Index, Arts and Humanities Citation Index, CINAHL, PUBMED and EMBASE, using key words and text words. Words indicating online interventions (Internet, Web, online, computer, mobile) were combined with terms indicative of type of treatment (self-help, brief intervention, treatment, unguided, guided, supported, low-intensity) and problematic alcohol use (alcohol abuse, alcohol misuse, problem drinking, hazardous, harmful, dependence, abstinence). We also re-examined exclusion lists of papers retrieved for our previous meta-analysis  to see if any would meet the inclusion criteria for the current study. No language restrictions were applied.
Our initial selection was based on titles and abstracts. If these yielded insufficient information to assess the eligibility criteria, full-text articles were retrieved and assessed in terms of our inclusion criteria. All papers included or excluded at all stages were assessed by two independent raters (authors HR and HH) (see figure 1). The same raters assessed the effect sizes and moderator variables in the included studies. Any disagreement was resolved by discussion. A protocol does not exist for this meta-analysis; steps undertaken are described in this method section.
Randomised controlled trials were included that (1) compared a web-based intervention with a control group (in an assessment-only, waitlisted or alcohol information brochure control condition); (2) included a low-intensity self-help intervention that the participant could perform on a computer or mobile phone, with or without guidance from a professional; (3) assessed alcohol drinking behaviour in terms of quantity consumed as a primary outcome measure; (4) studied adults aged 18 or older; (5) included alcohol drinkers who exceeded local guidelines for low-risk drinking (if lower-risk participants were also included, we retained only the results of those with alcohol misuse).
Risk-of-bias Assessment and Data Extraction
We assessed the validity of the included studies on the basis of four criteria from the risk-of-bias assessment tool developed by the Cochrane Collaboration . It verifies study attributes in randomised controlled trials that are potential sources of bias, including (1) adequacy of allocation sequence generation, (2) concealment of the allocation to the different conditions, (3) blinding of assessors and outcomes and (4) handling of incomplete outcome data using intention-to-treat analyses (this was rated as positive if intention-to-treat analyses were performed, thus retaining all randomised participants in the analyses; see table 1). Authors HH and MB assessed risk of bias as Yes, No or Unclear using the Cochrane Collaboration tool (see 2.3).
Characteristics of the analysed studies are described in table 1. We coded (1) year of study and country of origin; (2) participant characteristics: alcohol consumption level at baseline, recruitment setting, target group; (3) intervention characteristics: therapeutic principles, mode and setting of delivery, guided or unguided self-help format, number of sessions; and (4) other study characteristics: type of control condition, number of participants in each comparative condition, primary outcome measure (how consumed quantities of alcohol were assessed), intention-to-treat (ITT) versus completers-only (CO) analyses, post-treatment assessments in months, dropout rate and risk of bias. The brief self-help alcohol interventions we identified were based on one or more of the following principles: behavioural self-control , motivational interviewing , transtheoretical model of change , cognitive-behavioural therapy (CBT, ), and personalised normative feedback (PNF ).
We first calculated a mean alcohol consumption effect size for each comparison between an alcohol intervention and a control group. Effect sizes were calculated by subtracting the average post-test score of the alcohol self-help group from the average score of the comparison group and dividing the result by the pooled standard deviations of the two groups. This effect size is known as Cohen’s d. As the effect size d is subject to small-sample bias, it can be adjusted by using a scaling factor, which is multiplied by d to arrive at Hedges’s bias-corrected effect size g, so that g = d (1−[3/4(n1+n0]−9). An effect size of 0.50 indicates that the mean of the experimental group is half a standard deviation larger than the mean of the control group. Effect sizes of approximately 0.80 can be considered large, 0.5 as moderate, and 0.2 small . Participant adherence to low-risk alcohol guidelines (by either abstaining or not exceeding recommended limits) was assessed in terms of percentages (yes/no).
If means and standard deviations were not reported, we contacted the study authors to obtain these and/or we used the procedures of the Comprehensive Meta-Analysis software (CMA, version 2.2.021) to calculate the effect size using continuous or dichotomous outcomes. In the event these were not available either, we used other statistics (such a t- or p-value). Where possible, data from intention-to-treat analyses were used; completers-only data were used if the former were unavailable. If more than one alcohol consumption outcome measure was reported in a single study, we averaged the effect sizes from those measures to produce a single summary effect size for use in the meta-analysis, statistically adjusting those calculations to account for variance introduced by the multiple measures .
We calculated the mean effect sizes using a random effects model. This assumes that the included studies were drawn from ‘populations’ of studies that systematically differed from one another (heterogeneity). As a test of homogeneity of effect sizes, we calculated the I2 statistic, an indicator of heterogeneity in percentages. A value of 0% indicates no observed heterogeneity, and larger values show increasing heterogeneity, with 25% as low, 50% as moderate and 75% as high . As the I2 statistic is known to be imprecise , we calculated the 95% confidence interval using the non-central chi-squared-based approach within the heterogi module in Stata . We also estimated numbers needed to treat (NNTs) .
In consideration of the literature, ten subgroups analyses were carried out using the mixed effects model, whereby studies within subgroups are pooled with the random effects model (see table 2). Tests for significant differences between subgroups are then performed with the fixed effects model. For continuous variables, we used bivariate meta-regression analyses to test whether there was a significant relationship between each variable and the alcohol effect size, as indicated by a Z-value and an associated p-value.
We calculated both beforehand and afterwards how many studies would be needed to ensure sufficient statistical power to identify relevant effects as we expected a small to moderate effect size , . The power calculations were carried out according to the procedures described by Borenstein and colleagues . Beforehand we hoped to find enough studies to enable identification of a small effect size of d = 0.40 based on the random effects model. The power calculations indicated that this would require at least ten studies with a mean sample size of 70 participants per condition. That conservatively assumes a medium level of between-study variance (τ2), a statistical power of .80 and a significance level of α<.05.
To detect possible publication bias, we visually examined the funnel plots of the primary outcome measures for symmetry. We conducted Egger’s linear regression test of the intercept to quantify the bias captured by the funnel plot and test whether it was significant . Duval and Tweedie trim-and-fill procedure was performed to further verify whether the pooled effect size estimate was unbiased . These procedures were all performed with CMA.
Selection and Inclusion of Studies
Characteristics of Included Studies
Table 1 summarises the selected characteristics of the 16 studies (containing 23 comparisons) included in the meta-analysis. The studies assessed a total of 5,612 participants (3,268 in experimental and 2,344 in control conditions) and thus provided sufficient statistical power to detect a small effect size (see section 2.6).
In five studies, sample inclusion was based on self-reported alcohol consumption, using cut-off points indicative of alcohol use exceeding low-risk guidelines, with differing levels for men and women. Five other studies applied the Alcohol Use Identification Test (AUDIT ) or the Fast Alcohol Screening Test (FAST ). Two studies applied both AUDIT and alcohol consumption cut-off points; one selected on the basis of GGT (gamma-glutamyl transpeptidase) testing. Two of the sixteen studies ,  included anyone interested in participating; for these studies, we confined our analysis to subgroups belonging to the at-risk drinking population.
Seven studies applied a single-focus therapeutic strategy, which in six cases was personalised normative feedback (PNF) and in one case a generic health education approach. The other nine studies used combined treatment approaches consisting of motivational interviewing (MI), personalised normative feedback (PNF), cognitive-behavioural therapy (CBT) and/or behavioural self-control and change principles. The control groups represented assessment-only (n = 6), waitlisted (n = 3) or alcohol information brochure conditions (n = 7). The outcome assessments to indicate alcohol consumption were expressed in terms of mean standard drinks per drinking day, total numbers of standard drinks in the previous week, mean standard drinks per drinking occasion or amounts of alcohol in grams.
The risk of bias varied among the studies (table 1), with 14 studies reporting adequate sequence generation, 6 reporting allocation to conditions by an independent party, 15 reporting blinding of outcome assessors or using self-report outcomes only, and 10 using intention-to-treat analyses. Dropout rates varied from 0% to 42%.
The effect of low-intensity Internet-based alcohol interventions to reduce alcohol consumption in comparison to controls was small but significant at post-test (g = 0.20, random effects model, 95% CI: 0.13–0.27, p<.001, NNT = 8.93). Results are shown in figure 2 (from high to low study effect sizes) and table 2. Heterogeneity was low but with a moderate confidence interval (I2 = 27, 95% CI: 0–56). A post-hoc power calculation showed that our set of studies had sufficient statistical power (0.99) on the basis of the random effects model (with a low level of between-study variance, τ2 = .001, and a significance level of α <.05).
Seven studies , – compared more than one group receiving differing types of Internet-based brief treatment with a single control group, so that our analysis included multiple comparisons from these studies. The fact that the comparisons were not independent of one another could have artificially reduced the heterogeneity of the analysed studies, thereby affecting the pooled effect size. To test this, we carried out sensitivity analyses that included only one effect size per study. As table 2 shows, removal of the comparisons with the highest effect sizes had almost no influence on the pooled effect size nor did removing the comparisons with the lowest effect sizes. Removal of the one guided intervention comparison with the highest effect size (in Blankers ) did not influence the observed effect size either, nor did removal of that with the lowest effect size .
Mean Alcohol Consumption Reduction and Drinking within Low Risk Guidelines
On average, the intervention participants were drinking 2,2 alcohol consumptions (22 grams of ethanol) less per week at post-treatment than controls (n = 14; 95% CI: 0.87–3.46, p = .001, I2 = 0, p<.001; mean difference). Post-test differences , , –) revealed that intervention participants were significantly more likely than controls to have reduced their alcohol consumption to within the low-risk guidelines as compared to controls (n = 6; RD 0.13, 95% CI: 0.09–0.17, p<.001, I2 = 0, non-significant).
Subgroup analyses revealed no significant differences between study characteristics and effect sizes for alcohol consumption (see table 2). The differences between types of control conditions bordered on significance (p = .056). We found a higher effect size for decreased alcohol consumption for studies applying a waitlist control condition (g = 0.48) than those applying an alcohol brochure condition (g = 0.20) or an assessment-only condition (g = 0.15).
No significant differences in effect remained at follow-up (6 to 12 months after baseline) between the six unguided interventions (8 comparisons) and control groups (g = 0.06, 95% CI: −0.14–0.25, p = .567, random effects model) for which such follow-up assessments were available. No follow-up assessments were available for the guided interventions.
Meta-regression analyses with Hedges’s g as the dependent variable uncovered no significant associations between effect size and either the number of alcohol intervention sessions (β = −0.0001, 95% CI: −0.004–0.003, p = .938) or the risk of bias (β = 0.068, 95% CI: −0.15–0.01, p = .089) in the studies assessed.
There was evidence of publication bias in terms of Duval and Tweedie’s trim-and-fill method. After adjustment for missing studies, the effect size for decreased alcohol consumption diminished from g = 0.20 to g = 0.14 (95% CI: 0.06–0.22; trimmed studies n = 8, random effects model). Egger’s test indicated an asymmetric funnel plot (p = .028, two-tailed).
This meta-analysis showed a small but significant overall effect size (g = 0.20) in favour of low-intensity Internet-based self-help interventions to curb alcohol misuse over control conditions. At post-treatment, intervention participants were consuming an average of 22 grams of alcohol less per week than controls. The reduction appears lower than those found in analyses of face-to-face brief interventions in primary care. The latter include a Cochrane Collaboration systematic review of 29 primary care trials , which reported a significantly reduced weekly consumption of 38 grams at one-year follow-up (see also the study by Jonas and colleagues ). In our study, Internet intervention participants were 13% more likely than controls to stay within the guidelines after treatment (n = 6). This is in line with the study of Jonas and colleagues  who showed that those receiving primary care alcohol interventions were 11% more likely to do so when compared with controls.
The overall effect size in this meta-analysis is lower than, the effect size found in our previous study that focused solely on unguided e-interventions (7 studies, g = 0.39) . Some explanations for this may lie in the three-times-higher number of comparisons involved in the current analysis and the fact that studies with null findings were now included , . The current overall effect also compares with meta-analyses of face-to-face primary care samples , , ,  and of non-clinical samples performing postal self-help interventions based on bibliotherapy –. These studies all showed significant small to moderate effect sizes for curbing alcohol misuse. We found no significant differences between experimental and control conditions for those studies that assessed follow-up outcomes up to twelve months. Such a decay of intervention effects is not uncommon; larger effect sizes are generally found at the earliest follow-ups , . Some studies of brief interventions for problem drinking have nonetheless reported positive influences on alcohol reduction up to four years later  and on mortality .
Results of the subgroup analyses did not reveal any significant differences between experimental and control conditions. All these results need to be interpreted with caution, as the number of studies included in the subgroup analyses was low. This means that there where either no real differences between these conditions or that real difference may have gone undetected. The variation in types of control predictors was of borderline significance (p = .056) in terms of effect. A moderate effect size was found for studies using waitlist control conditions, while those with assessment-only or alcohol brochure control showed small ones. Other studies have similarly reported higher effect sizes for intervention studies that used waitlisted groups as comparators . One explanation could be that waitlisted participants tend to delay behavioural change because they anticipate professional help in the near future; that could cause overestimation of the intervention effect.
We did not find a significantly greater effect size for guided (g = 0.23) than for unguided (g = 0.20) alcohol interventions, even though such significant differences in benefit have been overwhelmingly established for web-based treatment of depression and anxiety , . Our lack of significant effect might be due to the fact that many participants in web-based alcohol interventions are first-time help seekers; they may hence derive health gains from their first formal attempt at behavioural change, whether unguided or guided. Alternatively, a real difference may have gone undetected as a consequence of the low number of guided interventions in our analysis (5 comparisons. Only the Blankers and colleagues , and the Doumas and Hannah  studies provided direct comparisons between guided and unguided interventions. Both showed a small, but non significant, difference in effect in terms of alcohol consumption reduction in favour of guided interventions. These non-significant results are probably due to lack of power in both studies as well.
In contrast with our previous analysis from 2011 , we now found no significant differences in alcohol reduction between single-session interventions and more extended ones. Although the literature is somewhat inconclusive , it provides some confirmation for our current findings , , .
Web-based interventions may offer considerable promise for reducing alcohol misuse by women. We found no difference in alcohol consumption outcomes between all-male and mixed-gender samples, whereas several studies on face-to-face alcohol interventions in primary care had reported that men were more likely to benefit than women , . In the case of Internet-based interventions for alcohol misuse, however, female uptake appears equally as high as male uptake ,  and have been seen to have similar impacts on female and on male drinking, or possibly even greater influence on females, as suggested by Riper and colleagues (2008, ).
No difference in effect sizes emerged between studies that used cut-off points in alcohol consumption as study inclusion criteria and those that applied stricter measurements such as AUDIT . AUDIT scores among the latter were high (averaging around 20, indicating a potentially high risk of alcohol dependence amongst participants. Internet interventions might thus well be effective for a broad spectrum of people who misuse alcohol. Just as in many trials of brief alcohol interventions and routine practice studies , , the studies in our analysis did not conduct diagnostic interviews to assess for alcohol dependence. This lack of actual diagnoses also hampers any attempt to use the available data to test the common view that self-help interventions are particularly suited to people with less serious alcohol problems, but less appropriate for those with alcohol dependence , .
Several limitations underlie our meta-analysis that may have affected our overall results. First, as indicated the number of studies included in the subgroup analyses was low. The resulting insufficient statistical power may call into question our outcomes whereby no significant difference between a number of conditions could be observed. Second, some included studies had substantial dropout rates (above 30%; see table 1). High study (and treatment) dropout rates are a common phenomenon in both online and offline self-help interventions for alcohol misuse and in Internet interventions in general , . Third, the impact of online self-help in reducing alcohol consumption may have been underestimated here because control group drinking was also assessed; such assessment alone possibly motivates controls to reduce their consumption , . Last but not least, we were not able to evaluate possible negative side-effects of Internet-based interventions for problem drinking, as the studies lack reports on such effects.
The results of this study support the use of guided and unguided Internet-based self-help interventions for curbing alcohol misuse in various settings (primary health care, work environments and the community). Although the overall effect size for these interventions was small, the public health impact could be substantial if large numbers of people who misuse alcohol were to take part in these interventions. Decreasing alcohol consumption as well as abstinence and adherence to low-risk guidelines are health benefits in their own right and potential predictors of longer-term maintenance of decreased alcohol consumption . A modelling study by Smit and colleagues  has suggested that if online interventions were to partially replace conventional face-to-face brief alcohol interventions, that could sustain comparable levels of population health at lower costs.
Future studies should try to assess which type (s) of alcohol misuse populations could benefit most from brief online alcohol interventions. More studies with longer-term follow-up periods (over 12 months) are needed, too, to assess the maintenance of intervention effects over time in terms of reduced consumption and other health outcomes. Studies focusing on the effects of guided self-help interventions in curbing alcohol misuse, in direct comparison with unguided interventions, could shed light on whether the former produce better outcomes and, if so, at what costs. It is also important to investigate whether combining low-intensity Internet interventions with brief face-to-face interventions (blending of channels) would increase the effectiveness of interventions to curb alcohol misuse.
Internet interventions are capable of reaching out effectively to the large group of people who engage in alcohol misuse. From a public health perspective, this justifies an upscaling of such interventions in routine practice as well as in a wide range of community settings.
Conceived and designed the experiments: HR HH PC. Performed the experiments: HR HH MB. Analyzed the data: HR HH MB PC. Contributed reagents/materials/analysis tools: HR PC. Contributed to the writing of the manuscript: HR MB HH JC SC DE RW PC.
- 1. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, et al. (2013) Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet 382: 1575–1586.
- 2. Tang YL, Xiang XJ, Wang XY, Cubells JF, Babor TF, et al. (2013) Alcohol and alcohol-related harm in China: policy changes needed. Bull World Health Organ 91: 270–276.
- 3. Moyer VA (2013) Screening and behavioral counseling interventions in primary care to reduce alcohol misuse: U.S. preventive services task force recommendation statement. Ann Intern Med 159: 210–218.
- 4. Saunders JB, Lee NK (2000) Hazardous alcohol use: its delineation as a subthreshold disorder, and approaches to its diagnosis and management. Compr Psychiatry 41: 95–103.
- 5. WHO (2000) International guide for monitoring alcohol consumption and related harm. Geneva.: World Health Organization.
- 6. Degenhardt L, Whiteford HA, Ferrari AJ, Baxter AJ, Charlson FJ, et al. (2013) Global burden of disease attributable to illicit drug use and dependence: findings from the Global Burden of Disease Study 2010. Lancet 382: 1564–1574.
- 7. Grucza RA, Bucholz KK, Rice JP, Bierut LJ (2008) Secular trends in the lifetime prevalence of alcohol dependence in the United States: a re-evaluation. Alcohol Clin Exp Res 32: 763–770.
- 8. Watson HE (1999) Minimal interventions for problem drinkers: a review of the literature. J Adv Nurs 30: 513–519.
- 9. Parry CD, Patra J, Rehm J (2011) Alcohol consumption and non-communicable diseases: epidemiology and policy implications. Addiction 106: 1718–1724.
- 10. Rehm J, Mathers C, Popova S, Thavorncharoensap M, Teerawattananon Y, et al. (2009) Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. Lancet 373: 2223–2233.
- 11. Cunningham JA, Breslin FC (2004) Only one in three people with alcohol abuse or dependence ever seek treatment. Addict Behav 29: 221–223.
- 12. Koski-Janne A, Cunningham J (2001) Interest in different forms of self-help in a general population sample of drinkers. Addict Behav 26: 91–99.
- 13. Nilsen P, McCambridge J, Karlsson N, Bendtsen P (2011) Brief interventions in routine health care: a population-based study of conversations about alcohol in Sweden. Addiction 106: 1748–1756.
- 14. Wilson GB, Heather N, Kaner EF (2011) New developments in brief interventions to treat problem drinking in nonspecialty health care settings. Curr Psychiatry Rep 13: 422–429.
- 15. Jonas DE, Garbutt JC, Amick HR, Brown JM, Brownley KA, et al. (2012) Behavioral counseling after screening for alcohol misuse in primary care: a systematic review and meta-analysis for the U.S. Preventive Services Task Force. Ann Intern Med 157: 645–654.
- 16. Jonas DE, Garbutt JC, Brown JM, Amick HR, Brownley KA, et al. (2012) Screening, Behavioral Counseling, and Referral in Primary Care To Reduce Alcohol Misuse. Rockville (MD): Agency for Healthcare Research and Quality (US). Report No.: 12-EHC055-EF.
- 17. Latimer N, Guillaume L (2009) Prevention and early identification of alcohol use disorders in adults and young people: screening and brief interventions: cost effectiveness review. Sheffield: ScHARR Public Health Collaborating Centre.
- 18. Purshouse RC, Brennan A, Rafia R, Latimer NR, Archer RJ, et al. (2013) Modelling the cost-effectiveness of alcohol screening and brief interventions in primary care in England. Alcohol Alcohol 48: 180–188.
- 19. Tariq L, van den Berg M, Hoogenveen RT, van Baal PH (2009) Cost-effectiveness of an opportunistic screening programme and brief intervention for excessive alcohol use in primary care. PLoS One 4: e5696.
- 20. Mdege ND, Fayter D, Watson JM, Stirk L, Sowden A, et al. (2013) Interventions for reducing alcohol consumption among general hospital inpatient heavy alcohol users: a systematic review. Drug Alcohol Depend 131: 1–22.
- 21. Watson JM, Fayter D, Mdege N, Stirk L, Sowden AJ, et al. (2013) Interventions for alcohol and drug problems in outpatient settings: a systematic review. Drug Alcohol Rev 32: 356–367.
- 22. Pedersen B, Oppedal K, Egund L, Tonnesen H (2011) Will emergency and surgical patients participate in and complete alcohol interventions? A systematic review. BMC Surg 11: 26.
- 23. Osilla KC, Van Busum K, Schnyer C, Larkin JW, Eibner C, et al. (2012) Systematic review of the impact of worksite wellness programs. Am J Manag Care 18: e68–e81.
- 24. Hester RK, Lenberg KL, Campbell W, Delaney HD (2013) Overcoming Addictions, a Web-based application, and SMART Recovery, an online and in-person mutual help group for problem drinkers, part 1: three-month outcomes of a randomized controlled trial. J Med Internet Res 15: e134.
- 25. White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, et al. (2010) Online alcohol interventions: a systematic review. J Med Internet Res 12: e62.
- 26. Riper H, Spek V, Boon B, Conijn B, Kramer J, et al. (2011) Effectiveness of E-self-help interventions for curbing adult problem drinking: a meta-analysis. J Med Internet Res 13: e42.
- 27. Cunningham JA, Wild TC, Cordingley J, Van Mierlo T, Humphreys K (2009) A randomized controlled trial of an internet-based intervention for alcohol abusers. Addiction 104: 2023–2032.
- 28. Riper H, Kramer J, Conijn B, Smit F, Schippers G, et al. (2009) Translating effective web-based self-help for problem drinking into the real world. Alcohol Clin Exp Res 33: 1401–1408.
- 29. Vernon ML (2010) A review of computer-based alcohol problem services designed for the general public. J Subst Abuse Treat 38: 203–211.
- 30. Kaner EF, Beyer F, Dickinson HO, Pienaar E, Campbell F, et al. (2007) Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev CD004148.
- 31. Rooke S, Thorsteinsson E, Karpin A, Copeland J, Allsop D (2010) Computer-delivered interventions for alcohol and tobacco use: a meta-analysis. Addiction 105: 1381–1390.
- 32. Portnoy DB, Scott-Sheldon LA, Johnson BT, Carey MP (2008) Computer-delivered interventions for health promotion and behavioral risk reduction: a meta-analysis of 75 randomized controlled trials, 1988–2007. Prev Med 47: 3–16.
- 33. Blankers M, Nabitz U, Smit F, Koeter MW, Schippers GM (2012) Economic evaluation of internet-based interventions for harmful alcohol use alongside a pragmatic randomized controlled trial. J Med Internet Res 14: e134.
- 34. Richards D, Richardson T (2012) Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 32: 329–342.
- 35. Cuijpers P, Marks IM, van Straten A, Cavanagh K, Gega L, et al. (2009) Computer-aided psychotherapy for anxiety disorders: a meta-analytic review. Cogn Behav Ther 38: 66–82.
- 36. Cuijpers P, Donker T, van Straten A, Li J, Andersson G (2010) Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med 1–15.
- 37. Blankers M, Koeter MW, Schippers GM (2011) Internet therapy versus internet self-help versus no treatment for problematic alcohol use: A randomized controlled trial. J Consult Clin Psychol 79: 330–341.
- 38. Postel MG, de Haan HA, ter Huurne ED, Becker ES, de Jong CA (2010) Effectiveness of a web-based intervention for problem drinkers and reasons for dropout: randomized controlled trial. J Med Internet Res 12: e68.
- 39. Higgins JPT, Green S (2008 February) Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.0. The Cochrane Collaboration. Available.
- 40. Hester RK (1995) Behavioral self-control training. In: Hester RK, Miller WR, editors. Handbook of Alcoholism Treatment Approaches: Effective Alternatives. Needham Heights, MA: Allyn and Bacon. 148–159.
- 41. Miller WR, Rollnick S (2002) Motivational Interviewing: Preparing people to change addictive behavior. New York: Guilford Press.
- 42. Prochaska JO, Velicer WF (1997) The transtheoretical model of health behavior change. Am J Health Promot 12: 38–48.
- 43. Kalden R, Caroll K, Donovan D, Cooney N, Monti P, et al. (1992) Cognitive behavioral Coping Skills Therapy Manual: A Clinical Research Guide for Therapists Treating Individuals With Alcohol Abuse and Dependence. In: Mattson MEM, editors. NIAAA Project MATCH Monograph Series. Rockville, Md: National Institute on Alcoholism and Alcohol Abuse.
- 44. Chan KK, Neighbors C, Gilson M, Larimer ME, Alan MG (2007) Epidemiological trends in drinking by age and gender: providing normative feedback to adults. Addict Behav 32: 967–976.
- 45. Cohen J (1997) Statistical power analyses for the behavioral sciences (revised ed.). New York: Academic Press.
- 46. Borenstein M, Hedges L, Higgins JPT, Rothstein HR (2009) Introduction to meta-analysis. Chichester, UK: Wiley.
- 47. Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analyses. BMJ 327: 557–560.
- 48. Ioannidis JP, Patsopoulos NA, Evangelou E (2007) Uncertainty in heterogeneity estimates in meta-analyses. BMJ 335: 914–916.
- 49. Orsini N, Bottai M, Higgins JP, Buchan I (2006) Heterogi: Stata module to quantify heterogeneity in a meta-analysis. [Computer Software].
- 50. Kraemer HC, Kupfer DJ (2006) Size of treatment effects and their importance to clinical research and practice. Biol Psychiatry 59: 990–996.
- 51. Riper H, van Straten A, Keuken M, Smit F, Schippers G, et al. (2009) Curbing problem drinking with personalized-feedback interventions: a meta-analysis. Am J Prev Med 36: 247–255.
- 52. Egger M, Davey SG, Schneider M, Minder C (1997) Bias in meta-analysis detected by a simple, graphical test. BMJ 315: 629–634.
- 53. Duval S, Tweedie R (2000) Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56: 455–463.
- 54. Moher D, Liberati A, Tetzlaff J, Altman DG (2010) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg 8: 336–341.
- 55. Saunders JB, Aasland OG, Babor TF, Defuentes-Merillas L, Grant M (1993) Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption II. Addiction 88: 791–804.
- 56. Hodgson R, Alwyn T, John B, Thom B, Smith A (2002) The FAST Alcohol Screening Test. Alcohol Alcohol 37: 61–66.
- 57. Doumas DM, Hannah E (2008) Preventing high-risk drinking in youth in the workplace: a web-based normative feedback program. J Subst Abuse Treat 34: 263–271.
- 58. Pemberton MR, Williams J, Herman-Stahl M, Calvin SL, Bradshaw MR, et al. (2011) Evaluation of two web-based alcohol interventions in the U.S. military. J Stud Alcohol Drugs 72: 480–489.
- 59. Bischof G, Grothues JM, Reinhardt S, Meyer C, John U, et al. (2008) Evaluation of a telephone-based stepped care intervention for alcohol-related disorders: a randomized controlled trial. Drug Alcohol Depend 93: 244–251.
- 60. Hansen AB, Becker U, Nielsen AS, Gronbaek M, Tolstrup JS, et al. (2012) Internet-based brief personalized feedback intervention in a non-treatment-seeking population of adult heavy drinkers: a randomized controlled trial. J Med Internet Res 14: e98.
- 61. Schulz DN, Candel MJ, Kremers SP, Reinwand DA, Jander A, et al. (2013) Effects of a web-based tailored intervention to reduce alcohol consumption in adults: randomized controlled trial. J Med Internet Res 15: e206.
- 62. Suffoletto B, Callaway C, Kristan J, Kraemer K, Clark DB (2012) Text-message-based drinking assessments and brief interventions for young adults discharged from the emergency department. Alcohol Clin Exp Res 36: 552–560.
- 63. Boon B, Risselada A, Huiberts A, Riper H, Smit F (2011) Curbing alcohol use in male adults through computer generated personalized advice: randomized controlled trial. J Med Internet Res (13(2)) e43.
- 64. Boon B, Huibers A (2006) Preventie problematisch alcoholgebruik. In: Meijer SA, Smit F, Schoemaker CG, Cuijpers P, editors. Gezond verstand. Evidence-based preventie van psychische stoornissen [Common sense. Evidence-based prevention of mental disorders]. VTV Themarapport (RIVM-rapportnummer: 270061003. Bilthoven: RIVM.
- 65. Riper H, Kramer J, Smit F, Conijn B, Schippers G, et al. (2008) Web-based self-help for problem drinkers: a pragmatic randomized trial. Addiction 103: 218–227.
- 66. Wallace P, Murray E, McCambridge J, Khadjesari Z, White IR, et al. (2011) On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption. PLoS One 6: e14740.
- 67. O’Donnell A, Anderson P, Newbury-Birch D, Schulte B, Schmidt C, et al. (2014) The impact of brief alcohol interventions in primary healthcare: a systematic review of reviews. Alcohol Alcohol 49: 66–78.
- 68. Moyer A, Finney JW, Swearingen CE, Vergun P (2002) Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction 97: 279–292.
- 69. Apodaca TR, Miller WR (2003) A meta-analysis of the effectiveness of bibliotherapy for alcohol problems. J Clin Psychol 59: 289–304.
- 70. Vasilaki EI, Hosier SG, Cox WM (2006) The efficacy of motivational interviewing as a brief intervention for excessive drinking: a meta-analytic review. Alcohol Alcohol 41: 328–335.
- 71. Burke BL, Arkowitz H, Menchola M (2003) The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. J Consult Clin Psychol 71: 843–861.
- 72. Cuijpers P, Riper H, Lemmers L (2004) The effects on mortality of brief interventions for problem drinking: a meta-analysis. Addiction 99: 839–845.
- 73. Cunningham JA, Kypri K, McCambridge J (2013) Exploratory randomized controlled trial evaluating the impact of a waiting list control design. BMC Med Res Methodol 13: 150.
- 74. Donker T, van SA, Riper H, Marks I, Andersson G, et al. (2009) Implementation of Internet-based preventive interventions for depression and anxiety: role of support? The design of a randomized controlled trial. Trials 10: 59.
- 75. Moyer VA (2013) Screening and behavioral counseling interventions in primary care to reduce alcohol misuse: U.S. preventive services task force recommendation statement. Ann Intern Med 159: 210–218.
- 76. Kaner E, Bland M, Cassidy P, Coulton S, Dale V, et al. (2013) Effectiveness of screening and brief alcohol intervention in primary care (SIPS trial): pragmatic cluster randomised controlled trial. BMJ 346: e8501.
- 77. Cunningham JA, Khadjesari Z, Bewick BM, Riper H (2010) Internet-based interventions for problem drinkers: From efficacy trials to implementation. Drug Alcohol Rev 29: 617–622.
- 78. Riper H, Kramer J, Keuken M, Smit F, Schippers G, et al. (2008) Predicting successful treatment outcome of web-based self-help for problem drinkers: secondary analysis from a randomized controlled trial. J Med Internet Res 10: e46.
- 79. Robinson SM, Sobell LC, Sobell MB, Arcidiacono S, Tzall D (2014) Alcohol and drug treatment outcome studies: new methodological review (2005–2010) and comparison with past reviews. Addict Behav 39: 39–47.
- 80. Saitz R (2010) Alcohol screening and brief intervention in primary care: Absence of evidence for efficacy in people with dependence or very heavy drinking. Drug Alcohol Rev 29: 631–640.
- 81. Eysenbach G (2005) The law of attrition. J Med Internet Res 7: e11.
- 82. Postel MG, de Haan HA, ter Huurne ED, van der Palen J, Becker ES, et al. (2011) Attrition in web-based treatment for problem drinkers. J Med Internet Res 13: e117.
- 83. McCambridge J, Kypri K, McElduff P (2013) Regression to the mean and alcohol consumption: A cohort study exploring implications for the interpretation of change in control groups in brief intervention trials. Drug Alcohol Depend.
- 84. McCambridge J, Kypri K, McElduff P (2014) Regression to the mean and alcohol consumption: a cohort study exploring implications for the interpretation of change in control groups in brief intervention trials. Drug Alcohol Depend 135: 156–159.
- 85. Roerecke M, Gual A, Rehm J (2013) Reduction of alcohol consumption and subsequent mortality in alcohol use disorders: systematic review and meta-analyses. J Clin Psychiatry 74: e1181–e1189.
- 86. Smit F, Lokkerbol J, Riper H, Majo MC, Boon B, et al. (2011) Modeling the cost-effectiveness of health care systems for alcohol use disorders: how implementation of eHealth interventions improves cost-effectiveness. J Med Internet Res 13: e56.