• Loading metrics

Effectiveness and treatment moderators of internet interventions for adult problem drinking: An individual patient data meta-analysis of 19 randomised controlled trials

  • Heleen Riper ,

    Roles Conceptualization, Data curation, Formal analysis, Writing – original draft

    Affiliations Department of Clinical, Neuro- and Developmental Psychology, VU University, Amsterdam, the Netherlands, Department of Psychiatry, VU University Medical Centre, Amsterdam, the Netherlands, APH Institute for Health and Care Research, VU University Medical Centre, Amsterdam, the Netherlands

  • Adriaan Hoogendoorn,

    Roles Formal analysis, Methodology, Writing – review & editing

    Affiliations Department of Psychiatry, VU University Medical Centre, Amsterdam, the Netherlands, APH Institute for Health and Care Research, VU University Medical Centre, Amsterdam, the Netherlands

  • Pim Cuijpers,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations Department of Clinical, Neuro- and Developmental Psychology, VU University, Amsterdam, the Netherlands, APH Institute for Health and Care Research, VU University Medical Centre, Amsterdam, the Netherlands

  • Eirini Karyotaki,

    Roles Data curation, Writing – review & editing

    Affiliations Department of Clinical, Neuro- and Developmental Psychology, VU University, Amsterdam, the Netherlands, APH Institute for Health and Care Research, VU University Medical Centre, Amsterdam, the Netherlands

  • Nikolaos Boumparis,

    Roles Investigation, Writing – review & editing

    Affiliations Department of Clinical, Neuro- and Developmental Psychology, VU University, Amsterdam, the Netherlands, APH Institute for Health and Care Research, VU University Medical Centre, Amsterdam, the Netherlands

  • Adriana Mira,

    Roles Project administration, Writing – review & editing

    Affiliations Department of Psychology and Technology, Universitat Jaume I, Castellon, Spain, Department of Psychology and Sociology, Universidad de Zaragoza, Zaragoza, Spain

  • Gerhard Andersson,

    Roles Investigation, Writing – review & editing

    Affiliations Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden, Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden

  • Anne H. Berman,

    Roles Data curation, Writing – review & editing

    Affiliations Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden, Stockholm Health Care Services, Stockholm County Council, Stockholm, Sweden

  • Nicolas Bertholet,

    Roles Data curation, Writing – review & editing

    Affiliation Alcohol Treatment Centre, Department of Community Medicine and Health, Lausanne University Hospital, Lausanne, Switzerland

  • Gallus Bischof,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany

  • Matthijs Blankers,

    Roles Data curation, Writing – review & editing

    Affiliations Arkin Mental Health Care, Department of Research, Amsterdam, the Netherlands, Academic Medical Centre, Department of Psychiatry, University of Amsterdam, Amsterdam, the Netherlands, Trimbos Institute—Netherlands Institute of Mental Health and Addiction, Utrecht, the Netherlands

  • Brigitte Boon,

    Roles Data curation, Writing – review & editing

    Affiliation Academy Het Dorp, Arnhem, the Netherlands

  • Leif Boß,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Health Psychology and Applied Biological Psychology, Institute of Psychology, Leuphana University of Lüneburg, Lüneburg, Germany

  • Håvar Brendryen,

    Roles Data curation, Writing – review & editing

    Affiliation Norwegian Centre for Addiction Research, Institute of Clinical Medicine, Faculty of Medicine, University of Oslo, Oslo, Norway

  • John Cunningham,

    Roles Data curation, Writing – review & editing

    Affiliations Centre for Addiction and Mental Health, University of Toronto, Ontario, Canada Department of Psychiatry and Department of Psychology, University of Toronto, Toronto, Ontario, Canada, Centre for Addiction and Mental Health, Toronto, Ontario, Canada, Research School of Population Health, Australian National University, Canberra, Australia

  • David Ebert,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany

  • Anders Hansen,

    Roles Data curation, Writing – review & editing

    Affiliation Strategic Research and Development Support, Metropolitan University College, Copenhagen, Denmark

  • Reid Hester,

    Roles Data curation, Writing – review & editing

    Affiliation Research Division, Behavior Therapy Associates, Albuquerque, New Mexico, United States of America

  • Zarnie Khadjesari,

    Roles Data curation, Writing – review & editing

    Affiliation School of Health Sciences, University of East Anglia, Norwich, United Kingdom

  • Jeannet Kramer,

    Roles Data curation, Writing – review & editing

    Affiliation Trimbos Institute—Netherlands Institute of Mental Health and Addiction, Utrecht, the Netherlands

  • Elizabeth Murray,

    Roles Data curation, Writing – review & editing

    Affiliations Health Service and Population Research Department, Centre for Implementation Science, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom, eHealth Unit, Research Department of Primary Care and Population Health, University College London, Royal Free Hospital, London, United Kingdom

  • Marloes Postel,

    Roles Data curation, Writing – review & editing

    Affiliations Department of Psychology, Health and Technology, University of Twente, Enschede, the Netherlands, Department of Development and Advice, Tactus Addiction Treatment, Deventer, the Netherlands

  • Daniela Schulz,

    Roles Data curation, Writing – review & editing

    Affiliation CAPHRI School for Public Health and Primary Care, Department of Health Promotion, Maastricht University, Maastricht, the Netherlands

  • Kristina Sinadinovic,

    Roles Data curation, Writing – review & editing

    Affiliations Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden, Stockholm Health Care Services, Stockholm County Council, Stockholm, Sweden

  • Brian Suffoletto,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America

  • Christopher Sundström,

    Roles Data curation, Writing – review & editing

    Affiliation Institute for Mental Health Policy Research, Centre for Addiction and Mental Health, Toronto, Ontario, Canada

  • Hein de Vries,

    Roles Data curation, Writing – review & editing

    Affiliation CAPHRI School for Public Health and Primary Care, Department of Health Promotion, Maastricht University, Maastricht, the Netherlands

  • Paul Wallace,

    Roles Data curation, Writing – review & editing

    Affiliation eHealth Unit, Research Department of Primary Care and Population Health, University College London, Royal Free Hospital, London, United Kingdom

  • Reinout W. Wiers,

    Roles Data curation, Writing – review & editing

    Affiliation Addiction Development and Psychopathology (ADAPT) Laboratory, Department of Psychology, University of Amsterdam, the Netherlands

  •  [ ... ],
  • Johannes H. Smit

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations Department of Psychiatry, VU University Medical Centre, Amsterdam, the Netherlands, APH Institute for Health and Care Research, VU University Medical Centre, Amsterdam, the Netherlands

  • [ view all ]
  • [ view less ]

Effectiveness and treatment moderators of internet interventions for adult problem drinking: An individual patient data meta-analysis of 19 randomised controlled trials

  • Heleen Riper, 
  • Adriaan Hoogendoorn, 
  • Pim Cuijpers, 
  • Eirini Karyotaki, 
  • Nikolaos Boumparis, 
  • Adriana Mira, 
  • Gerhard Andersson, 
  • Anne H. Berman, 
  • Nicolas Bertholet, 
  • Gallus Bischof



Face-to-face brief interventions for problem drinking are effective, but they have found limited implementation in routine care and the community. Internet-based interventions could overcome this treatment gap. We investigated effectiveness and moderators of treatment outcomes in internet-based interventions for adult problem drinking (iAIs).

Methods and findings

Systematic searches were performed in medical and psychological databases to 31 December 2016. A one-stage individual patient data meta-analysis (IPDMA) was conducted with a linear mixed model complete-case approach, using baseline and first follow-up data. The primary outcome measure was mean weekly alcohol consumption in standard units (SUs, 10 grams of ethanol). Secondary outcome was treatment response (TR), defined as less than 14/21 SUs for women/men weekly. Putative participant, intervention, and study moderators were included. Robustness was verified in three sensitivity analyses: a two-stage IPDMA, a one-stage IPDMA using multiple imputation, and a missing-not-at-random (MNAR) analysis. We obtained baseline data for 14,198 adult participants (19 randomised controlled trials [RCTs], mean age 40.7 [SD = 13.2], 47.6% women). Their baseline mean weekly alcohol consumption was 38.1 SUs (SD = 26.9). Most were regular problem drinkers (80.1%, SUs 44.7, SD = 26.4) and 19.9% (SUs 11.9, SD = 4.1) were binge-only drinkers. About one third were heavy drinkers, meaning that women/men consumed, respectively, more than 35/50 SUs of alcohol at baseline (34.2%, SUs 65.9, SD = 27.1). Post-intervention data were available for 8,095 participants. Compared with controls, iAI participants showed a greater mean weekly decrease at follow-up of 5.02 SUs (95% CI −7.57 to −2.48, p < 0.001) and a higher rate of TR (odds ratio [OR] 2.20, 95% CI 1.63–2.95, p < 0.001, number needed to treat [NNT] = 4.15, 95% CI 3.06–6.62). Persons above age 55 showed higher TR than their younger counterparts (OR = 1.66, 95% CI 1.21–2.27, p = 0.002). Drinking profiles were not significantly associated with treatment outcomes. Human-supported interventions were superior to fully automated ones on both outcome measures (comparative reduction: −6.78 SUs, 95% CI −12.11 to −1.45, p = 0.013; TR: OR = 2.23, 95% CI 1.22–4.08, p = 0.009). Participants treated in iAIs based on personalised normative feedback (PNF) alone were significantly less likely to sustain low-risk drinking at follow-up than those in iAIs based on integrated therapeutic principles (OR = 0.52, 95% CI 0.29–0.93, p = 0.029). The use of waitlist control in RCTs was associated with significantly better treatment outcomes than the use of other types of control (comparative reduction: −9.27 SUs, 95% CI −13.97 to −4.57, p < 0.001; TR: OR = 3.74, 95% CI 2.13–6.53, p < 0.001). The overall quality of the RCTs was high; a major limitation included high study dropout (43%). Sensitivity analyses confirmed the robustness of our primary analyses.


To our knowledge, this is the first IPDMA on internet-based interventions that has shown them to be effective in curbing various patterns of adult problem drinking in both community and healthcare settings. Waitlist control may be conducive to inflation of treatment outcomes.

Author summary

Why was this study done?

  • Global estimations continue to show increasing morbidity, mortality, and social harm caused by all types of problem drinking.
  • Face-to-face brief interventions for problem drinking are effective but rarely used.
  • Internet-based interventions could overcome this treatment gap.
  • We investigated effectiveness and moderators of treatment outcomes in internet-based interventions for adult problem drinking.

What did the researchers do and find?

  • We conducted a one-stage individual patient data meta-analysis (IPDMA). This is, to our knowledge, the first study to identify moderators at the participant, intervention, and study design levels that are associated with treatment outcomes in internet-based interventions for adult problem drinking.
  • Our IPDMA included 14,198 adults at baseline from 19 randomised controlled trials who exhibited various profiles of problem drinking. We obtained posttreatment data for 8,095 participants.
  • Our results show that internet-based alcohol interventions in both community and healthcare populations are effective in reducing mean weekly alcohol consumption and in achieving adherence to low-risk drinking limits.
  • We did not find differences in impact related to drinking profiles, meaning that people exceeding risk limits to a smaller or a larger degree benefited from the interventions, as did binge-only drinkers. Human-guided interventions showed a stronger impact on treatment outcome than fully automated ones, but waitlist design controls may inflate outcomes.

What do these findings mean?

  • The health gains of internet-based alcohol interventions could be substantial, because such programmes can reach high numbers of problem drinkers by virtue of their swift entry procedures and their easy scalability.
  • Future research should seek to identify categories of people for whom such interventions work best, to analyse how the interventions work and to determine what delivery contexts are most favourable. It should explore which patient populations could benefit most from referral to unguided forms and which would be more amenable to guidance by GPs or other professionals.


Global estimations continue to show increasing physical and psychological morbidity, all-cause and specific-cause mortality, and social harm deriving from all types of alcohol misuse. Usually, a positive and linear association is seen between increased consumption and related health risks [1]. A number of factors underlie this mounting health burden. These include increases in the prevalence of alcohol consumers due to population growth and societal ageing, an absolute increase in adult alcohol consumption due to greater wealth and wider acceptance of alcohol use, and escalating alcohol use amongst women and the elderly. At the same time, there are growing insights into health risks connected with even minimal levels of alcohol consumption [2,3].

Brief alcohol interventions (BAIs) in primary care and community settings have been found clinically and cost-effective, with effect sizes in the small to moderate range, for reducing both hazardous drinking (which increases the risk of physical or psychological harm) and harmful drinking (which has already caused some damage) [4]. Together, their target groups are referred to as ‘problem drinkers’ to distinguish them from drinkers with alcohol use disorders, for whom more intensive treatments are recommended [5]. Problem drinkers account for the highest prevalence of alcohol misuse. Based on accumulated evidence, many national and professional guidelines now recommend brief interventions for problem drinkers in primary care settings and among community populations [6]. These interventions are comprised mostly of brief single or multiple sessions (up to six) and are based on personalised normative feedback (PNF) [7] or combinations of PNF, motivational interviewing (MI) [8], cognitive-behavioural therapy (CBT) [9], or behavioural self-control (BSC) principles [10]. Despite the ample evidence available, the actual impact of BAIs on curbing the prevalence of problem drinking in the wider population has been disappointingly low. The main factors in the weak impact include problems with implementation, as relatively few healthcare professionals actually administer BAIs; in addition, only a small proportion of patients who might benefit are actually offered BAIs, and even fewer accept the offer [11].

Internet-based alcohol interventions (iAIs) may overcome some of these problems by virtue of their low-threshold accessibility, their high scalability, and their acceptability to problem drinkers, as was recently echoed by McCambridge and Saitz [11]. Major advantages of iAIs, as perceived by many problem drinkers, are reduced stigma and greater comfort about disclosing drinking problems. The majority of iAIs are based on manualised therapeutic principles similar to those in BAIs. They are offered in unguided and guided formats. Unguided iAIs are fully automated interventions that participants can perform without human guidance. Guided interventions provide human support to guide participants through the intervention, mainly via asynchronous secure email contact [12]. The support may come from health professionals or trained volunteers. Meta-analytic studies have shown that unguided iAIs, in particular, are now used on a wider scale than conventional BAIs [13]. They have been found clinically effective (small effects) in reducing mean weekly adult alcohol consumption as compared with controls [14]. As a result, iAIs have been incorporated into some clinical guidelines for treating problem drinking in primary care [15].

All this notwithstanding, various uncertainties still surround the evidence base for iAIs. First of all, still little is known about whether women and older people derive benefits comparable to those seen for male and younger problem drinkers. Such knowledge is important in view of the rising prevalence rates of problem drinking among women and the elderly and their underrepresentation in many intervention studies [16]. Secondly, problem drinking actually embraces several different drinking profiles, and only a few iAI studies have investigated whether these might moderate treatment outcomes [17]. Such profiles include exceeding the advised weekly alcohol limits to a moderate (‘regular drinking’) or a serious degree (‘heavy drinking’) and ‘binge-only drinking’, whereby alcohol users episodically exceed the maximum advised intakes per drinking occasion. Such divergent drinking profiles may or may not necessitate different interventions. Thirdly, there is the question of whether guided iAIs are more effective than unguided ones—a finding reported for CBT-based internet interventions for common mental disorders such as depression [18]. A related question is whether iAI treatment outcomes might vary according to the therapeutic orientation of the intervention.

The few moderator analyses conducted to date had a common limitation: they were statistically underpowered to properly address such questions [14]. To overcome this major problem, we conducted an individual patient data meta-analysis (IPDMA) that boosted the number of participants studied and thereby the statistical power. That enabled us to better evaluate the overall effectiveness of iAIs in reducing alcohol consumption, as well as to explore statistically significant differences within the data by performing moderator analyses on treatment outcomes, with a focus on participant, intervention, and study design characteristics.

Materials and methods

Identification and selection of randomised controlled trials

PsycINFO, Science Citation Index Expanded, Social Sciences Citation Index, Arts and Humanities Citation Index, CINAHL, PubMed, and EMBASE were searched up to 31 December 2016. All papers retrieved were evaluated by independent assessors (HR, EK, or NBo) (for search string, see S1 Data).

Eligibility criteria

Randomised controlled trials (RCTs) were eligible if they (1) studied people aged ≥18 with quantifiable levels of alcohol consumption that exceeded recommendations for low-risk drinking; (2) compared an iAI with a control condition (e.g., assessment only, waitlist, or minimal intervention); (3) studied an iAI based on therapeutic principles such as PNF, BSC, CBT, MI, or combinations thereof; and (4) studied either an unguided or a guided intervention or both. RCTs in populations of students or pregnant women were excluded. Primary authors of identified trials were asked to provide their raw RCT data for a set of pre-identified variables (HR/EK, S2 Data and see S4 Data for data access contact list of original studies) and were queried as to whether they were aware of ongoing RCTs that met our inclusion criteria; two more RCTs were thus identified [19,20]. No study protocol for this study has been developed.

Risk-of-bias assessment and data extraction

Five criteria from the Cochrane Collaboration risk-of-bias assessment tool were applied (by EK, HR, and NBo): (1) adequate random sequence allocation, (2) concealment of allocation to the different conditions, (3) blinding of participants and therapists to the study condition, (4) blinding of assessors to outcomes, and (5) handling of missing data [21].


Primary outcome measure.

The primary outcome was mean weekly alcohol consumption, expressed in standard units. As RCTs differ in the quantification of alcohol in beverages, based on national custom (ranging from 8 to 14 grams of ethanol per unit [22]), we recalculated these into standard units of alcohol consumption based on 10 grams of ethanol (SUs). Most RCTs measured alcohol consumption using time line follow-back (TLFB) approaches. For a few RCTs that did not report TLFB data, we estimated mean weekly SUs on the basis of the first two questions of The Alcohol Use Disorders Identification Test (brief, 3 items; AUDIT-C) scale [23] at post-intervention. Alcohol consumption at baseline was constructed identically. Most included participants were regular drinkers who were consuming more than the recommended low-risk weekly limits of 14 SUs (females) or 21 SUs (males) at baseline. Binge-only drinking is another problem drinking profile in which low-risk recommendations are exceeded. We defined binge-only drinkers by proxy as participants who drank more than 4 or 6 SUs (females/males) on at least one occasion per week, while still totalling less than 14/21 SUs weekly.

Secondary outcome measure.

Treatment response (TR) was defined as an alcohol consumption level below 14/21 SUs per week for females/males at the first post-intervention follow-up.


The following participant-level putative moderators were tested: gender (female/male); age (below 55/above 55); education (high/low, with ‘high’ referring to tertiary education and ‘low’ to primary or secondary schooling), employment (yes/no), and partner relationship (yes/no). Two dimensions of problem drinking were explored: regular drinking (>14/21 SUs female/male weekly) as contrasted with binge-only drinking (≥4/6 SUs female/male at least once a week but below 14/21 female/male SUs weekly); and heavy drinking (>35/50 SUs female/male weekly) as contrasted with non-heavy drinking (14–35 SUs weekly in females and 21–50 SUs weekly in males). Intervention-level putative moderators were therapeutic guidance (human-guided versus unguided interventions), intensity (single versus multiple sessions), therapeutic orientation (PNF-only versus integrated therapeutic principles), and intervention setting (in work, healthcare, or community populations). A study design moderator, type of control, was also included (waitlist control contrasted with assessment-only or minimal-intervention control).

One-stage and two-stage IPDMAs.

Replications of individual study outcomes based on the raw data in comparison with the published results led to only one correction to the published tables [24]. We next applied a one-stage individual patient data (IPD) model of analysis, as it is assumed to produce a more exact likelihood specification than a two-stage approach [25]. In a one-stage IPDMA, the effect of iAIs is evaluated by fitting a single comprehensive model to the IPD from all trials, while simultaneously accounting for the nesting of participants within these trials. To account for the nesting structure, we assessed the summary effect of iAIs on the primary outcome using a linear mixed model (LMM). At the participant level, we used an ANCOVA model [26], regressing the post-intervention outcome score on the iAI intervention indicator, with the baseline alcohol consumption score used as a covariate.

To deal with missing baseline alcohol data, we used mean imputation to estimate scores [27]. We subsequently analysed all available outcomes using complete cases—that is, including the full baseline outcomes (N = 14,198) but ignoring missing post-intervention outcomes. This analysis implicitly assumes that the missing data are missing at random (MAR) rather than missing completely at random (MCAR), allowing missingness of post-intervention scores to depend on the pre-intervention score.

To evaluate the effect of iAIs using an LMM, we regressed the post-intervention weekly SU level on the iAI intervention indicator, the baseline weekly SU level, and the comparison indicators (dummy variables contrasting the intervention arms with the control arms of the trials), assuming random effects (both intercepts and intervention slopes) for those comparisons and equal residual variances across trials. The estimates of the iAIs’ effects are presented as unstandardised regression coefficients (b), which refer to the overall effect of the intervention on posttreatment drinking behaviour in terms of comparative SU levels.

For TR, a generalised LMM with participants nested within trials (a logistic model) was similarly used. TR at follow-up (yes/no) was the dichotomous dependent variable, and all fixed and random effects were identical to those in the LMM for the continuous primary outcome, except that fixed intercepts were removed for reasons of identification (convergence), resulting in a model with random intercepts (and slopes). We calculated odds ratios (ORs), representing the probability that an outcome will occur given a particular exposure as compared with the probability in the absence of that exposure [28]. TR was additionally interpreted by transforming the OR to a number needed to treat (NNT) [29].

We subsequently tested whether participant, intervention, or study design characteristics moderated the effect of iAIs on either the primary or the secondary outcome or both. However, participant-level characteristics and study- and intervention-level characteristics were analysed differently. For participant-level characteristics, within-study and across-study interaction effects had to be separated to avoid ecological bias [25], whilst no such separation was needed for study- and intervention-level moderators. We additionally performed two-stage analyses to evaluate the sensitivity of the one-stage results, a recommendation by Burke and colleagues [25]. The two-stage approach in our study derived aggregate data for effect estimates and their CIs for each study individually (step one), then combined these in a conventional meta-analysis model (step two). In two-stage analyses, participant-level moderators are estimated for each study separately and combined in the second stage, without risk of ecological bias, while intervention- and study-level characteristics are studied by comparing subgroups of trials in the second stage.

In the one-stage approach, we added a second sensitivity analysis to compare our results against those of a procedure applying multiple imputation to include all participants (an intention-to-treat [ITT] analysis). This analysis was conducted on the request of one of the reviewers. The multiple imputation procedure used chained equations to impute missing alcohol consumption scores—both before and after the intervention—together with missing values of the participant-level putative moderators. The ITT analysis employed logistic regression models for the dichotomous variables and predicted-mean matching for the continuous variables, with study indicators and intervention indicators (fully interacted) included as covariates. This second sensitivity analysis tested the main intervention effect and the moderator effects of all participant-level and study-level moderators on the primary outcome variable.

In the two-stage approach, we employed a third sensitivity analysis that evaluated the MAR assumption on the missing data mechanism, thereby answering an additional question of one of the reviewers. This additional, missing-not-at-random (MNAR) analysis is part of the ITT strategy suggested by White and colleagues [30]; it includes all randomised individuals in the analysis, taking baseline outcomes of dropouts into account. It evaluates a series of values of a sensitivity parameter δ, which equals the difference between the mean of the observed values of post-intervention SUs of alcohol and the mean of the unobserved values. Under MAR, δ (being the covariate-adjusted mean difference between missing and observed outcomes) is assumed to be zero. In our case, positive (or negative) values of δ correspond to the situation in which the dropouts, after adjustment for pre-intervention SUs, would have higher (or lower) mean values of post-intervention SUs than those who continued participation (see S1 Text for a detailed explanation of the evaluation of the MAR assumption). This third sensitivity analysis targeted the main intervention effect on the primary outcome variable only.

To examine heterogeneity, we calculated the I2 statistic using the two-stage approach as well. This indicator is expressed as a percentage: an I2 value of 0% is interpreted as no heterogeneity, 25% as low, 50% as moderate, and 75% as high heterogeneity [31]. We calculated the 95% CIs around I2 using the noncentral chi-squared–based approach within the heterogeneity module for Stata [32,33]. All analyses were conducted with Stata 14.2.

Comparison of IPDMA-included with non-included RCTs

The potential differences in treatment outcomes between the trials included and those that could not be included in preparing our IPDMA were assessed with a conventional meta-analysis (Comprehensive Meta-Analysis, version 3.3.070; S3 Data).


Results are reported in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analyses for IPD (S1 PRISMA Checklist) [34].

Selection of RCTs

Fig 1 illustrates the selection process for the trials included in our IPDMA. We identified 183 full papers, from which 24 eligible RCTS were found, five of which [3539] could not be included (all involving unguided iAIs) because authors did not respond to our invitation.

Fig 1. PRISMA IPD diagram of RCTs selection process.

IPD, individual patient data; RCT, randomised controlled trial.

Study characteristics

Table 1 shows the characteristics of the 19 included RCTs (26 comparisons). Most trials applied the full Alcohol Use Disorders Identification Test (AUDIT) (n = 9, cutoff ≥8) [40] or AUDIT-C scales (n = 4, cutoff ≥4 or ≥5) [23] as inclusion criteria. Four RCTs used cutoff thresholds based on daily or weekly low-risk drinking recommendations; the Fast Alcohol Screening Test (FAST) was applied in two trials [41]. Participants were recruited either directly from the community (n = 12 trials), from healthcare settings (n = 4), or from work settings (n = 3). Eight trials employed a minimal-intervention control design, six trials applied assessment-only control, and five included a waitlist-control comparator. Eleven trials estimated the effects of multiple-session iAIs, seven studied single-session iAIs, and one study included both types. Twelve investigated effects of therapeutically integrated iAIs and seven studied PNF-only interventions. Most comparisons (n = 19) involved unguided iAIs; eight involved human-guided interventions. The first post-intervention assessment occurred in most trials (n = 15) between 1 and 3 months after treatment, in three trials at 6 months, and in one study at 12 months. A total of N = 14,198 participants was included, out of the 17,545 participants in the 24 identified trials (a 79.77% inclusion rate).

Table 1. Characteristics of studies analysed in IPDMA (19 studies, 27 comparisons).

Participants’ characteristics at baseline

Of the total of 14,198 enrolled participants, 8,095 provided post-intervention outcome data (complete cases, Table 2). The mean age of the overall sample was 40.7 (SD = 13.2) and the sample was rather evenly divided by gender (47.6% women, 52.4% men). Some 51.9% of participants had tertiary education, 74.8% had paid employment, and 56.7% were in partner relationships. The mean weekly SU level at baseline was 38.1 (SD = 26.9). Most problem drinkers (80.1%, SUs 44.7, SD = 26.4) could be categorised as regular drinkers and 19.9% (SUs 11.9, SD = 4.1) as binge-only drinkers. Regular drinkers could be distinguished into heavy drinkers (34.2%, SUs 65.9, SD = 27.1) and non-heavy drinkers (65.8%, SUs 23.7, SD = 10.6). Heavy drinkers were found in both unguided and guided iAIs (34% and 30%, respectively). The mean full AUDIT score (n = 9 trials) was 15.0 (SD = 6.8), indicating hazardous or harmful alcohol use [40]. Of the participants for which a full AUDIT score was available, 22.2% (n = 678) scored above 20, indicating a risk of alcohol dependence. Missing SU scores at baseline were virtually nil (0.4%). Missing data at the first post-intervention assessment for the primary outcome were considerable (43%), predominantly resulting from study dropout, which was not entirely random: participants under age 55 and those with baseline heavy-drinking profiles dropped out significantly more than others.

Table 2. Characteristics of all study participants at baseline (n = 14,198) and complete cases (n = 8,095).

Risk of bias

The quality of the RCTs was relatively high (Fig 2 and S1 Table). All but one scored high-risk on the blinding of participants, which was expected, as this criterion is difficult to meet for behavioural change trials. All trials included ITT analyses, but seven had a high bias risk in terms of high study dropout (over 30%).

One-stage IPDMA analyses: Main outcomes

The overall difference in mean weekly alcohol reduction was significant and in favour of the iAI condition (b = −5.02 SUs, 95% CI −7.57 to −2.48, p < 0.001; see Table 3). We identified four outliers (RCTs in which the 95% CI did not overlap with that of our pooled effect size) [43,52,53,59]. Removal of these outliers altered the result only slightly (b = −4.81 SUs, 95% CI −6.69 to −2.93, p < 0.001). For two trials (Khadjesari 2014, N = 1,330, and Sinadinovic 2014, N = 633), we had estimated the mean weekly SUs on the basis of the first two questions of the AUDIT-C; removal of those trials likewise only slightly altered the result (b = −5.74 SUs, 95% CI −8.55 to −2.92, p < 0.001).

Table 3. Effects of iAIs in terms of weekly SUs, moderating effects, and subgroup analyses (one- and two-stage results).

iAI participants also had a significantly greater likelihood of TR than controls (OR = 2.20, 95% CI 1.63–2.95, p < 0.001, NNT = 4.15, 95% CI 3.06–6.62), which remained after removal of the outliers (OR = 2.15, 95% CI 1.67–2.77, p < 0.001; see Table 4) or the two AUDIT-estimated trials (OR = 2.50, 95% CI 1.81–3.45, p < 0.001; see Table 4). Follow-up periods in the analysis were different, but they were not associated with outcomes (primary p = 0.41, secondary p = 0.12).

Table 4. Effects of iAIs in terms of TR (adherence to 14/21 guidelines), moderating effects, and subgroup analyses (one- and two-stage results).

Moderator analyses

Participant characteristics.

Both men and women treated in iAIs decreased their mean weekly SU levels to a greater degree than controls, but women did so less than men (2.19 SUs, 95% CI 0.52–3.85, p = 0.013). Additional sensitivity analyses maintained this difference. In the first analysis we included only men and women who were exceeding 14 SUs of alcohol at baseline and found a moderator effect of b = 2.36 (95% CI 0.41–4.31, p = 0.018) for female gender. In the second analysis we included males and females who were exceeding 21 SUs at baseline, resulting in a very similar difference of b = 2.52 (95% CI 0.22–4.82, p = 0.031). A comparable result emerged for higher- versus lesser-educated participants (2.12 SUs smaller reduction for the former, 95% CI 0.18–4.0, p = 0.033). Participants above age 55 were significantly more likely to show TR than younger participants (OR = 1.68, 95% CI 1.22–2.30, p = 0.001). No other participant-level moderators were identified for the primary or the secondary outcome.

Intervention characteristics.

Both unguided (−3.23 SUs, 95% CI −5.88–0.59, p = 0.017) and guided iAIs (−10.01 SUs, 95% CI −14.64 to −5.39, p < 0.001) were significantly more effective in reducing mean weekly SUs as compared with controls. Guided interventions were significantly more effective than unguided ones (−6.78 SUs, 95% CI −12.11 to −1.45, p = 0.013). Similar significant differences in favour of guided iAIs were seen in terms of TR (unguided: OR = 1.75, 95% CI 1.14–2.67, p < 0.001; guided: OR = 3.91, 95% CI 2.30–6.66, p < 0.001). Guided interventions positively moderated TR likelihood in comparison to unguided ones (OR = 2.23, 95% CI 1.22–4.08, p = 0.009). PNF-only interventions showed a significantly lower likelihood of TR than iAIs based on integrated therapeutic principles (OR = 0.52, 95% CI 0.29–0.93, p = 0.029). Intervention settings significantly moderated alcohol consumption outcomes for healthcare patients (−9.12 SUs, 95% CI −14.33 to −3.90, p = 0.001) and for community populations (−4.12 SUs, 95% CI −7.04 to −1.19, p = 0.006) but not for work populations. Similar significant results were evident for TR (healthcare: OR = 3.31, 95% CI 1.82–6.01, p < 0.001; community: OR = 2.07, 95% CI 1.50–2.85, p < 0.001).

Study design characteristics.

Treatment participants in waitlist-controlled (WLC) trials significantly reduced their mean weekly alcohol consumption by greater amounts in comparison to controls than those treated in otherwise-controlled trials (−9.27 SUs, 95% CI −13.97 to −4.57, p < 0.001). Only the guided iAIs in WLC designs differed significantly from those in otherwise-controlled trials (b = −10.51 SUs, 95% CI −18.38 to −2.64, p = 0.009). iAI intervention participants in WLC trials were also significantly more likely to show favourable TR (OR = 3.74, 95% CI 2.13–6.53, p < 0.001) than those in other trials; significant differences were maintained for both unguided and guided iAIs with WLC designs as compared to other control (unguided: OR = 2.51, 95% CI 1.21–5.22, p = 0.014; guided: OR = 5.32, 95% CI 2.08–13.58, p < 0.001).

Sensitivity analyses

In the first sensitivity analysis, we checked the extent to which the results would be different if we used a two-stage approach instead of a one-stage approach. The second sensitivity analysis involved the inclusion of all participants according to the ITT principle by use of a multiple imputation strategy.

The third sensitivity analysis concerned the MAR assumption that is commonly used to deal with missing outcome data. All three of our sensitivity analyses confirmed the results of our main analysis for the overall effect and for most of the moderating effects of participant-, intervention-, and study-level characteristics for the primary and secondary outcomes. This appears to verify the robustness of our findings (see Tables 3 and 4 for the results of the two-stage approach and S2 Table and S3 Table, in which the results of the multiple imputation analyses are presented). Some minimal differences for moderators were seen in the multiple imputation analyses. The moderating role of gender and education for the primary outcome lost significance after multiple imputation. For the secondary outcome, the moderating role of single versus multiple sessions became significantly different in favour of multiple sessions, while intervention in the work setting became effective (p = 0.041), as was the case for assessment-only interventions. The contrast between PNF versus integrated iAIs became nonsignificant, as was the case for the contrast between unguided iAIs with WLCs versus other types of control conditions. Thus, in some cases these made our moderator analysis appear more conservative, while in some other cases the MI was more conservative.

Fig 3 depicts the results of the third, MNAR sensitivity analysis, which assessed departure from the MAR assumption. The figure shows estimates (and 95% CIs) of the overall intervention effect on our primary outcome variable, SU, for differing values of δ. The value of δ = 0 corresponds to the MAR assumption, on which the results displayed in Table 3 are based. Positive (or negative) values of δ correspond to situations in which—in each study included in the IPDMA and in both the intervention and the control arms—the mean of unobserved scores for post-intervention SUs would be higher (or lower) than the observed post-intervention SUs, after adjustment for pre-intervention SUs. If MAR holds, the overall effect is estimated in the two-stage method at −4.80 SU. Fig 3 shows that if the post-intervention SUs of dropouts, adjusted for the pre-intervention SUs, were to be 35 SUs higher on average than the post-intervention SUs of participants (being about 1.4 SD above the pre-intervention SUs shown in Table 2), then the estimate of the overall effect would be −4.06 SUs (95% CI −6.25–1.87). If the mean post-intervention SU level of dropouts were to be lower than those of participants (negative value of δ), then the overall effect would be stronger; for instance, if δ = −20, then the estimated overall effect would be −5.32 SUs (95% CI −7.64 to −3.01). This sensitivity analysis leads us to conclude that our results would remain rather stable, even in the event of substantial deviations from the MAR assumption (see S1 Text).

Fig 3. MNAR sensitivity analysis.

MNAR, missing-not-at-random; SU, standard unit of alcohol consumption.

Heterogeneity for the overall primary outcome was high and significant (I2 = 89.6%, CI 78.4%–95.2%, p < 0.001) and for the secondary outcome as well (I2 = 78.2%, CI 56.3%–89.9%, p < 0.001). It could be partly explained by the identified outliers, as it dropped from high to moderate for the primary outcome (I2 = 55.5%, CI 16.2%–80.3%, p < 0.001) and from high to small for the secondary outcome (I2 = 30%, CI 0%–69.1%, p < 0.001) after removal of the outliers from the analyses (Tables 3 and 4).

Conventional meta-analysis comparing included with non-included RCTs

The conventional meta-analysis (24 trials, 34 comparisons) was based on our search up to 31 December 2016 and included additional data from two RCTs published in 2017 [20,47]. It revealed a small significant difference in mean weekly SUs at the first follow-up in favour of iAI participants as compared with controls (Hedges’ g = 0.26, 95% CI 0.17–0.34, p < 0.001; Fig 4, forest plot of results of conventional meta-analysis). There was significant, moderate heterogeneity, indicating that the effect was greater in some trials than in others (I2 = 65%, p < 0.001; 95% CI 49–75). No significant difference in effect size was observed between the included and non-included RCTs in the IPDMA in terms of the primary outcome (SU reduction).

Fig 4. Forest plot of conventional meta-analysis.

iAi, internet-based alcohol intervention.

There were indications of publication bias, based on a visual inspection of the funnel plot (see S1 Fig) and Egger test (intercept 1.559, p < 0.05), but there was no publication bias observed on the basis of Duval and Tweedie’s trim-and-fill procedure (random-effects model). We could not conduct a conventional meta-analysis for our secondary outcome, as only a limited number of studies reported on it. In S3 Data, this conventional meta-analysis has been expanded with two further eligible studies published between 1 January 2017 and 30 May 2018 that could not be included in our IPDMA. Our aim here was to explore whether more recent studies could potentially alter our IPDMA results; as they did not significantly alter the effect size in our conventional analysis, we believe this confirms the robustness of our analysis.


Principal findings and their interpretation

This study found that participants treated in iAIs showed a higher mean weekly decrease of 5.02 SUs of alcohol consumption and a greater likelihood of favourable TR (OR 2.20) than controls. Women decreased their mean weekly alcohol consumption significantly less than men (around 2 SUs). Our sensitivity analysis confirmed our assumption that this difference was not an artefact of the higher cutoff thresholds for men than for women at study inclusion (leaving women less space for alcohol reduction) [60]. More highly educated participants reduced their mean weekly consumption significantly less than lesser educated ones (around 2 SUs). This result differs from the few studies that have reported on education as a moderator of iAI treatment outcomes; these showed either improved outcomes for more educated participants [61] or no such impact [62]. For gender and education as moderators of the primary outcome, our sensitivity analyses pointed in similar directions to the outcomes of our main analysis, although the results were no longer significant. In our study, age was found to have moderated TR, with participants above 55 showing greater likelihood of post-intervention adherence to low-risk drinking recommendations than younger people. None of the other participant characteristics moderated treatment outcomes. Internet interventions appear effective when applied in community and healthcare settings, but effectiveness in work settings is still inconclusive.

Guided iAIs yielded significantly better results than unguided ones for both treatment outcomes. iAIs based solely on PNF showed a lower likelihood of TR than iAIs based on integrated therapeutic principles. Waitlist control moderated both types of treatment outcomes, with iAIs in WLC studies showing significantly better outcomes in terms of both SU reduction and TR than those in otherwise-controlled studies. It thus appears that iAI treatment outcomes could have been overestimated in studies in which WLC groups were applied as comparators. One possible explanation for such higher effect sizes in WLC studies would be that problem drinkers allocated to waiting lists might delay their alcohol reduction because they anticipate treatment soon. In contrast, people in other types of control groups might have already found alternative support by the time of the follow-up assessment, thus potentially reducing their alcohol consumption more than WLC controls. By the same token, such tendencies could deflate effect sizes in non-WLC studies [63].

The overall greater reduction of 5.02 SUs of alcohol consumption seen here in iAI treatment participants as compared with controls was higher than the 2.2 SUs we found in our earlier, conventional meta-analysis [14]. One potential explanation for that difference is the higher number of guided iAI studies included in the present IPDMA; these showed higher treatment outcomes than unguided ones. Our current finding is comparable to the 5.61-SU reduction by adult iAI participants over controls reported in the conventional meta-analysis by Kaner and colleagues [16]. Our results compare quite favourably with outcomes of patients treated in primary care settings with brief guided face-to-face interventions, who showed decreases from 2 to 4 SUs [64,65]. We were also able to assess TR in terms of NNT (4.15). Due to data limitations, conventional meta-analyses have not been able to report on NNTs or on potential moderators of iAI treatment such as gender, age, and drinking profiles [16].

Methodological considerations

To the best of our knowledge, this is the first IPDMA to test the impact of iAIs and their moderators on treatment outcomes with adequate statistical power. The included RCTs had a low overall risk of methodological bias. Our results appear robust after comparison with our two-stage IPDMA results, as well as with those from our multiple imputation analysis and those from our conventional meta-analysis. The ANCOVA model that underlies our IPDMA implicitly relies on the MAR assumption, allowing dropout, which was 43% in our study, to depend on baseline consumption level. Although it cannot be ruled out that dropout was actually attributable to characteristics not included in the model, our MNAR sensitivity analysis suggested that the estimate of the overall effect would be reasonably stable against moderate deviations from the MAR assumption. The generalisability of our results to people in real-life settings might be hampered by poor assessment of ethnicity and by the focus on studies from high-income countries. In addition, only a small number of studies addressed effects of iAIs administered in care settings other than the community (such as in primary care practices, emergency departments, or workplaces). Another limitation is that all studies applied self-reported alcohol consumption measures, which is possibly a source of social desirability bias [66]. We also observed high heterogeneity in our analyses, and it could be explained only partly by excluding outliers or by some of the subgroup analyses that we conducted. Hence, the moderating factors we identified offer only partial clarification of moderating influences on treatment outcome. We were bound, of course, by the available data. Other moderators, such as self-efficacy or participants’ preference for iAIs over other types of interventions, cannot be ruled out [67]. Longer-term outcomes of iAIs could not be assessed, as few studies addressed them.

Conclusions and clinical implications

Both men and women from different age groups and with different drinking profiles, including heavy drinking and binge-only drinking, can benefit from iAIs, and in particular from the therapeutically integrated ones as opposed to PNF-only interventions. Participants in iAIs reduced their mean alcohol consumption from 38.1 to 32.9 SUs per week, and they had a substantially higher probability of posttreatment adherence to low-risk drinking recommendations. The fact that heavy drinkers decreased their alcohol consumption by amounts similar to those of non-heavy drinkers has favourable implications, as the health impact of a given reduction is greater at higher levels of alcohol consumption [68]. Despite the finding that many participants were still consuming beyond low-risk limits at posttreatment, the population health gains could nevertheless be substantial, in view of the high number of participants that can be reached with iAIs and the positive relationship between decreased alcohol consumption and the lower risks of physical and mental health disorders in the long term. These include earlier-onset dementia [69], several types of cancer [70], cardiovascular diseases [3] (Wood 2018), and depression and anxiety [68,69,71]. iAIs have great scaling potential, partly by virtue of their swift entry procedures for patients and the relatively low cost of repeated reuse, especially if unguided. For many people, iAIs could serve as a first step towards changing their problem-drinking behaviours and towards more intensive treatment, if needed.

In view of the constraints experienced with face-to-face BAIs in primary care settings, future studies should also explore various types of brief interventions, in order to gauge how problem drinkers in such settings can best be targeted. Those could be either face-to-face BAIs or iAIs, and the latter could be guided by general practitioners (GPs) or other professionals. For some patient populations, referral to unguided forms could be more beneficial [72]. More primary care studies are needed, however, including head-to-head comparisons of unguided versus guided versus face-to-face interventions. The same applies to the optimum treatment orientations and levels of intensity and duration [73,74]. As we have seen, not all treatment participants benefited from iAIs. We therefore need to better understand for which people such interventions work, how they work, and in what contexts (an approach also highlighted by Babor in 2008) [75,76]. A final observation is that some countries have now substantially lowered the advised limits for daily and weekly alcohol consumption, in response to mounting epidemiological evidence of health risks inherent in the conventional limits [77]. A threshold not exceeding 10 SUs of weekly alcohol consumption for both men and women has been proposed [3]. Future studies should correspondingly adjust their sample inclusion criteria based on units of alcohol consumption.

Supporting information

S2 Data. Request sharing variables file regarding individual RCT results.

RCT, randomised controlled trial.


S3 Data. Results, conventional meta-analysis update (1 January 2017 and 30 May 2018).


S4 Data. Data access contact list (first contact excluding coauthors).


S1 Text. MNAR additional information.

MNAR, missing-not-at-random.


S2 Table. Results, primary outcome ‘multiple imputation’.


S3 Table. Results, secondary outcome ‘multiple imputation’.


S1 Fig. Publication bias funnel plot (conventional meta-analysis).



We are grateful to Michael Dallas for his English language edits.


  1. 1. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet. 2013;382(9904):1575–86. pmid:23993280
  2. 2. Kelly S, Olanrewaju O, Cowan A, Brayne C, Lafortune L. Alcohol and older people: A systematic review of barriers, facilitators and context of drinking in older people and implications for intervention design. PLoS ONE. 2018;13(1):e0191189. Epub 2018/01/26. pmid:29370214
  3. 3. Wood AM, Kaptoge S, Butterworth AS, Willeit P, Warnakula S, Bolton T, et al. Risk thresholds for alcohol consumption: combined analysis of individual-participant data for 599 912 current drinkers in 83 prospective studies. Lancet. 2018;391(10129):1513–23. Epub 2018/04/21. pmid:29676281
  4. 4. Angus C, Latimer N, Preston L, Li J, Purshouse R. What are the Implications for Policy Makers? A Systematic Review of the Cost-Effectiveness of Screening and Brief Interventions for Alcohol Misuse in Primary Care. Frontiers in psychiatry. 2014;5:114. Epub 2014/09/17. pmid:25225487
  5. 5. Rehm J, Manthey J, Struzzo P, Gual A, Wojnar M. Who receives treatment for alcohol use disorders in the European Union? A cross-sectional representative study in primary and specialized health care. Eur Psychiatry. 2015;30(8):885–93. Epub 2015/12/10. pmid:26647862
  6. 6. Excellence NIfHaC. Alcohol-Use Disorders: Diagnosis, Assessment and Management of Harmful Drinking and Alcohol Dependence. Leicester (UK): The British Psychological Society & The Royal College of Psychiatrists; 2011.
  7. 7. Chan KK, Neighbors C, Gilson M, Larimer ME, Alan Marlatt G. Epidemiological trends in drinking by age and gender: providing normative feedback to adults. Addict Behav. 2007;32(5):967–76. Epub 2006/08/30. pmid:16938410
  8. 8. Miller WR, Rollnick S. Motivational Interviewing: Preparing people to change addictive behavior. New York: Guilford Press; 2002.
  9. 9. Kalden R, Caroll K, Donovan D, Cooney N, Monti P, Abrams D, et al. Cognitive behavioral Coping Skills Therapy Manual: A Clinical Research Guide for Therapists Treating Individuals With Alcohol Abuse and Dependence. In: Mattson MEM, editor. NIAAA Project MATCH Monograph Series. 3. Rockville, Md: National Institute on Alcoholism and Alcohol Abuse; 1992.
  10. 10. Hester RK. Behavioral self-control training. In: Hester RK, Miller WR, editors. Handbook of Alcoholism Treatment Approaches: Effective Alternatives. 2nd. Needham Heights, MA: Allyn and Bacon; 1995. p. 148–59.
  11. 11. McCambridge J, Saitz R. Rethinking brief interventions for alcohol in general practice. BMJ. 2017;356:j116. Epub 2017/01/22. pmid:28108452
  12. 12. Riper H, Cuijpers P. Telepsychology and eHealth. In: Norcross JCV, G.R.; Freedheim D.K., editor. APA handbook of clinical psychology: Applications and methods (Vol 3). 3: Applications and Methods: American Psychological Association; 2016. p. 451–63.
  13. 13. Wallace P, Bendtsen P. Internet applications for screening and brief interventions for alcohol in primary care settings—implementation and sustainability. Frontiers in psychiatry. 2014;5:151. Epub 2014/11/18. pmid:25400593
  14. 14. Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS ONE. 2014;9(6):e99912. Epub 2014/06/18. pmid:24937483
  15. 15. Sijborn M, Luijkx H, Boomsma L, Larsen IM, Burgers J, van der Weele G. [The Dutch College of General Practitioners' practice guideline 'Problem drinking']. Ned Tijdschr Geneeskd. 2015;159:A8646. Epub 2015/03/26. pmid:25804112
  16. 16. Kaner EFS, Beyer FR, Garnett C, Crane D, Brown J, Muirhead C, et al. Personalised digital interventions for reducing hazardous and harmful alcohol consumption in community-dwelling populations. Cochrane Database of Systematic Reviews. 2017;9:Cd011479. Epub 2017/09/26. pmid:28944453
  17. 17. Khadjesari Z, Murray E, Hewitt C, Hartley S, Godfrey C. Can stand-alone computer-based interventions reduce alcohol consumption? A systematic review. Addiction. 2011;106(2):267–82. Epub 2010/11/19. pmid:21083832
  18. 18. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42. Epub 2012/04/03. pmid:22466510
  19. 19. Boss L, Lehr D, Berking M, Riper H, Schaub MP, Ebert DD. Evaluating the (cost-) effectiveness of guided and unguided Internet-based self-help for problematic alcohol use in employees—a three arm randomized controlled trial. BMC Public Health. 2015;15:1043. Epub 2015/10/16. pmid:26458872
  20. 20. Brendryen H, Johansen A, Duckert F, Nesvag S. A Pilot Randomized Controlled Trial of an Internet-Based Alcohol Intervention in a Workplace Setting. Int J Behav Med. 2017;24(5):768–77. Epub 2017/07/30. pmid:28755326
  21. 21. Higgins JPT, Green S. Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. 2011.
  22. 22. Mongan DJL J. Standard drink measures throughout Europe; peoples’ understanding of standard drinks and their use in drinking guidelines, alcohol surveys and labelling. Dublin: 2015.
  23. 23. Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med. 1998;158(16):1789–95. Epub 1998/09/17. pmid:9738608
  24. 24. Khadjesari Z, Freemantle N, Linke S, Hunter R, Murray E. Correction: Health on the web: randomised controlled trial of online screening and brief alcohol intervention delivered in a workplace setting. PLoS ONE. 2015;10(4):e0127371. Epub 2015/04/29. pmid:25915505
  25. 25. Burke DL, Ensor J, Riley RD. Meta-analysis using individual participant data: one-stage and two-stage approaches, and why they may differ. Stat Med. 2017;36(5):855–75. Epub 2016/10/18. pmid:27747915
  26. 26. Vickers AJ, Altman DG. Statistics notes: Analysing controlled trials with baseline and follow up measurements. BMJ. 2001;323(7321):1123–4. Epub 2001/11/10. pmid:11701584
  27. 27. White IR, Thompson SG. Adjusting for partially missing baseline measurements in randomized trials. Stat Med. 2005;24(7):993–1007. Epub 2004/12/01. pmid:15570623
  28. 28. Szumilas M. Explaining odds ratios. J Can Acad Child Adolesc Psychiatry. 2010;19(3):227–9. Epub 2010/09/16. pmid:20842279
  29. 29. Kraemer HC, Kupfer DJ. Size of treatment effects and their importance to clinical research and practice. BiolPsychiatry. 2006;59(11):990–6.
  30. 30. White IR, Horton NJ, Carpenter J, Pocock SJ. Strategy for intention to treat analysis in randomised trials with missing outcome data. BMJ. 2011;342:d40. Epub 2011/02/09. pmid:21300711
  31. 31. Cohen J. Statistical power analyses for the behavioral sciences (revised ed.). New York: Academic Press; 1997.
  32. 32. Orsini N. BM, Higgins J., Buchan I. HETEROGI: Stata module to quantify heterogeneity in a meta‐analysis. Boston: Boston, MA: Department of Economics, 2006. p. Statistical Software Components.
  33. 33. Ioannidis JP, Patsopoulos NA, Evangelou E. Uncertainty in heterogeneity estimates in meta-analyses. BMJ. 2007;335(7626):914–6. Epub 2007/11/03. pmid:17974687
  34. 34. Stewart LA, Clarke M, Rovers M, Riley RD, Simmonds M, Stewart G, et al. Preferred Reporting Items for Systematic Review and Meta-Analyses of individual participant data: the PRISMA-IPD Statement. JAMA. 2015;313(16):1657–65. Epub 2015/04/29. pmid:25919529
  35. 35. Delrahim-Howlett K, Chambers CD, Clapp JD, Xu R, Duke K, Moyer RJ 3rd, et al. Web-based assessment and brief intervention for alcohol use in women of childbearing potential: a report of the primary findings. Alcohol Clin Exp Res. 2011;35(7):1331–8. Epub 2011/03/18. pmid:21410488
  36. 36. Doumas DM, Hannah E. Preventing high-risk drinking in youth in the workplace: a web-based normative feedback program. J Subst Abuse Treat. 2008;34(3):263–71. Epub 2007/06/30. pmid:17600650
  37. 37. Finfgeld-Connett D. Web-based treatment for rural women with alcohol problems: preliminary findings. Comput Inform Nurs. 2009;27(6):345–53. Epub 2009/11/11. pmid:19901570
  38. 38. Pemberton MR, Williams J, Herman-Stahl M, Calvin SL, Bradshaw MR, Bray RM, et al. Evaluation of two web-based alcohol interventions in the U.S. military. Journal of studies on alcohol and drugs. 2011;72(3):480–9. Epub 2011/04/26. pmid:21513685
  39. 39. Boon B. Preventie problematisch alcoholgebruik. In: Meijer SA, Smit F, Schoemaker CG, Cuijpers P, editors. Gezond verstand Evidence-based preventie van psychische stoornissen [Common sense Evidence-based prevention of mental disorders ] VTV Themarapport. Bilthoven: RIVM; 2006.
  40. 40. Saunders JB, Aasland OG, Babor TF, de lF Jr., Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption—II. Addiction. 1993;88(6):791–804. pmid:8329970
  41. 41. Hodgson R, Alwyn T, John B, Thom B, Smith A. The FAST Alcohol Screening Test. Alcohol Alcohol. 2002;37(1):61–6. Epub 2002/02/05. pmid:11825859
  42. 42. Araki I, Hashimoto H, Kono K, Matsuki H, Yano E. Controlled trial of worksite health education through face-to-face counseling vs. e-mail on drinking behavior modification. J Occup Health. 2006;48(4):239–45. Epub 2006/08/12. pmid:16902267
  43. 43. Bertholet N, Cunningham JA, Faouzi M, Gaume J, Gmel G, Burnand B, et al. Internet-based brief intervention for young men with unhealthy alcohol use: a randomized controlled trial in a general population sample. Addiction. 2015;110(11):1735–43. Epub 2015/07/16. pmid:26173842
  44. 44. Bischof G, Grothues JM, Reinhardt S, Meyer C, John U, Rumpf HJ. Evaluation of a telephone-based stepped care intervention for alcohol-related disorders: a randomized controlled trial. Drug Alcohol Depend. 2008;93(3):244–51. pmid:18054443
  45. 45. Blankers M, Koeter MW, Schippers GM. Internet therapy versus internet self-help versus no treatment for problematic alcohol use: A randomized controlled trial. J Consult Clin Psychol. 2011;79(3):330–41. Epub 2011/05/04. pmid:21534652
  46. 46. Boon B, Risselada A, Huiberts A, Riper H, Smit F. Curbing alcohol use in male adults through computer generated personalized advice: randomized controlled trial. J Med Internet Res. 2011;13(2):e43. Epub 2011/07/02. pmid:21719412
  47. 47. Boß L, Lehr D, Schaub MP, Paz Castro R, Riper H, Berking M, et al. Efficacy of a web-based intervention with and without guidance for employees with risky drinking: results of a three-arm randomized controlled trial. Addiction. 2018;113(4):635–46. Epub 2017/11/07. pmid:29105879
  48. 48. Brendryen H, Lund IO, Johansen AB, Riksheim M, Nesvag S, Duckert F. Balance—a pragmatic randomized controlled trial of an online intensive self-help alcohol intervention. Addiction. 2014;109(2):218–26. Epub 2013/10/19. pmid:24134709
  49. 49. Cunningham JA, Wild TC, Cordingley J, van Mierlo T, Humphreys K. A randomized controlled trial of an internet-based intervention for alcohol abusers. Addiction. 2009;104(12):2023–32. Epub 2009/11/20. pmid:19922569
  50. 50. Hansen AB, Becker U, Nielsen AS, Gronbaek M, Tolstrup JS, Thygesen LC. Internet-based brief personalized feedback intervention in a non-treatment-seeking population of adult heavy drinkers: a randomized controlled trial. J Med Internet Res. 2012;14(4):e98. Epub 2012/08/01. pmid:22846542
  51. 51. Hester RK, Squires DD, Delaney HD. The Drinker's Check-up: 12-month outcomes of a controlled clinical trial of a stand-alone software program for problem drinkers. J Subst Abuse Treat. 2005;28(2):159–69. Epub 2005/03/23. pmid:15780546
  52. 52. Khadjesari Z, Freemantle N, Linke S, Hunter R, Murray E. Health on the web: randomised controlled trial of online screening and brief alcohol intervention delivered in a workplace setting. PLoS ONE. 2014;9(11):e112553. Epub 2014/11/20. pmid:25409454
  53. 53. Postel MG, de Haan HA, ter Huurne ED, Becker ES, de Jong CA. Effectiveness of a web-based intervention for problem drinkers and reasons for dropout: randomized controlled trial. J Med Internet Res. 2010;12(4):e68. Epub 2010/12/18. pmid:21163776
  54. 54. Riper H, Kramer J, Smit F, Conijn B, Schippers G, Cuijpers P. Web-based self-help for problem drinkers: a pragmatic randomized trial. Addiction. 2008;103(2):218–27. Epub 2008/01/18. pmid:18199300
  55. 55. Schulz DN, Candel MJ, Kremers SP, Reinwand DA, Jander A, de Vries H. Effects of a Web-based tailored intervention to reduce alcohol consumption in adults: randomized controlled trial. J Med Internet Res. 2013;15(9):e206. Epub 2013/09/21. pmid:24045005
  56. 56. Sinadinovic K, Wennberg P, Johansson M, Berman AH. Targeting individuals with problematic alcohol use via Web-based cognitive-behavioral self-help modules, personalized screening feedback or assessment only: a randomized controlled trial. Eur Addict Res. 2014;20(6):305–18. Epub 2014/10/11. pmid:25300885
  57. 57. Suffoletto B, Kristan J, Callaway C, Kim KH, Chung T, Monti PM, et al. A text message alcohol intervention for young adult emergency department patients: a randomized clinical trial. Ann Emerg Med. 2014;64(6):664–72 e4. Epub 2014/07/16. pmid:25017822
  58. 58. Sundstrom C, Gajecki M, Johansson M, Blankers M, Sinadinovic K, Stenlund-Gens E, et al. Guided and Unguided Internet-Based Treatment for Problematic Alcohol Use—A Randomized Controlled Pilot Trial. PLoS ONE. 2016;11(7):e0157817. Epub 2016/07/08. pmid:27383389
  59. 59. Wallace P, Murray E, McCambridge J, Khadjesari Z, White IR, Thompson SG, et al. On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption. PLoS ONE. 2011;6(3):e14740. Epub 2011/03/17. pmid:21408060
  60. 60. Cunningham JA. Unintended impact of using different inclusion cut-offs for males and females in intervention trials for hazardous drinking. Addiction. 2017;112(5):910–1. Epub 2017/02/09. pmid:28168847
  61. 61. Riper H, Kramer J, Keuken M, Smit F, Schippers G, Cuijpers P. Predicting successful treatment outcome of web-based self-help for problem drinkers: secondary analysis from a randomized controlled trial. J Med Internet Res. 2008;10(4):e46. Epub 2008/11/27. pmid:19033150
  62. 62. Blankers M, Koeter MW, Schippers GM. Baseline predictors of treatment outcome in Internet-based alcohol interventions: a recursive partitioning analysis alongside a randomized trial. BMC Public Health. 2013;13:455. Epub 2013/05/09. pmid:23651767
  63. 63. Gold SM, Enck P, Hasselmann H, Friede T, Hegerl U, Mohr DC, et al. Control conditions for randomised trials of behavioural interventions in psychiatry: a decision framework. The lancet Psychiatry. 2017;4(9):725–32. Epub 2017/04/12. pmid:28396067
  64. 64. Jonas DE, Garbutt JC, Amick HR, Brown JM, Brownley KA, Council CL, et al. Behavioral counseling after screening for alcohol misuse in primary care: a systematic review and meta-analysis for the U.S. Preventive Services Task Force. AnnInternMed. 2012;157(9):645–54.
  65. 65. Kaner EF, Beyer FR, Muirhead C, Campbell F, Pienaar ED, Bertholet N, et al. Effectiveness of brief alcohol interventions in primary care populations. The Cochrane database of systematic reviews. 2018;2:CD004148. Epub 2018/02/25. pmid:29476653
  66. 66. Del Boca FK, Darkes J. The validity of self-reports of alcohol consumption: state of the science and challenges for research. Addiction. 2003;98 Suppl 2:1–12. Epub 2004/02/27. pmid:14984237
  67. 67. Babor TF, Caetano R. The trouble with alcohol abuse: what are we trying to measure, diagnose, count and prevent? Addiction. 2008;103(7):1057–9. Epub 2008/06/17. pmid:18554338
  68. 68. Rehm J, Roerecke M. Reduction of drinking in problem drinkers and all-cause mortality. Alcohol Alcohol. 2013;48(4):509–13. Epub 2013/03/28. pmid:23531718
  69. 69. Schwarzinger M, Pollock BG, Hasan OSM, Dufouil C, Rehm J, QalyDays Study G. Contribution of alcohol use disorders to the burden of dementia in France 2008–13: a nationwide retrospective cohort study. The Lancet Public health. 2018;3(3):e124–e32. Epub 2018/02/25. pmid:29475810
  70. 70. Bagnardi V, Rota M, Botteri E, Tramacere I, Islami F, Fedirko V, et al. Alcohol consumption and site-specific cancer risk: a comprehensive dose-response meta-analysis. Br J Cancer. 2015;112(3):580–93. Epub 2014/11/26. pmid:25422909
  71. 71. Boschloo L, Vogelzangs N, Smit JH, Van den Brink W, Veltman DJ, Beekman AT, et al. Comorbidity and risk indicators for alcohol use disorders among persons with anxiety and/or depressive disorders: findings from the Netherlands Study of Depression and Anxiety (NESDA). JAffectDisord. 2011;131(1–3):233–42.
  72. 72. Wallace P, Struzzo P, Della Vedova R, Scafuri F, Tersar C, Lygidakis C, et al. Randomised controlled non-inferiority trial of primary care-based facilitated access to an alcohol reduction website. BMJ open. 2017;7(11):e014576. Epub 2017/11/06. pmid:29102982
  73. 73. Elzerbi C, Donoghue K, Drummond C. A comparison of the efficacy of brief interventions to reduce hazardous and harmful alcohol consumption between European and non-European countries: a systematic review and meta-analysis of randomized controlled trials. Addiction. 2015;110(7):1082–91. Epub 2015/04/29. pmid:25916993
  74. 74. Moyer VA, Preventive Services Task F. Screening and behavioral counseling interventions in primary care to reduce alcohol misuse: U.S. preventive services task force recommendation statement. Ann Intern Med. 2013;159(3):210–8. Epub 2013/05/24. pmid:23698791
  75. 75. Babor TF. Treatment for persons with substance use disorders: mediators, moderators, and the need for a new research approach. IntJMethods PsychiatrRes. 2008;17(1 Suppl):S45–S9.
  76. 76. Gaume J, McCambridge J, Bertholet N, Daeppen JB. Mechanisms of action of brief alcohol interventions remain largely unknown—a narrative review. Frontiers in psychiatry. 2014;5:108. Epub 2014/09/11. pmid:25206342
  77. 77. Broholm K. GL, Gandin C., Ghirini S., Ghiselli A., Jones L., Martire S., Mongan D. MM, Mäkelä P., Rossi L., Sarrazin D., Scafato E., Schumacher J., R. S. Good practice principles for low risk drinking guidelines. Helsinki: National Institute for Health and Welfare (THL), 2016.