Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Pathological Buying Online as a Specific Form of Internet Addiction: A Model-Based Experimental Investigation

  • Patrick Trotzke,

    Affiliation Department of General Psychology: Cognition, University Duisburg-Essen, Duisburg, Germany

  • Katrin Starcke,

    Affiliation Department of General Psychology: Cognition, University Duisburg-Essen, Duisburg, Germany

  • Astrid Müller,

    Affiliation Department of Psychosomatic Medicine and Psychotherapy, Hannover Medical School, Hannover, Germany

  • Matthias Brand

    matthias.brand@uni-due.de

    Affiliations Department of General Psychology: Cognition, University Duisburg-Essen, Duisburg, Germany, Erwin L. Hahn Institute for Magnetic Resonance Imaging, Essen, Germany

Abstract

The study aimed to investigate different factors of vulnerability for pathological buying in the online context and to determine whether online pathological buying has parallels to a specific Internet addiction. According to a model of specific Internet addiction by Brand and colleagues, potential vulnerability factors may consist of a predisposing excitability from shopping and as mediating variable, specific Internet use expectancies. Additionally, in line with models on addiction behavior, cue-induced craving should also constitute an important factor for online pathological buying. The theoretical model was tested in this study by investigating 240 female participants with a cue-reactivity paradigm, which was composed of online shopping pictures, to assess excitability from shopping. Craving (before and after the cue-reactivity paradigm) and online shopping expectancies were measured. The tendency for pathological buying and online pathological buying were screened with the Compulsive Buying Scale (CBS) and the Short Internet Addiction Test modified for shopping (s-IATshopping). The results demonstrated that the relationship between individual’s excitability from shopping and online pathological buying tendency was partially mediated by specific Internet use expectancies for online shopping (model’s R² = .742, p < .001). Furthermore, craving and online pathological buying tendencies were correlated (r = .556, p < .001), and an increase in craving after the cue presentation was observed solely in individuals scoring high for online pathological buying (t(28) = 2.98, p < .01, d = 0.44). Both screening instruments were correlated (r = .517, p < .001), and diagnostic concordances as well as divergences were indicated by applying the proposed cut-off criteria. In line with the model for specific Internet addiction, the study identified potential vulnerability factors for online pathological buying and suggests potential parallels. The presence of craving in individuals with a propensity for online pathological buying emphasizes that this behavior merits potential consideration within the non-substance/behavioral addictions.

Introduction

Pathological buying (PB), compulsive buying, buying addiction, and oniomania are different terminologies describing the same phenomenon in which individuals are preoccupied with shopping, suffer from recurrent buying impulses or episodes, and lose control over their buying behavior [1,2]. This behavioral excess is related to severe negative consequences such as marked distress, social and occupational problems, delinquency, or financial bankruptcy. Estimates of prevalence deriving from studies in the U.S. and Germany range from 5.8 to 8.0% [35]. The clinical classification of this phenomenon is still under debate, which is reflected by the different terminologies: Although some authors argue that PB should be classified as impulse control disorder [6,7], others emphasize parallels to an obsessive-compulsive spectrum [2] or to behavioral addictions [8,9]. Therefore, in the current paper, we use the neutral term “pathological buying” in accordance with Müller et al. [10].

With respect to etiology and pathogenesis, different emotional (e.g., pleasure seeking or escape of negative emotions) and cognitive mechanisms (e.g., impulsivity, failure in self-regulation, or decision-making deficits) appear to be involved in the development and maintenance of PB [1113]. Currently, a growing number of authors emphasize that PB shares several key characteristics with behavioral addictions when comparing the proposed diagnostic criteria for behavioral addictions, which include preoccupation with the behavior, diminished control over the behavior, repeated unsuccessful attempts to cut down or stop the behavior, tolerance, withdrawal, and adverse psychosocial consequences [8,9,14]. More important, studies have also demonstrated cue-reactivity and craving for individuals with PB [15,16]. The parallels between gambling disorder and substance-use disorders, especially with respect to cue-reactivity and craving, led to reclassification of gambling disorder to the new diagnostic category of non-substance addictions within the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) [17].

Until now, there has been scarce research on PB in the context of the Internet, although in contrast to brick-and-mortar stores, the growth rates of Internet retailing are steadily increasing, which indicates that more and more individuals use online shopping to acquire consumer goods [18,19]. Hence, it is reasonable that problematic buying behaviors now also occur online [20,21]. Previous studies reported that the Internet provides characteristics that seem to encourage PB, such as the opportunity to buy 24 hours a day, to shop from the convenience of the private home, or to use easy payment systems that lead to inadvertent expenses [2224]. Therefore, the question remains whether online PB is a distinct clinical condition or whether it is the mere translation of PB in conventional retail environments to another medium [22].

In the research field of Internet addiction, Davis [25] was the first to differentiate between a generalized Internet addiction (GIA) and a specific Internet addiction (SIA). GIA is related to a multidimensional overuse of the Internet with a non-specific usage of one application in particular, whereas SIA is characterized by excessive preoccupations and overuse of one specific Internet application [25,26]. It has been postulated that nearly every Internet application can be used in a dysfunctional/addictive manner; the applications used most frequently in a dysfunctional/addictive manner are online gaming and gambling, social network sites, cybersex, and online shopping [2729].

Recently, Brand et al. [26] refined a model of Internet addiction that interlinks vulnerability factors, cognitions (coping styles, Internet use expectancies), and mechanisms of reinforcement in the context of GIA and SIA. One path within the model explaining the addictive use of one Internet application is the association between a predisposition to receive gratification by the application (as a person’s core characteristic) and the expectancy that the application satisfies specific desires (i.e., Internet use expectancies as a person’s specific cognition). Therefore, the experienced gratification is reinforcing and constitutes one key element in the development and maintenance of the SIA. However, to the best of our knowledge, this relationship has not yet been tested for online PB. Previous studies have described single vulnerability factors in the context of online PB. With respect to Internet use expectancies, different cognitions that especially motivate online PB have been described (such as buying unobserved, avoiding social interaction, the presence of a greater product variety, or the possibility to satisfy an urge to buy more quickly) [23,30]. With respect to a specific predisposition to receive gratification through the Internet application, there is empirical evidence that online PB is associated with higher reward responsiveness, excitement, and enjoyment [3133]. Given these rewarding features, one potential predisposing factor might constitute cue-reactivity in the context of addiction models [34]. In more detail, it is postulated that in the context of learning mechanisms, the rewarding effect of the drug becomes associated with addiction-related cues (e.g., surroundings, odors, or paraphernalia) leading to incentive salience for these cues [35,36]. This cue-reactivity is often operationalized with subjective ratings (e.g., arousal and urge) as well as physiological responses (e.g., heart rate, skin conductance, or skin temperature) towards addiction-related cues [37,38]. Cue-reactivity differs among individuals and seems suitable as an indicator of excitation from shopping (shopping excitability), which reflects rewarding features in the context of a potential predisposing factor. Transferring the model of Brand et al. [26] to online pathological buying, it is supposed that an individual who has the predisposition to be highly sensitive for excitation from shopping and has the expectation that the use of Internet shopping sites could meet specific needs and goals (e.g., the expectancy to satisfy an urge to buy more quickly online) may use shopping sites more frequently. The experienced gratification reinforces the predisposing shopping excitability as well as the online shopping expectancies, which results in the uncontrolled and addictive use of online shopping [26].

Cue-reactivity (i.e., the excitability from shopping cues) constitutes the emotional/motivational basis for experiencing craving [39,40]. Craving is commonly described as the irresistible desire to consume a substance and is associated with drug seeking and relapse [34]. The cue-reactivity and craving concept has been transferred to behavioral addictions such as gambling, online gaming, or cybersex use [4144]. Most recently, cue-reactivity and craving were demonstrated in conventional PB in the offline context [15,16]. To the best of our knowledge, cue-reactivity and craving has not been investigated in online PB so far.

The objectives of the current study were as follows: First, we aimed to determine whether online PB can be conceptualized as SIA because previous research gives reason to assume that online PB is associated with vulnerability factors similar to SIA, such as a higher shopping excitability and specific online shopping expectancies [23,30,32,33,45,46]. In accordance with the proposed SIA model by Brand et al. [26], it is hypothesized that the specific predisposition (shopping excitability) and Internet use expectancies (such as buying anonymously and avoiding social interaction, reaching a greater product variety, and satisfying an urge to buy more quickly) are related to online PB. The higher shopping excitability should not lead exclusively to online PB, but in the context of specific expectancies towards the Internet, online buying will be used with a greater probability, which in turn will lead to addictive use. Transferred to a statistical model, we expect that there is a positive relationship between shopping excitability (operationalized by experimentally induced cue-reactivity) and online PB. We further hypothesized that online shopping expectancies mediate the link between shopping excitability and online PB (Fig 1).

thumbnail
Fig 1. Illustration of the proposed mediation model.

The tendencies towards online pathological buying are assumed to be predicted by the predisposing factor shopping excitability (operationalized by variables of cue-reactivity) and online shopping expectancies (operationalized by motives to shop and buy on the Internet). The expectancies should mediate the relationship between shopping excitability and tendencies towards online pathological buying. The direct effect is indicated by the continued arrow; the indirect effects are drawn dashed.

https://doi.org/10.1371/journal.pone.0140296.g001

Second, in line with other specific forms of Internet addiction (such as cybersex addiction, gaming, etc.) and conventional PB, we expected a positive relationship between measurements of craving and online PB tendency. Due to the assumed reinforcing effect of buying and the higher shopping excitability in addicted individuals, we hypothesized an increase in craving after exposure to online shopping-related pictures in individuals with a high propensity for online PB and not in individuals with a low propensity.

Third, as outlined before, there is still debate on whether online PB should be considered a distinct clinical condition or a virtual translation of conventional PB. In line with Davis [25], who has argued that in the case of SIA, the pathology could also be developed outside the Internet, we hypothesized that there is a positive relationship between conventional PB and online PB behavior.

Material and Methods

Participants

We investigated 240 female participants (mean age M = 26.63, SD = 10.39, range: 18–64 years; average education duration M = 12.34, SD = 1.42 years). Only women were included because women were more often represented in clinical samples for PB [1,7,47] and we used online shopping pictures that were selected specifically for women (see section Cue-reactivity paradigm). The participants were recruited via posted flyers at the University Duisburg-Essen and online advertisement in university internal networks. To take part in the study, participants should have bought products online at least once in the last 12 months. The data were collected between January and July 2014. On average, participants spent M = 22.93 (SD = 19.26) hours online per week, using M = 2.84 (SD = 3.94) hours for online shopping. All participants took part on a voluntary basis, were not paid, and gave their written informed consent prior to the study. The study was approved by the local ethics committee of the University Duisburg-Essen. The investigation had been conducted according to the principles expressed in the Declaration of Helsinki. The primary sample consisted of 244 female participants, but four participants had to be excluded due to incomplete data sets.

Instruments

We first evaluated sociodemographic variables to describe the sample in detail; afterwards, we applied the tests described below. All data were collected by trained investigators in a one-to-one setting with Lime Survey (www.limesurvey.org), an open source survey application that was installed on a local server.

Short Internet Addiction Test for online shopping.

To assess online PB, we used the Short Internet Addiction Test (s-IAT) [48] and modified the items with respect to online shopping (s-IATshopping). The terms “Internet” and “online” were replaced by “Internet shopping sites” or “online shopping activity”. One example is “How often do you try to cut down the amount of time you spend on Internet shopping sites and fail?” This procedure has been used frequently to assess the severity of dependence for specific Internet applications such as online gaming or cybersex [43,49,50]. Twelve items had to be answered on a five point rating scale ranging from 1 (never) to 5 (very often). A sum score was computed ranging from 12 to 60. The s-IAT has good psychometric properties and a sum score > 30 indicates problematic Internet use and a score > 37 a pathological use [48]. The s-IATshopping consists of two subscales: “control/time management” (s-IATshopping I) and “craving/social problems” (s-IATshopping II), which had good internal consistencies in our sample (for the s-IAT I, Cronbach’s α = .85 and for the s-IATshopping II, α = .82).

Compulsive buying scale.

The compulsive buying scale (CBS) [51] in the validated German version [4] was used to assess a tendency towards PB. It is the most frequently used screener to assess PB in conventional offline retail environments. Seven items had to be answered on five point rating scale ranging from 1 (very often or agreement) to 5 (never or disagreement). A total score was calculated using a regression formula [51]. The original scale ranges from -7.02 to 3.61 and in the validated German version, a cut-off criterion of ≤ -1.09 defines individuals as being at-risk for PB with lower scores in the CBS indicate stronger PB symptoms [4]. In our current study, we inverted the CBS total score in order to ensure that all measurements have positive correlations to get more intuitive values. This means that lower values indicate a lower tendency towards PB symptomatology and higher scores indicate a higher tendency towards PB symptomatology. Hence, the transformed scale ranges from -3.61 to 7.02 and a cut-off criterion of ≥ 1.09 indicates PB. Within the current study, we revealed good internal consistencies (Cronbach’s α = .81).

Online shopping expectancies.

Inspired by the work of Kukar-Kinney et al. [30], we adopted already existing items and added new items to assess different motives to shop and buy on the Internet. The resulting 20 items had to be answered on a five point rating scale ranging from 1 (absolute disagreement) to 5 (absolute agreement). In a first step, we extracted three factors using Horn’s parallel analysis [52]. In a second step, using exploratory factor analysis (with promax rotation), the items loaded on the following factors: “buying anonymously/avoiding social interaction”, “buying availability/product variety”, and “immediate positive feelings”. In contrast to Kukar-Kinney et al. [30], the factors “buying anonymously” and “avoiding social interaction” yielded one factor due to similarities in regard to content. Furthermore, due to non-loadings, five items were excluded, resulting in a final questionnaire consisting of 15 Items. The items and the results for the factor analysis are presented in S1 Table. The three resulting subscales had good internal consistencies (Cronbach’s α for “buying anonymously/avoiding social interaction”, α = .85, for “buying availability/product variety”, α = .84, and for “immediate positive feelings”, α = .86).

Cue-reactivity paradigm.

We applied a cue-reactivity paradigm with online shopping pictures to assess shopping excitability, which has been often used in addiction research [53,54]. The paradigm contained distal and proximal shopping pictures because it has been shown that both types of cues elicit craving reactions in individuals suffering from PB [15,55]. The distal shopping pictures were generally related to online shopping and showed cues such as the cover pages of online shopping sites, shopping cart symbols, or payment buttons. The proximal shopping cues contained pictures of specific online shopping products that female pathological buyers usually prefer to buy (i.e., housewares, cosmetics, clothes, shoes, books, jewelries, leatherware, and CD/DVDs; for examples of distal and proximal cues, see S1 Fig) [47,56,57]. The pictures were presented randomly on a screen in a size of 700 x 500 pixels, and the participants had to rate these cues with respect to arousal and urge to buy on a five-point rating scale ranging from 1 (not at all) to 5 (very).

Craving assessment.

Craving reactions were assessed by using a modified version of the Desires of Alcohol Questionnaire (m-DAQ) [58], which has been modified in recent studies to determine craving reactions towards buying [15,55]. The 14 Items had to be rated on a 7 point rating scale from 0 (absolute disagreement) to 6 (absolute agreement). The mean score was calculated after recoding two inverted items. The questionnaire was administered twice, before and after the presentation of the buying-related pictures within the cue-reactivity paradigm (pre- and post-craving measurement). The internal consistencies for the pre- and post-application were good (Cronbach’s α for the DAQ-pre, α = .85, and for the DAQ-post, α = .88).

Statistical analyses

With respect to the proposed mediation model, we operationalized the latent variables as follows: The arousal rating and the urge to buy rating of the cue-reactivity paradigm represent the latent dimension “shopping excitability”, whereas the different motives (“buying anonymously/avoiding social interaction”, “buying availability/product variety”, and “immediate positive feelings”) represented the latent dimension “online shopping expectancies”, which represents the hypothesized mediator. The s-IATshopping I (“control/time management”) and the s-IATshopping II (“craving & social problems”) represented the latent dimension “tendencies towards online PB”, which is the proposed dependent variable. All of the requirements for mediation modeling suggested by Baron and Kenny [59] were fulfilled. For the evaluation of the model fit, we applied the standard indices and cut-off criteria [60]: The standardized root mean square residual (SRMR; values below 0.08 indicate good fit with the data), the comparative fit index (CFI), the Tucker Lewis index (TLI; values above 0.90 indicate a good fit, values above 0.95 an excellent fit), and the root mean square error of approximation (RMSEA; “test of close fit”; a value below 0.08 with a significance value below 0.05 indicates acceptable fit). Basic statistical analyses were performed using SPSS 22 (IBM Corp., Armonk, USA) and structural equation modeling was performed using MPlus 6.0 [61]. For the bivariate correlational analysis, we applied Pearson’s correlations. With respect to the craving reactions, we divided the sample and compared the participants who scored one standard deviation below and one standard deviation above the mean score of the s-IATshopping (see section Craving reactions within the results). The craving reactions were analyzed using analysis of variance (ANOVA), with the between-subject factor “group” (scoring low vs. scoring high for online PB) and the within-subject factor “time” (pre- vs. post-craving measurement). The effect sizes were determined by using partial η² (ηp²). Post-hoc t-tests were performed, and Cohen’s d [62] was calculated to indicate effect sizes. To evaluate diagnostic concordances and divergences, the described cut-off criteria (see section Instruments) were used for the CBS and the s-IAT-shopping to describe the number of classified participants and calculate the interrater reliability (Cohen’s Kappa; κ).

Results

A description of the variables used in the questionnaires and the experimental paradigm are shown in Table 1.

thumbnail
Table 1. Description of the questionnaires and the experimental paradigm.

s-IATshopping = Short Internet Addiction Test modified for shopping; CBS = Compulsive Buying Scale

https://doi.org/10.1371/journal.pone.0140296.t001

Shopping excitability and online shopping expectancies

For the mediation model, the relevant variables were entered into the mediation model in accordance with the hypotheses. The effect sizes of the correlations between the manifest variables are moderate to high and are presented in Table 2. The model fits well with the data (CFI = .97; TLI = .95; RMSEA = .09, p < .05; SRMR = .034), although the RMSEA was somewhat high. For the whole model, the χ²-test was significant (χ² = 33.76, df = 11, p < .001), but the χ²/df ratio was next to 3. Overall, 74.2% of the variance within online PB was explained (R² = .742, p < .001). The direct and indirect effects are shown in Fig 2.

thumbnail
Fig 2. Results for the structural equation model.

The factor loadings of the latent dimensions and the β-weights with the significance, as well as the total direct and total indirect effects, are depicted. e = error *** p < .001, ** p < .01, * p < .05

https://doi.org/10.1371/journal.pone.0140296.g002

thumbnail
Table 2. Correlations of the manifest variables of the mediation model.

The manifest variables “Urge to buy” and “Arousal” were assessed experimentally using the cue-reactivity paradigm, whereas the variables “Variety”, “Anonym”, and “Immediate positive feelings” were assessed by questionnaire. s-IATshopping = Short Internet Addiction Test modified for shopping

https://doi.org/10.1371/journal.pone.0140296.t002

The direct effect of the predictor “shopping excitability” on the criterion “tendencies towards online PB” was significant (β = .186, SE = .08, p < .05). The direct effect from the predictor “shopping excitability” to the mediator “online shopping expectancies” was also significant (β = .617, SE = .05, p < .001), as well as the effect from the mediator “online shopping expectancies” to the criterion “tendencies towards online PB” (β = .734, SE = .08, p > .001). Furthermore, the total indirect effect from “shopping excitability” over “online shopping expectancies” to “tendencies towards online PB” was significant (β = .453, SE = .07, p < .001). Given that the direct effect remained significant after including the mediator, a partial mediation was observed.

Craving reactions

There were high correlations between the s-IATshopping and the craving before the online shopping picture presentation (pre-carving; r = .556, p < .001), as well as after the picture presentation (post-craving; r = .580, p < .001). To demonstrate that the increase in craving was solely observed in the individuals scoring high for online PB, we divided the sample and compared the participants who scored one standard deviation below and one standard deviation above the mean score of the s-IATshopping. A total of n = 49 participants scored at the upper and lower limits of the distribution. To compare the means of the respective craving scores, we used ANOVA with the between-subject factor “group” (scoring low vs. scoring high for online PB) and the within-subject factor “time” (pre- vs. post-craving measurement). We observed a significant main effect for “group”, F(1, 47) = 43.99, p < .001, ηp² = 0.48; and a significant main effect for “time”, F(1, 47) = 6.09, p < .01, ηp² = .12. The significant “group × time” interaction, F(1, 47) = 4.80, p < .05, ηp² = .09, indicated that the participants scoring high or low for online PB reacted differently across the two administration times. Post-hoc t-tests revealed an increase in craving after the picture presentation, t(28) = 2.98; p < .01, d = 0.44 for the individuals scoring high for online PB, whereas no changes were observed for individuals scoring low, t(28) = .35, p = .73, d = 0.04. In addition, the participants scoring high for online PB showed higher cravings before (t(47) = 6.08, p < .001, d = 1.81) and after (t(47) = 6.32, p < .001, d = 1.88) the picture presentation in comparison with the individuals scoring low for online PB (Fig 3).

thumbnail
Fig 3. Subjective craving reactions.

Results with respect to the craving reactions pre- and post-cue presentation for the participants scoring high and low on the s-IAT-shopping. Error bars represent standard deviation (SD). *** p < .001, n.s. = not significant.

https://doi.org/10.1371/journal.pone.0140296.g003

Clinical screening instruments

There was a strong correlation between the s-IATshopping and the CBS, r = .517, p < .001 (note that CBS total scores were inverted). Fig 4 depicts the frequencies of individuals detected as having PB (screened by the CBS with total scores > 1.09) and problematic as well as pathological use in the online context (screened by the s-IATshopping with problematic scores > 30 and pathological scores > 37). By applying the described cut-off criteria, some of the individuals within our samples were classified as pathological buyers solely by the CBS (n = 24), whereas some were classified as having problematic online buying behavior solely by the s-IATshopping (n = 7). In addition, there was an overlap of n = 8 participants (3.3%) fulfilling the criteria for pathological buying behavior as assessed by the CBS and the s-IAT-shopping. This overlap is evaluated as only mild with κ = .278, p < .001.

thumbnail
Fig 4. Frequencies of participants with problematic buying behavior.

Illustration of the frequencies of those participants who were screened as pathological buyers by the Compulsive Buying Scale (CBS; total score > 1.09) and as problematic/pathological buyers by the Short Internet Addiction Test modified for shopping (s-IATshopping; problematic score > 30; pathological score > 37). Whole sample size N = 240.

https://doi.org/10.1371/journal.pone.0140296.g004

Discussion

This study investigated whether online PB can be conceptualized as a SIA by investigating vulnerability factors for online PB, such as shopping excitability, specific Internet use expectancies and craving. Furthermore, the relationship of online PB and conventional PB measurements was investigated to explore whether online PB can be conceptualized as being independent from conventional PB. The results demonstrated, in line with the proposed model for SIA by Brand et al. [26], that the relationship of shopping excitability and the tendency towards online PB was partially mediated by the online shopping expectancies. Furthermore, craving reactions were correlated with online PB, and an increase in craving was observed after picture exposure only in those individuals who scored high for online PB. In addition, it was demonstrated that the two screening instruments (CBS and s-IATshopping) were correlated moderately, but there were differences and overlaps with respect to the diagnostic properties when applying the proposed cut-off scores. The results should be discussed in the context of the “Internet addiction” concept and with respect to mechanisms potentially contributing to the development and maintenance of addictive disorders.

Indicators of shopping excitability predicted online PB tendencies. One strength of the study is that shopping excitability was operationalized experimentally using variables of cue-reactivity (arousal and urge to buy) instead of questionnaire self-reports. Previous research demonstrated that drug-relevant cue exposure activated a generalized motivational state (including arousal), which is strongly related to reward approach behavior in addicted individuals [34,36]. Anticipating and receiving reward has been noted to be important in the development and maintenance of substance and non-substance-related addictions such as gambling disorder, pathological online gaming, or pathological cybersex use [41,44,63]. The rewarding and exciting nature of buying was demonstrated in previous studies in the conventional [7] and in the online context [31,32,64]. Therefore, the act of buying was described as being used to modulate mood and provide relief or escape from negative emotions [57,65]. Given these parallels, we argue for the addictive nature of buying in the online context.

The higher sensitivity for excitation from shopping does not lead exclusively to the buying pathology. Further influencing factors include expectations that buying on the Internet meets specific needs and goals. In accordance with Kukar-Kinney et al. [30], we explored three different expectancies that motivate especially online buying in contrast to conventional brick-and-mortar store buying. These expectancies were as follows: (1) buying anonymously and avoiding social interaction, (2) buying availability and reaching a greater product variety, and (3) receiving immediate positive feelings. Previous research showed that individuals with PB feel shame and regret after their buying episodes, so it is plausible that they may not want others (especially family members) to see what, how much, and how often they buy [10,30]. In addition, anxiety (especially social anxiety) is often associated with PB [66]. Consequently, the anonymity and the non-existent social interaction within the online shopping environment may intensify the preference for buying online [30]. A greater variety of products and brands and the perpetual availability provide a way for pathological buyers to achieve greater and more direct positive feelings [30], and it is proposed that the Internet with its ease, availability and convenience should satisfy needs and desires more instantly in contrast to conventional shopping [22,30]. Previous studies already emphasized the importance of specific expectancies in association with online PB [23,24,64]. Consistent with our results, Dittmar et al. [24] demonstrated that emotional and identity-related expectancies mediate the relationship between a predisposing factor (materialistic value orientation) and online PB tendencies.

Altogether, there is empirical evidence that the phenomenon of online PB is associated with specific factors of vulnerability (a predisposing shopping excitability and online shopping use expectancies), and these factors are interlinked as proposed in the currently published model for SIA by Brand et al. [26]. The model revealed that online PB is not singularly explained by specific predispositions such as excitability from shopping. The results demonstrated that Internet use expectancies were associated with online PB and partially mediated the relationship between shopping excitability and online PB tendencies, which increases the probability of using online shopping sites excessively. It is assumed that individuals with a high sensitivity for excitability from shopping who have the expectancy that online shopping meets specific needs and goals should be more prone to gratification from online buying and should therefore be more at risk for developing online PB. This means that it is suggested that a general excitability is not enough to develop online PB. Only if individuals also have the expectancy that their desires can be satisfied by online shopping (which is impacted by the predisposing factors), they use such Internet applications and experience gratification, which in turn reinforces the expectancies. This mediation model explained a great proportion of the variance (74.2%) within the tendency towards online PB measured by the s-IATshopping. More importantly, the predisposition for excitability from shopping determines why individuals develop the expectancy that using online shopping sites can satisfy their desires and then use online shopping sites addictively and not, for example, cybersex sites. The study, although preliminary, suggests parallels between online PB and SIA. This is the first study that tries to conceptualize the phenomenology of online PB in the context of Internet addiction, and the interpretations should be taken with care. However, this attempt has the advantage that it provides a theoretical base for testing hypotheses to confirm or refute conceptualizations of Internet addiction.

In addiction theory, it is postulated that cue-reactivity and craving have been fundamental mechanisms within the development and maintenance of addictions [36]. Cue-reactivity represents the manner in which addiction-related cues become associated with the reinforcing mechanisms of the drug and has been used to operationalize excitability from shopping (i.e., arousal and urge to buy ratings) [35,39]. However, cue-induced sensitization of incentive motivational processes and brain functions (especially the mesolimbic dopaminergic system) provide the emotional/motivational basis for experiencing craving [36,40,67,68]. Our results demonstrated that individuals who score high for online PB show higher cravings (assessed by the questionnaire) before and after cue exposure–in contrast to individuals scoring low, who were non-reactive. These findings coincide with studies showing cue-reactivity and craving reactions for PB patients in conventional buying environments [15,16]. Previous research demonstrated similarities between individuals with substance addictions and behavioral addictions (i.e., gambling disorder) with respect to cue-induced craving on subjective and brain functional levels [6971]. In consequence, within the DSM-5, the concept of substance abuse and dependency has been extended to the new diagnostic category of non-substance-related addictions [17]. Until now, only gambling disorder has been included, but it has been mentioned that Internet gaming disorder is one condition with a current need for further research [17]. It has already been argued that the addictive use of the Internet can also focus on other applications such as cybersex, shopping, or social network sites [26,29]. To the best of our knowledge, this is the first study demonstrating cue-induced craving in online PB. Given the parallels to other behavioral addictions and to the concept of Internet addiction, we suggest a potential consideration of online PB in the context of SIA within the category of behavioral/non-substance-related addictions. As outlined before, these are preliminary results, and the empirical basis for these considerations is not sufficiently evaluated; more research is needed to better understand the phenomenology and clinical aspects of the pathological behavior.

With respect to the question of whether online PB is only “an old problem in a new marketplace” ([22] p. 739), the results demonstrated that the s-IATshopping and the CBS were moderately correlated. Previous studies reported heterogeneous findings, and PB was sometimes related to a dysfunctional use of the Internet [64,72], and sometimes not [24,32]. However, most studies published in the context of online PB have been conducted without differentiating between GIA and SIA. Therefore, it is probable that in the case of non-correlation, the applied questionnaires reflect instead a general dysfunctional use of the Internet, for instance, an addictive use without a first-choice application (conceptualized as GIA). Online PB has characteristics of a SIA (as shown by the mediation model), and it seems that the phenomenon has to be screened specifically (e.g., using the s-IAT shopping instead of the original IAT or comparable scales). This circumstance indicates again parallels between online PB and SIA. In line with this assumption, by applying the proposed cut-off criteria for the screening instruments (CBS & s-IATshopping), there were individuals who were screened as pathological buyers solely either by the s-IATshopping or by the CBS, which indicated that there seemed to be specific features in the online context that could only be detected by specific screening instruments. This argument is supported by the study of LaRose and Eastin [64], who demonstrated that Internet domain-specific measurements were related to unregulated online buying, whereas offline measures were not. However, our findings also demonstrated that there are diagnostic concordances indicating that some individuals with pathological tendencies could be classified by both instruments. We interpret these findings, in line with Davis [25], as implying that PB could also be developed outside the Internet and that the online environment with its specific features (such as advertising pop-ups, timed discount offers, and vivid graphical displays) could aggravate the pathology.

The parallels between online PB and specific Internet addiction provide some clinical implications that should be sketched briefly. There is evidence that within the therapeutic context, cognitive-behavioral therapy (CBT) is the method of choice for the treatment of both PB [73,74] and Internet addiction [75,76]. With respect to our results, specific predispositions and cognitions seem to be related to the problematic behavior. Consequently, as proposed in the review by Brand et al. [26], self-monitoring techniques could be used to determine situational, emotional, and cognitive conditions as well as patterns of positive and negative reinforcement associated to PB. Furthermore, cognitive restructuring and reframing could be applied to change the described Internet use expectancies and negative feelings could be applied to establish new healthy buying patterns. Due to cue-reactivity for individuals with a high tendency for online PB, future therapeutic trials should explore the efficacy of cue-exposure or stimulus control techniques in the treatment context.

The current findings should also be discussed in light of some limitations. The main proportion of the sample was composed of female students, which limits the generalizability to the female German population. Another limiting factor may derive from the circumstance that income and ethnicity were not assessed. However, the goal of the study was to examine online PB, and the student sample seems suitable because it has often been reported that younger people use the Internet more frequently for shopping and younger age is an important predictor for PB [35]. Taking into account that students in Germany have good, interest-free credit accounts and the assumption that PB is not linked to education, the sample is comparable with young female adults in full-time employment.

Within our non-clinical sample, we did not control for potential influencing emotional factors (such as depression or anxiety) and did not assess confounding psychiatric comorbid conditions (e.g., obsessive-compulsive disorder or hoarding disorder). Future studies should control for potential influencing factors such as depression, anxiety and comorbid conditions to improve the specificity of the results with respect to addictive disorders. With respect to female samples, future studies should assess the menstrual cycle because it is known to influence craving for other behaviors such as smoking and eating [77,78].

Another limitation is that online shopping expectancies were measured by a newly developed questionnaire that had not been tested previously. Although the validity is not completely evaluated, the item development was inspired by a previous work of Kukar-Kinney et al. [30], and we revealed a similar factor structure using exploratory factor analysis with good internal consistencies. Furthermore, there is no valid scale to screen online PB. Due to this circumstance, we used the s-IAT in a modified version for shopping and applied the cut-off criteria, which derived from investigations towards Internet addiction in a German sample. This procedure had often been applied in studies investigating the pathological use of specific online activities such as gaming, or cybersex [42,49].

Future studies should investigate further vulnerability and cognitive factors potentially related to online PB (e.g., stress vulnerability, psychopathologies, or coping styles). Likewise, it would make sense to investigate male participants because population-based surveys indicated that there were no gender differences with respect to the prevalence of PB [3,4]. Within this first study, cue-reactivity and craving were investigated by subjective valuations, so future aims should focus on the assessment of peripheral physiological responses (e.g., electrodermal activity, skin temperature, or heart rate) and brain activity using functional techniques like previous studies on Internet addiction [44,79]. Finally, the presented model should be tested in clinical samples with patients suffering from online PB.

Conclusion

The study provided the first indications of potential vulnerability factors for online PB (i.e., excitability from shopping and specific Internet use expectancies), which suggests parallels to SIA. Given the parallels between online PB and other addictions with regard to craving, we argue for a potential consideration of online PB within the diagnostic category of non-substance/behavioral addictions. The applied screening instruments supported this view and led to the assumption that there are distinct features in the online context requiring specific screening instruments for online PB.

Supporting Information

S1 Fig. Example for the stimuli of the cue-reactivity paradigm.

(A) distal online shopping cue (content of a shopping cart); and (B, C) proximal online shopping cues (clothes, cosmetics).

https://doi.org/10.1371/journal.pone.0140296.s001

(PPTX)

S1 Table. Factor loadings and means of the items of the Internet shopping use expectancies questionnaire.

https://doi.org/10.1371/journal.pone.0140296.s002

(DOCX)

Acknowledgments

All authors reported no conflict of interests and have no financial disclosures. We would like to thank Julia Janouch for data handling and technical support within the project.

Author Contributions

Conceived and designed the experiments: PT KS AM MB. Performed the experiments: PT KS. Analyzed the data: PT KS MB. Contributed reagents/materials/analysis tools: MB. Wrote the paper: PT KS AM MB.

References

  1. 1. McElroy SL, Keck PE, Pope HG, Smith JM, Strakowski SM. Compulsive buying: A report of 20 cases. J Clin Psychiatry. 1994;55: 242–248. pmid:8071278
  2. 2. Ridgway NM, Kukar-Kinney M, Monroe KB. An expanded conceptualization and a new measure of compulsive buying. J Consum Res. 2008;35: 622–639.
  3. 3. Koran LM, Faber RJ, Aboujaoude E, Large MD, Serpe RT. Estimated prevalence of compulsive buying behavior in the United States. Am J Psychiatry. 2006;163: 1806–1812. pmid:17012693
  4. 4. Mueller A, Mitchell JE, Crosby RD, Gefeller O, Faber RJ, Martin A, et al. Estimated prevalence of compulsive buying in Germany and its association with sociodemographic characteristics and depressive symptoms. Psychiatry Res. 2010;180: 137–142. pmid:20494451
  5. 5. Neuner M, Raab G, Reisch LA. Compulsive buying in maturing consumer societies: An empirical re-inquiry. J Econ Psychol. 2005;26: 509–522.
  6. 6. Black DW. Compulsive buying disorder: Definition, assessment, epidemiology and clinical management. CNS Drugs. 2001;15: 17–27. pmid:11465011
  7. 7. Christenson GA, Faber RJ, de Zwaan M, Raymond NC, Specker SM, Ekern MD, et al. Compulsive buying: Descriptive characteristics and psychiatric comorbidity. J Clin Psychiatry. 1994;55: 5–11. pmid:7989292
  8. 8. Grüsser SM, Thalemann C, Albrecht U. [Excessive compulsive buying or “behavioral addiction”? A case study]. Wien Klin Wochenschr. 2004;116: 201–204. pmid:15088996
  9. 9. Hollander E, Allen A. Is compulsive buying a real disorder, and is it really compulsive? Am J Psychiatry. 2006;163: 1670–1672. pmid:17012670
  10. 10. Müller A, Mitchell JE, de Zwaan M. Compulsive buying. Am J Addict. 2015;24: 132–137. pmid:25864601
  11. 11. Kyrios M, Frost RO, Steketee G. Cognitions in compulsive buying and acquisition. Cognit Ther Res. 2004;28: 241–258.
  12. 12. Kellett S, Bolton J V. Compulsive buying: A cognitive-behavioural model. Clin Psychol Psychother. 2009;16: 83–99. pmid:19229837
  13. 13. Faber RJ, Vohs K. Self-regulation and spending: Evidence from impulsive and compulsive buying. In: Vohs KD, Baumeister RF, editors. Handbook of self-regulation: Research, theory, and applications. 2nd ed. New York, NY: Guilford Press; 2011. pp. 537–550.
  14. 14. Grant JE, Potenza MN, Weinstein A, Gorelick DA. Introduction to behavioral addictions. Am J Drug Acohol Abus. 2010;36: 233–241.
  15. 15. Trotzke P, Starcke K, Pedersen A, Brand M. Cue-induced craving in pathological buying: Empirical evidence and clinical implications. Psychosom Med. 2014;76: 694–700. pmid:25393125
  16. 16. Lawrence LM, Ciorciari J, Kyrios M. Cognitive processes associated with compulsive buying behaviours and related EEG coherence. Psychiatry Res. 2014;221: 97–103. pmid:24239477
  17. 17. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington, DC: American Psychiatric Publishing; 2013.
  18. 18. Agarwal V, Ganesh L. E-shopping: An extended technology innovation. J Res Mark. 2014;2: 119–126.
  19. 19. Schultz DE, Block MP. U.S. online shopping: Facts, fiction, hopes and dreams. J Retail Consum Serv. 2015;23: 99–106.
  20. 20. Lloyd N. Exploring the role of product involvement in shaping impulsive buying tendencies in online retail environments. J Promot Commun. 2014;2: 87–112.
  21. 21. Chen K, Tarn J, Han B. Internet dependency: Its impact on online behavioral patterns in e-commerce. Hum Syst Manag. 2004;23: 49–58.
  22. 22. Lyons B, Henderson K. An old problem in a new marketplace: Compulsive buying on the Internet. Proceedings of ANZMAC. 2000. pp. 739–744.
  23. 23. LaRose R. On the Negative Effects of E-Commerce: A Sociocognitive Exploration of Unregulated On-line Buying. J Comput Commun. 2006;6: 0–0.
  24. 24. Dittmar H, Long K, Bond R. When a better self is only a button click away: Associations between materialistic values, emotional and identity–related buying motives, and compulsive buying tendency online. J Soc Clin Psychol. 2007;26: 334–361.
  25. 25. Davis RA. A cognitive-behavioral model of pathological Internet use. Comput Human Behav. 2001;17: 187–195.
  26. 26. Brand M, Young KS, Laier C. Prefrontal control and internet addiction: A theoretical model and review of neuropsychological and neuroimaging findings. Front Hum Neurosci. 2014;8: 1–13. pmid:24474914
  27. 27. Brand M, Laier C, Young KS. Internet addiction: coping styles, expectancies, and treatment implications. Front Psychol. 2014;5: 1–14. pmid:24474945
  28. 28. Kuss D, Griffiths M, Karila L, Billieux J. Internet addiction: A systematic review of epidemiological research for the last decade. Curr Pharm Des. 2014;20: 4026–4052. pmid:24001297
  29. 29. Young K, Pistner M, Mara JO, Buchanan J. Cyber Disorders: The mental health concern for the new millenium. Cyberpsychology Behav. 1999;2: 475–480.
  30. 30. Kukar-Kinney M, Ridgway NM, Monroe KB. The relationship between consumers’ tendencies to buy compulsively and their motivations to shop and buy on the Internet. J Retail. 2009;85: 298–307.
  31. 31. Claes L, Müller A, Norré J, Van Assche L, Wonderlich S, Mitchell JE. The relationship among compulsive buying, compulsive internet use and temperament in a sample of female patients with eating disorders. Eur Eat Disord Rev. 2012;20: 126–131. pmid:21710571
  32. 32. Duroy D, Gorse P, Lejoyeux M. Characteristics of online compulsive buying in Parisian students. Addict Behav. 2014;39: 1827–1830. pmid:25128635
  33. 33. Rose S, Dhandayudham A. Towards an understanding of Internet-based problem shopping behaviour: The concept of online shopping addiction and its proposed predictors. J Behav Addict. 2014;3: 83–89. pmid:25215218
  34. 34. Drummond DC. Theories of drug craving, ancient and modern. Addiction. 2001;96: 33–46. pmid:11177518
  35. 35. Berridge KC, Robinson T, Aldridge J. Dissecting components of reward: “Liking”,’wanting', and learning. Curr Opin Pharmacol. 2009;9: 65–73. pmid:19162544
  36. 36. Robinson TE, Berridge KC. The incentive sensitization theory of addiction: Some current issues. Philos Trans R Soc B Biol Sci. 2008;363: 3137–3146.
  37. 37. Carter BL, Tiffany ST. Meta-analysis of cue-reactivity in addiction research. Addiction. 1999;94: 327–340. pmid:10605857
  38. 38. Stippekohl B, Winkler M, Mucha RF, Pauli P, Walter B, Vaitl D, et al. Neural responses to BEGIN- and END-stimuli of the smoking ritual in nonsmokers, nondeprived smokers, and deprived smokers. Neuropsychopharmacology. 2010;35: 1209–1225. pmid:20090671
  39. 39. Drummond DC. What does cue-reactivity have to offer clinical research? Addiction. 2000;95: 129–144.
  40. 40. Franken IHA. Drug craving and addiction: Integrating psychological and neuropsychopharmacological approaches. Prog Neuropsychopharmacol Biol Psychiatry. 2003;27: 563–579. pmid:12787841
  41. 41. Sodano R, Wulfert E. Cue reactivity in active pathological, abstinent pathological, and regular gamblers. J Gambl Stud. 2010;26: 53–65. pmid:19662519
  42. 42. Laier C, Pawlikowski M, Pekal J, Schulte FP, Brand M. Cybersex addiction: Experienced sexual arousal when watching pornography and not real-life sexual contacts makes the difference. J Behav Addict. 2013;2: 100–107. pmid:26165929
  43. 43. Brand M, Laier C, Pawlikowski M, Schächtle U, Schöler T, Altstötter-Gleich C. Watching pornographic pictures on the Internet: Role of sexual arousal ratings and psychological–psychiatric symptoms for using Internet sex sites excessively. Cyberpsychology, Behav Soc Netw. 2011;14: 371–377.
  44. 44. Thalemann R, Wölfling K, Grüsser SM. Specific cue reactivity on computer game-related cues in excessive gamers. Behav Neurosci. 2007;121: 614–618. pmid:17592953
  45. 45. Davenport K, Houston JE, Griffiths MD. Excessive eating and compulsive buying behaviours in women: An empirical pilot study examining reward sensitivity, anxiety, impulsivity, self-esteem and social desirability. Int J Ment Health Addict. 2011;10: 474–489.
  46. 46. Claes L, Bijttebier P, Mitchell JE, de Zwaan M, Mueller A. The relationship between compulsive buying, eating disorder symptoms, and temperament in a sample of female students. Compr Psychiatry. 2011;52: 50–5. pmid:21220065
  47. 47. Schlosser S, Black DW, Repertinger S, Freet D. Compulsive buying. Demography, phenomenology, and comorbidity in 46 subjects. Gen Hosp Psychiatry. 1994;16: 205–212. pmid:8063088
  48. 48. Pawlikowski M, Altstötter-Gleich C, Brand M. Validation and psychometric properties of a short version of Young’s Internet Addiction Test. Comput Human Behav. 2013;29: 1212–1223.
  49. 49. Pawlikowski M, Brand M. Excessive Internet gaming and decision making: Do excessive World of Warcraft players have problems in decision making under risky conditions? Psychiatry Res. 2011;188: 428–433. pmid:21641048
  50. 50. Laier C, Schulte FP, Brand M. Pornographic picture processing interferes with working memory performance. J Sex Res. 2013;50: 642–652. pmid:23167900
  51. 51. Faber RJ, O’Guinn TC. A clinical screener for compulsive buying. J Consum Res. 1992;19: 459–469.
  52. 52. Horn J. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30: 179–185. pmid:14306381
  53. 53. Braus DF, Wrase J, Grüsser S, Hermann D, Ruf M, Flor H, et al. Alcohol-associated stimuli activate the ventral striatum in abstinent alcoholics. J Neural Transm. 2001;108: 887–894. pmid:11515754
  54. 54. Grüsser SM, Heinz A, Flor H. Standardized stimuli to assess drug craving and drug memory in addicts. J Neural Transm. 2000;107: 715–720. pmid:10943911
  55. 55. Starcke K, Schlereth B, Domass D, Schöler T, Brand M. Cue reactivity towards shopping cues in female participants. J Behav Addict. 2013;2: 17–22. pmid:26165767
  56. 56. Black DW. A review of compulsive buying disorder. World Psychiatry. 2007;6: 14–18. pmid:17342214
  57. 57. Miltenberger RG, Redlin J, Crosby R, Stickney M, Mitchell J, Wonderlich S, et al. Direct and retrospective assessment of factors contributing to compulsive buying. J Behav Ther Exp Psychiatry. 2003;34: 1–9. pmid:12763389
  58. 58. Love A, James D, Willner P. A comparison of two alcohol craving questionnaires. Addiction. 1998;93: 1091–1102. pmid:9744139
  59. 59. Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J Pers Soc Psychol. 1986;51: 1173–1182. pmid:3806354
  60. 60. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model A Multidiscip J. 1999;6: 1–55.
  61. 61. Muthén LK, Muthén BO. MPlus. Los Angeles, CA: Muthén & Muthén; 2011.
  62. 62. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Lawrence Erlbaum Associates; 1988.
  63. 63. Laier C, Brand M. Empirical evidence and theoretical considerations on factors contributing to cybersex addiction from a cognitive-behavioral view. Sex Addict Compulsivity. 2014;21: 305–321.
  64. 64. LaRose R, Eastin MS. Is online buying out of control? Electronic commerce and consumer self-regulation. J Broadcast Electron Media. 2002;46: 549–564.
  65. 65. Müller A, Mitchell JE, Crosby RD, Cao L, Johnson J, Claes L, et al. Mood states preceding and following compulsive buying episodes: An ecological momentary assessment study. Psychiatry Res. 2012;200: 575–580. pmid:22560059
  66. 66. Mueller A, Mitchell JE, Black DW, Crosby RD, Berg K, de Zwaan M. Latent profile analysis and comorbidity in a sample of individuals with compulsive buying disorder. Psychiatry Res. 2010;178: 348–353. pmid:20471099
  67. 67. Robinson TE, Berridge KC. The neural basis of drug craving: An incentive-sensitization theory of addiction. Brain Res Rev. 1993;18: 247–291. pmid:8401595
  68. 68. Franken IHA, Booij J, Van Den Brink W. The role of dopamine in human addiction: From reward to motivated attention. Eur J Pharmacol. 2005;526: 199–206. pmid:16256105
  69. 69. Crockford DN, Goodyear B, Edwards J, Quickfall J, El-Guebaly N. Cue-induced brain activity in pathological gamblers. Biol Psychiatry. 2005;58: 787–795. pmid:15993856
  70. 70. Van Holst RJ, van den Brink W, Veltman DJ, Goudriaan AE. Why gamblers fail to win: A review of cognitive and neuroimaging findings in pathological gambling. Neurosci Biobehav Rev. 2010;34: 87–107. pmid:19632269
  71. 71. Potenza MN, Steinberg MA, Skudlarski P, Fulbright RK, Lacadie CM, Wilber MK, et al. Gambling urges in pathological gambling. Arch Gen Psychiatry. 2003;60: 828–836. pmid:12912766
  72. 72. Müller A, Mitchell JE, Peterson LA, Faber RJ, Steffen KJ, Crosby RD, et al. Depression, materialism, and excessive Internet use in relation to compulsive buying. Compr Psychiatry. 2011;52: 420–424. pmid:21683178
  73. 73. Lourenço Leite P, Pereira VM, Nardi AE, Silva AC, Lourenço P, Pereira VM, et al. Psychotherapy for compulsive buying disorder: A systematic review. Psychiatry Res. 2014;219: 1–9. pmid:24857566
  74. 74. Black DW. Compulsive buying disorder: A review of the evidence. CNS Spectr. 2007;12: 124–132. pmid:17277712
  75. 75. Young KS. Treatment outcomes using CBT-IA with Internet-addicted patients. J Behav Addict. 2013;2: 209–215. pmid:25215202
  76. 76. Wölfling K, Beutel ME, Dreier M, Müller KW. Treatment Outcomes in Patients with Internet Addiction: A Clinical Pilot Study on the Effects of a Cognitive-Behavioral Therapy Program. Biomed Res Int. 2014;2014: 1–8.
  77. 77. McVay MA, Copeland AL, Newman HS, Geiselman PJ. Food cravings and food cue responding across the menstrual cycle in a non-eating disordered sample. Appetite. 2012;59: 591–600. pmid:22824054
  78. 78. Weinberger AH, Smith PH, Allen SS, Cosgrove KP, Saladin ME, Gray KM, et al. Systematic and meta-analytic review of research examining the impact of menstrual cycle phase and ovarian hormones on smoking and cessation. Nicotine Tob Res. 2015;17: 407–21. pmid:25762750
  79. 79. Yuan K, Qin W, Liu Y, Tian J. Internet addiction: Neuroimaging findings. Commun Integr Biol. 2014;4: 637–639.