Smokers can use the web to continue or quit their habit. Online vendors sell reduced or tax-free cigarettes lowering smoking costs, while health advocates use the web to promote cessation. We examined how smokers' tax avoidance and smoking cessation Internet search queries were motivated by the United States' (US) 2009 State Children's Health Insurance Program (SCHIP) federal cigarette excise tax increase and two other state specific tax increases. Google keyword searches among residents in a taxed geography (US or US state) were compared to an untaxed geography (Canada) for two years around each tax increase. Search data were normalized to a relative search volume (RSV) scale, where the highest search proportion was labeled 100 with lesser proportions scaled by how they relatively compared to the highest proportion. Changes in RSV were estimated by comparing means during and after the tax increase to means before the tax increase, across taxed and untaxed geographies. The SCHIP tax was associated with an 11.8% (95% confidence interval [95%CI], 5.7 to 17.9; p<.001) immediate increase in cessation searches; however, searches quickly abated and approximated differences from pre-tax levels in Canada during the months after the tax. Tax avoidance searches increased 27.9% (95%CI, 15.9 to 39.9; p<.001) and 5.3% (95%CI, 3.6 to 7.1; p<.001) during and in the months after the tax compared to Canada, respectively, suggesting avoidance is the more pronounced and durable response. Trends were similar for state-specific tax increases but suggest strong interactive processes across taxes. When the SCHIP tax followed Florida's tax, versus not, it promoted more cessation and avoidance searches. Efforts to combat tax avoidance and increase cessation may be enhanced by using interventions targeted and tailored to smokers' searches. Search query surveillance is a valuable real-time, free and public method, that may be generalized to other behavioral, biological, informational or psychological outcomes manifested online.
Citation: Ayers JW, Ribisl K, Brownstein JS (2011) Using Search Query Surveillance to Monitor Tax Avoidance and Smoking Cessation following the United States' 2009 “SCHIP” Cigarette Tax Increase. PLoS ONE6(3): e16777. https://doi.org/10.1371/journal.pone.0016777
Editor: Jean Carr, Institute of Human Virology, United States of America
Received: November 13, 2010; Accepted: December 29, 2010; Published: March 16, 2011
Copyright: © 2011 Ayers et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by research funding from Google.org and the National Library of Medicine (National Institutes of Health) to JSB. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
About 70% of the 46 million smokers in the United States (US) desire to quit, with 3% of all smokers quitting and staying quit each year . Large decreases in smoking prevalence  have, in part, been achieved through stronger tobacco control policies ; . Still, smoking remains a leading cause of premature death in the US  and globally .
Raising cigarette prices, typically via excise tax increases, may be the most effective tobacco control measure ; . Higher prices increase smoking cessation, prevent smoking initiation, and reduce the quantity smoked among continuing smokers . However, tax avoidance undermines the public health effectiveness of cigarette taxes . Smokers seek out Internet cigarette vendors because their prices undercut brick and mortar retailers by selling from duty-free zones, low tax jurisdictions, or sovereign Indian reservations –.
Although used as a mechanism for tax avoidance, the Internet is also a popular venue for health promotion –. An estimated 4.5% of all Internet searches are believed to be health-related  and one in four smokers have sought cessation aid online . Professional internet-based cessation programs appear effective when users are enrolled in their services, although the impact of general information seeking on cessation is unclear –.
On April 1, 2009 the US federal cigarette excise tax was increased from $0.39 to $1.01 (USD) per pack under congress' reauthorization of the State Children's Health Insurance Program (SCHIP). Ideally, the “SCHIP tax” would lead to more cessation attempts with limited tax avoidance. However, the price increases may be avoided by buying cigarettes online–thereby undermining cessation attempts. This report presents an early examination of the SCHIP tax's impact on information-seeking behavior in the form of cessation and tax avoidance queries to an online search engine using a real-time, free and public surveillance alternative. Other state specific cigarette excise taxes that occurred near the SCHIP tax were investigated to further validate the methods used for the SCHIP evaluation and consider how taxes interact when occurring in sequence, as they typically do, rather than in isolation.
Materials and Methods
Traditional surveillance techniques are ill equipped to identify timely temporal and spatial health trends for public health and medical professionals, policy makers, and the public who influence policy choices. An alternative method is to monitor real-time search query behavior –. Google search queries related to smoking cessation, e.g. “quit smoking,” and attempts to avoid cigarette taxes, e.g. “cheap cigarettes,” were analyzed around the time of the federal SCHIP, and two recent state specific tax increases by comparing across geographies with and without a tax increase. Florida's July 1, 2009 $0.34–1.34 tax increase and New York's June 3, 2008 $1.50–2.75 increase were purposefully selected to demonstrate trends related to state-specific tax increases occurring before (New York) or after (Florida) the SCHIP tax.
Data were obtained from Google Insights for Search (www.google.com/insights/search/), a public, free and real-time monitoring of Google search queries. This tool produces relative search volume (RSV) indicators scaled to the highest search proportion week (RSV = 100) with lesser values demonstrating how other proportions compared to the highest proportion. For example, if during the highest search proportion week 400 of every 1,000,000 searches were related to cessation this would be RSV = 100. For another week, if 200 of every 1,000,000 searches were related to cessation this would be RSV = 50, interpreted as 50% of the highest search proportion. RSV indirectly corrects for variation in population size and Internet access, where both are increasing during the study period and would bias any absolute search volume measure.
Initially a single key term was selected, and then other related terms indicative of the concept were added to form a single composite indicator. For example, “quit smoking” and other related key-terms with strong internal consistency were obtained from Google Insights for Search. The results of this approach are shown in Table S1. Data were not available to independently validate Google methods at the time of this report. However, after omitting terms with unclear motivation, e.g. “smoking cigarettes,” the terms generally had strong face validity and showed strong convergent validity with prior studies . Alternative specifications of the root terms, e.g. “stop smoking” for smoking cessation, resulted in a similar sample set of search terms, suggesting the analysis is not dependent on the initial search term selection. Analyses were restricted to the root and next 10 related terms. The reliance on 11 terms for each concept was consistent with prior studies where a few, or even one search term , may identify key concepts.
The sample of search terms were used to derive a single RSV trend for their related concept. RSV was estimated from March 2007 through October 2010 for the US, New York, Florida, and Canada, where no similar tax took effect. All estimates, for both avoidance and cessation searches, were on the same weekly RSV scale (0–100), with the highest RSV (100) observed in Florida.
Visual data inspection suggested the likely impact of the SCHIP, and state specific tax increases, was a pulse-effect: an immediate increase in mean RSV around the tax hikes, rather than a change in RSV slope. Therefore, estimates regarding tax impacts were derived from a least squares regression predicting mean RSV during a pre period (about 52 weeks before), implementation period (the week of and two-weeks before and after) and post period (about 52 weeks after each tax increase). Inclusion of an implementation period, instead of a pre-post only model, facilitated estimation of the immediate responsiveness to tax increases while accommodating a washout between the pre and post periods to ensure stable estimates of durable differences between each, since immediate and durable differences in search queries may differ.
A comparison of search behavior within the US before and after the SCHIP tax may be biased due to simultaneous occurring time trends (searches are increasing or decreasing overtime because of another current event, not the SCHIP tax). To control for such bias, all estimates regarding tax impacts were made relative to a control unit where no similar tax took effect during the surveillance period (Canada), to estimate the treatment effect of the tax increase using a quasi-experimental design –. We estimated mean “differences of differences” in RSV, changes in RSV during and after the tax increase in the taxed geography (e.g., the US for the SCHIP tax) compared to changes during and after the tax increase in the untaxed geography (Canada); . As a result, to the degree thatsearch patterns overlap between the US and Canada independent of tax changes, our strategy controls for simultaneous occurring time trends in search.
Moreover, preliminary analysis suggested cessation searches increased around New Years; as a result, estimates for mean pre-, implementation and post periods were made in absence of New Years effects by including additional indicators in the model for New Years wash-out periods (See Methods S1.)
The $0.39–1.01 federal SCHIP tax increase was associated with immediate sharp peaks for smoking cessation and tax avoidance searches in the US indicative of anticipation of and responses to the tax (Figure 1A). In Canada, where no similar tax took effect, there was virtually no change in cessation or tax avoidance searches around the time of or after the SCHIP tax.
The vertical reference line indicates the week of the SCHIP and, where applicable, state specific tax increases. The shaded background trends are for the matched control (Canada) where no similar tax took effect.
In the US, smoking cessation RSV increased by a factor of 11.8% (95% confidence interval [95%CI], 5.7 to 17.9; p<.001) of the highest RSV comparing differences of differences from the pre-period, weeks 14 through 52 in 2008, with Canada. However, cessation searches quickly abated and approximated the differences from pre-tax levels in Canada during the post period (−0.1; 95%CI, −3.4 to 3.0; p<.904). Tax avoidance searches, on the other hand, increased more and remained higher for longer, than cessation searches. Tax avoidance RSV was 27.9% (95%CI, 15.9 to 39.9; p<.001) and 5.3% (95%CI, 3.6 to 7.1; p<.001) statistically significantly higher during the implementation and post periods, although searches were dissipating in the later portion of the post period (Figure 2A & 2B). Moreover, if we extend our analysis backwards to include all related searches since 2004, tax avoidance searches reached an all-time peak in the entire US during the SCHIP tax implementation [not shown graphically].
Note: Bars show the mean effect of each tax, and lines indicate the 95% confidence interval, during the implementation period (Imp.) and post (Post) period.
Changes in search trends for cessation and avoidance stimulated by the state specific tax increases followed a similar pattern as that for the SCHIP tax increase, where taxation typically prompted immediate increases in cessation and tax avoidance searches, with more durable changes for avoidance. The patterns also suggest when presented with two taxes (SCHIP and state specific tax increases), state residents had unique responses to each tax, as indicated by pronounced search peaks during each implementation period compared to Canada where neither tax took effect. Moreover, changes in searches appear to follow a dose-response pattern where larger tax increases produce visually larger increases in avoidance and cessation searches, e.g. in Florida (Figure 1B & 1C).
New York's tax increase was associated with a 6.0% (95%CI, −0.4 to 12.5; p<.068) higher cessation RSV during the implementation period compared to differences in searches in Canada; consistent with patterns for the SCHIP tax search trends. The increase in tax avoidance searches was typically twice as large as the increase for cessation searches. Tax avoidance RSV was 20.1% (95%CI, −1.9 to 42.2; p<.074) and 8.6% (95%CI, 6.8 to 10.4; p<.001) higher during the implementation and post periods respectively than changes in Canada (Figure 2A & 2B). A related question is: Did the SCHIP tax produce more cessation and avoidance in New York where a state tax had recently elevated the price of cigarettes? The SCHIP, on average, produced more searches for cessation (implementation = 6.4; 95%CI, −1.9 to 14.7, p<.130; post = 7.7; 95%CI, 1.8 to 13.6, p<.007) and tax avoidance (implementation = 3.7; 95%CI, −11.6 to 19.0, p<.631; post = 5.2; 95%CI, 1.7 to 8.6, p<.004) in New York after their state specific tax than overall estimates for the United States [not shown graphically].
The highest RSV observed was in Florida for tax avoidance, higher than RSV for the US, New York, or Canada. Florida's tax increase was associated with a 16.0% (95%CI, 6.8 to 10.4; p<.001) higher cessation RSV during the implementation period. During the post period when searches abated in taxed geographies, Florida's tax increase was associated with a 4.4% (95%CI, 0.5 to 8.2; p<.028) higher cessation RSV for the remainder of 2009 through the 51st week, and may be indicative of the combination of tax increases including the SCHIP tax that recently preceded it. Avoidance RSV was 49.2 (95%CI, 26.4 to 72.0; p<.001) and 15.4 (95%CI, 10.76 to 16.88; p<.001) higher in Florida during the state tax implementation and post period than differences in Canada. It is critical to note, that these represent an additional increase over cessation and tax avoidance stemming from the SCHIP tax that preceded Florida's state cigarette tax, suggesting that taxes in close communion, like the 12 weeks between the SCHIP and state tax, have a particularly potent impact upon online behavior.
Smoking cessation and tax avoidance searches peaked around the time the SCHIP tax took effect, suggesting both anticipation of, and responsiveness to, the tax. Smoking cessation searches quickly dissipated to pre-tax levels three weeks after the tax, although, interest in avoiding cigarette taxes almost doubled three weeks to months after the tax, than in the months preceding the tax. These suggest the SCHIP tax was immediately effective at promoting cessation but was more strongly associated with tax avoidance in the longer term. Analysis of two state-specific cigarette tax increases in Florida and New York largely corroborated the SCHIP trends and suggest plausible interaction between tax increases across geographies. For example, the SCHIP tax was associated with larger increases in cessation and avoidance searches in New York, than the overall national estimates, where a recent state tax had already elevated cigarette prices and only 12 weeks after the SCHIP tax Florida's state specific tax increase was associated with unique increases in avoidance and cessation searches over differences from the SCHIP tax.
Strengths and Limitations
Principally this report demonstrates the potential value of real-time, free and geographically comprehensive search query surveillance for tobacco control, and, more generally, health behavior research. However, understanding the limitations of search query surveillance peculiar to and beyond this study is critical for future research. First, analyses were restricted to ecologic inferences, where specific individuals' smoking behavior could not be induced. Second, search terms related a given concept might change overtime, necessitating sensitivity to such changes. Third, search queries may not capture some tax-motivated outcomes like reduced cigarette consumption that have been associated with cigarette tax increases. Fourth, online smokers may not be representative of all smokers. Smokers who ever used the Internet in 2003 were more likely to have a high school or greater education and have an annual household income in excess of $50K, and were 10 years younger than offline smokers . Internet use has since increased substantially, and differences between online and offline smokers may be minimal, although this needs to be investigated.
Last, the validity of search queries for health behaviors is a major concern. Search queries have strong predictive validity for outbreaks of influenza-like – gastrointestinal  and Lyme diseases  independent of media coverage. Google Flu Trends, for example, provides real-time geographically specific estimates of influenza-like searches in the US, with forecasts eclipsing the timeliness of other modern surveillance (http://www.google.org/flutrends). Moreover, search query trends forecast weekend box-office film revenue, video game sales, the Billboard Hot 100 song chart , and unemployment . One validity study suggests that when no other, or only limited, data exist, search queries reveal relevant details about present population behaviors, and provide a useful guide for future population behaviors . As a result, search queries may be valid indicators of smoking related behaviors. Nonetheless, as the correlation with actual behavior is imperfect, the trends described herein should be treated as preliminary, where searches indicate ideation.
Given the access to cheaper cigarettes the Internet affords, it may not be surprising that tax avoidance was the more prevalent option for smokers given quitting is a difficult option. It is essential to both minimize tax avoidance by addressing Internet tobacco sales, as governments tax cigarettes to maximize revenue collection, and enhance the impact of taxes on cessation.
About 13 to 23 million searches are conducted each year for tax free, or lower tax, cigarettes with lost government revenue approaching a billion dollars . Moreover, Internet vendors often circumvent other tobacco control policies, like bans on sales to minors . Under the Prevent All Cigarette Trafficking (PACT) Act of 2009 , all Internet tobacco vendors are required to verify the age and identity of customers and to pay all applicable taxes. This includes paying taxes for the destination state, which often have higher taxes. US states have new powers under the PACT Act, such as the ability to force out-of-state sellers to collect and remit that state's tobacco excise tax. The implication herein is state tobacco control programs can monitor searches, particularly after a tax hike, and stimulate enforcement against Internet cigarette vendors if avoidance searches spike after the tax hike. US states can also repeat measurements over time to test the impact of their strategies, particularly as state level policies are changing rapidly .
Online surveillance can easily lead to targeted and tailored online interventions . Since initial responses to policy changes likely take place on the Internet, it may be appropriate to target Internet users directly. Cobb  found only 34% of cessation searches on AOL's Google powered search page were linked to a professional cessation service, suggesting searchers interested in cessation may be sold short to the degree that non-professional services lack evidence-based methods. Regardless access to evidence-based cessation information may be increased through Internet advertising.
Intervention-specific advertisements triggered by users searching for the keyword searches described herein may be purchased from search providers for as little as $0.01 per click. Users linking via these advertisements would be provided evidence-based cessation services. Moreover, avoidance searchers could also be provided a tailored advertisement, e.g. “If you want to save money, quitting smoking now saves you the most and is the life saving alternative.” Moreover, such interventions may be tailored to cessation and avoidance searches by considering their stage in the cessation process ; . Where cessation searchers are likely contemplating cessation and avoidance searches are pre-contemplative, they should accordingly be provided cues to action including cessation enabling resources and motivation to consider cessation, respectively. The application of online cessation aids could yield enhanced public health effectiveness of cigarette taxation.
More generally, this study advances the use of search query surveillance outside of infectious disease trends, where this approach has largely been developed –; –. Internet saturation is greatest in affluent countries where behaviors, not infectious disease, are the leading cause of premature death . Our work addresses this gap, and accords with a development of a computational social science that draws on digital footprints left in a 21st century society to make scientific inferences .
Our strategy may be a useful adjunct to traditional surveillance methods broadly in public health behavior research but may also be a core surveillance method where surveillance advances have been weakly developed. Survey based surveillance of tobacco use and purchasing patterns is very costly, lacks timeliness, and may be biased by strong social desirability –especially when illegal behaviors such as tax avoidance are involved . Archival measures for tobacco use are typically outcome specific. For instance, nicotine replacement therapy sales are not indicative of tax avoidance and neither are calls to a cessation help line –. Moreover, online investigation can usually precede existing surveillance systems and thereby may serve as an early warning system.
Search query surveillance may also be politically relevant. Since policy changes typically require public support  evaluation strategies that take years to perform may not provide relevant feedback to public interest groups and voters, thereby limiting public trust in existing, or more reaching, public health policies. Instead, an evaluation that occurs almost immediately after the policy change may inform policy makers and their supporters of the associated costs and benefits when there is still interest to make modifications to, or expand, the policy change. Given the search query data used in this study is publically available, the added transparency may yield robust public health debates among scholars interested in conducting their own analyses and added credibility to lay audiences. Moreover, states and the federal government can use search query surveillance to refine implementation of tax policy and compare searches with other states as benchmarks. They can also use search query surveillance to step-up enforcement of Internet cigarette vendor sales by monitoring search volume while simultaneously monitoring the sales practices of the highest ranked and most visited online cigarette vendors.
This report demonstrated the potential value of real-time, free and geographically comprehensive search query surveillance for health behavior and health policy research, using some recent tobacco excise tax increases ; ; . A new research agenda is required to further understand online responses to health policy changes. This agenda may yield ancillary online interventions, thereby, improving the public health effectiveness of public policies. Search query surveillance could, in principle, detect population shifts in health behaviors and outcomes well in advance of traditional methods, especially when these shifts are unanticipated . Moreover, search query surveillance may be generalized to other behavioral, biological, informational or psychological outcomes manifested online, across public health and science.
We thank Jon-Patrick Allem, Mathew Childers, C. Richard Hofstetter, Melbourne Hovell, Carl Latkin, John McGready and Elizabeth Stuart for helpful discussions that improved this final report.
Analyzed the data: JW A KMR JSB. Wrote the paper: JWA KMR JSB. Conceived and designed the study: JWA KMR JSB.
- 1. Centers for Disease Control and Prevention (2009) Cigarette smoking among adults and trends in smoking cessation - United States, 2008. Morb Mortal Wkly Rep 58: 1227–1232.Centers for Disease Control and Prevention2009Cigarette smoking among adults and trends in smoking cessation - United States, 2008.Morb Mortal Wkly Rep5812271232
- 2. Centers for Disease Control and Prevention (2007) Cigarette smoking among adults–United States, 2006. Morb Mortal Wkly Rep 56: 1157–1161.Centers for Disease Control and Prevention2007Cigarette smoking among adults–United States, 2006.Morb Mortal Wkly Rep5611571161
- 3. Lee K (2008) Tobacco control yields clear dividends for health and wealth. PLoS Med 5: e189.K. Lee2008Tobacco control yields clear dividends for health and wealth.PLoS Med5e189
- 4. Samet JM, Wipfli H (2009) Unfinished business in tobacco control. JAMA 302: 681–682.JM SametH. Wipfli2009Unfinished business in tobacco control.JAMA302681682
- 5. Mokdad AH, Marks JS, Stroup DF, Gerberding JL (2004) Actual causes of death in the United States, 2000. JAMA 291: 1238–1245.AH MokdadJS MarksDF StroupJL Gerberding2004Actual causes of death in the United States, 2000.JAMA29112381245
- 6. Ezzati M, Lopez AD (2003) Estimates of global mortality attributable to smoking in 2000. Lancet 362: 847–852.M. EzzatiAD Lopez2003Estimates of global mortality attributable to smoking in 2000.Lancet362847852
- 7. Task Force on Community Preventive Services (2005) Tobacco. In: Zaza S, Briss PA, Harris KW, editors. The guide to community preventive services: What works to promote health. New York: Oxford University Press. pp. 1–79.Task Force on Community Preventive Services2005Tobacco.S. ZazaPA BrissKW HarrisThe guide to community preventive services: What works to promote healthNew YorkOxford University Press179
- 8. Institute of Medicine. (2007) Ending the tobacco problem: a blueprint for the nation. In: Bonnie RJ, Stratton K, Wallace RB, editors. Washington DC: National Academies Press. Institute of Medicine.2007Ending the tobacco problem: a blueprint for the nation.RJ BonnieK. StrattonRB WallaceWashington DCNational Academies Press
- 9. Centers for Disease Control and Prevention (2010) State cigarette excise taxes - United States, 2009. Morb Mortal Wkly Rep 59: 385–388.Centers for Disease Control and Prevention2010State cigarette excise taxes - United States, 2009.Morb Mortal Wkly Rep59385388
- 10. Stehr M (2005) Cigarette tax avoidance and evasion. J Health Econ 24: 277–297.M. Stehr2005Cigarette tax avoidance and evasion.J Health Econ24277297
- 11. Hrywna M, Delnevo CD, Staniewska D (2004) Prevalence and correlates of internet cigarette purchasing among adult smokers in New Jersey. Tob Control 13: 296–300.M. HrywnaCD DelnevoD. Staniewska2004Prevalence and correlates of internet cigarette purchasing among adult smokers in New Jersey.Tob Control13296300
- 12. Ribisl KM, Kim AE, Williams RS (2001) Web sites selling cigarettes: how many are there in the USA and what are their sales practices? Tob Control 10: 352–359.KM RibislAE KimRS Williams2001Web sites selling cigarettes: how many are there in the USA and what are their sales practices?Tob Control10352359
- 13. Ribisl KM, Kim AE, Williams RS (2007) Sales and marketing of cigarettes on the Internet: Emerging threats to tobacco control and promising policy solutions. Reducing tobacco use: Strategies, barriers, and consequences. Washington DC: National Academy Press. KM RibislAE KimRS Williams2007Sales and marketing of cigarettes on the Internet: Emerging threats to tobacco control and promising policy solutions.Reducing tobacco use: Strategies, barriers, and consequencesWashington DCNational Academy Press
- 14. Kim AE, Ribisl KM, Delnevo CD, Hrywna M (2006) Smokers' beliefs and attitudes about purchasing cigarettes on the Internet. Public Health Rep 121: 594–602.AE KimKM RibislCD DelnevoM. Hrywna2006Smokers' beliefs and attitudes about purchasing cigarettes on the Internet.Public Health Rep121594602
- 15. Bennett GG, Glasgow RE (2009) The delivery of public health interventions via the Internet: actualizing their potential. Annu Rev Public Health 30: 273–292.GG BennettRE Glasgow2009The delivery of public health interventions via the Internet: actualizing their potential.Annu Rev Public Health30273292
- 16. Cooper CP, Mallon KP, Leadbetter S, Pollack LA, Peipins LA (2005) Cancer Internet search activity on a major search engine, United States 2001-2003. J Med Internet Res 7: e36.CP CooperKP MallonS. LeadbetterLA PollackLA Peipins2005Cancer Internet search activity on a major search engine, United States 2001-2003.J Med Internet Res7e36
- 17. Webb TL, Joseph J, Yardley L, Michie S (2010) Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 12: e4.TL WebbJ. JosephL. YardleyS. Michie2010Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy.J Med Internet Res12e4
- 18. Eysenbach G, Kohler C (2003) What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the internet. AMIA Annu Symp Proc 225–229.G. EysenbachC. Kohler2003What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the internet.AMIA Annu Symp Proc225229
- 19. Fox S (2005) Health Information Online. Washington, DC: Pew Internet & American Life Project. S. Fox2005Health Information Online.Washington, DCPew Internet & American Life Project
- 20. Cobb NK, Graham AL, Bock BC, Papandonatos G, Abrams DB (2005) Initial evaluation of a real-world Internet smoking cessation system. Nicotine Tob Res 7: 207–216.NK CobbAL GrahamBC BockG. PapandonatosDB Abrams2005Initial evaluation of a real-world Internet smoking cessation system.Nicotine Tob Res7207216
- 21. Etter JF, Perneger TV (2001) Effectiveness of a computer-tailored smoking cessation program: a randomized trial. Arch Intern Med 161: 2596–2601.JF EtterTV Perneger2001Effectiveness of a computer-tailored smoking cessation program: a randomized trial.Arch Intern Med16125962601
- 22. Lenert L, Muñoz RF, Stoddard J, Delucchi K, Bansod A, et al. (2003) Design and pilot evaluation of an internet smoking cessation program. J Am Med Inform Assoc 10: 16–20.L. LenertRF MuñozJ. StoddardK. DelucchiA. Bansod2003Design and pilot evaluation of an internet smoking cessation program.J Am Med Inform Assoc101620
- 23. Munoz RF, Barrera AZ, Delucchi K, Penilla C, Torres LD, et al. (2009) International Spanish/English Internet smoking cessation trial yields 20% abstinence rates at 1 year. Nicotine Tob Res 11: 1025–1034.RF MunozAZ BarreraK. DelucchiC. PenillaLD Torres2009International Spanish/English Internet smoking cessation trial yields 20% abstinence rates at 1 year.Nicotine Tob Res1110251034
- 24. Myung SK, McDonnell DD, Kazinets G, Seo HG, Moskowitz JM (2009) Effects of Web- and computer-based smoking cessation programs: meta-analysis of randomized controlled trials. Arch Intern Med 169: 929–937.SK MyungDD McDonnellG. KazinetsHG SeoJM Moskowitz2009Effects of Web- and computer-based smoking cessation programs: meta-analysis of randomized controlled trials.Arch Intern Med169929937
- 25. Brownstein JS, Freifeld CC, Madoff LC (2009) Digital disease detection–harnessing the Web for public health surveillance. N Engl J Med 360: 2153–2157.JS BrownsteinCC FreifeldLC Madoff2009Digital disease detection–harnessing the Web for public health surveillance.N Engl J Med36021532157
- 26. Wilson K, Brownstein JS (2009) Early detection of disease outbreaks using the Internet. CMAJ 180: 829–831.K. WilsonJS Brownstein2009Early detection of disease outbreaks using the Internet.CMAJ180829831
- 27. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, et al. (2009) Detecting influenza epidemics using search engine query data. Nature 457: 1012–1014.J. GinsbergMH MohebbiRS PatelL. BrammerMS Smolinski2009Detecting influenza epidemics using search engine query data.Nature45710121014
- 28. Hulth A, Rydevik G, Linde A (2009) Web queries as a source for syndromic surveillance. PLoS One 4: e4378.A. HulthG. RydevikA. Linde2009Web queries as a source for syndromic surveillance.PLoS One4e4378
- 29. Eysenbach G (2006) Infodemiology: tracking flu-related searches on the web for syndromic surveillance. AMIA Annu Symp Proc. pp. 244–248.G. Eysenbach2006Infodemiology: tracking flu-related searches on the web for syndromic surveillance.AMIA Annu Symp Proc244248
- 30. Polgreen PM, Chen Y, Pennock DM, Nelson FD (2008) Using internet searches for influenza surveillance. Clin Infect Dis 47: 1443–1448.PM PolgreenY. ChenDM PennockFD Nelson2008Using internet searches for influenza surveillance.Clin Infect Dis4714431448
- 31. Seifter A, Schwarzwalder A, Geis K, Aucott J (2010) The utility of "Google Trends" for epidemiological research: Lyme disease as an example. Geospat Health 4: 135–137.A. SeifterA. SchwarzwalderK. GeisJ. Aucott2010The utility of "Google Trends" for epidemiological research: Lyme disease as an example.Geospat Health4135137
- 32. Cobb NK, Graham AL (2006) Characterizing Internet searchers of smoking cessation information. J Med Internet Res 8: e17.NK CobbAL Graham2006Characterizing Internet searchers of smoking cessation information.J Med Internet Res8e17
- 33. Cook TD, Shadish WR, Wong VC (2008) Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. J Policy Analysis Management 27: 724–750.TD CookWR ShadishVC Wong2008Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons.J Policy Analysis Management27724750
- 34. Shadish WR, Cook TD, Campbell DT (2002) Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin. WR ShadishTD CookDT Campbell2002Experimental and quasi-experimental designs for generalized causal inference.BostonHoughton Mifflin
- 35. West SG, Duan N, Pequegnat W, Gaist P, Des Jarlais DC, et al. (2008) Alternatives to the randomized controlled trial. Am J Public Health 98: 1359–1366.SG WestN. DuanW. PequegnatP. GaistDC Des Jarlais2008Alternatives to the randomized controlled trial.Am J Public Health9813591366
- 36. Stoddard JL, Augustson EM (2006) Smokers who use internet and smokers who don't: data from the Health Information and National Trends Survey (HINTS). Nicotine Tob Res 8: S77–S85.JL StoddardEM Augustson2006Smokers who use internet and smokers who don't: data from the Health Information and National Trends Survey (HINTS).Nicotine Tob Res8S77S85
- 37. Goel S, Hofman JM, Lahaie S, Pennock DM, Watts DJ (2010) Predicting consumer behavior with Web search. Proc Natl Acad Sci U S A 107: 17486–17490.S. GoelJM HofmanS. LahaieDM PennockDJ Watts2010Predicting consumer behavior with Web search.Proc Natl Acad Sci U S A1071748617490
- 38. Askitas N, Zimmermann KF (2009) Google econometrics and unemployment forecasting. Applied Econom Qtrly 55: 107–120.N. AskitasKF Zimmermann2009Google econometrics and unemployment forecasting.Applied Econom Qtrly55107120
- 39. Goolsbee A, Lovenheim MF, Slemrod J (2010) Playing with fire: Cigarettes, taxes, and competition from the internet. Am Econom J: Econom Policy 2: 131–154.A. GoolsbeeMF LovenheimJ. Slemrod2010Playing with fire: Cigarettes, taxes, and competition from the internet.Am Econom J: Econom Policy2131154
- 40. 111th Congress (2010) Public Law 111-154. The Library of Congress. 111th Congress2010Public Law 111-154The Library of CongressAvailable at: http://thomas.loc.gov/cgi-bin/bdquery/z?d111:SN01147:|TOM:/bss/d111query.html. Retrieved on Jul 13, 2010. Available at: http://thomas.loc.gov/cgi-bin/bdquery/z?d111:SN01147:|TOM:/bss/d111query.html. Retrieved on Jul 13, 2010.
- 41. Chriqui JF, Ribisl KM, Wallace RM, Williams RS, O'Connor JC, et al. (2008) A comprehensive review of state laws governing Internet and other delivery sales of cigarettes in the United States. Nicotine Tob Res 10: 253–265.JF ChriquiKM RibislRM WallaceRS WilliamsJC O'Connor2008A comprehensive review of state laws governing Internet and other delivery sales of cigarettes in the United States.Nicotine Tob Res10253265
- 42. Graham AL, Milner P, Saul JE, Pfaff L (2008) Online advertising as a public health and recruitment tool: comparison of different media campaigns to increase demand for smoking cessation interventions. J Med Internet Res 10: e50.AL GrahamP. MilnerJE SaulL. Pfaff2008Online advertising as a public health and recruitment tool: comparison of different media campaigns to increase demand for smoking cessation interventions.J Med Internet Res10e50
- 43. Cobb NK (2010) Online consumer search strategies for smoking-cessation information. Am J Prev Med 38: S429–S432.NK Cobb2010Online consumer search strategies for smoking-cessation information.Am J Prev Med38S429S432
- 44. Prochaska JO, DiClemente CC (1983) Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol 51: 390–395.JO ProchaskaCC DiClemente1983Stages and processes of self-change of smoking: toward an integrative model of change.J Consult Clin Psychol51390395
- 45. Herzog TA, Blagg CO (2007) Are most precontemplators contemplating smoking cessation? Assessing the validity of the stages of change. Health Psychol 26: 222–231.TA HerzogCO Blagg2007Are most precontemplators contemplating smoking cessation? Assessing the validity of the stages of change.Health Psychol26222231
- 46. Lazer D, Pentland A, Adamic L, Aral S, Barabasi AL, et al. (2009) Computational social science. Science 323: 721–723.D. LazerA. PentlandL. AdamicS. AralAL Barabasi2009Computational social science.Science323721723
- 47. Giovino GA, Schooley MW, Zhu BP, Chrismon JH, Tomar SL, et al. (1994) Surveillance for selected tobacco-use behaviours–United States, 1900-1994. Morb Mortal Wkly Rep 43: 986–993.GA GiovinoMW SchooleyBP ZhuJH ChrismonSL Tomar1994Surveillance for selected tobacco-use behaviours–United States, 1900-1994.Morb Mortal Wkly Rep43986993
- 48. Metzger KB, Mostashari F, Kerker BD (2005) Use of pharmacy data to evaluate smoking regulations' impact on sales of nicotine replacement therapies in New York City. Am J Public Health 95: 1050–1055.KB MetzgerF. MostashariBD Kerker2005Use of pharmacy data to evaluate smoking regulations' impact on sales of nicotine replacement therapies in New York City.Am J Public Health9510501055
- 49. Centers for Disease Control and Prevention (2009) State-specific prevalence and trends in adult cigarette smoking–United States, 1998-2007. Morb Mortal Wkly Rep 58(9): 221–226.Centers for Disease Control and Prevention2009State-specific prevalence and trends in adult cigarette smoking–United States, 1998-2007.Morb Mortal Wkly Rep589221226
- 50. Zaller J (1992) The nature and origins of mass opinion. Cambridge: Cambridge University Press. J. Zaller1992The nature and origins of mass opinion.CambridgeCambridge University Press
- 51. Mayhew DR, Arnold RD (2004) Congress: The electoral connection. New Haven, CT: Yale Univ Pr. DR MayhewRD Arnold2004Congress: The electoral connection.New Haven, CTYale Univ Pr
- 52. Eysenbach G (2009) Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res 11: e11.G. Eysenbach2009Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet.J Med Internet Res11e11
- 53. Ayers JW, Ribisl KM, Brownstein JS (2011) Tracking the Rise in Popularity of Electronic Nicotine Delivery Systems (“Electronic Cigarettes”) Using Search Query Surveillance. Am J Prev Med. JW AyersKM RibislJS Brownstein2011Tracking the Rise in Popularity of Electronic Nicotine Delivery Systems (“Electronic Cigarettes”) Using Search Query Surveillance.Am J Prev Med