Figures
Abstract
Introduction
Results of the impact of lockdowns and stay-at-home orders during the COVID-19 pandemic on changes in cigarette smoking are mixed. Previous studies examining smoking changes during the early stages of the pandemic in 2020 have mainly focused on smoker’s perception of changes in cigarette consumption. Such measure has not been widely used in other contexts, and therefore we aim to compare the discrepancy between smokers’ perceived changes in cigarette smoking and the actual change in the number of cigarettes smoked, using repeated measurements.
Methods
We included 134 smokers from the French TEMPO cohort with repeated measurements of their perceived changes in smoking habits during the first phase of the COVID-19 pandemic and the number of cigarettes smoked repeatedly from March to May 2020. We used generalized estimation equations (GEE) to examine the association between changes in the number of cigarettes smoked and the odds of mismatched answers.
Results
The results suggest that at each study wave, 27–45% of participants provided mismatching answers between their perceived change in smoking habits and the actual change in the number of cigarettes smoked daily, measured repeatedly. Results from GEE analysis demonstrated that a mismatching assessment of smoking behavior was elevated among those who had an increase (OR = 2.52 [1.37;4.65]) or a decrease (OR = 5.73 [3.27;10.03]) in number of cigarettes smoked.
Discussion
Our findings highlight the possibility of obtaining different results depending on how changes in tobacco smoking are measured. This highlights the risk of underestimating the actual changes in cigarette smoking during the COVID-19 pandemic, but also more generally when validating public health interventions or smoking cessation programs. Therefore, objective measures such as the actual consumption of psychoactive substances should be utilized, preferably on a longitudinal basis, to mitigate recall bias.
Citation: Andersen AJ, Wallez S, Melchior M, Mary-Krause M (2024) Our perception may not be reality: A longitudinal study of the relationship between perceived and actual change in smoking behavior. PLoS ONE 19(4): e0301515. https://doi.org/10.1371/journal.pone.0301515
Editor: Suzit Bhusal, Everest Hospital Pvt Ltd, NEPAL
Received: November 27, 2023; Accepted: March 17, 2024; Published: April 1, 2024
Copyright: © 2024 Andersen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Due to the personal questions asked in this study, research participants were guaranteed that all raw data will remain confidential. On reasonable request including standards for General Data Protection Regulation data can be accessed, please send an email to cohort.tempo@inserm.fr. Anonymized data can only be shared after explicit approval of the French national committee for data protection for approval (Commission Nationale de l’Informatique et des Libertés, CNIL).
Funding: This research benefited from support from the French Institute for Public Health Research (IReSP) and the French Institute of Cancer (INCa), within the framework of the call for doctoral grants launched in 2020, under the project reference number “AAC-SPA-04”. The TEMPO cohort is supported by the French National Research Agency (ANR) (ANR-Flash COVID), the French Insititue for Public Health Research IReSP (TGIR Cohortes), the French Institute of Cancer (INCa), the French Inter-departmental Mission for the Fight against Drugs and Drug Addiction (MILDeCA), and the Pfizer Foundation. The TEMPO COVID-19 study is supported by the European Union’s Horizon 2020 research and innovation program RESPOND (funded under Horizon 2020 – the Framework Programme for Research and Innovation (2014-2020)). The content of this article reflects only the authors’ views, and the European Community is not liable for any use that may be made of the information contained therein. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Since the onset of the COVID-19 pandemic in the spring of 2020, there has been a focus on changes in lifestyle habits due to pandemic-related rules and restrictions, including numerous international studies illustrating changes in smoking patterns. A recent systematic review and meta-analysis examining changes in tobacco smoking during the first pre-vaccination phases of the COVID-19 pandemic [1] concluded that the results are mixed. Literature from the early stages of the pandemic found no convergent results, neither in the number of persons who changed their behavior nor the direction of change [2–24], and later studies also reported this discrepancy [3, 25]. Indeed, varying percentages of people increasing their daily tobacco use have been found, ranging from 7% to 45% among smokers in general populations [2–11, 13–18, 20–24], as well as different values for the increase in the number of cigarettes smoked [2, 9]. In other contexts, no change or reduced tobacco consumption has been reported [19, 21].
In our view, the emerging literature has one major limitation. The way in which changes in smoking during the pandemic are measured in epidemiological studies varies and may contribute to an explanation of the different conclusions that have been drawn. In particular, since the COVID-19 pandemic led to major disruptions in regular life habits, it may have been particularly difficult for individuals to keep track of their smoking levels retrospectively. Most studies investigating changes in tobacco smoking are mainly based on self-reported survey questions about perceived changes in smoking habits [2–4, 6, 7, 9, 11, 13, 14, 16–18, 21–24, 26, 27], which is not a commonly used measure prior to the pandemic and could be imprecise [28]. In this study, we aim to examine the relationship between participants’ perception of changes in smoking habits during the COVID-19 pandemic and the reported number of cigarettes smoked, measured longitudinally from March to May 2020.
Material and methods
Study population and procedures
Statistical analyses are based on data from participants in the French TEMPO cohort, a longitudinal study aiming to improve understanding of factors associated with mental health and psychoactive substance use, including tobacco smoking patterns [29]. The cohort was set-up in 2009 among young adults aged 22 to 35 years who had previously participated in a study on children’s psychological problems in 1991 and 1999. Briefly, TEMPO participants were followed through self-completed questionnaires in 2009, 2011, 2015, and 2018 [29]. Between March and May 2020, TEMPO participants completed seven self-administered questionnaires (weekly for the first five questionnaires, and biweekly for questionnaire six and seven) aiming to better understand their experience of the COVID-19 epidemic, including changes in smoking levels. This aspect was named TEMPO COVID-19 study.
As the aim was to study changes in tobacco smoking, only smokers were included in this study.
The TEMPO cohort obtained approval from the French data protection authority (Commission Nationale de l’Informatique et des Libertés, CNIL, n° 908163). All participants provided their informed consent.
Measures
Tobacco smoking behavior.
Throughout the seven data collection points, TEMPO COVID-19 participants were asked to record the number of cigarettes smoked daily or weekly. Additionally, they were asked whether they had changed their smoking behavior within the preceding seven days (“In the last 7 days, has your consumption of tobacco products changed?” with response options including ‘No’, ‘Yes, it decreased’, ‘Yes, I stopped smoking’, ‘Yes, I relapsed to smoking after quitting’, ‘Yes, it increased’, ‘Yes, I started smoking’). In this paper, we will use the term perceived change to denote this measure.
Outcome: Match/mismatch variable.
To examine the extent of discrepancy between participants’ assessment of changes in smoking levels and the actual change in the reported number of cigarettes smoked, our outcome variable captures a match vs. mismatch between perceived changes in smoking patterns and the actual change in the number of cigarettes participants reported smoking between two waves of data collection. Therefore, we calculated the percentage change in smoking by subtracting the number of cigarettes reported in one particular week from the number reported in the preceding week. To the best of our knowledge, there is no consensus in the scientific literature on a meaningful threshold to define changes in tobacco consumption. Given that the average number of cigarettes smoked per day was 7.0 (standard deviation = 6.8) in our sample, we opted for a 25% change (equivalent to 2 cigarettes). Participants were considered to have altered their smoking levels if the number of cigarettes smoked varied by at least 25%, resulting in one of the following classifications: 1) no change, 2) increase, or 3) decrease. In additional analyses, we used other definitions of changes in smoking patterns (≥10% and ≥50% of cigarettes smoked). If no information was available in the preceding week, the last available data were used. Hereafter, we compared whether the percentage change in the number of cigarettes smoked was consistent with participants’ perceived changes in smoking. If the two variables were consistent, the outcome was a match; if not, we considered it to be a mismatch.
Covariates.
To study factors associated with a mismatch in smoking assessments, our statistical analyses controlled for factors potentially associated with tobacco smoking, including sex, age, marital status (single, divorced or widowed vs. married, civil union or in a relationship), education level (Bac+2 or lower vs. Bac+3 or higher), employment status (unemployed vs. employed), type of employment (unstable vs. stable), household income (≤2500 euros vs. ≥2501 euros), and symptoms of depression (yes vs. no), measured with items from the depressive syndrome scale based on the Adult Self Report (ASR)-Achenbach System [30].
Statistical analysis
First, we described the distribution of matching and mismatching answers by study wave. Second, to examine the longitudinal association between mismatching answers and the actual change in the number of cigarettes smoked, we used Generalized Estimation Equations (GEE) with a logit link and an exchangeable model fit for both bivariate and multivariate models. In the final multivariate model, we included variables associated with the outcome with a p-value < 0.20 in bivariate analyses (S1 Table). To account for differential attrition, we estimated inverse probability weights (IPW) by estimating non-response among study participants included in our statistical analyses compared to the original TEMPO cohort, and weighted bivariate and multivariate GEE regression models. In sensitivity analyses, we used a 10% and 50% change in the number of cigarettes smoked to define the study outcome. All statistical analyses were performed using SAS® (version 9.4).
Results
Our study included 134 persons who reported daily or occasional tobacco smoking and completed at least one TEMPO COVID-19 questionnaire. Participants were predominantly female (60%), were on average 40 years old, married or in a relationship (78%), and the majority had a household income exceeding 2500 euros (73%) (S1 Table).
As shown in Table 1, in all seven study waves, 21–30% of participants perceived an increase in their smoking behavior, while 8–25% reported a decrease, and more than 50% reported no change. When examining the actual change in the number of cigarettes smoked, 17–31% of participants increased their consumption, 13–27% decreased, and 50–60% reported no change. However, at each study wave, 27–45% provided mismatching answers. Among participants with mismatching assessments of smoking, the majority did not perceive a change, despite actually reporting a change in the number of cigarettes smoked.
TEMPO cohort study, March to May 2020 (n = 134).
Results from the multivariate GEE model are presented in Table 2, and demonstrate that a mismatching assessment of smoking behavior reflected more of a decrease in cigarette consumption (OR = 5.73, 95% confidence interval (CI) = [3.27;10.03]) than an increase (OR = 2.52, 95%CI = [1.37;4.65]). Supplementary analyses yielded similar results using a 10% cutoff for change in smoking behavior. When using a 50% cutoff for change in smoking behavior, marital status was additionally associated with a mismatching assessment; compared to individuals married or in a partnership, those who were single, separated, or divorced had an odds ratio of 2.09 (95% CI = [1.07;4.08]).
Discussion
This study highlights the possibility of mismatching assessments of smoking behavior depending on the type of measure used. This situation often reflects a perception of no change, while the reported number of cigarettes smoked differs from previous assessments. At the same time, people who reduce their consumption are more likely to report mismatching answers than those with unchanged consumption, suggesting that a decrease in the number of cigarettes smoked is not perceived. Persons not in stable relationships, and therefore likely living alone, had an elevated probability of reporting different perceptions and actual changes in smoking levels. Misperceptions of smoking patterns may have been exacerbated in the context of the COVID-19 pandemic, as individuals’ daily routines and habits were modified, possibly making it difficult to accurately assess their own behavior. This should be considered when studying self-reported changes in smoking behavior.
The interpretation of our results needs to be considered in light of several possible limitations. First, we studied a relatively small sample of smokers, most of whom had a high socioeconomic position, which may limit the generalizability of our results [29]. Nevertheless, there is no previous evidence showing that the difference between perceived and actual change in smoking patterns may vary depending on these characteristics. However, it may be that in a larger study, other factors associated with a mismatch in smoking assessment may have become apparent. Second, for respondents who did not answer all seven waves of data collection, we used the last available measurement of the number of cigarettes, which may have induced measurement error. Nevertheless, the time between each study wave was very limited (7–15 days), and this should not be a major source of bias. Third, the smoking measures we used are self-reported and may be subject to misclassification. However, self-reported smoking status is considered accurate when compared with biomarkers and biochemical measures of tobacco use [31–33]. We chose a cutoff of 25% based on the relatively low mean of cigarettes smoked daily to ensure that a change in the number of cigarettes smoked would minimize the risk of misclassification. Sensitivity analyses showed similar results. Our study also has several strengths that outweigh the previously mentioned limitations. First, we used longitudinal data to compare perceived changes in tobacco use and the number of cigarettes smoked across seven waves of measurements, thus limiting recall bias. Second, both perceived and actual changes in smoking behavior were measured simultaneously.
Our study reveals that more than one-third of study participants provided inconsistent answers when asked about perceived changes in tobacco use during the COVID-19 pandemic and the number of cigarettes smoked. While changes in tobacco consumption in the context of the COVID-19 pandemic have been previously reported, the direction of change and associated factors vary considerably. Through this study, we demonstrate that the method of measuring changes in tobacco consumption may impact our findings.
As previous mentioned, there has been an increased focus on studying changes in tobacco consumption during the COVID-19 pandemic, with most studies relying on perceptions of change phrased as ‘Compared to pre-lockdown, has your smoking consumption changed?’ with response categories like ‘It has increased/it has remained the same/it has decreased’ [2, 5, 14, 17, 21, 24]. As observed in our study, participants’ subjectivity might explain some of the differences across studies conducted during the COVID-19 pandemic. Furthermore, the use of retrospectively collected data may increase the risk of recall bias [34] and result in biased estimates and associations. The reported number of cigarettes may be highly influenced by the perception of change and the time since the beginning of lockdown. When studying changes in working time before and during the pandemic, the use of retrospective questions has been found to lead to an underestimation of change between the current and pre-pandemic situation [28]. This trend is likely to be present in our study as well, where a substantial group of participants perceives no change, while longitudinal measures indicate their behavior did change. Therefore, the results of this paper must be seen in the light of the assumption that repeated measures of the number of cigarettes smoked are more valid than perceived change, particularly when reported retrospectively [28].
Conclusion
To our knowledge, ours is the first study to examine the match and mismatch between perceived and actual changes in tobacco consumption during the COVID-19 pandemic. Our findings highlight the possibility of obtaining different results depending on to the way changes in tobacco smoking are measured. This highlights the risk of underestimating the actual change in cigarette smoking during the first two months of the COVID-19 pandemic.
The results of this study should be considered when planning future data collection aimed at studying changes in cigarette smoking. Questions related to perceived change and cross-sectional measurement, including both a pre- and post-pandemic dimension, increase the risk of underestimating actual changes in smoking patterns, which may lead to biased results and conclusions. Examining changes in smoking may be more complex and cannot be based only on smokers’ own perception of change. Instead, objective measures such as the actual consumption of psychoactive substances before and after should be used, preferably on a longitudinal basis, to mitigate recall bias, especially when validating public health interventions or smoking cessation programs.
Supporting information
S1 Table. Socio-demographic characteristics of study population and unadjusted associations with a mismatching tobacco use assessment.
TEMPO cohort (n = 134), GEE model (OR, 95% CI).
https://doi.org/10.1371/journal.pone.0301515.s001
(DOCX)
Acknowledgments
We would like to thank all the TEMPO participants who provided data for this project.
References
- 1. Sarich P, Cabasag CJ, Liebermann E, Vaneckova P, Carle C, Hughes S, et al. Tobacco smoking changes during the first pre-vaccination phases of the COVID-19 pandemic: A systematic review and meta-analysis. EClinicalMedicine. 2022;47: 101375. pmid:35434579
- 2. Bar-Zeev Y, Shauly M, Lee H, Neumark Y. Changes in smoking behaviour and home-smoking rules during the initial COVID-19 lockdown period in Israel. Int J Environ Res Public Health. 2021;18(4): 1931. pmid:33671203
- 3. Carreras G, Lugo A, Stival C, Amerio A, Odone A, Pacifici R, et al. Impact of COVID-19 lockdown on smoking consumption in a large representative sample of Italian adults. Tob Control. 2022;31(5): 615–622. pmid:33782199
- 4. Constant A, Conserve DF, Gallopel-Morvan K, Raude J. Socio-cognitive factors associated with lifestyle changes in response to the COVID-19 epidemic in the general population: Results from a cross-sectional study in France. Front Psychol. 2020;11: 579460. pmid:33132989
- 5. Cordon M, Eyestone E, Hutchison S, Dunlap D, Smith L, Williams RM, et al. A qualitative study exploring older smokers’ attitudes and motivation toward quitting during the COVID-19 pandemic. Prev Med Rep. 2021;22: 101359. pmid:33868901
- 6. Đogaš Z, Lušić Kalcina L, Pavlinac Dodig I, Demirović S, Madirazza K, Valić M, et al. The effect of COVID-19 lockdown on lifestyle and mood in Croatian general population: A cross-sectional study. Croat Med J. 2020;61(4): 309–318. pmid:32881428
- 7. Ferrante G, Camussi E, Piccinelli C, Senore C, Armaroli P, Ortale A, et al. Did social isolation during the SARS-CoV-2 epidemic have an impact on the lifestyles of citizens? Epidemiol Prev. 2020;44(5–6 Suppl 2): 353–362. https://doi.org/10.19191/EP20.5-6.S2.137
- 8. García-Esquinas E, Ortolá R, Gine-Vázquez I, Carnicero JA, Mañas A, Lara E, et al. Changes in health behaviors, mental and physical health among older adults under severe lockdown restrictions during the COVID-19 pandemic in Spain. Int J Environ Res Public Health. 2021;18(13): 7067. pmid:34281004
- 9. Gendall P, Hoek J, Stanley J, Jenkins M, Every-Palmer S. Changes in tobacco use during the 2020 COVID-19 lockdown in New Zealand. Nicotine Tob Res. 2021;23(5): 866–871. pmid:33515223
- 10. Giovenco DP, Spillane TE, Maggi RM, Lee EY, Philbin MM. Multi-level drivers of tobacco use and purchasing behaviors during COVID-19 “lockdown”: A qualitative study in the United States. Int J Drug Policy. 2021;94: 103175. pmid:33662811
- 11. Glenister KM, Ervin K, Podubinski T. Detrimental health behaviour changes among females living in rural areas during the COVID-19 pandemic. Int J Environ Res Public Health. 2021;18(2): 722. pmid:33467693
- 12. Gonzalez M, Epperson AE, Halpern-Felsher B, Halliday DM, Song AV. Smokers are more likely to smoke more after the COVID-19 California lockdown order. Int J Environ Res Public Health. 2021;18 (5): 2582. pmid:33807503
- 13. Gravely S, Craig LV, Cummings KM, Ouimet J, Loewen R, Martin N, et al. Smokers’ cognitive and behavioural reactions during the early phase of the COVID-19 pandemic: Findings from the 2020 ITC Four Country Smoking and Vaping Survey. PloS One. 2021;16(6): e0252427. pmid:34086706
- 14. Guignard R, Andler R, Quatremère G, Pasquereau A, du Roscoät E, Arwidson P, et al. Changes in smoking and alcohol consumption during COVID-19-related lockdown: A cross-sectional study in France. Eur J Public Health. 2021;31(5): 1076–1083. pmid:33826721
- 15. Klein EG, Koopman Gonzalez S, Pike Moore S, Bohnert EJ, Quisenberry AJ, Trapl ES. Pulling your mask down to smoke: Qualitative themes from young adults on nicotine use during a pandemic. Subst Use Misuse. 2021;56(4): 437–441. pmid:33435783
- 16. Koopmann A, Georgiadou E, Reinhard I, Müller A, Lemenager T, Kiefer F, et al. The effects of the lockdown during the COVID-19 pandemic on alcohol and tobacco consumption behavior in Germany. Eur Addict Res. 2021;27(4): 242–256. pmid:33902030
- 17. Kowitt SD, Cornacchione Ross J, Jarman KL, Kistler CE, Lazard AJ, Ranney LM, et al. Tobacco quit intentions and behaviors among cigar smokers in the United States in response to COVID-19. Int J Environ Res Public Health. 2020;17(15): 5368. pmid:32722469
- 18. Reynolds CME, Purdy J, Rodriguez L, McAvoy H. Factors associated with changes in consumption among smokers and alcohol drinkers during the COVID-19 ‘lockdown’ period. Eur J Public Health. 2021;31(5): 1084–1089. pmid:33839763
- 19. Siddiqi K, Siddiqui F, Khan A, Ansaari S, Kanaan M, Khokhar M, et al. The Impact of COVID-19 on smoking patterns in Pakistan: Findings from a longitudinal survey of smokers. Nicotine Tob Res. 2021;23(4): 765–769. pmid:33029618
- 20. Tzu-Hsuan Chen D. The psychosocial impact of the COVID-19 pandemic on changes in smoking behavior: Evidence from a nationwide survey in the UK. Tob Prev Cessat. 2020;6: 59. pmid:33163705
- 21. Vanderbruggen N, Matthys F, Van Laere S, Zeeuws D, Santermans L. Self-reported alcohol, tobacco, and cannabis use during COVID-19 lockdown measures: Results from a web-based survey. Eur Addict Res. 2020;26(6): 309–315. pmid:32961535
- 22. Vogel EA, Henriksen L, Schleicher NC, Prochaska JJ. Perceived susceptibility to and seriousness of COVID-19: Associations of risk perceptions with changes in smoking behavior. Int J Environ Res Public Health. 2021;18(14): 7621. pmid:34300072
- 23. Yingst JM, Krebs NM, Bordner CR, Hobkirk AL, Allen SI, Foulds J. Tobacco use changes and perceived health risks among current tobacco users during the COVID-19 pandemic. Int J Environ Res Public Health. 2021;18(4): 1795. pmid:33673207
- 24. Zhang X, Oluyomi A, Woodard L, Raza SA, Fahmideh MA, El-Mubasher O,et al. Individual-level determinants of lifestyle behavioral changes during COVID-19 lockdown in the United States: Results of an online survey. Int J Environ Res Public Health. 2021;18(8): 4364. pmid:33924056
- 25. Pelham 3rd WE, Yuksel D, Tapert SF, Baker FC, Pohl KM, Thompson WK, et al. Did the acute impact of the COVID-19 pandemic on drinking or nicotine use persist? Evidence from a cohort of emerging adults followed for up to nine years. Addict Behav. 2022;131: 107313. pmid:35413486
- 26. Kalkhoran SM, Levy DE, Rigotti NA. Smoking and e-cigarette use among U.S. adults during the COVID-19 pandemic. Am J Prev Med. 2022;62(3): 341–349. pmid:34756629
- 27. Stanton R, To QG, Khalesi S, Williams SL, Alley SJ, Thwaite TL, et al. Depression, anxiety and stress during COVID-19: Associations with changes in physical activity, sleep, tobacco and alcohol use in Australian adults. Int J Environ Res Public Health. 2020;17(11): 4065. pmid:32517294
- 28. Hipp L, Bünning M, Munnes S, Sauermann A. Problems and pitfalls of retrospective survey questions in COVID-19 studies. Survey Res Methods. 2020;14: 109–114. https://doi.org/10.18148/SRM/2020.V14I2.7741
- 29. Mary-Krause M, Herranz Bustamante JJ, Bolze C, Galéra C, Fombonne EJ, Melchior M. Cohort profile: The TEMPO cohort study. Int J Epidemiol. 2021;50(4): 1067–1068k. pmid:34015132
- 30.
ASEBA—The Achenbach System of Empirically Based Assessment. ASEBA. Available from: https://aseba.org/
- 31. Patrick DL, Cheadle A, Thompson DC, Diehr P, Koepsell T, Kinne S. The validity of self-reported smoking: A review and meta-analysis. Am J Public Health. 1994;84(7): 1086–93. pmid:8017530
- 32. van der Aalst CM, de Koning HJ. Biochemical verification of the self-reported smoking status of screened male smokers of the Dutch–Belgian randomized controlled lung cancer screening trial. Lung Cancer. 2016;94: 96–101. pmid:26973213
- 33.
Wong SL, Shields M, Leatherdale S, Malaison E, Hammond D. Assessment of validity of self-reported smoking status. Health Rep. 2112;23(1): 47–53. pmid:22590805.
- 34.
Recall Bias—An overview | ScienceDirect Topics. Available from: https://www.sciencedirect.com/topics/neuroscience/recall-bias