Figures
Abstract
Snacks, while widely consumed in the United States (U.S.), do not have a standard definition, complicating research to understand associations, if any, with weight status. Therefore, the purpose of this study was to examine the association between snacking frequency and weight status using various snacking definitions that exist in the scientific literature among U.S. adults (NHANES 2013–2016; ≥20y n = 9,711). Four event-based snacking definitions were operationalized including participant-defined snacks, eating events outside of meals, and operationally defined snacks based on absolute thresholds of energy consumed (>50 kcal). Weight status was examined using body mass index (BMI), waist circumference, and sagittal abdominal diameter risk. Logistic regression models examined snacking frequency and associations with weight status. Outcomes varied by the definition of a snack employed, but the majority of findings were null. Mean energy from snacks was significantly higher among women with obesity compared to women with normal weight when a snack was defined as any event outside of a typical mealtime (i.e. other than breakfast, lunch, dinner, super, brunch), regardless of whether or not it contributed ≥50 kcal. Further investigation into ingestive behaviors that may influence the relationship between snacking frequency and weight status is needed.
Citation: Cowan AE, Higgins KA, Fisher JO, Tripicchio GL, Mattes RD, Zou P, et al. (2020) Examination of different definitions of snacking frequency and associations with weight status among U.S. adults. PLoS ONE 15(6): e0234355. https://doi.org/10.1371/journal.pone.0234355
Editor: Mauro Lombardo, San Raffaele Roma Open University, ITALY
Received: February 7, 2020; Accepted: May 22, 2020; Published: June 17, 2020
Copyright: © 2020 Cowan et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: We have read the journal's policy and the authors of this manuscript have the following competing interests: KAH is an employee at Exponent Inc. and a board member of the Institute of Food Technologists Washington, DC section. RLB has served as a consultant in the past to the NIH Office of Dietary Supplements, Nestlé, the General Mills Bell Institute, Columbia University, RTI International, and Nutrition Impact; and is a trustee of the International Food Information Council and a board member of International Life Sciences Institute-North America. RLB has received travel support to present her research from Council of Responsible Nutrition, American Society of Nutrition, RTI International, and the New York Academy of Sciences unrelated to this work. JOF has served as a consultant in the past to Weight Watchers and Nestle. This does not alter our adherence to PLOS ONE policies on sharing data and materials. There are no patents, products in development or marketed products to declare. AEC, GLT, RDM, and PZ have no conflicts of interest to disclose.
Introduction
Snacking (i.e., eating between meals) is a hallmark of the American dietary pattern, with more than 90% of adults in the United States (U.S.) reporting consumption of one or more snacks on a given day [1]. Although snacking has been prevalent for decades in the U.S., the frequency and portion sizes of snacks have increased over time [2]. This has prompted concern that snacking may potentially contribute to positive energy balance [1, 2]. Indeed, snacks currently comprise nearly one-quarter (22%) of total energy intake among adults [1]. Given the associations between excess energy intake and overweight and obesity, with attendant comorbidities such as type 2 diabetes, hypertension, and dyslipidemia [3, 4], understanding the role of snacking and weight status is of paramount public health importance.
The ability to elucidate the relationship between snacking and weight status is impeded by the lack of a consistent definition of the term “snack” or behavior “snacking” [5]. Various measures have assessed the energy content of the foods ingested [5, 6], timing of consumption [7–11], type of food [11, 12], juxtaposition to meal (also ambiguously defined) ingestion [13–15], or simple, consumer-defined categorizations [2, 11, 16–19]. These indices each capture one component of snacking behavior but do not adequately capture the phenomenon. Measurement of snack energy content alone fails to account for possible compensatory or exacerbating effects of eating frequency; in addition, defining by snack energy content can lead to defining trivial amounts of energy as snacks and categorizing high-energy events between typical meal times as meals. Timing of snack consumption does not account for portion size and/or energy density. Categorizing foods as snacks or meal components is fraught with error since many foods are commonly ingested under both eating events. Drawing a distinction between ingestive events labeled as “snacks” or “meals” requires that at least one be clearly defined and that has not been the case in research to date. Finally, the reliance on consumer-defined categorizations, often the only practical option in large epidemiological trials, suffers from uncontrolled inter-individual variance in opinion of what a snack is and reporting bias. Therefore, the snack definitions used in a dietary analysis address different research questions and have important implications for how the findings can be interpreted.
Given the limitations of each snack definition and the consequent low confidence in the conclusions that can be drawn from studies that use them [7, 20–23], there are conflicting viewpoints on whether to encourage or restrict snack consumption [18, 19, 24–27]. Some evidence indicates that snacking may contribute substantially to nutrient intake and, if appropriately managed, could enhance diet quality [25]. In order to address these limitations, the present study aims to examine associations between snacking and body weight status using multiple definitions of intake.
Previous studies have shown that snacking frequency is associated with greater risk of overweight and obesity (OW/OB) in both younger children [16] and among older children and adolescents [17]. However, compensatory responses to additional dietary energy either in the form of increased ingestive frequency or portion size tend to be more robust among children than adults in some [20, 21, 28], but not all clinical trials [22]. Therefore, increased snacking frequency may pose a greater risk of OW/OB among adults. However, little is known about the nature and ramifications of adult snacking. Therefore, the aim of this NHANES analysis was to examine associations of snacking and weight status among U.S. adults, comparing four definitions of a snack based on definitions commonly used in the literature. Measures of weight status include body mass index (BMI), as well as waist circumference (WC) and sagittal abdominal diameter (SAD); two emerging parameters related with cardio metabolic health [23, 29, 30].
Methods
Survey description
The 2013–2016 National Health and Nutrition Examination Survey (NHANES) was used for the present analysis. NHANES is a nationally representative, continuous cross-sectional survey of the noninstitutionalized, civilian residents of the U.S., conducted by the Centers for Disease Control and Prevention, National Center for Health Statistics (NCHS) [31]. NHANES employs a complex, stratified, multistage probability cluster sampling design. The NHANES protocol includes an in-person household interview that queries health information and demographics as well as a follow-up health examination in the Mobile Examination Center (MEC) for each participant. All demographic and health-related characteristics included in this report were collected during the household interview. Anthropometric measurements and dietary intake data were collected by trained study staff approximately three weeks after the household interview during the follow-up health examination in the MEC. Written informed consent was obtained for all participants or proxies and NHANES survey protocol was approved by the Research Ethics Review Board at NCHS. Additional details about NHANES dietary and anthropometric assessment are available elsewhere [32, 33].
Demographic, anthropometric, and dietary data from the NHANES 2013–2014 and 2015–2016 cycles were combined to form a sample of 20,146 participants. Participants who were < 20 years of age (n = 8,295), did not complete either the household interview or MEC examination (n = 789), were missing BMI or race/Hispanic origin information (n = 136), pregnant and/or lactating (n = 217), or did not provide reliable dietary recall information that met the minimum criteria (DR1DRSTZ not equal to 1) (n = 932) were excluded, yielding a total sample of 9,777 U.S. adults. Data on WC and SAD were available for 9,473 and 9,312 participants, respectively. Few participants were underweight (58 men and 86 women), and thus excluded due to small sample size, resulting in a final analytic sample of 9,633 adults (4,726 men and 4,907 women).
Demographic and health-related characteristics
Demographic and health-related characteristics, including data on sex, age, race/Hispanic origin, income, and smoking status were collected from participants using the Computer-Assisted Personal Interview system during the household interview. These covariates were included because of their association with BMI and other dietary behaviors [34–37]. Age (in years) was included as a continuous variable in all analyses. Race and Hispanic origin is categorized in this analysis as recommended by the NCHS as non-Hispanic white, non-Hispanic black, non-Hispanic Asian, and Hispanic/Mexican American (combined). Income was classified using the family income-to-poverty ratio (PIR), a measure of income established by the Department of Health and Human Services representing the ratio of family income to the poverty guidelines relative to family size, a variable that is available in NHANES (INDFMPIR) [38]. Three PIR categories were used in this analysis: ≤ 130%, 131% to 350%, and > 350% to be consistent with previous NHANES analyses [39–42]. Current smoking status was determined based on whether participants were never smokers (smoked < 100 cig/lifetime), former smokers (>100 cig/lifetime but do not currently smoke), or current smokers. Current smokers were then further classified based on whether they smoked cigarettes daily (current, daily) or whether they classified themselves as a smoker, but did not smoke cigarettes daily (current, occasional) [39, 43].
Dietary assessment
Dietary intake was self-reported in the MEC using the in-person, day one 24-hour dietary recall (24HR). The 24HR is collected by trained interviewers using the U.S. Department of Agriculture’s (USDA) automated multiple-pass method (AMPM) [44]. The USDA, Food and Nutrient Database for Dietary Studies 2015–2016 (FNDDS) [45] was used to convert foods and beverages as reported, to their respective energy and nutrient values. For each ingestive event reported on the 24HR, a time stamp, name of eating event, and all foods and/or beverages consumed during that event were collected. Types of ingestion events and their Spanish equivalents include: breakfast, lunch, dinner, supper, brunch, snack, drink, desayano, almuerzo, comida, merienda, cena, entre comida, botana, bocadillo, tentempie, bebida, and extended consumption. Events defined as “infant feeding,” “other,” or “don’t know” were excluded from this analysis. Consistent with previous studies, all foods consumed at the same clock time were considered the same ingestive event [6, 46]. Mean energy density of a snack was included as a covariate in the models to serve as a proxy for nutrient quality and was calculated as the total energy density of a snack (kcal/g) inclusive of foods and beverages. Energy density varies extensively between liquids and semi-sold/solid foods due to differences in water content [47]; thus, preliminary analyses calculating mean energy density with and without the inclusion of beverages were conducted. Insignificant differences in mean total snack energy density were observed when excluding beverages; therefore, mean total snack energy density inclusive of beverages was chosen as the continuous covariate in all subsequent analyses including mean energy density of a snack (Models 1 and 3, described below). Models adjusting for mean energy of a meal were also explored; however, due to strong correlation between mean energy of a meal and the ratio of reported energy intake (EI) to estimated energy requirement (EER), as observed by Murakami et al. [6], this covariate was excluded from all subsequent analyses. Additional dietary variables included in the models as nominal covariates include recall day of the week (weekday/ weekend), and typical food consumption day amount (as defined in NHANES (DR1_300)).
Reporting accuracy
Self-reported dietary intake data can be prone to systematic error, like energy underreporting [48]. In order to mitigate the effects of energy underreporting, the ratio of reported EI to EER (EI:EER) was used to determine the accuracy of reported EI and was included as a covariate in select statistical models [6, 49, 50]. The EER equation used in the Dietary Reference Intakes (DRI) is based on age, sex, weight, height, and physical activity level (PAL) [51]. Low PAL (i.e., 1.4–1.59) was assumed because data from the physical activity questionnaire were not adequate to estimate PAL and physical activity monitor data were not available in the 2013–2014, 2015–2016 cycles of NHANES [31].
Snacking definitions
Four event-based definitions were operationalized based on energy content, participant definition of a snack, and ingestive events consumed outside of typical meals. These definitions included: (1) any consumption event defined by the reporter as a “snack” or Spanish language equivalent; (2) any consumption event defined by the reporter as a “snack” or Spanish language equivalent that contributed ≥50 kcal; (3) any consumption event outside of a typical meal time (i.e. other than breakfast, lunch, dinner, super, brunch) including self-defined snacks; and (4) any consumption event outside of a typical meal time (i.e. other than breakfast, lunch, dinner, super, brunch) including self-defined snacks that contributed ≥50 kcal. Two of the four definitions took into account a 50 kcal cut-point in order to evaluate each definition with and without occasions that may not be considered an ingestive episode, as some previous studies consider ingestive episodes with less than 50 kcal to be trivial [6]. While it is possible that this method may eliminate low-energy eating occasions (i.e., ingestive episodes containing fruit, vegetables, diet beverages, and/or other reduced-energy snacks), and in turn, attenuate the relationship between snacking frequency and weight status; a sensitivity analysis using a 5 kcal cut-point definition, as conducted in previous work [16, 17], did not differ from a 50 kcal cut-point. The inclusion of two additional snack definitions based on percentage of total daily energy were explored because of its use differentiating meals in other epidemiological trials investigating meal pattern behaviors [7]. These definitions included any consumption event that contributed < 15% of total daily energy intake and any consumption event that contributed < 15% of total daily energy intake and contributed ≥50 kcal. However, due to the fact that breakfast meals typically contribute approximately 18% of total daily energy among adult men and women [52], this definition likely misclassifies breakfast meals as snacks. Therefore, this definition lacks specificity and is not appropriate for this analysis. (Table 1).
Anthropometric characteristics
Three indicators of weight status were chosen for examination in this analysis, including BMI, WC, and SAD. BMI, obtained from height and weight collected by trained health technicians during the health examination in the MEC, was calculated as weight in kg divided by height in meters squared. Standard BMI categories were constructed: underweight (<18.5, excluded), normal (18.5–24.9), overweight (25.0–29.9), and obese (≥30) [53]. Overweight and obese (OW/OB) were combined because few demographic differences were observed with exceptions noted for race/Hispanic origin in men and women, and PIR in women. In addition to BMI, WC and SAD were also collected during the health examination by trained health technicians using standardized NHANES protocol [54]. WC cut-points of ≥102 cm for men and ≥88 cm for women were used to define abdominal obesity, as well as SAD cut-points of ≥25 cm and ≥24cm in men and women, respectively [29, 30, 55].
Statistical analysis
Statistical analyses were performed using SAS software (version 9.4; SAS Institute Inc., Cary, NC) and SAS-callable SUDAAN (version 11; Research Triangle Institute, Raleigh, NC, USA) software programs to account for differential nonresponse and non-coverage, and to adjust for oversampling and post-stratification by use of the NHANES dietary day 1 sample weights. PROC DESCRIPT was used to compute prevalence estimates and means of a group for demographic characteristics; a p-value of <0.01 was considered statistically significant (Table 2, S1 Table). Associations between BMI and mean snacking frequency, mean energy of a snack event, and percent daily energy from snacks adjusted for EI:EER were investigated for each of the snacking definitions using multiple linear regression analysis derived from the PROC REGRESS procedure (Table 3). Satterthwaite-adjusted F-tests were conducted to assess differences in mean number of snacks per day, mean energy of a snack event, and percent daily energy from snacks for each of the snacking definitions across BMI categories when compared to those with a normal weight, respectively, at a two-sided p-value of <0.001 (Table 3). Logistic regression (PROC RLOGIST) was used to evaluate the odds ratio (OR) of overweight and obesity (OW/OB, BMI ≥ 24.9 kg/m2), elevated WC risk (WC ≥102 cm men; ≥88 cm women), and elevated SAD risk (SAD ≥25 cm; ≥24 cm), relative to snacking frequency when compared to the referent group of 0 snacks per day (i.e., the lowest snack category) (Tables 4 and 5). Because of the large number of snacking definitions and models examined and the exploratory nature of this analysis, a p value of < 0.001 was established to minimize the chance of a Type I error. A Taylor Series Linearization approach was used to approximate standard errors (SEs) for all estimates.
Several models comparing snacking frequency by definition with weight status were examined. First, we examined the crude, unadjusted relationship between snacking and weight status. Second, we built models including factors related to the exposure and outcome and derived fully adjusted models, including demographic, lifestyle, and dietary factors related to the research question and informed by previous analyses, as presented in the main tables [6, 16, 17, 46]. In supplemental tables, we present additional models that are more parsimonious as part of a sensitivity analysis to examine the effects of covariate selection.
Results
As representative of the adult U.S. population, this analytic sample was approximately 48.3 years of age, non-Hispanic white (65.3%), primarily women (50.7%), and had overweight (33.2%) or obesity (39.3%) (Table 2). While more men were classified as overweight, more women were classified as obese. Overall, the majority of adults did not have a history of smoking (56.1%), but sex differences were noted. Most Americans fall in to the low or middle PIR categories. Additional details regarding the demographic characteristics of men and women included in our analytic sample by weight status are provided in S1 Table.
The number of daily snacking occasions varied in magnitude by the snack definition employed, and generally ranged between 1.2 and 3.0 snacks per day among men and women (Table 3). The frequency of snack consumption was highest when a snack was defined as any eating occasion outside of a typical meal time (Snacks + other eating between meals), with this definition yielding an average of approximately three snacks per day (Fig 1). Frequency of snacking was generally similar between men and women across the various snack definitions, with the biggest difference in snack frequency being when a snack was defined by the participant (i.e. Snacks). No significant differences in number of snacks consumed were observed when comparing weight status categories, regardless of the snack definition among men and women.
1 Values are means unless otherwise indicated. An asterisk “*”denotes a snack defined as an event that contributed ≥ 50 kcal. 2 Snack defined as an event defined by the reporter as a “snack.” 3Snack defined as an event outside of a typical mealtime.
Mean snack energy ranged from 67.4 to 134.0 kcal per snacking occasion among men, and from 54.1 to 96.2 kcal per snacking occasion among women, contributing approximately 15.3–24.2% and 16.9–24.3% of total daily energy among men and women, respectively (Table 3). Snacks defined as any event outside of a typical meal time that contributed more than 50 kcal were consistently higher in snack energy content, as opposed to snacks defined by the participant, which were the lowest in snack energy content out of the four snacking definitions operationalized. Mean energy from snacks differed by weight status in women but not men. Specifically, when snacks were defined as any event outside of a typical meal time, mean energy from snacks was significantly higher (~15–20 kcals/snack) among women with obesity compared to women with normal weight, regardless of whether it contributed more than 50 kcal (Snacks + other eating between meals and Snacks + other eating between meals, ≥50 kcal). These findings were not congruent with percent of daily energy from snacks; unlike mean snack energy, the percent of daily energy contributed by snacks did not differ by weight status among men and women, but varied by snack definition (Table 3). Broadly, snacks defined as any event outside of a typical meal time provided approximately 24% of total daily energy, regardless of whether it contributed more than 50 kcal (Snacks + other eating between meals and Snacks + other eating between meals, ≥50 kcal), as opposed to snacks defined by the participant, which contributed only 15–17% of total daily energy, regardless of whether the snack contributed more than 50 kcal (Snacks and Snacks, ≥50 kcal). Yet, these differences did not differ substantially by weight status categories.
In general, the relationship between snacking frequency and adiposity was largely null across all indicators of weight status (i.e., OW/OB, WC, and SAD) (Tables 4 and 5). In both men and women, frequency of snacking was not significantly associated with adverse weight status for any of the definitions examined (Tables 4 and 5); yet, these associations did vary somewhat by indicator of weight status. Most notably, men who consumed two snacks per day tended (p = 0.01) to be at lower risk of elevated WC than men who did not consume any snacks (i.e., 0 snacks per day), when a snack was defined by the participant and contributed more than 50 kcal; however, this difference did not reach statistical significance, and this association was not observed with increased risk of OW/OB or elevated SAD. Furthermore, even when evaluating the relationship between weight status indicators and snacking frequency in further models with more minimal adjustments, no associations were observed among men or women when adjusting for fewer covariates than those included in the fully adjusted models (S2 and S3 Tables).
Discussion
Overweight and obesity persist as significant public health issues in the U.S. Understanding modifiable factors that are related to unhealthy weight status in adults is critical for the development of public health interventions aimed at reducing the risk of overweight, obesity, and their related comorbidities. Snacking is one behavior that has been implicated in the etiology of overweight/obesity. Snacking incidence has increased markedly over the past four decades [2] and it is estimated to contribute approximately 20–25% of daily energy [1, 56, 57]. In North America, Northern Europe, and South America, snacking contributes approximately as much energy as breakfast to the daily diet [56]. While snacking and eating frequency have been associated with positive energy balance, the link to overweight/obesity has been less clearly established [27, 58]. One possible contributor to this apparent lack of congruency may be the inconsistency in definitions of snacking as this could add considerable variance to its estimation. While associations between snack characteristics and adiposity varied by event-based definitions of snacking as hypothesized, the association between snack frequency and adiposity was largely null among U.S. adults.
Two important dimensions of snacking are its possible contribution to eating frequency and the energy content of snacking events. This analysis focused on the effects of frequency and size of snacking occasions on multiple metrics of adiposity in a nationally representative sample of U.S. adults. While BMI categories and WC are primarily used to define weight status, SAD is an additional proposed measure that may provide a more accurate indicator of adiposity associated with increased risk of adverse metabolic effects/metabolic syndrome [23, 29, 30].
This analysis indicated snack frequency was not associated with weight status regardless of the event-based definition tested. However, snack definition did play a role in the associations between weight status, mean energy from snacks among women, and the percent of total daily energy from snacks. Most notably, mean energy from snacks among women with obesity was higher than in women with a normal weight when a snack was defined as any ingestive event between meals (Snacks + other eating between meals), but not when a snack was defined by the participant (Snacks). This difference in mean energy between definitions suggests that energy from other ingestive events between typical meal times that participants do not consider to be snacks may be underestimated or poorly compensated and contribute to excess energy intake. Snack frequency and percent of total energy from snacks were not significantly different between women with a normal weight and women with obesity. Because this association is not statistically significant in men, other psychosocial factors associated with sex may play a role, or may be related to the omission of reported snacks by men [59, 60]. Total percent daily energy from snacks was different between snack definitions, which is attributed to potentially more ingestive occasions being included in the snack definitions that included all events outside of typical meal times (Snacks + other eating between meals). This further emphasizes that events consumed outside of typical meal times may not be considered snacks by the consumer. This is not just a semantic issue; these events that are not defined by the consumer as snacks or meals potentially contribute as much as 7–9% of total energy intake (17–19% of energy with Snacks definition versus 24% of energy with Snacks + other eating between meals), or approximately 140 to 180 kcal assuming a 2,000 kcal diet. Therefore, measurement of snacks defined by the consumer and typical meal times may underestimate total daily energy intake. Despite the potential ramifications the different definitions may have on interpretation of research findings, there was generally no difference in adiposity risk between the different snack definitions utilized in this analysis.
The second dimension of snacking contributes to total energy intake and is related to the energy content of snacking events, which was not investigated in this analysis. An investigation into the association between total snack energy intake and weight status may provide insight into whether snack energy intake opposed to snack frequency promotes differences in weight status. It would also be useful to examine food form or snacks as beverages, which may evoke weaker energy compensation [61] than solid foods and are common components of snacking occasions [62, 63].
Each event-based definition included in the analysis addresses a slightly different question regarding the association between snack frequency and weight status. Defining a snack based on the participant’s self-report is culturally relevant and provides insight into how snacks are defined by the general population. However, each subject has their own individual classification system to define their ingestive events that could be based on a variety of criteria including time of day, type of food consumed, or portion size. This variability in snack classification between subjects introduces error leading to an over- or under-estimation of snack frequency. In addition, sugar-sweetened beverages, which can contribute substantially (236–388 kcal/day among U.S. adults [64]) to total energy intake [65], are commonly not classified as snacks or not reported entirely despite meeting the criteria of a snack (e.g., consumption between meals and energy content lower than typical meals). Defining a snack based on events consumed outside of typical meal times does provide a more systematic measure of snack frequency than self-report. However, because this definition does not take into account energy content, events consumed outside typical meals that may be equivalent to the energy consumed within a meal could in fact contribute substantially to total daily energy intake. Therefore, results should be interpreted in the context of the snack definition utilized and the question each definition addresses in this and other analyses.
At this time, an association between snacking and weight status among adults continues to be debated, and evidence remains mixed. Murakami and colleagues [6] observed models adjusted for the accuracy of energy reporting resulted in a positive or null association between snacking frequency and risk of OW/OB in both men and women. Notably, the odds of OW/OB was associated with snacking frequency when snacking was defined as a “snack” by the reporter or by percent of total daily energy intake among men, and when snacking was defined by percent of total daily energy intake (but not when defined by the reporter) among women [6]. However, the cut off used by Murakami et al. to define a meal based on percent of total daily energy intake was 15% of total daily energy [6], which may misclassify breakfast meals due to the low energy content of breakfast compared to other meal times (i.e., ~18% of total daily energy among U.S. men and women [52]). In addition, models employed in this analysis controlled for protein, fat, total sugar, alcohol, and fiber intake, which may over adjust or confound the model, biasing resultant findings [66]. The results of our current analysis do not support previous literature, which may be related to the inclusion of snack energy density in the model.
These largely null associations also differ from our previous work in children. A recent study conducted by Tripicchio et al. among U.S. adolescents concluded that adolescents with overweight and obesity not only consumed a greater number of snacks per day than their normal weight counterparts, but also have a higher energy intake at each snacking occasion than those with a normal weight [17]. These findings by Tripicchio et al. are concordant with research conducted by Kachurak et al. in children, specifically among those under 2 years of age, where positive associations between weight status and snacking were consistently seen when the snacking definitions accounted for ingestive events outside of traditional meal time [16]. Kachurak et al. also determined that regardless of age, children with overweight and obesity were more likely to have greater daily energy intake than their normal weight counterparts, which may, in turn, corroborate their findings [16]. Growth is a time of increasing energy need, so the relationship with snacking observed in children does not appear to be similar to our findings in adults.
Strengths and limitations
NHANES is a nationally representative survey of the U.S. noninstitutionalized population. This analysis was designed to provide a framework to evaluate the association between snacking and body weight status at the population-level. The USDA’s AMPM is a state of the art method for dietary data collection as is the FNDDS database used to process dietary data. However, self-reported dietary data are prone to systematic errors, and tend to underestimate true energy intake [67]. Nevertheless, there are many important uses of self-reported dietary data, especially for monitoring trends over time for nutrition and health outcomes [48]. In order to reduce potential bias in energy underreporting, we included the EI:EER ratio in our models to account for reporting bias to the extent possible. Because detailed information on physical activity was not available in these survey years, a low physical activity was assumed based on prior research suggesting this is a reasonable assumption based on previous research that included activity monitors [6, 68, 69]. However, assuming all individuals are sedentary or participate in low physical activity would bias estimates for adults who report moderate or vigorous physical activity. In addition to systemic underestimation of total energy intake, snack foods are more likely to be underreported compared to foods consumed as meals [70]. The event-based snack definitions utilized in the analysis are representative of definitions in the published literature; however, other snack definitions such as definitions based on the type of food consumed, amount of energy consumed, or time of day may provide additional insight into the relationship between snack frequency and adiposity and warrant further exploration. Our findings are limited by the cross-sectional nature of NHANES data, and a causal relationship cannot be definitively determined. We chose to use NHANES to examine this research question, because NHANES is a nationally representative sample of the US population and allowed for analysis of snacking patterns at the population level. Longitudinal cohort studies and randomized controlled trials are needed to address the causal relationship, if any, between frequency and definition of snacking with weight status. Due to the exploratory nature of this analysis, a p value of < 0.001 was established to minimize the chance of a Type I error; however, under a less restrictive p value of <0.05, some significant findings were observed, suggesting that the conservative approach taken may serve as a potential limitation of our analysis. OW/OB results from a constellation of dietary, genetic, behavioral, and environmental factors and remains of serious public health concern given that OW/OB increases the risk of metabolic syndrome, cardiovascular disease, type 2 diabetes mellitus, and some cancers [71–73]. Furthermore, while we made every attempt to control for known confounding variables, given the cross-sectional nature of this study and the complexity of etiologic factors that are related to weight, we cannot rule out the potential of residual confounding.
Conclusions
Despite hypotheses that the use of different event-based definitions of snacking may account for the mixed findings on the role of snacking in weight management, this analysis did not yield robust effects of the definitions tested. Confirmation of these findings based on cross-sectional survey data with longitudinal assessments and clinical trials is warranted given the high level of energy contributed by snacks and consequent potential challenge they pose to achieving a healthy weight.
Supporting information
S1 Table. Demographic characteristics by weight status, NHANES 2013–2016.
1–4 Abbreviations: BMI, body mass index (calculation as weight in kilograms divided by height in meters squared); SE, standard error; PIR, family income-to-poverty ratio. 1 Values are percent (SE) unless otherwise indicated. 2 Different superscript letters (a,b,c) indicate significant differences within a row (i.e., weight status categories) at p-value of < 0.01. 3 BMI Categories (kg/m2): Normal weight, 18.5≤ BMI <25; Overweight, 25≤ BMI <30; Obese, BMI ≥ 30. Underweight (BMI < 18.5, n = 144) were excluded due to a small sample size. 4 Race/Hispanic Origin does not sum to 100 because the other race category is not shown.
https://doi.org/10.1371/journal.pone.0234355.s002
(DOCX)
S2 Table. Odds ratio of overweight or obesity (BMI ≥ 25 kg/m2), Waist Circumference (WC) >102cm, and Sagittal Abdominal Diameter (SAD) >25cm with snacking frequency among U.S. adult men (≥20y) in models controlling for additional covariates, NHANES 2013–2016.
1–2 Abbreviations: Ref, Reference Value. 1 OW/OB: Odds ratio of overweight or obesity (BMI≥25); WC: Odds ratio of waist circumference > 102cm; SAD: Odds ratio of SAD>25cm; EER: Men EER = 662 –(9.53 x age [y]) + PA x [(15.91 x weight [kg]) + (539.6 x height [m])], Women EER = 354 –(6.91 x age [y]) + PA x [(9.36 x weight [kg]) + (726 x height [m])]. A p-value of < 0.001 was considered statistically significant. 2 An asterisk “*”denotes a snack defined as an event that contributed ≥ 50 kcal. 3 Snack defined as an event defined by the reporter as a “snack.” 4 Covariates included in Model 2: age (continuous), race (NH—White, NH-Black, NH-Asian, Hispanic), family income-to-poverty ratio (PIR ≤ 130%, 130% < PIR ≥ 350%, PIR > 350%), day of recall (weekend, weekday), typical intake (usual intake, much more than usual, much less than usual), smoking status (never smoked, former smoker, current smoker occasionally, current smoker daily), and EI:EER. 5 Covariates included in Model 3: covariates included in Model 2 with the exception of EI:EER, and the addition of mean energy of a snack and mean energy density (kcal/g) of a snack. 6 Snack defined as an event outside of a typical mealtime.
https://doi.org/10.1371/journal.pone.0234355.s003
(DOCX)
S3 Table. Odds ratio of overweight or obesity (BMI ≥ 25 kg/m2), Waist Circumference (WC) >102cm, and Sagittal Abdominal Diameter (SAD) >25cm with snacking frequency among U.S. adult women (≥20y) in models controlling for additional covariates, NHANES 2013−2016.
1,2 Abbreviations: Ref, Reference Value. 1 OW/OB: Odds ratio of overweight or obesity (BMI≥25); WC: Odds ratio of waist circumference > 102cm; SAD: Odds ratio of SAD>25cm; EER: Men EER = 662 –(9.53 x age [y]) + PA x [(15.91 x weight [kg]) + (539.6 x height [m])], Women EER = 354 –(6.91 x age [y]) + PA x [(9.36 x weight [kg]) + (726 x height [m])]. A p-value of < 0.001 was considered statistically significant. 2 An asterisk “*”denotes a snack defined as an event that contributed ≥ 50 kcal. 3 Snack defined as an event defined by the reporter as a “snack.” 4 Covariates included in Model 2: age (continuous), race (NH—White, NH-Black, NH-Asian, Hispanic), family income-to-poverty ratio (PIR ≤ 130%, 130% < PIR ≥ 350%, PIR > 350%), day of recall (weekend, weekday), typical intake (usual intake, much more than usual, much less than usual), smoking status (never smoked, former smoker, current smoker occasionally, current smoker daily), and EI:EER. 5 Covariates included in Model 3: covariates included in Model 2 with the exception of EI:EER, and the addition of mean energy of a snack and mean energy density (kcal/g) of a snack. 6 Snack defined as an event outside of a typical mealtime.
https://doi.org/10.1371/journal.pone.0234355.s004
(DOCX)
Acknowledgments
The authors’ responsibilities were as follows: AEC, KAH, and RLB: designed the research and concepts presented; AEC, KAH, RLB, and RDM: wrote sections of the paper; AEC, KAH, and PZ: preformed the analysis; RLB, RDM, JOF, and GLT: provided critical review and insights presented; and all authors: read and approved the final paper.
References
- 1.
U.S. Department of Agriculture Agricultural Research Service. Snacks: Percentages of Selected Nutrients Contributed by Food and Beverages Consumed at Snack Occasions by Gender and Age, What We Eat in America, NHANES 2015–2016. 2018.
- 2. Kant AK, Graubard BI. 40-year trends in meal and snack eating behaviors of American adults. Journal of the Academy of Nutrition and Dietetics. 2015;115(1):50–63. pmid:25088521
- 3.
Institute of Medicine Committee on D, Health. In: Woteki CE, Thomas PR, editors. Eat for Life: The Food and Nutrition Board's Guide to Reducing Your Risk of Chronic Disease. Washington (DC): National Academies Press (US) Copyright (c) 1992 by the National Academy of Sciences.; 1992.
- 4. Mozaffarian D. Dietary and Policy Priorities for Cardiovascular Disease, Diabetes, and Obesity: A Comprehensive Review. Circulation. 2016;133(2):187–225. Epub 2016/01/10. pmid:26746178.
- 5. Ma Y, Bertone ER, Stanek EJ 3rd, Reed GW, Hebert JR, Cohen NL, et al. Association between eating patterns and obesity in a free-living US adult population. Am J Epidemiol. 2003;158(1):85–92. Epub 2003/07/02. pmid:12835290.
- 6. Murakami K, Livingstone MBE. Eating Frequency Is Positively Associated with Overweight and Central Obesity in US Adults. The Journal of nutrition. 2015;145(12):2715–24. pmid:26468490
- 7. Duffey KJ, Rivera JA, Popkin BM. Snacking is prevalent in Mexico. The Journal of nutrition. 2014;144(11):1843–9. Epub 2014/10/22. pmid:25332484.
- 8. Garriguet D. Canadians' eating habits. Health Rep. 2007;18(2):17–32. Epub 2007/06/21. pmid:17578013.
- 9. Ovaskainen ML, Tapanainen H, Pakkala H. Changes in the contribution of snacks to the daily energy intake of Finnish adults. Appetite. 2010;54(3):623–6. Epub 2010/03/30. pmid:20347899.
- 10. Ng SW, Zaghloul S, Ali H, Harrison G, Yeatts K, El Sadig M, et al. Nutrition transition in the United Arab Emirates. Eur J Clin Nutr. 2011;65(12):1328–37. Epub 2011/07/21. pmid:21772317.
- 11. Leech RM, Worsley A, Timperio A, McNaughton SA. Characterizing eating patterns: a comparison of eating occasion definitions. The American Journal of Clinical Nutrition. 2015;102(5):1229–37. pmid:26447152
- 12. Macdiarmid J, Loe J, Craig LCA, Masson LF, Holmes B, McNeill G. Meal and snacking patterns of school-aged children in Scotland. European Journal of Clinical Nutrition. 2009;63(11):1297–304. pmid:19707230
- 13. Wang Z, Zhai F, Zhang B, Popkin BM. Trends in Chinese snacking behaviors and patterns and the social-demographic role between 1991 and 2009. Asia Pac J Clin Nutr. 2012;21(2):253–62. pmid:22507613.
- 14. Murakami K, Livingstone MBE. Associations between energy density of meals and snacks and overall diet quality and adiposity measures in British children and adolescents: the National Diet and Nutrition Survey. British Journal of Nutrition. 2016;116(9):1633–45. Epub 2016/11/08. pmid:27823581
- 15. Ritchie LD. Less frequent eating predicts greater BMI and waist circumference in female adolescents. The American Journal of Clinical Nutrition. 2012;95(2):290–6. pmid:22218154
- 16. Kachurak A, Davey A, Bailey RL, Fisher JO. Daily Snacking Occasions and Weight Status Among US Children Aged 1 to 5 Years. Obesity (Silver Spring, Md). 2018;26(6):1034–42.
- 17. Tripicchio GL, Kachurak A, Davey A, Bailey RL, Dabritz LJ, Fisher JO. Associations between Snacking and Weight Status among Adolescents 12–19 Years in the United States. Nutrients. 2019;11(7). Epub 2019/07/03. pmid:31261906.
- 18. Hess JM, Jonnalagadda SS, Slavin JL. What Is a Snack, Why Do We Snack, and How Can We Choose Better Snacks? A Review of the Definitions of Snacking, Motivations to Snack, Contributions to Dietary Intake, and Recommendations for Improvement. Advances in Nutrition. 2016;7(3):466–75. pmid:27184274
- 19.
Mattes R, Tan S-Y. Chapter 27—Snacking and Energy Balance in Humans. In: Coulston AM, Boushey CJ, Ferruzzi M, editors.: Academic Press; 2013. p. 501–15.
- 20. Appleton KM, Martins C, Morgan LM. Age and experience predict accurate short-term energy compensation in adults. Appetite. 2011;56(3):602–6. Epub 2011/02/08. pmid:21295627.
- 21. Cecil JE, Palmer CN, Wrieden W, Murrie I, Bolton-Smith C, Watt P, et al. Energy intakes of children after preloads: adjustment, not compensation. Am J Clin Nutr. 2005;82(2):302–8. Epub 2005/08/10. pmid:16087972.
- 22. Zandstra EH, Mathey MF, Graaf C, van Staveren WA. Short-term regulation of food intake in children, young adults and the elderly. Eur J Clin Nutr. 2000;54(3):239–46. Epub 2000/03/14. pmid:10713747.
- 23. Kahn HS, Cheng YJ. Comparison of adiposity indicators associated with fasting-state insulinemia, triglyceridemia, and related risk biomarkers in a nationally representative, adult population. Diabetes Res Clin Pract. 2018;136:7–15. Epub 2017/12/01. pmid:29183845.
- 24. Johnson GH, Anderson GH. Snacking Definitions: Impact on Interpretation of the Literature and Dietary Recommendations. Critical Reviews in Food Science and Nutrition. 2010;50(9):848–71. pmid:20924867
- 25. Bellisle F. Meals and snacking, diet quality and energy balance. Physiol Behav. 2014;134:38–43. pmid:24657181
- 26. Hess JM, Slavin JL. The benefits of defining “snacks”. Physiol Behav. 2018;193:284–7. pmid:29678598
- 27. Mattes RD. Snacking: A cause for concern. Physiol Behav. 2018;193:279–83. pmid:29421590
- 28. Birch LL, Deysher M. Caloric compensation and sensory specific satiety: evidence for self regulation of food intake by young children. Appetite. 1986;7(4):323–31. Epub 1986/12/01. pmid:3789709.
- 29. Kahn HS, Gu Q, Bullard KM, Freedman DS, Ahluwalia N, Ogden CL. Population distribution of the sagittal abdominal diameter (SAD) from a representative sample of US adults: comparison of SAD, waist circumference and body mass index for identifying dysglycemia. PloS one. 2014;9(10):e108707–e. pmid:25272003
- 30. Han TS, van Leer EM, Seidell JC, Lean MEJ. Waist circumference action levels in the identification of cardiovascular risk factors: prevalence study in a random sample. BMJ. 1995;311(7017):1401 LP—5–5.
- 31. Zipf G, Chiappa M, Porter KS, Ostchega Y, Lewis BG, Dostal J. National health and nutrition examination survey: plan and operations, 1999–2010. Vital Health Stat 1. 2013;(56):1–37. Epub 2014/08/01. pmid:25078429.
- 32.
Centers for Disease Control and Prevention. National Health and Nutrition Examination Survey (NHANES): Anthropometry Procedure Manual. 2016.
- 33. Ahluwalia N, Dwyer J, Terry A, Moshfegh A, Johnson C. Update on NHANES Dietary Data: Focus on Collection, Release, Analytical Considerations, and Uses to Inform Public Policy. Adv Nutr. 2016;7(1):121–34. Epub 2016/01/17. pmid:26773020.
- 34. Ogden CL, Carroll MD, Fryar CD, Flegal KM. Prevalence of Obesity Among Adults and Youth: United States, 2011–2014. NCHS data brief. 2015;(219):1–8. pmid:26633046
- 35.
Wright J, Wang C. Trends in intake of energy and macronutrients in adults from 1999–2000 through 2007–2008. US Department of Health and Human Services. Centers for Disease Control and Pevention. NCHS Data Brief No. 49. National Center for Health Statistics, NCHS Data Brief. 2010;49.
- 36. Veldheer S, Yingst J, Zhu J, Foulds J. Ten-year weight gain in smokers who quit, smokers who continued smoking and never smokers in the United States, NHANES 2003–2012. International journal of obesity (2005). 2015;39(12):1727–32.
- 37. Chang VW, Lauderdale DS. Income disparities in body mass index and obesity in the united states, 1971–2002. Archives of Internal Medicine. 2005;165(18):2122–8. pmid:16217002
- 38.
The poverty guidelines updated periodically in the Federal Register by the U.S. Department of Health and Human Services under the authority of 42 U.S.C. 9902(2). 2018.
- 39. Cowan AE, Jun S, Gahche JJ, Tooze JA, Dwyer JT, Eicher-Miller HA, et al. Dietary Supplement Use Differs by Socioeconomic and Health-Related Characteristics among U.S. Adults, NHANES 2011(-)2014. Nutrients. 2018;10(8). Epub 2018/08/22. pmid:30126136.
- 40. Kant AK, Graubard BI. Secular trends in the association of socio-economic position with self-reported dietary attributes and biomarkers in the US population: National Health and Nutrition Examination Survey (NHANES) 1971–1975 to NHANES 1999–2002. Public Health Nutr. 2007;10(2):158–67. Epub 2007/01/31. pmid:17261225.
- 41. Masters MA, Stanek Krogstrand KL, Eskridge KM, Albrecht JA. Race/ethnicity and income in relation to the home food environment in US youth aged 6 to 19 years. J Acad Nutr Diet. 2014;114(10):1533–43. Epub 2014/06/18. pmid:24935611.
- 42. Bailey RL, Akabas SR, Paxson EE, Thuppal SV, Saklani S, Tucker KL. Total Usual Intake of Shortfall Nutrients Varies With Poverty Among US Adults. J Nutr Educ Behav. 2017;49(8):639–46.e3. Epub 2017/05/26. pmid:28539198.
- 43. MacLean RR, Cowan A, Vernarelli JA. More to gain: dietary energy density is related to smoking status in US adults. BMC Public Health. 2018;18(1):365. Epub 2018/04/05. pmid:29614996.
- 44. Blanton CA, Moshfegh AJ, Baer DJ, Kretsch MJ. The USDA Automated Multiple-Pass Method accurately estimates group total energy and nutrient intake. The Journal of nutrition. 2006;136(10):2594–9. Epub 2006/09/22. pmid:16988132.
- 45.
US Department of Agriculture. USDA Food and Nutrient Database for Dietary Studies (FNDDS) 2015–2016. In: Agricultural Research Service USDA, editor. Beltsville Human Nutrition Research Center2018.
- 46. Murakami K, Livingstone MBE. Associations between Meal and Snack Frequency and Diet Quality in US Adults: National Health and Nutrition Examination Survey 2003–2012. Journal of the Academy of Nutrition and Dietetics. 2016;116(7):1101–13. pmid:26847912
- 47.
U.S. Department of Agriculture ARS, Beltsville Human Nutrition Research Center, Food Surveys Research Group. Snacking Patterns of U.S. Adults, NHANES 2007–2008. 2011.
- 48. Subar AF, Freedman LS, Tooze JA, Kirkpatrick SI, Boushey C, Neuhouser ML, et al. Addressing Current Criticism Regarding the Value of Self-Report Dietary Data. The Journal of nutrition. 2015;145(12):2639–45. Epub 2015/10/16. pmid:26468491.
- 49. Murakami K, Livingstone MBE. Prevalence and characteristics of misreporting of energy intake in US adults: NHANES 2003–2012. British Journal of Nutrition. 2015;114(8):1294–303. pmid:26299892
- 50. Belcher BR, Berrigan D, Dodd KW, Emken BA, Chou CP, Spruijt-Metz D. Physical activity in US youth: effect of race/ethnicity, age, gender, and weight status. Med Sci Sports Exerc. 2010;42(12):2211–21. pmid:21084930.
- 51.
Institute of Medicine. Dietary Reference Intakes: The Essential Guide to Nutrient Requirements (2006): National Academies Press; 2006.
- 52.
Breakfast: Percentages of Selected Nutrients Contributed by Food and Beverages Consumed at Breakfast, by Gender and Age, What We Eat in America, NHANES 2015–2016. U.S. Department of Agriculture, Agricultural Research Service, 2018.
- 53. Goodwin S. The Practical Guide to the Identification, Evaluation and Treatment of Overweight and Obesity in Adults. Clinical Nurse Specialist. 2002;16(3):164.
- 54.
National Center for Health Statistics. National Health and Nutrition Examination Survey: body composition procedures manual. 2018.
- 55.
Organization WH. Obesity: preventing and managing the global epidemic: World Health Organization; 2000.
- 56. Almoosawi S, Vingeliene S, Karagounis LG, Pot GK. Chrono-nutrition: a review of current evidence from observational studies on global trends in time-of-day of energy intake and its association with obesity. Proc Nutr Soc. 2016;75(4):487–500. Epub 2016/06/22. pmid:27327252.
- 57. Piernas C, Popkin BM. Snacking increased among U.S. adults between 1977 and 2006. The Journal of nutrition. 2010;140(2):325–32. Epub 2009/12/02. pmid:19955403.
- 58.
Hunter SR, Mattes RD. The Role of Eating Frequency and Snacking on Energy Intake and BMI. In: Meiselman HL, editor. Handbook of Eating and Drinking: Interdisciplinary Perspectives. Cham: Springer International Publishing; 2019. p. 1–21.
- 59. Wardle J, Haase AM, Steptoe A, Nillapun M, Jonwutiwes K, Bellisle F. Gender differences in food choice: The contribution of health beliefs and dieting. Annals of Behavioral Medicine. 2004;27(2):107–16. pmid:15053018
- 60. Tooze JA, Subar AF, Thompson FE, Troiano R, Schatzkin A, Kipnis V. Psychosocial predictors of energy underreporting in a large doubly labeled water study. The American Journal of Clinical Nutrition. 2004;79(5):795–804. pmid:15113717
- 61. DiMeglio DP, Mattes RD. Liquid versus solid carbohydrate: effects on food intake and body weight. International journal of obesity and related metabolic disorders: journal of the International Association for the Study of Obesity. 2000;24(6):794–800. Epub 2000/07/06. pmid:10878689.
- 62. Mattes RD, Rothacker D. Beverage viscosity is inversely related to postprandial hunger in humans. Physiol Behav. 2001;74(4):551–7. https://doi.org/10.1016/S0031-9384(01)00597-2.
- 63. Kant AK, Graubard BI, Mattes RD. Association of food form with self-reported 24-h energy intake and meal patterns in US adults: NHANES 2003–2008. The American Journal of Clinical Nutrition. 2012;96(6):1369–78. pmid:23097271
- 64. Han E, Powell LM. Consumption patterns of sugar-sweetened beverages in the United States. J Acad Nutr Diet. 2013;113(1):43–53. Epub 2012/12/25. pmid:23260723.
- 65. Bailey RL, Fulgoni VL, Cowan AE, Gaine PC. Sources of Added Sugars in Young Children, Adolescents, and Adults with Low and High Intakes of Added Sugars. Nutrients. 2018;10(1). Epub 2018/01/18. pmid:29342109.
- 66. VanderWeele TJ. Principles of confounder selection. Eur J Epidemiol. 2019;34(3):211–9. Epub 2019/03/06. pmid:30840181.
- 67. Hill RJ, Davies PS. The validity of self-reported energy intake as determined using the doubly labelled water technique. Br J Nutr. 2001;85(4):415–30. Epub 2001/05/12. pmid:11348556.
- 68. Troiano RP, Berrigan D, Dodd KW, Mâsse LC, Tilert T, Mcdowell M. Physical Activity in the United States Measured by Accelerometer. Medicine & Science in Sports & Exercise. 2008;40(1):181–8. pmid:18091006
- 69. Luke A, Dugas LR, Durazo-Arvizu RA, Cao G, Cooper RS. Assessing physical activity and its relationship to cardiovascular risk factors: NHANES 2003–2006. BMC Public Health. 2011;11:387-. pmid:21612597.
- 70. Poppitt SD, Swann D, Black AE, Prentice AM. Assessment of selective under-reporting of food intake by both obese and non-obese women in a metabolic facility. International journal of obesity and related metabolic disorders: journal of the International Association for the Study of Obesity. 1998;22(4):303–11. Epub 1998/05/13. pmid:9578234.
- 71. Musialik K, Szulińska M, Hen K, Skrypnik D, Bogdański P. The relation between osteoprotegerin, inflammatory processes, and atherosclerosis in patients with metabolic syndrome. European review for medical and pharmacological sciences. 2017;21(19):4379–85. Epub 2017/10/28. pmid:29077157.
- 72. Skrypnik D, Mostowska A, Jagodziński PP, Bogdański P. Association of rs699947 (-2578 C/A) and rs2010963 (-634 G/C) Single Nucleotide Polymorphisms of the VEGF Gene, VEGF-A and Leptin Serum Level, and Cardiovascular Risk in Patients with Excess Body Mass: A Case-Control Study. Journal of clinical medicine. 2020;9(2). Epub 2020/02/13. pmid:32046348.
- 73. Skrypnik D, Bogdański P, Zawiejska A, Wender-Ożegowska E. Role of gestational weight gain, gestational diabetes, breastfeeding, and hypertension in mother-to-child obesity transmission. Polish archives of internal medicine. 2019;129(4):267–75. Epub 2019/01/29. pmid:30688285.