http://orcid.org/0000-0003-2039-6295
Abstract
A growing body of literature suggests that post-secondary students experience food insecurity (FI) at greater rates than the general population. However, these rates vary dramatically across institutions and studies. FI assessment methods commonly used in studies with college students have not been scrutinized for psychometric properties, and varying protocols may influence resulting FI prevalence estimates. The objective of this study was to assess the performance of standard food security assessment protocols and to evaluate their agreement as well as the relative accuracy of these protocols in identifying student FI. A randomized sample of 4,000 undergraduate students were invited to participate in an online survey (Qualtrics, LLC, Provo, Utah, USA) that evaluated sociodemographic characteristics and FI with the 2-item food sufficiency screener and the 10-item USDA Adult Food Security Survey Module (FSSM; containing the abbreviated 6-item module). Four hundred sixty-two eligible responses were included in the final sample. The psychometric analysis revealed inconsistencies in college student response patterns on the FSSM when compared to national evaluations. Agreement between FI protocols was generally high (>90%) but was lessened when compared with a protocol that incorporated the 2-item screener. The 10-item FSSM with the 2-item screener had the best model fit (McFadden’s R2 = 0.15 and Bayesian Information Criterion = -2049.72) and emerged as the tool providing the greatest relative accuracy for identifying students with FI. Though the 10-item FSSM and 2-item screener yields the most accuracy in this sample, it is unknown why students respond to FSSM items differently than the general population. Further qualitative and quantitative evaluations are needed to determine which assessment protocol is the most valid and reliable for use in accurately identifying FI in post-secondary students across the U.S.
Figures
Citation: Nikolaus CJ, Ellison B, Nickols-Richardson SM (2019) Are estimates of food insecurity among college students accurate? Comparison of assessment protocols. PLoS ONE 14(4): e0215161. https://doi.org/10.1371/journal.pone.0215161
Editor: Tamar Ringel-Kulka, The University of North Carolina at Chapel Hill, UNITED STATES
Received: January 7, 2019; Accepted: March 27, 2019; Published: April 24, 2019
Copyright: © 2019 Nikolaus et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This research was supported by funding from the National Institute of Food and Agriculture, U.S. Department of Agriculture, under award number ILLU-470-334 at the University of Illinois. The lead author received support from the Seymour Sudman Dissertation Award from the Survey Research Laboratory at the University of Illinois at Chicago. The funding sources had no involvement in the study design, collection, analysis, or interpretation of the data.
Competing interests: The authors have declared that no competing interests exist.
Introduction
A rapidly growing body of literature has developed on the topic of food insecurity (FI), defined as the unavailability of sufficient food, among post-secondary students. Recent reviews estimate that 32.9% to 50.9% of college students in the U.S. experience FI [1,2]. Compared to the 2016 U.S. estimate indicating 12.3% of American households experience FI [3], students seem to be more susceptible to FI. This is concerning, as evidence suggests that FI among adults is associated with lower quality dietary patterns [4–6], more mental health concerns [7,8], diminished physical health [9,10], and greater risk for chronic diseases [11,12]. Studies conducted specifically in college settings indicate that students experiencing FI are more likely to have lower quality dietary patterns, physical health status, and academic success [2]. Though the culmination of findings from studies on university campuses indicate FI is a prevalent issue among college students, the evidence is hindered by limited psychometric testing of food security questionnaires used and thus, related concerns about accuracy in reported estimates.
A variety of assessment procedures have been used to characterize the prevalence of FI among college students. Some studies have used novel questionnaires, such as providing the definitions of food security levels [13,14], evaluating FI on a single item [15,16], using selected items from pre-existing tools [17–21], or making various modifications to standard surveys [22–24]. The primary concern regarding estimates from these reports is that their precision and accuracy in identifying students with FI are unknown. However, the vast majority of studies exploring FI among college students have used the United States Department of Agriculture (USDA) Food Security Survey Modules (FSSM) [25], with several studies utilizing the abbreviated 6-item [15,26–40] and the full individual adult 10-item [41–55] or 18-item household versions [56,57].
Using USDA FSSMs when assessing college students for FI has advantages. The FSSMs were tested extensively when they were originally developed throughout the 1990s, using rhetorical arguments [58,59] as well as qualitative [60] and quantitative evidence [60–63]. Since initial development, the FSSMs have been used widely to evaluate domestic food security prevalence, nationally and locally. This widespread adoption allows for FI estimates to be easily compared across locations, time points, and populations. Therefore, recent studies using the FSSMs when evaluating FI in college students are applying some of the strongest assessment tools available for estimating FI domestically.
Despite the strength of evidence supporting the use of FSSMs, evaluation of their appropriateness for college student populations has not been conducted, as has been the practice for adaptation of other survey instruments to sub-populations [64–67]. There are two critical methodological questions related to FI that warrant evaluation. Broadly, it is worthwhile to know if the FSSMs are appropriate for this audience and if they perform in expected quantitative ways and psychometric patterns. A previous study of students indicated that instrument testing had been performed before use of the 10-item questionnaire; however, results of such testing were unclear, as this evaluation was a small element within a larger non-peer reviewed report with limited description of methods, results, and generalizability [55]. Explicit analyses of the FSSMs against psychometric benchmarks are needed and necessary to support the accuracy and reliability of results. As a second concern, many studies compare their prevalence rates to those published nationally, such as from the Current Population Survey (CPS). Yet, these national procedures use a multi-step FI assessment protocol that includes screening after which many respondents are removed before FI is determined. At present, no prior studies have adopted this multi-step FI assessment protocol when estimating FI prevalence among post-secondary students. Given that the CPS estimates of national FI are the benchmark with which most studies compare their results, it is worthwhile to adopt the multi-step screening methodology and estimate FI prevalence among college students using methods similar to those in the CPS.
The purpose of this study was to address these gaps in the literature related to FI among post-secondary U.S. college students. The objective of the research was to assess the psychometric properties of the FSSM in a student sample and to evaluate the relative accuracy of different protocols (the 6- and 10-item USDA FSSMs, with or without screeners) in identifying high-risk students. It was hypothesized that: 1) the psychometric qualities of the FSSM would be lower than in national samples, and 2) utilizing the screener questions would result in the most relative accuracy when compared to other protocols. These hypotheses were tested in a cross-sectional sample of undergraduate students at a U.S. four-year university by assessment of data fit to the Rasch model and then comparison of each protocol and its performance in predicting students with FI.
Materials and methods
Participants
A randomized sample of 1,000 students from each college classification (freshman, sophomore, junior, and senior; 4,000 students total) at one midwestern university was invited from the enrolled student registry to participate in an online survey hosted by the Qualtrics, LLC (Provo, Utah, USA) survey platform. After reviewing a digital informed consent form, respondents consented to participate by selecting “I have read the procedure described above, and I voluntarily agree to participate in this survey.” All study procedures were approved by the institutional review board for research involving human subjects at the University of Illinois at Urbana-Champaign (#16008). Previous studies have reported sociodemographic differences between midwestern college students based on FI status [26], and race/ethnicity results were used as a basis for a chi-squared power analysis (α = 0.05, β = 0.9) using G*Power (Version 3.1.9.2, Heinrich Heine University Düsseldorf). This revealed that a minimum of 134 individuals overall would be needed for bivariate analyses. Given the planned data analyses and projected response rate of online surveys, 1,000 students were sought per college classification to account for incomplete or unusable responses. The survey was administered beginning October 2017 (approximately 7 weeks into the fall 16-week semester) and two reminder emails were sent to eligible respondents, each one full week after the last. Participants who completed the survey were entered into a drawing for one of 250 $10 digital gift cards. To be eligible, students needed to be: 1) between the ages of 18–24 years; 2) enrolled as an undergraduate student at the University of Illinois; and 3) fluent in English.
Survey
The online questionnaire was designed for completion within approximately 15 minutes on a mobile device or personal computer. Various participant sociodemographic characteristics were collected, including participant’s age, gender, college undergraduate class, race, country of birth, first-generation student status, and living situation. Financial resources were evaluated as a checklist with respondents indicating whether they received monetary support from their family/parent, employment, government/federal grants, scholarships, loans, and/or other sources. For those selected, participants were further asked to estimate the amount they received from each source within a specified timeframe (week, month, semester, or year). An overall estimate of financial support was calculated by converting all values to a 1-semester interval and summing these values. To capture family socioeconomic background, respondents estimated their parent’s income, perceived familial social class, and whether their family used the Supplemental Nutrition Assistance Program and/or free and reduced school lunches while the participant was enrolled in high school.
The surveying procedure was designed to emulate the screening protocol used in the CPS. However, the procedures were adapted for this survey of students. The 2-item screener used by the CPS (Table 1) was included and if a respondent answered ‘No’ and ‘Enough of the kinds of foods that we want to eat’, respectively, they were considered food secure. This screener in the CPS normally references the last twelve months, but a 30-day reference was used to only capture the on-campus experiences of students. In the CPS, high-income households who answer in a secure fashion are not asked the remaining food security questions. In the present study, the screener appeared before the 10-item USDA FSSM, but those who answered affirmatively to these items were not eliminated (i.e., screened out) from answering the FSSM. The impact of the screener was simulated during analyses by following the CPS procedures with additional modifications to the income threshold. Thus, the comparison between differing FI assessment protocols could be tested with a single sample. The screening procedure was first tested using no income estimates and this was followed with a second test where an estimate of ‘financial adequacy’ was developed to approximate an appropriate income threshold for students. To calculate financial adequacy, the overall estimate of financial support per semester was compared with the in-state cost of attendance for an average in-state resident at the University of Illinois [68,69] for the 2017 fall semester. While the survey instrument was designed to capture a variety of sources of financial support, results revealed that students had a tendency to underreport their support level, as only 34.6% of students were considered to have adequate financial support. Given concerns that these financial support estimates and their accuracy were untenable, results from the assessment protocols integrating them with screening procedures are not presented here; however, these results are available upon request.
FI-related questions included the 2-item screener and the 10-item USDA FSSM with a reference period of the last 30 days. The 10-item USDA FSSM queried participants on their experiences with food and financial resources in a series of items that increased in severity. Items of these questionnaires and affirmative responses are included in Table 1. Individuals were experienced FI if they responded affirmatively to three or more items or food secure otherwise. The abbreviated 6-item USDA FSSM is produced from a subset of the 10-item FSSM to reduce participant burden. Therefore, responses of a single sample of participants who answer all items on the 10-item FSSM can be used to simulate response patterns as if only the 6-item FSSM was presented. Items used in the 6-item version are specified in Table 1. Given the reduced number of items, FI is identified if individuals responded affirmatively to two or more items or food secure otherwise.
Data analyses
Before analyses, survey responses were excluded from the dataset if the respondent was ineligible for the study, the response was a duplicate of a prior response, or less than half of the 10-item USDA FSSM was complete. Once these responses were removed, the averages and distributions of responses on sociodemographic questions were calculated and compared to data (when available) from the entire university undergraduate student body. Descriptive analyses were conducted on all FI assessment protocols to illustrate differences in FI prevalence rates.
The psychometric properties of data were assessed by evaluating whether they fit the single-parameter Rasch measurement model, specifically to identify if items had similar calibrations and item severity order. Per the standardized questionnaire, items on the FSSMs were ordered from least to most severe, and in the general population, the quantity of affirmative responses to each item reflected this order. Similarity to projected response patterns [25] would indicate that the population manages and describes food deprivation similarly and would validate the comparison of rates ascertained among college students with national estimates. For this analysis, item severity parameters, item-infit statistics, and item-outfit statistics were assessed. Item severity parameters, and their ordering, were compared with data collected in the CPS [25]. The estimates of infit and outfit statistics, which reflect the discrimination and consistency of the item responses, respectfully, provided further psychometric indicators of participant response patterns. A conservative range of 0.8 and 1.2 was used to evaluate the fit statistics produced by the 10-item FSSM [70] due to the range of distribution procedures in field settings and the use of FI prevalence studies to directly impact policy. This analysis was not conducted with participants who had missing values on some food security items or ‘extreme’ respondents (those who affirm either all or none of the items), per Rasch model protocol (Appendix C) [25, 71].
The agreement between four potential food security assessment protocols were compared: 1) the 6-item USDA FSSM without a screener; 2) the 10-item USDA FSSM without a screener; 3) the 6-item USDA FSSM with a 2-item screener; and 4) the 10-item USDA FSSM with a 2-item screener. Agreement was calculated for each comparison by taking the difference of the FI designation (yes = 1, no = 0) produced from two protocols. These agreement values were expressed as percentages with 95% confidence intervals based on the standard deviation of the difference.
The relative accuracy of the assessment protocols in identifying participants with FI was assessed by testing each protocol’s designation of the individual (food insecure = 1, food secure = 0) as the dependent variable in logistic regression models and comparing the relative fit of each model. Multivariate logistic regression models were constructed to predict the odds of a student being considered FI based upon risk factors that have been identified as impactful in previous literature [17,20,30,35,41–43,46,51,56]. After testing for potential collinearity, these variables included: race/ethnicity, college classification (Freshman, Sophomore, etc.), social support (living with others), transfer student status (prior enrollment in a community college), first-generation college student status, familial socioeconomic status (comprised of perceived familial social class and use of federal nutrition assistance programs during high school), and sources of financial support [including family, employment, government, scholarship(s), and loan(s)].
To analyze the fit of data to the Rasch model, the ‘ERSRasch’ protocols for SAS 9.4 (SAS Institute Inc, Cary, North Carolina, U.S.) provided by the U.S. Economic Research Service were used. All other statistical analyses were performed in STATA/MP 14.1 (StataCorp, LP, College Station, Texas, U.S.). The complete de-identified dataset as well as the corresponding codebook and statistical analysis files are available as supplementary materials.
Results
A total of 633 responses were received for the online survey. Of these, 44 respondents did not consent to participate, 22 individuals did not meet inclusion criteria, 80 completed less than half of the 10-item FSSM, and 25 completed the survey twice (the second response or incomplete responses were removed), resulting in a final response rate of 11.5% and sample of 462 participants. Sociodemographic characteristics of participants and comparisons with the institution’s undergraduate student body are reported in Table 2.
Participating students were, on average, aged 19.6 years and roughly balanced across undergraduate college classifications. The majority was born in the U.S., identified as female, and White or Asian/Pacific Islander. Financially, most students received support from their families. The vast majority estimated their familial social class was middle class, though 21% (n = 96) did not estimate their parents’ income. A minority of students indicated limited socioeconomic resources, with a few identifying as families of lower social class or reporting that their families used federal nutrition assistance programs (i.e., free or reduced National School Lunch Program and the Supplemental Nutrition Assistance Program). A minority of respondents indicated that they were first-generation students. In comparison to the entire student body, the recruited sample was younger, less likely to be a college senior, more likely to identify as White or Asian/Pacific Islander and female.
Results when analyzing the 10-item FSSM using the Rasch model are presented in Table 3. This procedure reflects the way that the survey is often used in the field and provides indications of responses on all 10 items. Affirmations of FSSM items ranged from 4.1% on the most severe item, which asked about number of days in which no food was consumed, to 64.5% on the third item that asked if students can afford a balanced meal. Item difficulty estimates reflected these affirmations in quantifiable severity estimates, showing that the final item on the 10-item AFSSM was the most difficult and the balanced meal item was considered the least difficult. The expected response pattern was for items to flow from least to most difficult, and results in this sample deviated from this pattern. The first four items of the survey showed particular deviation, with the ‘balanced meals’ item accruing 5% more affirmative responses than item one, which was expected to be the most commonly affirmed. For infit and outfit statistics, there were deviations outside of the acceptable range of 0.8–1.2 for seven of the ten items evaluated. These non-conforming infit and outfit statistics indicate that there was inconsistency in response patterns and potentially high discriminating value in single items.
When estimating FI (low and very low levels), Fig 1 reflects how prevalence differs by protocol used. The greatest prevalence of FI was estimated by the 6-item FSSM without screening, and the lowest prevalence was ascertained from the 10-item questionnaire when used with the 2-item screener. Prevalence rates when using the 2-item screener were lower because 327 students (70.8%) answered the screener questions in food secure patterns and thus would not be administered the FSSM under the CPS protocol.
Note. Assessment procedures and scoring protocols being compared are the: 1) Six-Item Short Form of the USDA Food Security Survey Module; 2) 10-item USDA Adult Food Security Survey Module; 3) Six-Item Short Form with two screening items used in the Current Population Survey; and 4) 10-item USDA Adult Module with two screening items used in the Current Population Survey.
Agreement between FI protocols is displayed in Table 4. Overall, each protocol had strong levels of agreement, but there was variation across protocols. The greatest agreement levels (>95% agreement) were seen when comparing the length of questionnaires (6- or 10-item) with consistent screening protocols. Agreement was diminished when comparing protocols across screening regimes, with percent agreement as low as 84%.
Multivariate logistic regression models were built for each FI estimation protocol. Due to missing data, regression analyses were run on a sub-sample of respondents (n = 427). The multivariate regression models are presented in Table 5. Sources of financial support had a significant impact on predicting FI status. Across all FI protocols, familial financial support significantly predicted lower odds of experiencing FI, while loans significantly predicted higher odds of experiencing FI. Financial support from employment also increased the odds of experiencing FI in two of the four models. Outside of sources of financial support, a higher college classification (sophomore, junior or senior status) significantly increased the odds of experiencing FI in the majority of models when compared to freshman students. Higher perceived social class also decreased odds for FI, but only in the models predicting FI based on protocols that incorporated the screener. The protocol using the 10-item FSSM and the 2-item screener had the overall best model fit based on McFadden’s R2 (0.15) and the Bayesian Information Criterion (-2049.72).
Discussion
The aim of this study was to evaluate the standard food security assessment protocols when used among undergraduate college students. Specifically, cross-sectional data from 462 students were used to assess the psychometric properties of the overall survey and then compare the agreement and relative accuracy of four FI estimation procedures. Data supported both proposed hypotheses. First, student responses on the USDA FSSM did not follow the expected difficulty pattern and fit statistics indicated some potential issues on the item-level. Then, when protocols were compared, agreement was generally high. However, agreement was lowest for the FSSMs when paired with the 2-item screener, which resulted in the two lowest FI estimates among students. Finally, this lowest prevalence of FI was supported as the most relatively accurate when predicted by student sociodemographic characteristics.
Results of the Rasch model analysis indicated that the performance of the 10-item FSSM was less than ideal in this college student sample. Affirmative response patterns deviated from the expected flow from least to most severe and the corresponding proportion of affirmative responses. The item that asked students if they could afford a balanced meal was affirmed the most frequently. This keyword ‘balanced meals’ has been scrutinized previously when the FSSMs were evaluated for use in Asian and Pacific Islander populations [64–66]. This item, as well as others, may have keywords that elicit different cognitive responses than expected, based on the formative work used to construct the questions that ultimately resulted in the USDA FSSMs [60,72].
Beyond the deviated order of item difficulty, the Rasch model analysis also revealed that item fit statistics were outside of customary ranges for several items. These statistics reflect ‘noisy’ response patterns, which can result as a product of careless responses due to survey fatigue or limited discriminating power of the questions. The potential fatigue of respondents in this study is less likely given that the FSSM items were placed at the beginning of the online survey, which in and of itself was structured to take less than 15 minutes. Alternatively, limited item discrimination power may be a result of heterogenous responses that participants had to the financial qualifying aspect of each item. When a general adult audience responds to the questionnaire, many would equate an inability to ‘afford’ or have ‘enough money’ for food with the presence and/or adequacy of regular paychecks resulting from employment. In contrast, post-secondary students have a variety of financial situations. An increasing number of college students are employed while enrolled in school [73], but this is one source of support within a larger assortment of resources, both formal or informal, that students may have access to and utilize to ascertain food. The need to consider and calculate these various food and financial support sources while answering seemingly straightforward questions may result in participants ‘satisficing’ and providing a less accurate but convenient response [74]. Given the heterogeneity of support situations, this may explain the erratic response patterns on the survey. However, qualitative studies utilizing cognitive interviewing techniques would be needed to accurately illustrate how students process the FSSMs and to support modifications to the FSSMs for this population.
Until adapted FSSMs are proposed and tested, researchers in the field will need to consider which current FI assessment protocol is appropriate for their sub-population. Findings from the current study comparing protocols provide clear indications that different methods impact FI prevalence estimates, with estimates ranging from 19.1% to 34.9% in a single sample. The protocols tested are a subset of those used previously in the field, and the various agreement levels between methods may, in part, explain the wide range of prevalence estimates previously reported across studies [1,2]. When the 2-item screener was implemented, FI prevalence rates in the sample were reduced by approximately one-third.
Using the 10-item FSSM with the 2-item screener had the greatest ability to identify FI based on established predictor variables. Though all models had limited predictive power, this protocol may provide the most relative accuracy when estimating FI prevalence as well as evaluating the impact of interventions taking place across campuses nationally [57,75]. Furthermore, this protocol more closely resembles those used in the CPS and will allow for more straightforward comparisons of rates of FI among students with those at the national level. However, efforts to simulate the CPS screening that included financial adequacy estimates were unsuccessful in this study. Issues with measurement of financial support in this sample are indicated by the estimate that only 34.6% were considered to have adequate financial support.
Evaluating financial resources among students is inherently complex and is reflected in the methods used to evaluate financial support in the current study. Though efforts were made to create a comprehensive assessment of ‘income’ among students, the estimate showed low predictive power of FI and was ultimately not presented in the current article. Though FI is not synonymous with low-income status, and other factors have mitigating impacts on FI risk [76,77], there is commonly a strong relationship in the general population. Parental income could be used as a proxy for student income, as it is used to calculate the Expected Family Contribution when calculating financial aid offers [78], but this has issues in practice. Specifically, there is the concern that parental income and calculated expected contributions do not resemble actual contributions to students. More practically, many students in the current study selected ‘don’t know’ when asked about their parent’s income, making it difficult to accurately assess. In contrast, asking about the presence of familial financial support may be a valuable proxy as it was a significant protector against FI among students in this population and respondents could more readily provide responses to the discrete question.
The current study provides indications for relative accuracy of differing FI assessment protocols among college students. At its core, accuracy attempts to evaluate whether tests result in an unbiased correct answer. However, it is difficult to evaluate whether a FI assessment protocol is identifying “true” FI, as this is an inherently subjective social condition. In other populations, these accuracy analyses have been conducted by evaluating how different protocols correlated with indicators of food insufficiency, such as use of a food pantry as a coping mechanism [79,80]. However, some of these coping behaviors are not as common for young adults, even when considered to have very low food security [15]. Other researchers have attempted to assess ‘definitive classifications’ of FI to develop criterion validity [81,82], but this is labor-intensive and often requires subjective assessments from observers. In contrast, the current study compares how differing assessment protocols estimate FI prevalence and which protocol is best predicted by student characteristics that are theorized. This method of using determinants and consequences of FI has been conducted in other populations but provides the strongest indication of FI protocol accuracy when interpreted as part of a larger body of literature (as was done for the larger U.S. population in previous work) [58].
Considerations of FI assessment accuracy are important not only for researchers in the field, but also for universities interested in supporting increasingly diverse student populations. Many universities are enacting policies and interventions to address FI among their students [83]. Given the limited resources, both in terms of time and finances, available to many universities, it is vital that students with the greatest need are accurately identified. It is important that universities carefully consider which questionnaire they use not only for screening students but also for evaluating the effectiveness of any programs (such as campus food pantries or free dining hall meals) in alleviating FI. Though the 6- and 10-item USDA FSSMs have been commonly used in the past because they take little time to complete, minimize participant burden, and are simple to score, the current results suggest that including a 2-item screener may be valuable for assessing FI among post-secondary students in the field.
This research should be interpreted with considerations to the limitations of the study design and methodological choices. First, the online survey received a limited response rate. The study sample is comprised of those who decided to participate, which introduces selection bias. However, the sociodemographic characteristics of the sample had several similarities to the larger undergraduate student body. The largest difference between the sample and sampling pool was the greater proportion of female student participants, but women often respond at greater rates to surveys [84,85]. If questionnaires were administered in-person, a larger number of responses may have been collected. However, this methodology is much more time-intensive and still can pose its own issues with ascertaining a truly random sample. For example, prior FI assessment studies in college settings have recruited participants by selecting a list of courses [41,42], but this assumes all enrollees are in attendance. Ultimately, the recruitment efforts for this study resulted in a sample size that met power analysis needs. Aside from response rates, the study design attempted to identify an accurate measure of food security, but this is a subjective experience and thus is limited based on how accuracy is evaluated. Evaluations of these protocols in tandem with qualitative interviews and triangulation with other student risk factors and coping behaviors would provide further evidence for accuracy of assessment protocols. Further, generalizability of current results is limited by the single midwestern University sample. Therefore, this psychometric evaluation can, and should, be re-evaluated utilizing samples that include students from universities in various geographical and socio-economic settings. The limited population included in the current sample inhibits generalizability, but the homogeneity of the sample increases the internal validity of the results and overall statistical power to speak to traditional aged undergraduate students at a Midwest university in the U.S.
Conclusions
Results from the current study indicate that the psychometric properties of FSSMs when used in college students were not ideal. These results warrant additional qualitative investigations of the FSSMs and possible adaptations for FI assessments in the college student population. Until these survey modifications are made, results of this protocol comparison analysis provide evidence that the way that FI is estimated among college students makes a substantial difference in reported prevalence, particularly with use of screeners. Given the limited resources available for universities to identify and serve students living with FI, it is vital that the way FI is assessed will accurately identify students most critically in need, such that the true impact of interventions may be evaluated. Current results suggest that the 10-item FSSM used along with the 2-item screener is the best currently available measure; however, replicating these analyses with a larger and more diverse sample is warranted.
Supporting information
S1 Dataset. Deidentified data for college food insecurity.
https://doi.org/10.1371/journal.pone.0215161.s001
(DTA)
S1 File. Codebook for deidentified data for college food insecurity.
https://doi.org/10.1371/journal.pone.0215161.s002
(PDF)
S2 File. Statistical protocol for all non-Rasch analyses in STATA 14.1 for college food insecurity.
https://doi.org/10.1371/journal.pone.0215161.s003
(DO)
Acknowledgments
We thank staff members with the U.S. Economic Research Services for providing critical insights for completing and interpreting Rasch models.
References
- 1. Nazmi A, Martinez S, Byrd A, Robinson D, Bianco S, Maguire J, et al. A systematic review of food insecurity among US students in higher education. J Hunger Environ Nutr. 2018; 13(1); 1–16.
- 2. Bruening M, Argo K, Payne-Sturges D, Laska MN. The struggle is real: a systematic review of food insecurity on postsecondary education campuses. J Acad Nutr Diet. 2017; 117(11): 1767–1791. pmid:28754200
- 3. Coleman-Jensen A, Rabbitt MP, Gregory CA, Singh A. Household Food Security in the United States in 2016. September 2017. Available from https://www.ers.usda.gov/publications/pub-details/?pubid=84972. Cited 15 November 2018.
- 4. Dixon LB, Winkleby MA, Radimer KL. Dietary intakes and serum nutrients differ between adults from food-insufficient and food-sufficient families: third National Health and Nutrition Examination Survey, 1988–1994. J Nutr. 2001; 131(4): 1232–1246. pmid:11285332
- 5. Kirkpatrick SI, Tarasuk V. Food insecurity is associated with nutrient inadequacies among Canadian adults and adolescents. J Nutr. 2008; 138(3): 604–612. pmid:18287374
- 6. Park CY, Eicher-Miller HA. Iron deficiency is associated with food insecurity in pregnant females in the United States: National Health and Nutrition Examination Survey 1999–2010. J Acad Nutr Diet. 2014; 114(12): 1967–1973. pmid:24953790
- 7. Heflin CM, Ziliak JP. Food insufficiency, food stamp participation, and mental health. Soc Sci Q. 2008; 89(3): 706–727.
- 8. Jones AD. Food insecurity and mental health status: a global analysis of 149 countries. Am J Prev Med. 2017; 53(2): 264–273. pmid:28457747
- 9. Stuff JE, Casey PH, Szeto KL, Gossett JM, Robbins JM, Simpson PM, et al. Household food insecurity is associated with adult health status. J Nutr. 2004; 134(9), 2330–2335. pmid:15333724
- 10. Vozoris NT, Tarasuk VS. Household food insufficiency is associated with poorer health. J Nutr. 2003; 133(1): 120–126. pmid:12514278
- 11. Seligman HK, Bindman AB, Vittinghoff E, Kanaya AM, Kushel MB. Food insecurity is associated with diabetes mellitus: results from the National Health Examination and Nutrition Examination Survey (NHANES) 1999–2002. J General Intern Med. 2007; 22(7): 1018–1023.
- 12. Seligman HK, Laraia BA, Kushel MB. Food insecurity is associated with chronic disease among low-income NHANES participants. J Nutr. 2009; 140(2): 304–310. pmid:20032485
- 13.
Koller K. Extent of BGSU Student Food Insecurity and Community Resource use (Honors project, Bowling Green State University). 2014. Available from https://scholarworks.bgsu.edu/cgi/viewcontent.cgi?article=1146&context=honorsprojects. Cited 15 November 2018.
- 14. Twill SE, Bergdahl J, Fensler R. Partnering to build a pantry: a university campus responds to student food insecurity. J Poverty. 2016; 20(3): 340–358.
- 15. Broton KM, Goldrick-Rab S. Going without: an exploration of food and housing insecurity among undergraduates. Educ Res. 2018; 47(2): 121–133.
- 16. Lin M-T, Peters RJ Jr, Ford K, Meshack A, Johnson RJ, Hill M, et al. The relationship between perceived psychological distress, behavioral indicators and African-American female college student food insecurity. Am J Health Stud. 2013; 28(3): 127–133.
- 17. Bruening M, Brennhofer S, van Woerden I, Todd M, Laska M. Factors related to the high rates of food insecurity among diverse, urban college freshmen. J Acad Nutr Diet. 2016; 116(9): 1450–1457. pmid:27212147
- 18. Silva MR, Kleinert WL, Sheppard AV, Cantrell KA, Freeman-Coppadge DJ, Tsoy E, et al. The relationship between food security, housing stability, and school performance among college students in an urban university. J Coll Stud Ret. 2017; 19(3): 284–299.
- 19. Miles R, McBeath B, Brockett S, Sorenson P. Prevalence and predictors of social work student food insecurity. J Social Work Educ. 2017; 53(4): 651–663.
- 20. Freudenberg N, Manzo L, Jones H, Kwan A, Tsui E, Gagnon M. Food Insecurity at CUNY: Results From a Survey of CUNY Undergraduate Students. 2011. Available from https://www.gc.cuny.edu/CUNY_GC/media/CUNY-Graduate-Center/PDF/Centers/Center%20for%20Human%20Environments/cunyfoodinsecurity.pdf. Cited 15 November 2018.
- 21. Broton K, Frank V, Goldrick-Rab S. Safety, Security, and College Attainment: An Investigation of Undergraduates’ Basic Needs and Institutional Response. October 2014. Available from https://s3.amazonaws.com/academia.edu.documents/38697182/APPAM.Draft.10.28.2014.pdf?AWSAccessKeyId=AKIAIWOWYYGZ2Y53UL3A&Expires=1543375980&Signature=gna5ZMmvFCdn8KdcwVZCzPL2Hfw%3D&response-content-disposition=inline%3B%20filename%3DSafety_Security_and_College_Attainment_A.pdf. Cited 15 November 2018.
- 22.
Camelo K. Predictors of Food Insecurity and their Relationship to Academic Achievement of College Students. Dissertation, University of Nevada, Reno. May 2017. Available from https://scholarworks.unr.edu/handle/11714/2008. Accessed November 2018.
- 23. Hanna L. Evaluation of food insecurity among college students. Am Int J Contemp Res. 2014; 4(4): 46–49.
- 24.
MacDonald A. Food Insecurity and Educational Attainment at the University of Arkansas. Thesis, University of Arkansas. May 2016. Available from https://scholarworks.uark.edu/scwkuht/3/.
- 25. Bickel G, Nord M, Price C, Hamilton W, Cook J. Guide to Measuring Household Food Security. March 2000. Available from https://www.fns.usda.gov/guide-measuring-household-food-security-revised. Cited 15 November 2018.
- 26. Mirabitur E, Peterson KE, Rathz C, Matlen S, Kasper N. Predictors of college-student food security and fruit and vegetable intake differ by housing type. J Am Coll Health. 2016; 64(7): 555–564. pmid:27414196
- 27. Patton-López MM, López-Cevallos DF, Cancel-Tirado DI, Vazquez L. Prevalence and correlates of food insecurity among students attending a midsize rural university in Oregon. J Nutr Educ Behav. 2014; 46(3): 209–214. pmid:24406268
- 28. Martinez SM, Webb K, Frongillo EA, Ritchie LD. Food insecurity in California’s public university system: What are the risk factors? J Hunger Environ Nutr. 2018; 13(1): 1–18.
- 29.
Adamovic E. Food Insecurity Among College Students: An Assessment of Prevalence and Solutions. Thesis, University of Colorado Boulder. May 2017. Available from https://scholar.colorado.edu/honr_theses/1275/.
- 30. Goldrick-Rab S, Broton K, Eisenberg D. Hungry to Learn: Addressing Food & Housing Insecurity Among Undergraduates. December 2015. Available from https://postsecondary.gatesfoundation.org/wp-content/uploads/2016/11/Hungry-to-Learn.pdf. Cited 15 November 2018.
- 31.
Magoc T. Physical Activity and Household Food Insecurity as Important Predictors of Health Status in EIU Students. Thesis, Eastern Illinois University. August 2012. Available from https://thekeep.eiu.edu/theses/844/.
- 32.
Maguire J, O’Neill M, Aberson C. California State University Food and Housing Security Survey: Emerging Patterns from the Humboldt State University Data. January 2016. Available from http://hsuohsnap.org/wp-content/uploads/2016/01/ExecutiveSummary.docx1-14-16.pdf. Cited 15 November 2018.
- 33. Goldrick-Rab S, Richardson J, Hernandez A. Hungry and Homeless in College: Results from a National Study of Basic Needs Insecurity in Higher Education. March 2017. Available from https://www.acct.org/files/Publications/2017/Homeless_and_Hungry_2017.pdf. Cited 15 November 2018.
- 34. Ellis A, Burns T, Buzzard J, Dolan L, Register S, Crowe-White K. Food insecurity among college students does not differ by affiliation in Greek life. J Acad Nutr Diet. 2017; 117(10): A145.
- 35. Bruening M, van Woerden I, Todd M, Laska MN. Hungry to learn: the prevalence and effects of food insecurity on health behaviors and outcomes over time among a diverse sample of university freshmen. Int J Behav Nutr Phys Act. 2018; 15(1): 9. pmid:29347963
- 36. Davidson A, Morrell J. Food insecurity among undergraduate students. FASEB J. 2015; 29(1_supplement): LB404.
- 37. Calvez K, Miller C, Thomas L, Vazquez D, Walenta J. The university as a site of food insecurity: evaluating the foodscape of Texas A&M University’s main campus. The Southwestern Geographer. 2016; 19: 1–14.
- 38. Bianco S, Bedore A, Jiang M, Stamper N, Breed J, Paiva M, et al. Identifying Food Insecure Students and Constraints for SNAP/CalFresh Participation at California State University, Chico. 2016. Available from http://www.csuchico.edu/chc/_assets/documents/chico-food-insecurity-report-2016.pdf. Cited 15 November 2018.
- 39.
Mercado V. Food and Housing Insecurity Among Students at a Community College District. Dissertation, San Francisco State University. August 2017. Available from https://sfsu-dspace.calstate.edu/bitstream/handle/10211.3/196520/AS352017EDDM47.pdf?sequence=3.
- 40.
Kashuba KE. The Prevalence, Correlates, and Academic Consequences of Food Insecurity among University of Oregon Students. Dissertation, University of Oregon. 2017. Available from https://scholarsbank.uoregon.edu/xmlui/handle/1794/22865.
- 41. Chaparro MP, Zaghloul SS, Holck P, Dobbs J. Food insecurity prevalence among college students at the University of Hawai’i at Mānoa. Public Health Nutr. 2009; 12(11): 2097–2103. pmid:19650961
- 42. Gaines A, Robb CA, Knol LL, Sickler S. Examining the role of financial factors, resources and skills in predicting food security status among college students. Int J Consum Stud. 2014; 38(4): 374–384.
- 43. Maroto ME, Snelling A, Linck H. Food insecurity among community college students: prevalence and association with grade point average. Community Coll J. 2015; 39(6), 515–526.
- 44. Morris LM, Smith S, Davis J, Null DB. The prevalence of food security and insecurity among Illinois university students. J Nutr Educ Behav. 2016; 48(6): 376–382. pmid:27118138
- 45.
King JA. Food Insecurity Among College Students-Exploring the Predictors of Food Assistance Resource Use. Dissertation, Kent State University. May 2017. Available from https://etd.ohiolink.edu/pg_10?0::NO:10:P10_ETD_SUBID:149689.
- 46. Knol LL, Robb CA, McKinley EM, Wood M. Food insecurity, self-rated health, and obesity among college students. Am J Health Educ. 2017; 48(4): 248–255.
- 47. McArthur LH, Ball L, Danek AC, Holbert D. A high prevalence of food insecurity among university students in Appalachia reflects a need for educational interventions and policy advocacy. J Nutr Educ Behav. 2018; 50(6): 564–572. pmid:29242138
- 48. Gonzales K. The impact of residence on dietary intake, food insecurity, and eating behavior among university undergraduate students. Ursidae: The Undergraduate Research Journal at the University of Northern Colorado. 2013; 3(2): 8.
- 49.
Gorman AM. Food insecurity prevalence among college students at Kent State University. Dissertation, Kent State University. May 2014. Available from https://etd.ohiolink.edu/ap/10?0::NO:10:P10_ACCESSION_NUM:kent1396903865.
- 50. Dubick J, Mathews B, Cady C. Hunger on Campus: The Challenge of Food Insecurity for College Students. 2016. Available from http://studentsagainsthunger.org/wp-content/uploads/2016/10/Hunger_On_Campus.pdf. Cited 15 November 2018.
- 51. Hagedorn RL, Olfert MD. Food insecurity and behavioral characteristics for academic success in young adults attending an Appalachian university. Nutrients. 2018; 10(3): 361.
- 52. Holland R, Barbera A, Sadek A, Koszewski W, Brooks G. Prevalence of food insecurity among college students at a southeastern university. J Acad Nutr Diet. 2017; 117(9): A93.
- 53.
West AN. The Struggle is Real: An Exploration of the Prevalence and Experiences of Low-Income Latinx Undergraduate Students Navigating Food and Housing Insecurity at a Four-Year Research University. Dissertation, Sacramento State University. 2017. Available from https://csus-dspace.calstate.edu/bitstream/handle/10211.3/194896/A_West_MA_Thesis.pdf?sequence=1.
- 54. McArthur LH, Fasczewski KS, Wartinger E, Miller J. Freshmen at a university in Appalachia experience a higher rate of campus than family food insecurity. J Community Health. 2018; 1–8.
- 55. Crutchfield R, Maguire J. Study of Student Basic Needs. January 2018. Available from https://www2.calstate.edu/impact-of-the-csu/student-success/basic-needs-initiative/Documents/BasicNeedsStudy_phaseII_withAccessibilityComments.pdf. Cited 15 November 2018.
- 56. Blagg K, Gundersen C, Schanzenbach DW, Ziliak JP. (2017). Assessing food insecurity on campus. Available from https://www.urban.org/research/publication/assessing-food-insecurity-campus. Cited 15 November 2018.
- 57. Payne-Sturges DC, Tjaden A, Caldeira KM, Vincent KB, Arria AM. Student hunger on campus: food insecurity among college students and implications for academic institutions. Am J Health Promot. 2018; 32(2): 349–354. pmid:28699401
- 58. Frongillo EA Jr. Validation of measures of food insecurity and hunger. J Nutr. 1999; 129: 506S–509S. pmid:10064319
- 59. Campbell CC. (1991). Food insecurity: a nutritional outcome or a predictor variable? J Nutr. 1991; 121: 408–415. pmid:2002411
- 60. Radimer KL, Olson CM, Greene JC, Campbell CC, Habicht JP. Understanding hunger and developing indicators to assess it in women and children. J Nutr Educ. 1992; 24(1): 36S–44S.
- 61. Blumberg SJ, Bialostosky K, Hamilton WL, Briefel RR. The effectiveness of a short form of the household food security scale. Am J of Public Health. 1999; 89: 1231–1234.
- 62. Carlson SJ, Andrews MS, Bickel GW. Measuring food insecurity and hunger in the United States: development of a national benchmark measure and prevalence estimates. J Nutr. 1999; 129: 510S–516S. pmid:10064320
- 63. Wehler CA, Scott RI, Anderson JJ. The Community Childhood Hunger Identification Project: a model of domestic hunger-demonstration project in Seattle, Washington. J Nutr Educ. 1992; 24: 29S–35S.
- 64. Derrickson JP, Sakai M, Anderson J. Interpretations of the “balanced meal” household food security indicator. J Nutr Educ. 2001; 33(3): 155–160. pmid:11953231
- 65. Derrickson JP, Fisher AG, Anderson JE. The core food security module scale measure is valid and reliable when used with Asians and Pacific Islanders. J Nutr. 2000; 130(11): 2666–2674. pmid:11053505
- 66. Derrickson J, Anderson J. Face validity of the core food security module with Asians and Pacific Islanders. J Nutr Educ. 2000; 32(1): 21–30.
- 67. Rabbitt MP, Coleman-Jensen A. Rasch analyses of the standardized Spanish translation of the US household food security survey module. JESM. 2017; 42(2): 171–187.
- 68.
Office of the Registrar. 2017–2018 Academic Year Undergrad Base Tuition Rates. Available from https://registrar.illinois.edu/tuition-fees/tuition-fee-rates/ug-base-rates-1718/. Cited 15 November 2018.
- 69.
Office of the Registrar. 2017–2018 Academic Year Undergrad Estimated Additional Expenses. Available from https://registrar.illinois.edu/tuition-fees/tuition-fee-rates/ug-additional-expenses-1718/. Cited 15 November 2018.
- 70. Wright BD, Linacre JM. Reasonable mean-square fit values. Rasch Measurement Transactions. 1994; 8(3): 370.
- 71.
Boone WJ, Staver JR, Yale MS. Rasch Analysis in the Human Sciences. Springer Science & Business Media; 2013 Dec 13.
- 72. Radimer KL, Olson CM, Campbell CC. Development of indicators to assess hunger. J Nutr. 1990; 120(S11): 1544–1548.
- 73. Carnevale AP, Smith N, Melton M, Price E. Learning While Earning: The New Normal. 2015. Available from https://cew.georgetown.edu/cew-reports/workinglearners/. Cited 15 November 2018.
- 74. Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003; 12(3): 229–238. pmid:12769135
- 75. Watson TD, Malan H, Glik D, Martinez S. College students identify university support for basic needs and life skills as key ingredient in addressing food insecurity on campus. California Agriculture. 2017; 71(3): 130–138.
- 76. Nikolaus CJ, Schierer M, Ellison B, Eicher-Miller HA, Gundersen C, Nickols-Richardson SM. Grit is associated with food security among U.S. parents and adolescents. J Am Health Behav. 2019. pmid:30522578
- 77. Gundersen CG, Garasky SB. Financial management skills are associated with food insecurity in a sample of households with children in the United States. J Nutr. 2012; 142(10): 1865–1870. pmid:22955515
- 78. U.S. Department of Education. The EFC Formula 2018–2019. Available from https://studentaid.ed.gov/sa/resources#fafsa. Cited 15 November 2018.
- 79. Coleman-Jensen A, Rabbitt MP, Gregory CA. Examining an" Experimental" Food-security-status Classification Method for Households with Children. 2017. Available from https://www.ers.usda.gov/publications/pub-details/?pubid=85213. Cited 15 November 2018.
- 80. Derrickson JP, Anderson JE, Fisher AG. Concurrent Validity of the Face Valid Food Security Measure. March 2000. Available from https://ideas.repec.org/p/wop/wispod/1206-00.html. Cited 15 November 2018.
- 81. Fram MS, Frongillo EA, Draper CL, Fishbein EM. Development and validation of a child report assessment of child food insecurity and comparison to parent report assessment. J Hunger Environ Nutr. 2013; 8(2): 128–145.
- 82.
Frongillo EA Jr. The use of scaling and indexing to measure the severity of food insecurity. In: Conference on Food Security Measurement and Research. Food and Consumer Service, U.S. 1994.
- 83.
Government Accountability Office. Food Insecurity: Better Information Could Help Eligible College Students Access Federal Food Assistance Benefits. 2018. Available from https://www.gao.gov/products. Cited 24 February 2019.
- 84. Curtin R, Presser S, Singer E. The effects of response rate changes on the index of consumer sentiment. Public Opin Q. 2000; 64(4): 413–428. pmid:11171024
- 85. Sax LJ, Gilmartin SK, Bryant AN. Assessing response rates and nonresponse bias in web and paper surveys. Res High Educ. 2003; 44(4): 409–432.
