Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The QUIC-SP: A Spanish language tool assessing unpredictability in early life is linked to physical and mental health

  • Sabrina R. Liu ,

    Contributed equally to this work with: Sabrina R. Liu, Natasha A. Bailey

    Roles Writing – original draft, Writing – review & editing

    Current address: Department of Human Development, California State University San Marcos, San Marcos, California, United States of America

    Affiliation Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, California, United States of America

  • Natasha A. Bailey ,

    Contributed equally to this work with: Sabrina R. Liu, Natasha A. Bailey

    Roles Formal analysis, Project administration, Writing – original draft

    Current address: Department of Psychology, University of Virginia, Charlottesville, Virginia, United States of America

    Affiliation Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, California, United States of America

  • Sara Romero-González,

    Roles Conceptualization, Methodology, Project administration, Writing – review & editing

    Current address: Department of Psychiatry, University Hospital Virgen del Rocio, Seville, Spain

    Affiliation Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, California, United States of America

  • Amy Moors,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, California, United States of America

  • Belinda Campos,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Chicano/Latino Studies, University of California-Irvine, Irvine, California, United States of America

  • Elysia Poggi Davis,

    Roles Conceptualization, Funding acquisition, Methodology, Writing – review & editing

    Affiliations Department of Psychology, University of Denver, Denver, Colorado, United States of America, Department of Pediatrics, University of California-Irvine, Irvine, California, United States of America

  • Laura M. Glynn

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Writing – review & editing

    lglynn@chapman.edu

    Affiliation Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, California, United States of America

Abstract

Accumulating evidence indicates that unpredictable signals in early life represent a unique form of adverse childhood experiences (ACEs) associated with disrupted neurodevelopmental trajectories in children and adolescents. The Questionnaire of Unpredictability in Childhood (QUIC) was developed to assess early life unpredictability [1], encompassing social, emotional, and physical unpredictability in a child’s environment, and has been validated in three independent cohorts. However, the importance of identifying ACEs in diverse populations, including non-English speaking groups, necessitates translation of the QUIC. The current study aims to translate and validate a Spanish language version of the QUIC (QUIC-SP) and assess its associations with mental and physical health. Spanish-speaking participants (N = 285) were recruited via the online market crowdsourcing platform, Amazon Mechanical Turk (MTurk), and completed an online survey that included the QUIC-SP and validated Spanish language assessments of physical and mental health. The QUIC-SP demonstrated excellent psychometric properties and similar mean scores, endorsement rates, and internal reliability to the English language version, thus establishing its validity among Spanish-speaking adults. Higher QUIC-SP scores, indicating greater unpredictability in early life, predicted increased symptoms of anxiety, anhedonia, depression, and poorer physical health. Given significant racial and ethnic disparities in health, the QUIC-SP may serve as a valuable tool to address the public health consequences of ACEs among Spanish-speaking populations.

Introduction

A substantial body of work has established that adverse childhood experiences (ACEs) negatively impact physical and mental health across the lifespan through mechanisms related to neurodevelopmental disruption, alterations in stress, metabolic and immune systems, as well as epigenetic modifications [25]. However, within this body of research, what has been conceptualized as “adversity” greatly varies and some forms have been studied more than others (e.g., poverty, parental separation, abuse). Unpredictable signals (e.g., social, emotional, and physical unpredictability) from caregivers and the environment represent a novel conceptualization of an additional ACE [611]. The importance of unpredictability of sensory inputs was initially supported by preclinical work demonstrating that unpredictable maternal signals (patterns of licking, grooming, and nursing in rodents) causally influence the maturation of brain systems that govern emotional and cognitive functions [1215]. Further validating the importance of unpredictability in childhood, several independent human cohorts have confirmed that unpredictable environmental signals contribute to adverse neurodevelopmental outcomes and compromised mental health, even after accounting for the predictive capacity of previously established ACEs [1]. To date, exposures to unpredictable caregiver(s) signals in infancy have been linked to trajectories of cognitive and emotional functioning through adolescence [7, 1619]. These findings across species warrant additional research among diverse populations on unpredictability as a novel type of early life adversity as a step to address the significant and costly public health consequences of ACEs.

Given that unpredictability in early life occurs in a broad range of contexts (e.g., parental, family, neighborhood) and in different distributions over time (e.g., from seconds to years), we recognized the need to develop a comprehensive self-report measure. To address this unmet need, the Questionnaire of Unpredictability in Childhood (QUIC) was developed [1]. This 38-item measure captures aspects of the early environment that are characterized by stochastic variation in events or exposures and that cannot be anticipated or foreseen with a high degree of certainty. In the validation paper, we show that the QUIC demonstrated excellent psychometrics (internal consistency, test-retest reliability) and associations with mental health (depression, anhedonia, and anxiety) in three independent cohorts: adult females, male military veterans, and adolescents. Further, the QUIC’s contribution to mental health persisted above and beyond other established ACE predictors, such as parenting, income-to-needs ratio, traumatic life events, and child maltreatment. Importantly, research has demonstrated accuracy of self-reports on the QUIC. We found agreement between specific QUIC scale items (e.g., moving frequently) and longitudinal data that was collected from birth in a cohort of adolescents. Additionally, prospective measures of unpredictability assessed during infancy and childhood were associated with QUIC scores obtained in adolescence [1].

As the first comprehensive self-report measure of unpredictability in childhood, the QUIC enables researchers and clinicians to easily gather information about a unique predictor of compromised health and development. An important next step is to ensure this measure is widely accessible, which includes translation into other languages. Although researchers have highlighted heightened risk of early adversity to be a potential root cause of existing racial/ethnic disparities in health and development [20], these topics have been less studied in culturally diverse populations. Hispanic/Latinos (for use of these terms see [21]) make up the second largest racial/ethnic group in the U.S. (after whites), and Spanish constitutes the second most spoken language with over 41 million speakers aged five and older [2224]. Thus, to better understand the impact of early childhood experiences, including unpredictability, and to meet the needs of diverse Hispanic/Latino populations, the goals of the current study were to: 1) translate and validate a Spanish language version of the QUIC (QUIC-SP), and 2) examine how unpredictability in early childhood (via the newly translated QUIC-SP measure) is associated with mental and physical health outcomes. We expected that the QUIC-SP would demonstrate negative associations with mental health akin to those found by Glynn and colleagues with the English-language QUIC. Although not previously explored with the QUIC, it was also expected that the QUIC-SP would have an inverse relation to physical health, consistent with previous research on other ACE types [25, 26].

Methods

Description of scale

The Questionnaire of Unpredictability in Childhood (QUIC) is a self-report measure designed to assess unpredictability in social, emotional and physical domains of the childhood environment. Details regarding the development of the original English language version of the scale can be found in Glynn et al. (2019).

The English language version of the QUIC is intended for people aged 12 and older, as the 38 items assess family and home conditions prior to age 18, with a subset of items focusing on life circumstances prior to age 12. It comprises five subscales: Parental Monitoring and Involvement (parent kept track of child’s activities; 9 items), Parental Predictability (stability and presence of a parent; 12 items), Parental Environment (stability in parent’s life; 7 items), Physical Environment (household chaos, moving; 7 items), and Safety and Security (fear of lacking basic necessities; 3 items). Respondents answer yes (1) or no (0) for each item. Total scores range from 0 to 38, with higher scores representing greater childhood unpredictability. The scale exhibits excellent test-retest reliability (r = .92) and internal consistency (α = .89). The validity of the measure is supported by the fact that QUIC scores are positively associated with prospectively measured indicators of unpredictability in infancy and childhood (unpredictability of maternal mood and sensory signals) and that accuracy of recall was confirmed with prospective data (e.g., number of household moves, parental separation) [1].

Translation

First, the QUIC was translated into Spanish by an English-Spanish bilingual individual, whose childhood was spent in both Mexico and the U.S. After completing the initial translation, the translator reviewed and discussed the items with five bilingual individuals for cultural relevance and interpretability, including an English-Spanish bilingual psychologist and expert in Latino culture, a Spanish teacher living in Mexico, and three native Spanish speakers who reside in the U.S. This approach to receiving feedback from individuals who were formal educators of Spanish and community members who spoke Spanish helped ensure accessible translation of items for a wide range of Spanish speakers with different backgrounds [27]. After finalizing the items, the scale was then back-translated by a sixth, independent, bilingual English-Spanish speaker to confirm the quality and integrity of the translation. The English and Spanish versions of the items can be found in Table 1.

thumbnail
Table 1. Questionnaire of Unpredictability in Childhood (QUIC) items by subscale in Spanish and English.

https://doi.org/10.1371/journal.pone.0298296.t001

Participants and procedures

The study was approved by the Chapman University Institutional Review Board. The recruitment period for the study began on November 24, 2020 and ended on November 28, 2020. Participants were recruited through Amazon Mechanical Turk (MTurk), an online market crowdsourcing platform where users can complete surveys for monetary incentives. Inclusion criteria consisted of the following: the participant must speak and read Spanish fluently, be 18 years of age or older, and live in the United States. MTurk users who met eligibility criteria were able to view the description of the survey and could access the survey via a link, which was administered through the Research Electronic Data Capture (REDCap) online survey platform. Participants were then presented with the written electronic informed consent form. If they consented to participate, they proceeded to the main survey.

A total of 498 respondents consented to participate in the survey that included the QUIC, demographic information, and measures of mental and physical health. Ninety-three participants were excluded for not completing the survey and 120 participants were excluded for failing one or more of the three attention checks, resulting in a final count of 285 participants (57.9% female). The attention checks consisted of items embedded within measures asking participants to select a particular response for that item (e.g., “please select ‘totally disagree’ for this question”). Importantly, inattentiveness and high rates of attrition on online surveys is common, with previous research documenting estimates as high as 60% of respondents answering items carelessly [28, 29]. However, compared to research using different recruitment strategies (e.g., participant pools), research has suggested MTurk respondents are more attentive to instructions and items [28]. Excluding responses from those who fail manipulation checks ensures MTurk survey data is high-quality and reliable [3032]. Moreover, the MTurk platform has been shown to be a reliable way to recruit Spanish-speaking participants and has been used in clinical and non-clinical scale validation research [3335]. Demographic information of the final study sample is reported in Table 2.

Measures

Mental health assessment. Depressive symptoms. Depressive symptoms were assessed with the Spanish version of the Beck Depression Inventory-II (BDI-II; [36]). The BDI-II is a 21-item instrument that is valid for use in both psychiatric and non-psychiatric populations [37]. The measure assesses 21 depressive symptoms rated on a 0–3 scale, with higher scores indicating greater symptom severity. Internal consistency was excellent in the current sample (α = .94).

Anxiety. Symptoms of anxiety were measured with a 9-item version of the State Anxiety Scale from the State-Trait Anxiety Inventory (STAI; [38]) that has been adapted for use in Spanish-speaking populations [39]. Participants rated their agreement with 9 statements about anxiety symptoms experienced at the time of assessment and in the days leading up to assessment (e.g., “I am worried”) on a 4-point Likert scale from 1 (not at all) to 4 (very much). It is important to note that the original STAI contains 10 items; however in this survey, one item was excluded by mistake. Despite this error, internal consistency for the current sample was very high at .90, thus providing support to the validity of the 9-item STAI utilized in this study. As an additional validity check, we imputed values for the missing item and found no significant changes in the overall pattern of results.

Anhedonia. Anhedonia was examined using the 14-item Snaith-Hamilton Pleasure Scale (SHAPS; [40]). The Spanish version of the scale has been found to have good internal consistency and construct validity [41]. Participants were asked to indicate how much they enjoyed various pleasurable experiences (e.g., “I would enjoy a warm bath or refreshing shower”). Responses were recorded on a 4-point Likert scale from 1 (strongly disagree) to 4 (strongly agree). Internal consistency for the SHAPS in the current sample was .86.

Physical health assessment. Physical functioning. Assessment of physical functioning was measured using the Spanish version of the Patient-Reported Outcomes Measurement Information System (PROMIS–57) Physical Functioning subscale [42]. This subscale contains 8 items; participants rated how difficult it was for them to complete various physical activities (e.g., “Are you able to go for a walk of at least 15 minutes?”) using a 5-point scale from 1 (unable to do) to 5 (without difficulty). Internal consistency in the current sample was high (α = .93).

Global health. Participants’ global health was assessed using one question from the Spanish version of the Health-Related Quality of Life (HRQOL) scale [43]. Participants were asked to give a general rating of their health on a scale of 1 (excellent) to 5 (poor).

Results

Mean scores and endorsement rates

Means and standard deviations for the total score and each of the five subscales on the Spanish language QUIC (QUIC-SP) can be found in Table 3 (endorsement rates for each item are shown in S1 Table). There was a wide distribution of scores ranging from 0–32, which is similar to that reported in the English language version [1]. On average, participants endorsed having experienced 8.8 of the 38 items. Mean subscale scores ranged from 0.7 to 3.4.

thumbnail
Table 3. Means and standard deviations of the QUIC-SP score and subscale scores (N = 285).

https://doi.org/10.1371/journal.pone.0298296.t003

Internal reliability

There was strong internal consistency for the total score (α = 0.92) and each of the five subscale scores (αrange = 0.73–0.83; see Table 3). Cronbach’s alphas were consistent with those initially reported by Glynn et al. (2019) in the English language version of the QUIC.

Associations with indicators of mental and physical health

The QUIC-SP was associated with all indicators of mental and physical health (see Table 4). Increased exposures to unpredictability in childhood assessed with the QUIC-SP predicted higher levels of anxiety, anhedonia, and depressive symptoms. Elevated QUIC-SP scores were also correlated with poorer self-reported physical functioning and global physical health.

thumbnail
Table 4. Bivariate correlations between the QUIC-SP and measures of mental and physical health.

https://doi.org/10.1371/journal.pone.0298296.t004

Discussion

A growing body of research demonstrates that unpredictable environments in early life have a large impact on the developing brain and later emotional and cognitive functioning [1, 58, 14, 44]. Moreover, disproportionality in exposure to adversity in early life may play a pivotal role in explaining racial/ethnic disparities in health and development [20], yet until the present study, measures of early life unpredictability in languages other than English did not exist. The Questionnaire of Unpredictability in Childhood (QUIC) is a multifaceted self-report measure to assess early life adversity and unpredictability [1]. The current study expanded the QUIC’s utility by translating the scale into Spanish and providing evidence of internal consistency, predictive validity, and associations with important health outcomes among Spanish-speaking adults. Specifically, we showed with data from 285 adult Spanish speakers in the U.S. that there was meaningful variability in scores and strong internal consistency on the five QUIC subscales as well as the total scale score. Mirroring previous findings with the English language QUIC [1], early life unpredictability assessed with the QUIC-SP is predictive of negative mental health outcomes (depression, anxiety, and anhedonia). Further, this study adds an important novel result that early life unpredictability (as measured by the QUIC-SP) is associated with poorer physical health later in life [25, 26], strengthening the evidence that the QUIC-SP has great utility for understanding antecedents of later life health.

The development of the QUIC-SP presents several new research opportunities and opportunities to advance the inclusion of populations that may otherwise be overlooked in this critical area of research. In this study, we documented associations between the QUIC-SP and several physical and mental health outcomes, and future research can expand these findings to additional health conditions, identify possible mediators of these relations, and examine how QUIC-SP scores predict later health above and beyond other established predictors such as traumatic life events. Our sample was diverse across several demographic categories including age, gender, income, and native language (English or Spanish). The majority (78%) of our participants were born in the U.S., and future research also can expand the validity of this measure by exploring its performance and interrelations with health in Spanish-speaking populations across the globe.

Finally, we believe that understanding unpredictable environments in early life (as measured by the QUIC-SP) among Spanish-speaking populations in the U.S. will be beneficial to future researchers, given the social contextual factors that may disproportionately expose these populations to unpredictability. Over the past several years, there have been unprecedented levels of migration across the globe, including to the U.S. [45]. In 2019, Spanish was the dominant language among immigrants in the U.S. who were not primary English speakers [46]. The premigration, migration, and postmigration phases of immigration can be marked by various forms of unpredictability, such as poverty and violence in one’s home country, the migration journey, and searching for resources in a new country. The year 2022 marked the highest rates of unaccompanied child immigrants to the U.S. [47]. Upon arrival, families and children face the potential of separation and/or deportation without knowing when they may be reunited [48]. Lastly, U.S. policies on immigration are everchanging. For example, Mexican immigrants make up 89% of recipients of the Deferred Action for Childhood Arrivals (DACA) program, which allows residents brought to the U.S. as children without citizenship to apply for employment, benefits, certain schooling and schooling resources too (e.g., in state college tuition), and various funding mechanisms [46, 49]. In just the past nine years, DACA has been expanded, rescinded, and reinstated with new restrictions [50]. The program’s status continues to be in flux today. These sociopolitical considerations highlight a few of the plausible forms of unpredictability likely to be imposed on various Spanish-speaking populations in the U.S.—unpredictability that can now be captured and assessed by the QUIC-SP which includes questions about routines, parental presence and separation, parental job stability, moving, food and monetary security, and safety. As such, the QUIC-SP offers the ability to advance research and inform policy related to how unpredictability in early life impacts the health and well-being of Spanish-speaking populations.

Supporting information

S1 Table. Item-by-item endorsement rates for the QUIC-SP.

https://doi.org/10.1371/journal.pone.0298296.s001

(DOCX)

References

  1. 1. Glynn LM, Stern HS, Howland MA, Risbrough VB, Baker DG, Nievergelt CM, et al. Measuring novel antecedents of mental illness: the Questionnaire of Unpredictability in Childhood. Neuropsychopharmacology. 2019;44: 876–82. pmid:30470840
  2. 2. Gunnar MR. Early adversity, stress, and neurobehavioral development. Dev Psychopathol. 2020;32: 1555–62. pmid:33427166
  3. 3. McLaughlin KA. Future directions in childhood adversity and youth psychopathology. J Clin Child Adolesc Psychol. 2016;45: 361–82. pmid:26849071
  4. 4. Nelson CA, Scott RD, Bhutta ZA, Harris NB, Danese A, Samara M. Adversity in childhood is linked to mental and physical health throughout life. Bmj-Brit Med J. 2020;371: m3048. pmid:33115717
  5. 5. Smith KE, Pollak SD. Rethinking concepts and categories for understanding the neurodevelopmental effects of childhood adversity. Perspect Psychol Sci 2021;16: 67–93. pmid:32668190
  6. 6. Baram TZ, Davis EP, Obenaus A, Sandman CA, Small SL, Solodkin A, et al. Fragmentation and unpredictability of early-life experience in mental disorders. Am J Psychiatry. 2012;169: 907–15. pmid:22885631
  7. 7. Davis EP, Stout SA, Molet J, Vegetabile B, Glynn LM, Sandman CA, et al. Exposure to unpredictable maternal sensory signals influences cognitive development across species. Proc Natl Acad Sci USA. 2017;114: 10390–5. pmid:28893979
  8. 8. Glynn LM, Baram TZ. The influence of unpredictable, fragmented parental signals on the developing brain. Front Neuroendocrinol. 2019;53: 100736. pmid:30711600
  9. 9. Short AK, Baram TZ. Early-life adversity and neurological disease: age-old questions and novel answers. Nat Rev Neurol. 2019;15: 657–69. pmid:31530940
  10. 10. Belsky J, Schlomer GL, Ellis BJ. Beyond cumulative risk: distinguishing harshness and unpredictability as determinants of parenting and early life history strategy. Dev Psychol. 2012;48: 662–73. pmid:21744948
  11. 11. Ellis BJ, Figueredo AJ, Brumbach BH, Schlomer GL. Fundamental dimensions of environmental risk: the impact of harsh versus unpredictable environments on the evolution and development of life history strategies. Hum Nat. 2009;20: 204–68. pmid:25526958
  12. 12. Bolton JL, Molet J, Regev L, Chen Y, Rismanchi N, Haddad E, et al. Anhedonia following early-life adversity involves aberrant interaction of reward and anxiety circuits and is reversed by partial silencing of amygdala corticotropin-releasing hormone gene. Biol Psychiatry. 2018;83: 137–47. pmid:29033027
  13. 13. Bolton JL, Schulmann A, Garcia-Curran MM, Regev L, Chen Y, Kamei N, et al. Unexpected transcriptional programs contribute to hippocampal memory deficits and neuronal stunting after early-life adversity. Cell Rep. 2020;33: 108511. pmid:33326786
  14. 14. Molet J, Heins K, Zhuo X, Mei YT, Regev L, Baram TZ, et al. Fragmentation and high entropy of neonatal experience predict adolescent emotional outcome. Transl Psychiatry. 2016;6: e702–e. pmid:26731439
  15. 15. Molet J, Maras PM, Kinney-Lang E, Harris NG, Rashid F, Ivy AS, et al. MRI uncovers disrupted hippocampal microstructure that underlies memory impairments after early-life adversity. Hippocampus. 2016;26: 1618–32. pmid:27657911
  16. 16. Davis EP, Korja R, Karlsson L, Glynn LM, Sandman CA, Vegetabile B, et al. Across continents and demographics, unpredictable maternal signals are associated with children’s cognitive function. EBioMedicine. 2019;46: 256–63. pmid:31362905
  17. 17. Davis EP, Stout SA, Molet J, Vegetabile B, Glynn LM, Sandman CA, et al. Exposure to unpredictable maternal sensory signals influences cognitive development across species. Proc Natl Acad Sci U S A. 2017;114: 10390–5. pmid:28893979
  18. 18. Howland MA, Sandman CA, Davis EP, Stern HS, Phelan M, Baram TZ, et al. Prenatal maternal mood entropy is associated with child neurodevelopment. Emotion. 2021;21: 489–98. pmid:32202848
  19. 19. Glynn LM, Howland MA, Sandman CA, Davis EP, Phelan M, Baram TZ, et al. Prenatal maternal mood patterns predict child temperament and adolescent mental health. J Affect Disord. 2018;228: 83–90. pmid:29241049
  20. 20. Shonkoff JP. Leveraging the biology of adversity to address the roots of disparities in health and development. Proc Natl Acad Sci USA. 2012;109: 17302–7. pmid:23045654
  21. 21. McCarthy J, Dupreé W. No preferred racial term among most black, Hispanic adults 2021. Available from: https://news.gallup.com/poll/353000/no-preferred-racial-term-among-black-hispanic-adults.aspx.
  22. 22. Frey W. The nation is diversifying even faster than predicted, according to new census data 2020. Available from: https://www.brookings.edu/research/new-census-data-shows-the-nation-is-diversifying-even-faster-than-predicted/.
  23. 23. Lopez MH, Gonzalez-Barrera A. What is the future of Spanish in the United States? 2013. Available from: https://www.pewresearch.org/fact-tank/2013/09/05/what-is-the-future-of-spanish-in-the-united-states/.
  24. 24. Language spoken at home: 2017 American Community Survey 1-year estimates 2017. Available from: https://archive.ph/20200214011034/ https://factfinder.census.gov/faces/tableservices/jsf/pages/productview.xhtml.
  25. 25. Felitti VJ, Anda RF, Nordenberg D, Williamson DF, Spitz AM, Edwards V, et al. Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults: The Adverse Childhood Experiences (ACE) Study. Am J Prev Med. 1998;14: 245–58. pmid:9635069
  26. 26. Petruccelli K, Davis J, Berman T. Adverse childhood experiences and associated health outcomes: A systematic review and meta-analysis. Child Abuse Negl. 2019;97: 104127. pmid:31454589
  27. 27. Perczek R, Carver CS, Price AA, Pozo-Kaderman C. Coping, mood, and aspects of personality in Spanish translation and evidence of convergence with English versions. J Pers Assess. 2000;74: 63–87. pmid:10779933
  28. 28. Hauser DJ, Schwarz N. Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behav Res Methods. 2016;48: 400–7. pmid:25761395
  29. 29. Meade A, Craig B. Identifying careless responses in survey data. Psychol Methods. 2012;17: 437–55. pmid:22506584
  30. 30. Chmielewski M, Kucker SC. An MTurk crisis? Shifts in data quality and the impact on study results. Soc Psychol Personal Sci. 2019;11: 464–73.
  31. 31. Hunt NC, Scheetz AM. Using MTurk to distribute a survey or experiment: Methodological considerations. J Inf Syst. 2018;33: 43–65.
  32. 32. Zhang B, Gearhart S. Collecting online survey data: A comparison of data quality among a commercial panel & MTurk. Survey Practice. 2020;13: 1–10.
  33. 33. Kanamori Y, Cornelius-White JHD, Pegors TK, Daniel T, Hulgus J. Development and validation of the transgender attitudes and beliefs scale. Arch Sex Behav. 2017;46: 1503–15. pmid:27571743
  34. 34. Shapiro DN, Chandler J, Mueller PA. Using Mechanical Turk to study clinical populations. Clin Psychol Sci. 2013;1: 213–20.
  35. 35. Ortega-Santos I. Crowdsourcing for Hispanic Linguistics: Amazon’s Mechanical Turk as a source of Spanish data. Borealis–An International Journal of Hispanic Linguistics. 2019;8: 187–215.
  36. 36. Sanz J, Perdigón AL, Vázquez C. Adaptación española del Inventario para la Depresión de Beck-ll (BDI-II): 2. Propiedades psicométricas en población general. [The Spanish adaptation of Beck’s Depression Inventory-ll (BDI-II): 2. Psychometric properties in the general population.]. Clínica y Salud. 2003;14: 249–80.
  37. 37. Beck AT, Steer RA, Brown GK. Beck Depression Inventory (BDI-II): Pearson; 1996.
  38. 38. Spielberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA. Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press; 1983.
  39. 39. Spielberger CD, Gorsuch RL, Lushene R. Cuestionario de Ansiedad Estado-Rasgo: Manual. Madrid, Spain: TEA; 1982.
  40. 40. Snaith RP, Hamilton M, Morley S, Humayan A, Hargreaves D, Trigwell P. A scale for the assessment of hedonic tone the Snaith–Hamilton Pleasure Scale. Br J Psychiatry. 1995;167: 99–103. pmid:7551619
  41. 41. Fresán A, Berlanga C. Translation into Spanish and validation of the Snaith-Hamilton Pleasure Scale (SHAPS) for anhedonia. Actas Españolas de Psiquiatría. 2013;41: 226–31.
  42. 42. Cella D, Choi SW, Condon DM, Schalet B, Hays RD, Rothrock NE, et al. PROMIS((R)) Adult Health Profiles: efficient short-form measures of seven health domains. Value Health. 2019;22: 537–44. pmid:31104731
  43. 43. Cintron Y. Health-Related Quality of Life—Puerto Rico, 1996–2000. Morbidity and Mortality Weekly Report. 2002;51: 166–8. pmid:11900118
  44. 44. Glynn LM, Howland MA, Sandman CA, Davis EP, Phelan M, Baram TZ, et al. Prenatal maternal mood patterns predict child temperament and adolescent mental health. J Affect Disord. 2018;228: 83–90. pmid:29241049
  45. 45. Okazaki S, Guler J, Haarlammert M, Liu SR. Translating psychological research on immigrants and refugees. Transl Issues Psychol Sci. 2019;5: 1–3.
  46. 46. Batalova J, Hanna M, & Levesque C. Frequently requested statistics on immigrants and immigration in the United States. 2021. Available from https://www.migrationpolicy.org/article/frequently-requested-statistics-immigrants-and-immigration-united-states-2020.
  47. 47. Montoya-Galvez C. Nearly 130,000 unaccompanied migrang children entered the U.S. shelter system in 2022, a record. 2022. Available from: https://www.cbsnews.com/news/immigration-unaccompanied-migrant-children-record-numbers-us-shelter-system/].
  48. 48. Sheridan MA, Nelson C. Opinion | How to turn children into criminals. The New York Times. 2018.
  49. 49. Sims GM, Kia-Keating M, Liu SR, Taghavi I. Political climate and sense of belonging in higher education: Latina undergraduates and mental health. Peace Confl. 2020;26: 356–64.
  50. 50. Deferred Action for Childhood Arrivals (DACA): Arizona State University. 2020. Available from: https://libguides.law.asu.edu/DACA/history.