Overweight patients report weight discrimination in health care settings and subsequent avoidance of routine preventive health care. The purpose of this study was to examine implicit and explicit attitudes about weight among a large group of medical doctors (MDs) to determine the pervasiveness of negative attitudes about weight among MDs. Test-takers voluntarily accessed a public Web site, known as Project Implicit®, and opted to complete the Weight Implicit Association Test (IAT) (N = 359,261). A sub-sample identified their highest level of education as MD (N = 2,284). Among the MDs, 55% were female, 78% reported their race as white, and 62% had a normal range BMI. This large sample of test-takers showed strong implicit anti-fat bias (Cohen’s d = 1.0). MDs, on average, also showed strong implicit anti-fat bias (Cohen’s d = 0.93). All test-takers and the MD sub-sample reported a strong preference for thin people rather than fat people or a strong explicit anti-fat bias. We conclude that strong implicit and explicit anti-fat bias is as pervasive among MDs as it is among the general public. An important area for future research is to investigate the association between providers’ implicit and explicit attitudes about weight, patient reports of weight discrimination in health care, and quality of care delivered to overweight patients.
Citation: Sabin JA, Marini M, Nosek BA (2012) Implicit and Explicit Anti-Fat Bias among a Large Sample of Medical Doctors by BMI, Race/Ethnicity and Gender. PLoS ONE 7(11): e48448. https://doi.org/10.1371/journal.pone.0048448
Editor: Richard Fielding, The University of Hong Kong, Hong Kong
Received: May 31, 2012; Accepted: September 26, 2012; Published: November 7, 2012
Copyright: © 2012 Sabin et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This project was supported by Project Implicit, Inc. BN is an officer of Project Implicit, a non-profit organization that includes in its mission, “To develop and deliver methods for investigating and applying phenomena of implicit social cognition, including especially phenomena of implicit bias based on age, race, gender or other factors. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: This project was supported by Project Implicit, Inc. BN is an officer of Project Implicit, a non-profit organization that includes in its mission, “To develop and deliver methods for investigating and applying phenomena of implicit social cognition, including especially phenomena of implicit bias based on age, race, gender or other factors.”
In 2007–2008, the National Health and Nutrition Examination Survey estimated that 34.2% of US adults were overweight (BMI 25.0–29.9), 33.8% were obese (BMI≥30), and 5.7% were extremely obese (BMI≥40). (Centers for Disease Control and Prevention (CDC)) Prevalence of obesity among US children ages 2–19 is estimated at 17% with greater prevalence among minority children , . In 33 US states, rates of obesity are ≥25%, and in nine states rates of obesity are ≥33% (CDC, Accessed March 3, 2011) In 2007–2008, the prevalence of obesity among white women was 33%, white men 31.9%, non-Hispanic black women 49.6%, non-Hispanic black men 37.3%, 45.1% among Hispanic women and 35.9% among Hispanic men. (Prevalence of Overweight, Obesity, and Extreme Obesity Among Adults: United States, Trends 1960–1962 Through 2007–2008. Centers for Disease Control and Prevention; June 2010. Accessed July 21, 2011).
Physicians agree that there is a necessity to treat obesity but many do not feel competent to do so . In one study of primary care physicians, only 56% of physicians felt qualified to treat obesity . In a systematic review of the literature, physicians’ perception of their competence to treat obesity in children and adolescents ranged from 5% to 33% . A study of primary care physicians found that more than 50% viewed obese patients as awkward, unattractive and non-compliant . More than one third of these physicians characterized obese patients as weak-willed, sloppy and lazy . In another study, 45% of a sample of physicians agreed that they have a negative reaction to obese individuals . A study of military family physicians found that physicians’ stereotypical attitudes of obese people as lazy increased 145% between 1998 and 2005, with younger physicians more likely to endorse this attitude .
The prevalence of weight discrimination among Americans has increased by 66% over the past 10 years . Overweight patients report being treated disrespectfully by health professionals because of their weight . One study found that 53% of overweight and obese women reported receiving inappropriate comments about weight from their doctors . Obese patients who report perceptions of weight discrimination avoid seeking routine preventive care such as cancer screenings , .
In addition to self-reported beliefs, people also possess implicit or unconscious beliefs or biases that exist in memory but are often distinct from conscious values and beliefs. Implicit bias may predict discrimination behavior even among individuals who have no intention to discriminate . In socially sensitive areas such as interracial attitudes and beliefs, implicit attitudes are a better predictor of discriminatory behavior than is self-report . Implicit or unconscious negative attitudes about overweight people may be an under-recognized barrier to physicians engaging in weight management and appropriate communication about weight. Weight stigma in health care settings leads to poor quality of care for overweight patients . Physicians’ implicit and explicit attitudes about weight remain understudied. One of the few published studies on implicit weight bias among health professionals found that they held negative implicit attitudes about weight . Another study found that health professionals held implicit anti-fat attitudes associating “fat” with bad, lazy, stupid and worthless .
The purpose of this study was to examine implicit and explicit attitudes about weight among a large group of medical doctors (MDs) to determine the pervasiveness of negative attitudes about overweight among MDs. We examined and compared implicit and explicit attitudes about weight among a large convenience sample of the general population (N = 359,261), and a large sub-sample of MDs (N = 2,284) who chose to take the Weight Implicit Association Test (IAT) by accessing the Project Implicit® Web site (https://implicit.harvard.edu/). We disaggregated weight bias by MD gender, BMI, and race/ethnicity. We hypothesized that, similar to others in society, MDs would implicitly prefer thin people to fat people . We explored whether MDs implicit attitudes favoring thin people rather than fat people would be similar to an expected explicit self-reported preference for thin people. The University of Virginia Institutional Review Board for the Social and Behavioral Sciences approved this research.
Sample and Procedures
Test-takers voluntarily, and without any recruitment from the researchers, accessed a public Web site, Project Implicit (https://implicit.harvard.edu), between May 2006 and October 2010 and chose to take the Weight Implicit Association Test. Participants accessed the Project Implicit site because of recommendations from others, a classroom assignment, media coverage, random web surfing, and many other mechanisms. As a volunteer and non-targeted sample, the sample is large and diverse; however, it should not be mistaken for a representative population sample. The size and diversity of the sample provides the opportunity to extend generalization of laboratory investigations that often use small, non-diverse samples. Test-takers were asked their age, gender, race, ethnicity, height/weight, country of residence, highest level of education and other characteristics. We identified medical doctors (MDs) through their self-reported highest level of education.
The Implicit Association Test (IAT).
The IAT is a widely used measure of implicit social cognition that measures relative association strengths between two pairs of concepts . For example, for measuring implicit attitudes about weight the concepts are thin people, fat people, good words, and bad words . The Weight IAT was developed by researchers at Yale University, Department of Psychology, Rudd Center for Food Policy and Obesity and first reported in the literature in 2001 . Since then it has been made widely available for research and demonstration purposes on the Project Implicit web site. In the Weight IAT, test takers are required to quickly categorize pictures of overweight and thin people and value laden words as they appear on a computer screen by pressing one of two computer keys. In one condition, participants categorize pictures of overweight people and “good” words with one key and pictures of thin people and “bad” words with the other key. In a second condition, the key assignments are reversed, pictures of thin people and “good” words are categorized with one key and pictures of overweight people and “bad” words are categorized with the other key. The difference in the average response time between the two conditions is an indicator of the relative association strength or bias toward one group rather than the other. For example, people that categorize good words with thin people and bad words with fat people faster than the other condition are said to have an implicit preference for thin rather than fat people , . The IAT has become widely accepted as a measure of implicit social cognition because it captures evaluations that are related but distinct from self-report , achieves good reliability in comparison with other implicit measures , , is relatively robust with repeated measures for pre-post evaluation , , and has predictive validity across a variety of topics . The IAT has been used in health disparities research with physicians to measure implicit attitudes about race. One study found that physicians hold implicit race bias, similar to others in society , and recent research is showing that these attitudes affect medical care , .
Test takers reported their attitudes about weight by endorsing one answer from the following list; 1. I strongly prefer thin people to fat people. 2. I moderately prefer thin people to fat people. 3. I slightly prefer thin people to fat people. 4. I prefer thin people and fat people equally. 5. I slightly prefer fat people to thin people. 6. I moderately prefer fat people to thin people. 7. I strongly prefer fat people to thin people.
Calculation of Body Mass Index (BMI).
BMI was calculated according the centers for Disease Control and Prevention (CDC) formula of dividing weight in pounds (lbs) by height in inches (in) squared and multiplying by a conversion factor of 703. (BMI = weight (lb)/[height (in)] 2×703). For adults, BMI is interpreted using standard weight status categories that are the same for all ages and for both men and women. The categories are as follows; <18.5 = Underweight, BMI 18.5–24.9 = Normal, BMI 25.0–29.9 = Overweight and BMI ≥30.0 = Obese. (Calculation of BMI 2011; http://www.cdc.gov/healthyweight/assessing/bmi/adult_bmi/, Accessed December 13, 2011).
We used descriptive statistics (means, standard deviations, and frequencies), to characterize the sample. For the explicit measure we coded the seven-point response scale to range from −3 to +3, with zero indicating no relative preference for fat people vs. thin people. For this study, an explicit measure mean that differs positively from zero indicated an explicit preference for thin people over fat people. We compared means for the implicit and explicit measures for the complete sample of test takers, for the MD sub-sample and for the MD sub-sample disaggregated by MD gender, BMI, and race/ethnicity.
The IAT effect is calculated as the standardized difference in mean response time on two key conditions of the IAT, known as the IAT D score . The IAT was analyzed according to the improved scoring algorithm  with the following features: responses faster than 350 milliseconds were removed, responses slower than 10,000 milliseconds were removed, and errors were replaced with the mean of the correct responses in that response block plus a 600 millisecond penalty. In addition, IAT scores were disqualified for any of the following criteria suggestive of careless participation: (1) going too fast (<350 ms) on more than 10% of the total test trials, (2) making more than 30% erroneous responses across the critical blocks.
The IAT D score ranges from −2 to +2, with zero indicating no relative preference between thin people and fat people. Positive scores indicate an implicit preference for thin people, negative scores indicate an implicit preference for fat people. Because large samples result in virtually all effects being statistically significant, this report emphasizes reporting of effect size. Cohen’s d, a standardized effect size measure, was calculated for each of the implicit and explicit measures for each group. Cohen suggested the following interpretation of d guidelines; d of 0.20 = small effect, d of 0.5 = medium effect, and d of 0.80 = large effect.  Pearson’s correlation coefficient (r) was used to characterize the relationship between implicit and explicit measures.
Among the complete sample of test-takers (N = 359,261), 73% were female, 86% resided in the US, mean age was 26 years (SD = 10.7) and mean BMI was 25 (SD = 5.9). Table 1. Among all test-takers, 58% had a BMI in the normal range. Race/ethnicity of the complete sample was 82% white, 7% African American, 6% Asian, and 5% Hispanic. Among the sub-sample that identified their highest level of education as MD (medical doctor), 55% were female, 78% reside in the US, mean age was 34 years (SD = 11.5) and mean BMI was 24 (SD = 4.7). MDs reported their race/ethnicity as; 78% white, 5% African American, 15% Asian, and 2% Hispanic. Among MDs, 62% reported a BMI in the normal range versus 58% in the complete sample of test-takers. BMI distribution for the complete sample was as follows; 58% normal weight, 6% underweight, 21% overweight and 15% obese. BMI distribution for the MD sample was as follows; 62% normal weight, 3% underweight, 24% overweight and 11% obese.
Results for large general population samples of Weight IAT test takers have been reported elsewhere . These reports show that the general population holds strong implicit and explicit anti-fat bias. Similar to previous reports, this study’s large sample of test-takers showed strong implicit anti-fat bias (Cohen’s d = 1.0). Table 2. MDs, on average, also showed strong implicit anti-fat bias (Cohen’s d = 0.93). Implicit attitudes about weight among all test-takers were strong among both males and females. Among all female test takers and female MDs’ implicit anti-fat bias was significantly weaker than for males (p<.01, and p<.01). Although there were differences by gender, implicit anti-fat bias was strong among both male and female MDs (Cohen’s d = 1.02 for males and Cohen’s d = 0.86 for females). These differences by gender remained significant after adjustments for multiple comparisons. Table 3.
For the MD sub-sample, implicit anti-fat bias was strong among underweight, normal weight and overweight medical doctors. Table 4. Among the 11% of MDs whose BMI classified them as obese, implicit anti-fat bias was moderate (Cohen’s d = 0.60). After adjustments for multiple comparisons, variations in implicit bias by MD weight remained significantly different between normal weight vs. obese MDS (p<.01) and overweight and obese MDs (p = .01). This pattern of strong anti-fat bias among all weight groups except for obese individuals was similar among the complete sample of test-takers. (results not shown) Strong implicit anti-fat bias was found among white (Cohen’s d = 1.0), and Hispanic (Cohen’s d = 0.93) MDs. Table 5. After adjusting for multiple comparisons, there was a significant difference in implicit anti-fat bias between white and Asian MDs (p = .01). In the complete sample of test-takers all racial/ethnic groups showed strong implicit anti-fat bias. (not shown).
All test-takers reported a strong explicit preference for thin people over fat people on average (Cohen’s d = 0.90). There was variation in self-reported anti-fat bias among all test takers by gender, however, the variation was within the range of strong bias (Cohen’s d = 1.15 for males and Cohen’s d = 0.84 for females). We found strong self-reported anti-fat attitudes among MDs by gender (Cohen’s d = 1.44 for males and Cohen’s d = 1.13 for females). These differences by gender for all tests takers and for MDs remained significant after adjustments were made for multiple comparisons. For MDs who were underweight, normal weight and overweight we found strong explicit anti-fat bias. Among the sub-sample of MDs who were obese, we found moderate explicit anti-fat attitudes (MD sample Cohen’s d = 0.67), similar to all obese test-takers (not shown). After adjusting for multiple comparisons, we found a significant difference in strength of self-reported anti-fat attitudes between underweight vs. obese MDs (p<.001), normal vs. overweight MDs (p = .05), normal vs. obese MDs (p<.001), and overweight vs. obese MDs (p<.001). We found a significant difference in self-reported weight bias among white and African American MDs (p<.001), African American and Asian MDs (p = .02), and African American and Hispanic MDs (p = .02) although all groups showed strong anti-fat bias.
We found a statistically significant, but modest relationship, between implicit and explicit measures for the complete sample of test-takers (r = .20, p<.01), and for the MD sub-sample (r = .23, p<.01). Table 6. This pattern was found among MDs by MD gender, BMI, and for white and Asian MDs. There was no significant relationship between implicit and explicit attitudes about weight among African American MDs (r = .14, p = .17) and Hispanic MDs (r = .01, p = .95), though those groups were much smaller samples than the others.
This study is the first to show strong implicit and explicit weight bias among a very large sample of MDs by MD’s BMI, race/ethnicity and gender. Our study extends prior knowledge of physicians’ implicit and explicit attitudes about weight measured by the IAT, by comparing a very large sample of MDs with a very large sample from the general population and by MD’s personal characteristics. The results for MDs are similar to results from large samples of the general public who voluntarily take the Weight Implicit Association Test at the Project Implicit® web site . We found that MDs’ implicit and explicit attitudes about weight follow the same general pattern seen in the very large public samples that hold strong implicit and explicit anti-fat bias. We conclude that implicit and explicit anti-fat bias is as pervasive among MDs as it is among most people in society. In socially sensitive areas such as race, sexuality, disability, and age, implicit attitudes are often stronger than self-reported attitudes . However, for weight bias, both implicit and explicit anti-fat attitudes are very strong, with self-reported attitudes slightly stronger. Strong explicit attitudes suggest that individuals, including medical doctors, may feel that it is socially acceptable to express negative attitudes about overweight people.
Our study found strong implicit and explicit weight bias among male and female MDs, similar to all test takers in the sample, with females showing less implicit bias. Although weight bias was strong among all MD test takers, we found significant variations in strength of implicit and explicit weight bias by MD BMI and race/ethnicity. We do not yet know how MDs implicit and explicit anti-fat attitudes affect interpersonal clinical behavior. Nor do we know whether implicit weight bias is related to how overweight patients experience health care interactions. However, parallel evidence with implicit racial biases suggest that these are important areas to investigate .
An important limitation of this study is that the sample is not a random, representative sample of MDs. Thus, the sample means and distributions cannot be considered parameter estimates of MDs in general. It is possible that due to selection effects, the presence of implicit weight bias among MDs is either underestimated or overestimated. We do not know who chose to voluntarily self-assess their implicit weight bias by taking the Weight IAT, but we expect that the sample does not include the most biased individuals in society. However, because the analysis included more than 2,200 MDs, the present findings show that implicit and explicit weight bias among medical doctors is widespread.
Although we are relying on self-report of MD status, which is imprecise, some research shows that for sensitive topics, Web test takers are more likely to be honest than face-to-face or telephone survey respondents , , , . Data collected from Project Implicit® has been studied intensively for several years and the validity of results is comparable to that of similar data collected in experimental laboratory conditions , . Several studies that compare information provided by Web responders with information from traditional methods found no difference in validity of the data collected , . While there is a slightly higher probability of test takers providing misinformation than in more controlled conditions , this issue is not a factor in the interpretation of very large data sets , . The quality of data collected on the Web is often better than the quality of data gathered using other methods because the human error rate in the data collection process is reduced , .
Despite its limitations, this study is the first research to measure implicit and explicit attitudes about weight among a very large group of MDs to demonstrate just how pervasive these attitudes are among MDs and compare them to the general population. Strong negative implicit and explicit attitudes about weight among MDs may contribute to less-than-ideal clinical interactions and subsequent medical avoidance among overweight patients. Exploring the effects of physicians’ implicit and explicit weight bias on quality of care of overweight patients is an important area for future study.
Physicians express great interest in additional training in obesity management . In one study, one fourth of physicians (pediatricians and family medicine physicians) report that they are “not at all” or only “slightly competent” when addressing obesity and that treating obesity is “very frustrating” . Medical residents do not feel they are competent in weight management . In one study, only 23.6% of clinicians reported receiving training in good obesity practices in medical school and 30.9% in residency training . Those who reported receiving training in good obesity practices were more likely to discuss diet and exercise with obese patients.
Education programs for physicians and other health professionals, which often focus on causes and treatment of obesity, should also aim to increase clinicians’ self-awareness about implicit and explicit personal attitudes about weight and identify how these attitudes may affect care delivered to overweight patients. Some evidence suggests that explicit attitudes are more related to deliberate and verbal behavior and implicit attitudes are more related to spontaneous and non-verbal behavior . Educational interventions for providers that focus on weight management should emphasize improving clinicians’ verbal and non-verbal communication skills in the prevention and management of overweight. An important area for future research is to investigate the links among clinicians’ implicit and explicit attitudes about weight, patient reports of weight discrimination in health care, and quality of care delivered to overweight patients.
Conceived and designed the experiments: JS MM BN. Performed the experiments: BN. Analyzed the data: MM BN. Wrote the paper: JS MM BN. Conceptualization of the research: JS MM BN. Interpretation of results: JS MM BN.
- 1. Kim J, Peterson KE, Scanlon KS, Fitzmaurice GM, Must A, et al. (2006) Trends in overweight from 1980 through 2001 among preschool-aged children enrolled in a health mainteinance organization. Obesity 14: 1107–1112.
- 2. Flores G (2010) Technical Report-Racial and Ethnic Disparities in the Health and Health Care of Children. Pediatrics 125: e979–e1020.
- 3. van Gerwin M, Franc C, Rosman S, Le Vallant M, Pelletier-Fleury N (2008) Primary care physicians' knowledge, attitudes, beliefs and practices regarding childhood obesity: A systematic review. Obesity Reviews: 1–10.
- 4. Jay M, Kalet A, Ark T, McMacken M, Messito MJ, et al. (2009) Physicians' attitudes about obesity and their associations with competency and specialty:A cross-sectional study. BMC Health Services Research 106: 1–11.
- 5. Foster GB, Wadden TA, Makris AP, Davidson D, Sanderson RS, et al. (2003) Primary care physicians' attitudes about obesity and its treatment. Obesity Research 11: 1168–1177.
- 6. Warner CH, Warner CM, Morganson J, Appenzeller GN, Rachal J, et al. (2008) Military family physician attitudes toward treating obesity. Military Medicine 173: 978–984.
- 7. Andreyeva T, Puhl RM, Brownell KD (2008) Changes in perceived weight discrimination among Americans, 1995–1996 through 2004–2006. Obesity (Silver Spring) 16: 1129–1134.
- 8. Anderson DA, Wadden TA (2004) Bariatric surgery patients' views of their physicians' weight-related attitudes and practices. Obes Res 12: 1587–1595.
- 9. Puhl RM, Brownell KD (2006) Confronting and coping with weight stigma: an investigation of overweight and obese adults. Obesity (Silver Spring) 14: 1802–1815.
- 10. Wee CC, McCarthy EP, Davis RB, Phillips RS (2000) Screening for cervical and breast cancer: is obesity an unrecognized barrier to preventive care? Ann Intern Med 132: 697–704.
- 11. Mitchell RS, Padwal RS, Chuck AW, Klarenbach SW (2008) Cancer screening among the overweight and obese in Canada. Am J Prev Med 35: 127–132.
- 12. Dovidio J, Gaertner SL (2000) Aversive Racism and Selection Decisions: 1989 and 1999. Psychological Science 11: 315–319.
- 13. Greenwald AG, Poehlman AT, Ulhman E, Banaji MR (2009) Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity. Journal of Personality and Social Psychology 97: 17–41.
- 14. Puhl RM, Heuer CA (2010) Obesity stigma: important considerations for public health. Am J Public Health 100: 1019–1028.
- 15. Teachman BA, Brownell KD (2001) Implicit anti-fat bias among health professionals: Is anyone immune? International Journal of Obesity 25: 1525–1531.
- 16. Schwartz MB, Chambliss HO, Brownell KD, Blair SN, Billington C (2003) Weight bias among health professionals specializing in obesity. Obesity Research 11: 1033–1039.
- 17. Nosek BA, Smyth FL, Hansen JJ, Devos T, Lindner N, et al. (2007) Pervasiveness and variability of implicit attitudes and stereotypes. European Review of Social Psychology 18: 36–88.
- 18. Greenwald AG, McGhee DE, Schwartz JL (1998) Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology 74: 1464–1480.
- 19. Nosek BA, Greenwald AG, Banaji MR (2007) The Implicit Association Test at age 7: A methodological and conceptual review; In: Bargh JA, editor: Psychology Press.
- 20. Hofmann W, Gawronski B, Gschwender T, Le H, Schmitt M (2005) A meta-analysis on the correlation between the Implicit Association Test and Explicit self-report measures. Personality and Social Psychology Bulletin 31: 1369–1385.
- 21. Cunningham WA, Preacher KJ, Banaji MH (2001) Implicit attitude measures: Consistency, stability, and convergent validity. Psychological Science 12: 163–170.
- 22. Elgoff B, Schwerdtfeger A, Schmukle SC (2005) Temporal stability of the Implicit Association Test- anxiety. Journal of Personality Assessment 84: 82–88.
- 23. Sabin J, Nosek BA, Greenwald A, Rivara FP (2009) Physicians' implicit and explicit attitudes about race by MD race, ethnicity, and gender. J Health Care Poor Underserved 20: 896–913.
- 24. Sabin JA, Greenwald AG (2012) The influence of implicit bias on treatment recommendations for 4 common pediatric conditions: pain, urinary tract infection, attention deficit hyperactivity disorder, and asthma. Am J Public Health 102: 988–995.
- 25. Cooper LA, Roter DL, Carson KA, Beach MC, Sabin JA, et al. (2012) The associations of clinicians' implicit attitudes about race with medical visit communication and patient ratings of interpersonal care. Am J Public Health 102: 979–987.
- 26. Nosek BA, Banaji MR, Greenwald AG (2001) Harvesting implicit group attitudes and beliefs from a demonstration web site Group Dynamics: Theory, Research and Practice. 6: 101–115.
- 27. Greenwald AG, Nosek BA, Banaji MR (2003) Understanding and using the Implicit Association Test I: An improved scoring algorithm. Journal of Personality and Social Psychology 85: 197–216.
- 28. Cohen J (1988) Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates.
- 29. Nosek BA, Hawkins CB, Frazier RS (2011) Implicit social cognition: From measures to mechanisms Trends in Cognitive Sciences. 15: 152–159.
- 30. Nosek BA, Smyth FL, Hansen JJ, Devos T, Lindner N, et al. (2007) Pervasiveness and variability of implicit attitudes and stereotypes. European Review of Social Psychology: 36–88.
- 31. Penner LA, Dovidio JF, West TV, Gaertner SL, Albrech TL (2010) Aversive racism and medical interactions with black patients: A field study. Journal of Experimental Psychology 46: 436–440.
- 32. Rhodes SD, Bowie DA, Hergenrather KC (2003) Collecting behavioural data using the world wide web: considerations for researchers. J Epidemiol Community Health 57: 68–73.
- 33. Nosek BA, Banaji MR, Greenwald AG (2002) eResearch: Ethics, security,design, and control in psychological research on the Internet. Journal of Social Issues 58: 161–176.
- 34. Davis RN (1999) Web-based administration of a personality questionnaire: Comparison with traditional methods. Behav Res Methods Instrum Comput 31: 572–577.
- 35. Skitka LJ, Sargis EG (2006) The internet as psychological laboratory. Annn Rev Psychol 57: 529–555.
- 36. Nosek BA, Greenwald AG, Banaji MR (2005) Understanding and using the Implicit Association Test: II. Method variables and construct validity. Pers Soc Psychol Bull 31: 166–180.
- 37. Kraut R, Olson J, Banaji M, Bruckman A, Cohen J, et al. (2004) Psychological research online: Report of board of scientific affairs' advisory group on the conduct of research on the Internet American Psychologist. 59: 105–117.
- 38. Cronk BC, West JL (2003) Personality research on the Internet: A comparison of web-based and traditional instruments in take-home and in-class settings. Behav Res Methods Instrum Comput 34: 1770180.
- 39. Greenwald AG, Nosek BA, Banaji MR (2003) Understanding and using the implicit association test: I. An improved scoring algorithm. J Pers Soc Psychol 85: 197–216.
- 40. Story M, Stevens J, Himes JH, Stone E, Rock BH, et al. (2003) Obesity in American-Indian children: prevalence, consequences, and prevention. Prevention Medicine 37: S3–12.
- 41. Davis NJ, Shishodia H, Taqui B, Dumfeh C, Wyle-Rosett J (2007) Resident physician attitudes and competence about obesity treatment: Need for improved education. Med Educ Online 13.
- 42. Forman-Hoffman V, Little A, Wahls T (2006) Barriers to obesity management: a pilot study of primary care clinicians. BMC Fam Pract 7: 35.
- 43. Dovidio JF, Kawakami K, Gaertner SL (2002) Implicit and Explicit Prejudice and Interracial Interaction. Journal of Personality and Social Psychology 82: 62–68.