Figures
Abstract
Background
This paper investigates the personal, professional and institutional predictors of health institution personnel's attitudes regarding access to healthcare for refugee claimants in Canada.
Methods
In Montreal, the staff of five hospitals and two primary care centres (n = 1772) completed an online questionnaire documenting demographics, occupation, exposure to refugee claimant patients, and attitudes regarding healthcare access for refugee claimants. We used structural equations modeling to investigate the associations between professional and institutional factors with latent functions of positive and negative attitudes toward refugee's access to healthcare.
Results
Younger participants, social workers, participants from primary care centres, and from 1st migrant generation had the lowest scores of negative attitudes. Respondents who experienced contact with refugees had lower scores of negative attitudes (B = -14% standard deviation [SD]; 95% CI: -24, -4%). However, direct contact with refugees increased scores of negative attitudes in the institution with the most negative attitudes by 36% SD (95% CI: 1, 71%).
Citation: Rousseau C, Oulhote Y, Ruiz-Casares M, Cleveland J, Greenaway C (2017) Encouraging understanding or increasing prejudices: A cross-sectional survey of institutional influence on health personnel attitudes about refugee claimants' access to health care. PLoS ONE 12(2): e0170910. https://doi.org/10.1371/journal.pone.0170910
Editor: Ignacio Correa-Velez, Queensland University of Technology, AUSTRALIA
Received: July 27, 2016; Accepted: January 12, 2017; Published: February 14, 2017
Copyright: © 2017 Rousseau et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The study was supported by a grant from the Canadian Institutes of Health Research, MOP-130451, to CR, CG, MR-C and JC. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Public representations of refugees in North America and Europe have progressively shifted from vulnerable individuals deserving protection to potential criminals and fraudsters seeking to abuse host country resources, in particular the health care system [1]. In parallel, there have been initiatives to welcome refugees such as the recent resettlement of 25,000 Syrian refugees in Canada. While the right to health for all, including vulnerable migrants, has been promoted by the United Nations, [2] governments have increasingly restricted health care coverage for precarious status migrants [3].
As the health impact of these policy changes on refugees is beginning to be documented, [4] it becomes evident that the obstacles to health care access related to these transformations are multilayered and should be analyzed within a systemic framework. Gee & Ford [5] showed how immigration policy influences health disparities both by modulating direct access through the introduction of different levels of coverage and through indirect obstacles stemming from racism manifesting as xenophobia. The racialization of immigration and the intersection of race, ethnicity or religion with socioeconomic and migratory status may constitute an important obstacle to health care access given that all of these factors have been shown to unconsciously bias clinicians, sometimes affecting their practices [6–9].
Research on attitudes of healthcare professionals towards immigrants and refugees is scant. Some studies suggest wide disparities between health professionals who favor a humanitarian or human rights perspective and those who feel they have the duty to protect their country’s scarce resources against what they understand as fraud and abuse [10–12]. Professional and personal background have been shown to be determinants of these attitudes [12,13]. There is however a dearth of studies examining the possible influence of institutional factors on professional attitudes, in spite of the growing evidence that institutional racism plays a role in health inequalities, [14] and that leadership and governance are central elements of a right to health approach [15].
In 2012, a major policy change restricted healthcare coverage for refugee claimants in Canada, introducing different levels of limited coverage [16]. We undertook a study to document its impact on systemic barriers to refugee claimants’ access to healthcare. Although full coverage of refugee healthcare was restored on April 1, 2016, actual access to care may vary depending on the attitudes of healthcare providers and institutions. The main aim of this paper is to answer the following research questions:
- What are the personal, professional and institutional predictors of health institution personnel’s attitudes to access to healthcare for refugee claimants?
- To what extent does direct contact with refugee claimants have a modifying effect on these attitudes?
Methods
Study population
The survey was conducted in Montreal, a large multiethnic city receiving about a quarter of the refugee claimants (aka asylum seekers) arriving in Canada. All administrators, clinicians, and other staff in five hospitals and two primary care centres, were invited to complete an online questionnaire. The five hospitals selected constitute all but one of the major general hospitals of Montreal, plus one (out of two) large pediatric hospital. Several of the hospitals are networks, so the five hospitals actually represent 12 locations and provide services to over 80% of the population of the Island of Montreal. The two primary care centres comprise 5 public primary care clinics out of a total of 29 on the Island of Montreal. They are located in areas with a high proportion of recent immigrants and refugee claimants.
Survey design and administration
Refugee claimants were defined as individuals who apply for refugee status in Canada until either they are accepted as refugees or they are deported following the definitive rejection of their refugee claim. They are legally in Canada and entitled to Interim Federal Health (IFH) Program coverage. Government Assisted and Privately Sponsored Refugees eligible for provincial health insurance upon arrival were not considered in the study.
The survey instrument was designed by a multidisciplinary team specialized in refugee health and policy, translated (from English to French) and pretested. The wording of the items of the KAP survey was based on three main sources: First, a previous survey conducted by the first author on access to health care for pregnant women and children with precarious status in 2010–2011 validated the positive and negative attitude constructs [12]. Second, themes emerging from the open-ended comments in response to the previous survey on healthcare coverage for precarious status women and children were also taken into account [10]. This played a minor role in the formulation of survey items but confirmed the pertinence of the questions and their content validity. Third, analysis of the discourse of the Canadian government justifying the cuts to the IFHP and of the opponents to these cuts also provided qualitative data to validate the items [17]. The wording of the arguments for and against healthcare coverage for refugee claimants reflect the themes and wording adopted by advocates and opponents of cuts to refugee healthcare coverage in the two years immediately preceding the survey (2012–2014). The attitude questions elicit the most common positive and negative representations around these issues in the health sector. The survey contained 18 multiple-choice questions, recording respondents’ (a) demographics, occupation, institution and exposure to refugee claimant clients; (b) attitudes regarding healthcare access for refugee claimants; (c) knowledge about applicable federal and provincial healthcare coverage policies, (d) practices regarding access to services for refugee claimants. Questions about attitudes toward refugee claimants’ access to publicly funded health care were divided into two sections. The first concerned level of agreement on restricting access based on five arguments: cost, increased wait times, bogus refugee claims, taxpayer-only access to free healthcare and refugees take advantage by coming to receive free health care. The second section measured level of agreement with maintaining or expanding refugee claimants’ access to health care based on five arguments: compassion, legality of refugee claimant status, increased cost of delayed health-seeking, refugees as future citizens, and access to healthcare as a fundamental human right. All the answers were recorded on a 4-point Likert scale. Two questions documented respondent direct seeking health care and frequency of contact with culturally diverse population. Full text of survey questions is in supplemental material.
The questionnaire was administered using LimeSurvey, over a period of six weeks in May-June 2014. A link to the survey was posted on the institutions’ intranet and/or emailed to respondents and individual email reminders were sent twice during the survey period.
Montreal hospitals have two internal institutional email lists, one including all physicians practicing at the institution and another including all employees (professional and non-professional), except for kitchen and maintenance staff and personal care attendants.
Participation was informed, voluntary, and anonymous (to preserve anonymity institutions are numbered). The Research Ethics Boards of all participating institutions approved the study. The overall response rate was 6.2% (Hospital 1:3.2%; Hospital 2: 3.3%; Hospital 3: 10.2%; Hospital 4: 15.5%; Hospital 5: 7.0%; Primary care centers: 16.9%.
Statistical analyses
We considered the following predictors in the models as described in Table 1: age, gender, language, institution, generation, previous contact with refugees, and contact with patients from different cultural backgrounds. We selected the covariates retained in the final models a priori using Directed Acyclic Graphs (DAGs) [18] to infer a minimal set of sufficient confounders. Contact with refugees was forced in all the models to isolate the independent effect of the covariates regardless of the contact with refugees. Final models included age, occupation, institution, generation, and contact with refugees.
We used structural equations modeling (SEM) [19] to investigate the association between professional and institutional predictors and attitudes towards access to health care. SEM is a powerful technique that combines a path analysis with a confirmatory factor analysis. It includes a measurement part in which the observed outcomes are linked to a limited number of latent functions, and a structural part describing the relationship between the latent variables and other observed variables [20]. This approach is often used in the case of theoretical constructs (in our case, measuring attitudes), and allows reduction of multiple comparisons testing and a more comprehensive assessment of negative and positive attitudes. We considered responses to individual questions regarding specific attitudes toward access to health care for refugee claimants as indicators of two underlying broader latent functions reflecting positive and negative attitudes (Fig 1). The positive attitudes function was indicated by the reported levels of agreement with maintaining or expanding refugee claimants’ access to publicly funded health care based on five arguments, whereas the negative attitudes function was indicated by reported levels of agreement on restricting refugee claimants’ access based on five arguments. We constructed these latent variables using a confirmatory factor analysis (CFA), allowing good discriminant validity. We also tested a model with a single construct including responses to the 10 questions as direct indicators to a latent function of positive attitudes (reversing the responses for the questions about negative attitudes). However, the overall model with one latent function showed a poor fit to the data and we decided to keep the two construct model. To correct for local dependence when the correlation between the indicators could not be fully explained by the underlying latent variable, we allowed measurement errors of several outcomes indicating the same latent function to correlate. Because the response modalities of the original outcome scores were ordinal (Likert scale), we used a weighted least squares mean- and variance-adjusted estimator, a robust estimator which provides better estimates for modeling categorical or ordinal data compared to the maximum likelihood estimator [21]. We tested goodness of model fit using several indices that are the most insensitive to sample size, model misspecification and parameter estimates [22]: the root mean square error of approximation (RMSEA), the comparative fit index (CFI), and the weighted root mean square residual (WRMR)
Observed variables (measured) are represented by a rectangle, whereas latent (unmeasured) factors are represented by an ellipse. Single headed arrows are used to define a causal path, whereas double-headed arrows indicate covariances and correlations, without a causal link. The latent function of negative attitudes was indicated by reported levels of agreement on restricting access to health care for RC based on the 5 arguments (Argument N1: Cost; Argument N2: increased wait times; Argument N3: bogus refugee claims; Argument N4: taxpayer-only access to free healthcare; Argument N5: refugees take advantage by coming to receive free health care). The latent function of positive attitudes was indicated by reported levels of agreement on maintaining or expanding access to health care for RC based on the 5 arguments (Argument P1: compassion; Argument P2: legality of refugee claimant status; Argument P3: increased cost of delayed health-seeking; Argument P4: refugees as future citizens; Argument P5: access to healthcare as a fundamental human right).
In additional analyses, we explored possible differences in the associations between individual and institutional characteristics and attitudes in regard to contact with refugees. We tested the difference in the associations among the groups with and without previous contact with refugees by comparing the value of d/SEd to the standard normal distribution, where d is the difference between the two estimates, and is the standard error of the difference.[23]
All tests were two-sided, and analyses were conducted using the lavaan [24] package in R.[25]
Results
Descriptive analyses
The survey was completed by 1,772 participants. Table 1 describes the characteristics of the study population. Most participants were women (77%) and worked in hospitals (77%). Fifty two percent reported having previous contact with a refugee claimant, 56% were 3rd generation (i.e. had both parents born in Canada), and 76% had regular contact with populations from different cultural backgrounds. Contact with refugees varied across occupational groups, with 61% of professionals, 36% of managers, 35% of administrative employees, and 33% of others indicating ever having had contact with a refugee claimant seeking healthcare (data not shown).
About 49% of respondents agreed on restricting refugee claimants’ access to health care based on the argument that refugee claimants take advantage of the Canadian health system, while 42%, 32%, and 37% of respondents agreed on restricting refugee claimants’ access to health care based on the arguments about cost, increased wait times and taxpayer-only access, respectively. Finally, only 23% of respondents agreed that access to health care should be restricted on the grounds that many refugee claims are bogus (Table 2).
Regarding positive attitudes, 89%, 87%, and 85% of respondents agreed on maintaining or expanding refugee claimants’ access to health care based on the arguments that healthcare is a human right, refugees may be future citizens, and compassion, respectively, and 71% agreed based on legal status and cost of delayed care (Table 2).
Determinants of positive and negative attitudes
Table 3 describes the factor loadings and estimated correlation of measured variables to each of the constructed latent variables. All model fit indices showed an excellent fit to data (RMSEA = 0.04; CFI = 0.996; WRMR = 0.86). All observed variables for attitudes were adequate indicators of the latent functions with significant standardized correlations ranging between 0.68 and 0.93. The CFA also showed strong negative correlation between latent functions of positive and negative attitudes (r = -0.81).
In multivariable models of negative attitudes (Table 4), social workers had scores of negative attitudes lower by -0.41 standard deviation [SD] (95% CI: -0.65, -0.18) compared to doctors. All other occupational groups had higher levels of negative attitudes compared to doctors with the highest ones being administrative employees (B = 0.65 SD; 95% CI: 0.50, 0.80). Respondents from primary care centres had scores for negative attitudes lower by -0.24 SD (95% CI: -0.40, -0.08) compared to respondents from hospital 1, whereas respondents from Hospital 5 had scores of negative attitudes higher by 0.24 SD (95% CI: 0.07, 0.42). Respondents aged 40–49 and respondents aged 50–59 years had scores of negative attitudes respectively higher by 0.37 SD (95% CI: 0.21, 0.53) and 0.29 SD (95% CI: 0.13, 0.46), compared to the youngest participants. Non-migrant and 2nd generation immigrant respondents had scores of negative attitudes higher by 0.38 SD (95% CI: 0.26, 0.49) and 0.26 SD (95% CI: 0.12, 0.39) respectively compared to 1st generation migrant respondents. Finally, respondents with previous contact with refugees had scores lower by -0.14 SD (95% CI: -0.24, -0.04) compared to respondents with no previous contact with refugee claimants. Results regarding the latent variable of positive attitudes exhibited the opposite pattern (Table 5).
In further analyses exploring the modification effect by contact with refugee claimants, we observed significant effect modification by contact with refugees (p<0.05) in the associations between institution and generation, and negative attitudes regarding refugee claimants’ access to care (Fig 2). Regarding institutions, there were no apparent differences in negative attitudes between respondents with and without previous contact with refugee claimants in hospitals 2, 3, and 4. Most importantly, Hospital 5 and primary care centres exhibited opposite patterns, with contact with refugees significantly increasing negative attitudes in Hospital 5 (d = 0.36; SEd = 0.18), while decreasing negative attitudes in primary care centres (d = -0.15; SEd = 0.17), but not significantly. Likewise, previous contact with refugee claimants attenuated negative attitudes in respondents from the 3rd generation (d = -0.25; SEd = 0.12). Previous contact with refugee claimants attenuated negative attitudes in most occupational groups except nurses, though not significantly (Fig 2).
We observed similar patterns for positive attitudes, with previous contact with refugee claimants increasing positive attitudes among administrative employees (d = 0.31; SEd = 0.17) and social workers. Likewise, contact with refugee claimants lowered positive attitudes in respondents from Hospital 5 (d = -0.40; SEd = 0.20).
Discussion
The main findings from this investigation are that in the Montreal health sector, personal, professional and institutional factors influence positive and negative attitudes of healthcare professionals toward refugee claimants’ entitlement to healthcare. In terms of individual characteristics, age and migration history have a significant influence. Younger and older healthcare personnel appear to be more sensitive to the refugee predicament. In institutions where overall attitudes were either particularly negative or positive, direct contact with refugee claimants amplified the dominant institutional tendency. The modification effect size was larger than the effect size of contact with refugee claimants itself. In Hospital 5, the institution where negative attitudes were most prevalent, contact was significantly associated with more negative attitudes than the absence of contact. Conversely, in primary care centres, where more positive attitudes towards healthcare access for refugee claimants predominated, respondents reporting previous contact with refugee claimants had more positive attitudes than those who did not, although not significantly. Contact did not modify attitudes in institutions where attitudes were less polarized.
Our findings converge with previous studies on the topic. The fact that first and second generation immigrants have more positive attitudes toward refugee claimants’ access to health care is consistent with the results of a similar survey about undocumented patients in Montreal. This may possibly be related to less prejudice toward refugees and more identification with migrants’ experience [26].
As in this previous study, profession was also associated with attitudes and had the strongest observed effect sizes, with social workers having the most positive attitudes and administrative personnel among the most negative (Tables 4 and 5). This could be, in part, associated with the level of contact and engagement with refugee claimants. In particular, contact with refugees was associated with a decrease in negative attitudes among most of the occupational groups, especially social workers and administrative employees, although the effect modification did not reach the level of significance.
Social cognition literature emphasizes that individual attitudes are influenced by the implicit and explicit prejudices and stereotypes that prevail in the person’s social environment, including the workplace, [27,28], as well as by institutional policies [29]. The presence of outgroup members (here, refugee claimants) is often initially experienced as threatening and may lead to increased hostility, but positive interpersonal contacts between ingroup and outgroup members have been consistently found to help in overcoming prejudice and promoting friendly relations [30]. Negatively valenced contacts, however, may increase prejudice [31]. Our findings are overall in line with this trend.
The differences among institutions, and in particular the fact that primary care centre personnel showed more positive attitudes than hospital personnel, even after adjustment for contact with refugees, is consistent with findings of a study on undocumented patients [12]. Our qualitative data and our knowledge of the different institutions can shed some light on the contact-institution relationship. All participating institutions service the highly multiethnic population of the Island of Montreal. However, they do not share the same historical relations with migrant and refugee communities. The participating primary care centres have traditionally welcomed vulnerable newly arrived families who settle first in the low-cost housing neighborhoods they service. They often, in different ways, have advocated institutionally for this population. Among the hospitals, some are situated in the central part of Montreal, while notably Hospital 5, are in neighborhoods that were not traditionally migrant neighborhoods, and for which this may be a relatively new reality. Further research is needed to document to what extent a tradition of care and advocacy for refugee patients and/or the actual leadership of an institution are associated with staff attitudes toward entitlement to health care for these groups.
A recent study found that individual attitudes toward outgroup members are more positive when living in social contexts in which people have, on average, more cordial intergroup contact, with group contact having an even larger impact on reduction of prejudice than individual contact [32]. This may be due to more tolerant attitudes being perceived as normative. Our results converge with these observations suggesting that the predominant values and stereotypes in an institution may frame individuals’ experience of the encounter with refugee claimants and that, in a context of overall negative representations; contact may further confirm preexisting prejudices.
These results have implications for institutional and health systems decision makers. By highlighting the importance of institutional variables as determinants of attitudes, they lend support to the hypothesis of institutional leadership and orientation as an obstacle or a facilitator to health care access for refugee claimants. They indicate that to address the institutional stance toward vulnerable or excluded populations and raise awareness around the potential bias of majority in decision-making, [33] the active support of the highest levels of the institution may be needed [29]. Dealing with vulnerable immigrant exclusion from healthcare requires a systemic conceptualization of the issue to address the upsurge in negative representations of refugees [5,34].
Some limitations should be noted. Variation in the means used for recruitment in different institutions (i.e., staff and physicians’ email lists, intranet) may explain variance in response rates by institution and professional groups. Response rates were generally low and may have been influenced by strength of opinions on the issue under study, thus limiting the generalizability of results. The measure of prior contact is limited as it does not evaluate frequency or valence [35]. We have no information as to whether respondents considered their contact with either refugee claimants or with ‘culturally diverse populations’ as negative or positive. The literature has increasingly shown that attitudes are predicted not only by the amount of previous intergroup contact, but also by its valence [31,32,35–37]. As we do not have data on valence of contact, this greatly limits our ability to interpret the role of contact.
Conclusions
This study provides evidence that beyond health professional and administrative staff’s personal and professional positions, institutions may have a significant role as facilitators or obstacles to vulnerable migrants’ access to health care. While more research is warranted to understand the processes associated with this institutional influence, this indicates that institution leadership should be a focus of action to promote more equity in health care access and that training and rights education need to raise awareness about personal and institutional biases [38,39].
Supporting information
S1 Table. Survey responses.
The file contains the anonymized survey results (full data set).
https://doi.org/10.1371/journal.pone.0170910.s001
(XLS)
Author Contributions
- Conceptualization: CR MR-C JC.
- Formal analysis: CR MR-C JC.
- Methodology: CR MR-C JC.
- Project administration: JC.
- Supervision: CR.
- Writing – original draft: CR YO MR-C JC.
- Writing – review & editing: CR YO JC MR-C CG.
References
- 1. Kronick R, Rousseau C (2015) Rights, compassion and invisible children: A critical discourse analysis of the parliamentary debates on the mandatory detention of migrant children in Canada. Journal of Refugee Studies: First published online: June 18, 2015.
- 2. Lancet T (2007) Vulnerable migrants have a right to health. The Lancet 370: 2.
- 3. Cole P (2009) Migration and the human right to health. Cambridge Quarterly of Healthcare Ethics 18: 70–77. pmid:19091148
- 4. Steele LS, Lemieux-Charles L, Clark JP, Glazier RH (2002) The impact of policy changes on the health of recent immigrants and refugees in the inner city: A qualitative study of service providers' perspectives. Canadian Journal of Public Health/Revue Canadienne de Sante'e Publique: 118–122.
- 5. Gee GC, Ford CL (2011) Structural racism and health inequities. Du Bois review: social science research on race 8: 115–132. pmid:25632292
- 6. Haider AH, Sexton J, Sriram N, Cooper LA, Efron DT, Swoboda S, et al. (2011) Association of unconscious race and social class bias with vignette-based clinical assessments by medical students. JAMA 306: 942–951. pmid:21900134
- 7. Stepanikova I, Cook KS (2008) Effects of poverty and lack of insurance on perceptions of racial and ethnic bias in health care. Health services research 43: 915–930. pmid:18546546
- 8. Shavers VL, Fagan P, Jones D, Klein WM, Boyington J, Moten C, et al. (2012) The state of research on racial/ethnic discrimination in the receipt of health care. American Journal of Public Health 102: 953–966. pmid:22494002
- 9. Van Ryn M, Burke J (2000) The effect of patient race and socio-economic status on physicians' perceptions of patients. Social science & medicine 50: 813–828.
- 10. Vanthuyne K, Meloni F, Ruiz-Casares M, Rousseau C, Ricard-Guay A (2013) Health workers perceptions of access to care for children and pregnant women with precarious immigration status: Health as a right or privilege? Social science & medicine 93: 78–85 http://dx.doi.org/10.1016/j.socscimed.2013.1006.1008.
- 11. Willen SS (2011) Do “Illegal” Immigrants have a right to health? Engaging ethical theory as social practice at a Tel Aviv Open Clinic. Medical anthropology quarterly 25: 303–330. pmid:22007560
- 12. Ruiz-Casares M, Rousseau C, Laurin-Lamothe A, Rummens AJ, Zelcowitz P, Crépeau F, et al. (2013) Access to health care for undocumented migrant children and pregnant women: The paradox between values and attitudes of health care professsionals. Maternal and Child Health Journal http://www.springerlink.com/openurl.asp?genre=article&id=doi:10.1007/s10995-012-0973-3
- 13. Michaelsen JJ, Krasnik A, Nielsen AS, Norredam M, Torres AM (2004) Health professionals' knowledge, attitudes, and experiences in relation to immigrant patients: a questionnaire study at a Danish hospital. Scandinavian journal of public health 32: 287–295. pmid:15370769
- 14. Brach C, Lewit EM, VanLandeghem K, Bronstein J, Dick AW, Kimminau KS, et al. (2003) Who’s enrolled in the state children’s health insurance program (SCHIP)? An overview of findings from the child health insurance research initiative (CHIRI). Pediatrics 112: e499–e507. pmid:14654672
- 15. Hunt P, Backman G (2008) Health systems and the right to the highest attainable standard of health. Health and Human Rights: 81–92. pmid:20845831
- 16. Arya N, McMurray J, Rashid M (2012) Enter at your own risk: government changes to comprehensive care for newly arrived Canadian refugees CMAJ 184: 1875–1875. pmid:22927516
- 17. Beatson J (2016) The stories we tell about refugee claimants: Contested frames of the health-care access question in Canada. Refugee 32: refuge.journals.yorku.ca/index.php/refuge/article/view/40370/36427.
- 18. Greenland S, Pearl J, Robins J (1999) Causal Diagrams for Epidemiologic Research. Epidemiology 10: 37–48. pmid:9888278
- 19.
Bollen KA (1989) Structural Equations with Latent Variables: John Wiley & Sons, Inc. 528 p.
- 20.
Kline RB (2015) Principles and practice of structural equation modeling: Guilford publications.
- 21. Rhemtulla M, Brosseau-Liard PE, Savalei V (2012) When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychol Methods 17: 354–373. pmid:22799625
- 22.
Kline RB (2005) Principles and practice of structural equation modeling (2nd ed.). New York, NY, US: Guilford Press. xviii, 366 p.
- 23. Altman DG, Bland JM (2003) Interaction revisited: the difference between two estimates. BMJ: British Medical Journal 326: 219–219. pmid:12543843
- 24. R Y. (2012) lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software 48: 37.
- 25.
R Development Core Team (2012) R: A language and environment for statistical computing. In: R Foundation for Statistical Computing, editor. Vienna, Austria.
- 26.
Fernando S, Keating F (2008) Mental health in a multi-ethnic society: A multidisciplinary handbook (2nd ed.). London, England: Routledge.
- 27. Sinclair S, Kenrick AC, Jacoby-Senghor DS (2014) Whites’ Interpersonal Interactions Shape, and Are Shaped by, Implicit Prejudice. Policy Insights from the Behavioral and Brain Sciences 1: 81–87.
- 28. Glaser J, Spencer K, Charbonneau A (2014) Racial Bias and Public Policy. Policy Insights from the Behavioral and Brain Sciences 1: 88–94.
- 29. Plaut VC (2014) Diversity science and institutional design. Policy Insights from the Behavioral and Brain Sciences 1: 72–80.
- 30. Pettigrew TF, Tropp LR, Wagner U, Christ O (2011) Recent advances in intergroup contact theory. International Journal of Intercultural Relations 35: 271–280.
- 31. Barlow FK, Paolini S, Pedersen A, Hornsey MJ, Radke HR, Harwood J, et al. (2012) The contact caveat negative contact predicts increased prejudice more than positive contact predicts reduced prejudice. Personality and Social Psychology Bulletin 38: 1629–1643. pmid:22941796
- 32. Christ O, Schmid K, Lolliot S, Swart H, Stolle D, Tausch N, et al. (2014) Contextual effect of positive intergroup contact on outgroup prejudice. Proceedings of the National Academy of Sciences 111: 3996–4000.
- 33. Came H (2014) Sites of institutional racism in public health policy making in New Zealand. Social science & medicine 106: 214–220.
- 34. Feagin J, Bennefield Z (2014) Systemic racism and US health care. Social science & medicine 103: 7–14.
- 35. Christ O, Hewstone M, Tausch N, Wagner U, Voci A, Hughes J, et al. (2010) Direct contact as a moderator of extended contact effects: Cross-sectional and longitudinal impact on outgroup attitudes, behavioral intentions, and attitude certainty. Personality and Social Psychology Bulletin 36: 1662–1674. pmid:20966179
- 36. Graf S, Paolini S, Rubin M (2014) Negative intergroup contact is more influential, but positive intergroup contact is more common: Assessing contact prominence and contact prevalence in five Central European countries. European Journal of Social Psychology 44: 536–547.
- 37. Paolini S, Harwood J, Rubin M, Husnu S, Joyce N, Hewstone M (2014) Positive and extensive intergroup contact in the past buffers against the disproportionate impact of negative contact in the present. European Journal of Social Psychology 44: 548–562.
- 38. Teal CR, Shada RE, Gill AC, Thompson BM, Frugé E, Villarreal GB, et al. (2010) When best intentions aren’t enough: helping medical students develop strategies for managing bias about patients. Journal of general internal medicine 25: 115–118.
- 39. Burgess DJ, Warren J, Phelan S, Dovidio J, Van Ryn M (2010) Stereotype threat and health disparities: what medical educators and future physicians need to know. Journal of general internal medicine 25: 169–177.