http://orcid.org/0000-0003-0732-887X
Figures
Abstract
Although racism has been posited as driver of racial/ethnic inequities in healthcare, the relationship between racism and health service use and experience has yet to be systematically reviewed or meta-analysed. This paper presents a systematic review and meta-analysis of quantitative empirical studies that report associations between self-reported racism and various measures of healthcare service utilisation. Data were reviewed and extracted from 83 papers reporting 70 studies. Studies included 250,850 participants and were conducted predominately in the U.S. The meta-analysis included 59 papers reporting 52 studies, which were analysed using random effects models and mean weighted effect sizes. Racism was associated with more negative patient experiences of health services (HSU-E) (OR = 0.351 (95% CI [0.236,0.521], k = 19), including lower levels of healthcare-related trust, satisfaction, and communication. Racism was not associated with health service use (HSU-U) as an outcome group, and was not associated with most individual HSU-U outcomes, including having had examinations, health service visits and admissions to health professionals and services. Racism was associated with health service use outcomes such as delaying/not getting healthcare, and lack of adherence to treatment uptake, although these effects may be influenced by a small sample of studies, and publication bias, respectively. Limitations to the literature reviewed in terms of study designs, sampling methods and measurements are discussed along with suggested future directions in the field.
Citation: Ben J, Cormack D, Harris R, Paradies Y (2017) Racism and health service utilisation: A systematic review and meta-analysis. PLoS ONE 12(12): e0189900. https://doi.org/10.1371/journal.pone.0189900
Editor: Hajo Zeeb, Leibniz Institute for Prvention Research and Epidemiology BIPS, GERMANY
Received: August 10, 2017; Accepted: December 4, 2017; Published: December 18, 2017
Copyright: © 2017 Ben et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: YP is supported by ARC grant FT130101148. Initial work by RH and DC on the systematic review was supported by a New Zealand Ministry of Health-funded fellowship. Contributions by DC and RH to the current systematic review and meta-analysis was supported (in part) by a contract from Health Research Council of New Zealand (HRC 14/262). The funders did not play a role in the research. The work is the authors' own.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Differential and inequitable patterns of healthcare access, utilisation and quality by race/ethnicity are evident in many countries and for a range of healthcare indicators [1–6]. Racial/ethnic inequities in patient experience, including levels of satisfaction and trust, have also been demonstrated [7–10]. While racism has been posited as driver of racial/ethnic inequities in healthcare [5], the existing studies focused on how racial discrimination affects use and experience of health services have yet to be systematically reviewed or meta-analysed [11, 12].
Racism is a complex social system underpinned by unequal power relations and beliefs about ‘race’ and related systems of categorisation, expressed through attitudes, prejudice, and discrimination as well as racialised practices and structures [13]. Research on the health impacts of racism and its role in (re)producing racial/ethnic inequities in health through entrenched systems of privilege and oppression has increased substantially in recent years. The negative impacts of racism on physical and mental health and on exposure to health-damaging factors is well-documented, with the bulk of this research focused on measures of self-reported personal experiences of racism [14, 15].
Although less interrogated, racism may also impact the quality of healthcare, how individuals access and use health services, and experiences and perceptions of healthcare, with flow-on effects for health and racial/ethnic inequities [16]. Racial discrimination experienced within the healthcare setting, or in society more generally, may influence how people perceive the healthcare system, how they engage with health services and providers, and the patterns and quality of their healthcare access [16, 17]. Experiences of racism have the potential to impact on patient satisfaction, levels of trust, and perceived quality of healthcare interactions, and to influence whether individuals follow provider recommendations as well as impacting on their future patterns of health service use [17–19]. Reported racism may be directly linked to healthcare-related outcomes in that it may capture discriminatory treatment experienced by individuals in their interactions with healthcare providers [12]. This may operate without physicians’ awareness as is demonstrated by increasing evidence that physician racial/ethnic bias can affect the quality of communication with patients and patient management decisions [20, 21]. Stereotype threat among patients, influenced by past experiences of racism, may influence patients’ behaviour in subtle ways and can also increase physicians’ racial/ethnic bias through the reinforcement of racial/ethnic stereotypes [16]. After experiencing racism in healthcare or other social settings, individuals may seek less contact with the healthcare system. More indirectly, experiences of racism may limit the time and energy required to access health care [22]. Conversely, racism may be indirectly associated with an increased need for healthcare, due to its negative impacts on physical and mental health [23].
Drawing on approaches used in recent reviews of self-reported racism and health [14, 24], this paper describes a systematic review and meta-analysis of quantitative empirical literature that reports associations between self-reported racism and healthcare-related measures. Although publication of primary studies in this area has seen considerable growth in recent years, this empirical evidence base has yet to be synthesised via a systematic review and meta-analysis. Consequently, the overall magnitude and direction of the relationship between racism and healthcare service utilisation (HSU) outcomes are not yet known. This paper aims to address these gaps and provide a comprehensive, up-to-date overview of this burgeoning field.
Methods
Search strategy
The literature search for this review focused on papers reporting direct associations between racism and HSU outcomes. Two separate searches were conducted in English, and papers in languages other than English were excluded. The first, principal search, covered four databases, namely CINAHL, MEDLINE, PsychINFO, and PubMed. The search originally ran until September 2011, and was extended until the end of October 2015 (earliest date limit was not specified). A second, supplementary, search entailed re-screening search results from a recent systematic review and meta-analysis conducted by two of the authors [14] on racism and health (which included HSU outcomes as search terms). The supplementary search covered the databases Academic Search Premier, CINAHL, ERIC, MEDLINE, ProQuest (for dissertations/theses), PsychINFO, Sociological Abstracts, Social Work Abstracts and Web of Science. It originally ran until October 2013 and was extended until October 2015 (earliest date limit was not specified). The supplementary search aimed to broaden the principal search, through covering additional databases and by including additional search terms. For a list of search terms used in each search, see S1 Appendix. The searches overlapped to a certain extent. The results of the principal search were screened first. Duplicates that were found also by the supplementary search were removed, and the supplementary search was used to identify additional papers that were not previously located. Each search was also supplemented by searching bibliographies of included empirical papers and review articles. Although the searches originally included both published and unpublished materials, only published papers were included in the current review. Theses, dissertations, and conference papers and presentations were excluded during screening.
Inclusion criteria
To be included in the review, papers had to report empirical research and contain quantitative data on the association between racism and HSU outcomes.
Exposure.
This review uses reported racism as an exposure. Exposure measures included in this review are racism, discrimination, prejudice, stereotypes, maltreatment, aggression and related terms, where possible reasons for these include race, skin colour, ethnicity, religion, and language. This review includes two types of racism: 1) self-reported racism, experienced directly in interpersonal contact; and 2) self reported racism experienced indirectly, when it is directed towards a group which the person is a member of, for example based on skin colour, race or ethnicity. Other types of exposure to reported racism (e.g., vicarious experiences of witnessing racism, proxy reports, internalized racism) were originally included, but all studies reporting them were excluded on other grounds.
General measures of discrimination, where the specific effect of racism on HSU outcomes cannot be isolated, were excluded, unless the measure was modified to explicitly specify race, ethnicity, skin colour, etc. as the reason/s for discrimination. When the majority of items within an exposure measure assessed racism while all remaining items assessed discrimination broadly defined (without specifying the reason for discrimination), the measure was included. Measures of exposure to discrimination due to other reasons, such as gender, sexuality, socioeconomic status and so on, were excluded. Exposure measures that combine racism with responses to racism or with possible health outcomes were excluded to allow for assessment of the association between exposure and outcome measures as two separate constructs, and to avoid possible conflation of racism with potentially related outcomes. We therefore excluded exposures to race-related stress, discrimination-distress, and other exposures combining racism with responses to racism (e.g., how much respondents are bothered by racism) or relating racism to health within the same instrument. Finally, because this study focuses on observational studies of racism as reported by research participants, we excluded measures of racism that were ecological (e.g., racial segregation), experimental (e.g., videos, vignettes, tasks) as well as other exposures where racism was assessed by the researcher.
Outcomes.
This review includes two types of HSU outcomes: outcomes relating to patients’ use of healthcare (including access), and outcomes relating to patients’ experiences. This distinguishes between measures of contact or engagement with healthcare (e.g. access, uptake) and patient perceptions of their healthcare experience, which captures aspects of quality of care. Patients’ experiences relating to HSU (HSU-E) include the following outcomes (in brackets the abbreviations of outcome names as used throughout this review): 1) communication and relationships with health service professionals (COM); 2) satisfaction with health services and perceived quality of care (SAT); 3) trust in healthcare systems and professionals (TRUST); and 4) a mix of different HSU-E outcomes (HSU-EMIX).
Outcomes relating to Health Service Use (HSU-U) include the following: 5) having had examinations, tests, screening and/or checks (EXAM); 6) having followed prescriptions, recommended treatments and behaviours and having taken medications and vaccinations (UPTAKE); 7) visits to health professionals (VP); 8) visits and admissions to hospitals and emergency departments (VH); 9) delaying/not getting healthcare (self-assessed) (DELAY); 10) having insurance and/or healthcare (INS); and 11) a mix of different HSU-U outcomes (HSU-UMIX).
Several HSU-related outcomes were excluded because they were reported by very few papers and/or were conceptually different from the outcome groups listed above. Examples of outcomes that were excluded for being too rarely reported include: length of patient-provider relationship, provider warmth/respect, whether care was cost-prohibitive, and attitudes and intentions to use health services. Examples of outcomes that were excluded for conceptual reasons include: source of healthcare (e.g., source type, usual source, use of informal services), knowledge, information, and type and quality of information about health services.
In several cases, papers included relevant exposure and outcome measures, yet they were excluded because they did not examine or did not report an association between them. Associations were also excluded when racism was treated as an outcome in multivariate analyses (rather than as an exposure).
Screening
Online search results were imported into Endnote X7 [25], and duplicates were deleted. The online search yielded 3,666 search results, while supplementary searches of the wider literature on racism and health initially yielded over 28,000 search results.
First, one reviewer screened the titles and abstracts of all papers to assess their eligibility for inclusion, i.e. whether titles and abstracts indicated papers may report empirical research and contain quantitative data on the association between racism and one or more HSU outcomes. In addition, a sample of titles and abstracts were double screened. Disagreements between the reviewers were resolved by consensus. At the end of screening titles and abstracts, 319 references were retained: 127 were found through the principal search, and 192 were found through the supplementary search.
The full-text of each reference was then reviewed for its inclusion eligibility by two independent reviewers. Disagreements were resolved by consensus between the reviewers. The main reasons for exclusion were papers reporting irrelevant outcomes and/or irrelevant exposures. At the end of screening full-texts, 57 papers were retained in the principal search, and an additional 26 papers were retained in the supplementary search. The final sample size of papers included in this review consists of 83 papers [18, 19, 23, 26–105]. Fig 1 summarises the numbers of papers at each stage of screening.
Data extraction and coding
Data from each paper were extracted and reviewed by two reviewers. One reviewer (DC, JB or MVT) extracted data into a Microsoft Excel spreadsheet and another reviewer (RH or YP) reviewed the data that were extracted. Five types of data were extracted from each paper, namely at the level of the study, participants, exposure measures, outcome measures, and effect size data. Disagreements were discussed and resolved by consensus between the reviewers. Data coding was undertaken by one reviewer, and coding decisions were made in discussion with a second reviewer.
This review includes papers that contain unadjusted bivariate associations between racism and HSU as well as associations between racism and HSU that adjust for different covariates. While the meta-analysis focuses exclusively on unadjusted associations between racism and HSU (see details below), the review also includes papers that only report associations that adjust for covariates. These papers are included in the descriptive analysis, and some of them are also included in the vote-counting analysis of associations that adjust for age, gender and race.
Data integration and analysis
Odds ratios (ORs) and 95% Confidence Intervals (CIs) were the most commonly used metrics for measuring associations between racism and HSU in the papers reviewed, and are employed as the measures of effect size in the meta-analysis aspect of this study. Other metrics were converted to ORs and 95% CIs where possible. One reviewer examined whether papers reported appropriate and sufficient data to be included in the meta-analysis, and decisions regarding exclusion were discussed with a second reviewer.
The following data formats were converted to ORs using Comprehensive Meta Analysis (CMA) Version 2.2 [106]: 1) correlation coefficient and sample size; 2) cross-tabulation (2x2) of events and non-events (racism/no racism x poor/good health); 3) means, standard deviations and sample sizes for two groups (racism and no racism); 4) means and samples sizes for two groups (racism and no racism), and an independent group p-value; and 5) p -value and sample size for correlation coefficient. In some papers, a p-level was reported rather than the exact p-value. Where the association was significant and only the p-level was reported, the p-value was conservatively recorded just below the p-level used in the study (e.g., a significant p-value at <0.0001 was recorded as p = 0.00009999). Where the p-value was not significant and its exact value not reported, the association was conservatively recorded as zero (see [107] for a similar approach). Altogether, such conservative approximations of p-values and effect sizes were used to retain 34 associations, accounting for 17.8% of the 191 associations used in the meta-analysis.
Several papers did not report appropriate and/or sufficient data to be converted into ORs and 95% CIs, and were included in this review, but excluded from the meta-analysis. Adjusted analyses of racism and HSU outcomes, which commonly contain different sets of covariates, were excluded from the meta-analysis as well since combining adjusted data with unadjusted data in meta-analysis limits transformations between different effect sizes and poses difficulties in interpreting the effects of covariates ([24] pg 534, [108]).
Effect size data were coded using CMA. In the analysis, an OR lower than 1 indicates that an increase in racism is associated with decreased HSU, i.e. an inverse association between racism and HSU. Where a paper coded ORs and CIs in the opposite way, i.e., where an OR lower than 1 indicates that an increase in racism is associated with increased HSU, ORs and 95% CIs were reverse-coded using 1/OR.
Using CMA, weighted effect sizes were calculated to account for variation in sample sizes, thus giving more weight to effect sizes from larger samples. When a study comprised multiple associations between racism and HSU for the same participant group/s, to ensure associations were independent, averaging was used across these associations. All relevant associations were extracted and a shifting unit of analysis approach (e.g., [109]) was employed to conduct analyses both at the level of individual outcomes (e.g., for the outcome ‘visits to health professionals’ (VP) only), and at the level of broader outcome groups (e.g., for the outcome group HSU-U, consisting of the outcome VP among other outcomes), in which case we averaged associations for different outcomes relating to health service use, including outcomes such as visits to health professionals and visits and admissions to hospitals and emergency departments.
The review included 5 studies that were each reported in two papers or more. These studies were reported in 15 papers altogether (k indicating the number of papers reporting each study): Behavioral Risk Factor Surveillance System (BRFSS) (k = 6), California Health Interview Survey (CHIS) (k = 3), Latin American Cancer Research Coalition (LACRC) (k = 2), National Latino and Asian American Study (NLAAS) (k = 2), Sinai Improving Community Health Survey (k = 2). In addition, we examined associations from papers by the same first author/s where the names of studies or data sources were not mentioned but where the methodology and sample characteristics were identical or nearly identical, suggesting the same data may have been used in multiple papers. Three such potential data sources, each reported in two papers, were identified in discussion between two reviewers. Associations from the same study that were reported in multiple papers were averaged using CMA. The 83 papers included in this review report data from 70 studies, while the meta-analysis consists of 59 papers that report data from 52 studies.
Similar to previous meta-analyses on racism/discrimination and health [14, 24], a random effects model was used for aggregating effect sizes in all analyses. Previous studies on racism and health have viewed this model as more appropriate than a fixed effects model because of the various differences across studies, including methods, instrumentation and sample characteristics (e.g., [24]), and given that the aim of this study is to generalise findings to the population of studies on racism and HSU outcomes (see also [110, 111]). Mixed effect models were used in moderation analyses, as a more conservative approach that enables testing of differences between different moderator levels (e.g., [111]).
Moderation analyses.
The direction and strength of the relationship between a predictor variable and an outcome variable may be influenced by variables known as moderators [112]. Existing health or medical conditions and the setting where racism was experienced (healthcare focused/not healthcare focused) were used as moderators.
Co-morbidities (i.e. health/medical conditions) are drivers of both the need for services from the healthcare system and, due to increased contact with service providers, possible exposure to racism in healthcare settings. Additionally, health/medical conditions could be one of the pathways by which experience of racism is associated with healthcare outcomes, i.e. racism may affect health, which may affect HSU. Such potentially complex interactions may result in a different relationship between racism and HSU at various levels of co-morbidity. In terms of racism setting, there is initial evidence that racism experienced in healthcare vs. other settings may differ in their strength of association [57, 58, 113].
Moderation analyses were run per outcome group, where at least two levels of the moderator each included 5 or more studies (for a similar approach see [14]). Study was the unit of analysis in all moderation analyses.
Vote-counting analysis.
To supplement our meta-analysis of unadjusted associations between racism and HSU outcomes, the findings of studies adjusting for age, gender, and race were summarised using vote-counting methods. These variables were selected as those which were most commonly reported across studies of racism and HSU. Vote-counting included analyses that adjust for age among participants over 18 years, for gender, and for at least two racial groups (African American and White American). In most cases, studies also adjusted for additional covariates. Altogether, there were 9 papers (reporting data from 7 studies) with empirical data on the association between racism and HSU outcomes that adjust for these covariates.
Publication bias assessment.
We used three methods to assess publication bias: 1) Funnel plots were produced, and their symmetry was examined to visually assess evidence of bias; 2) Egger’s weighted regression method [114] was employed, and the regression intercept’s significance was examined for statistical evidence of bias; 3) A failsafe N was calculated to assess whether the effect may be a result of publication bias due to the “file-drawer problem” where significant results may be more likely to get published than non-significant results that remain in the researcher’s ‘file drawer’. Failsafe N estimates the number of additional, unlocated studies with an average effect size of zero that would be required to change a significant result to a non-significant one [115]. We used Rosenthal’s criterion that the failsafe N value should be at least 5k + 10 the number of studies included in the meta-analysis [116]. The trim-and-fill method [117, 118] was used to adjust for missing (un-reported) studies, to estimate what the effect size would be in the absence of bias. All publication bias tests, as well as trim-and-fill point estimates, were calculated using CMA.
Results
Descriptive analysis
The results of the descriptive analysis are presented in Table 1. This analysis reports on data per paper rather than per study or data source, which is in line with previous reviews and meta-analyses. Since multiple papers reporting the same study often examine different subsets of the data, reporting descriptive data at the level of the study/data source was not feasible. This approach potentially double counts participants from 8 studies, each reported in multiple papers (altogether 21 papers), which we recognize as a potentially minor bias.
All papers were academic journal articles except one report. Papers were published between 1997 and 2015, with numbers showing a considerable increase over time; from just 2 (2.4%) papers published until 2000 and another 10 (12.0%) published between 2001 and 2005, to 30 (36.1%) published between 2006 and 2010, and 41 (49.4%) published between 2011 and 2015. The majority (95.2%) reported on research conducted in the U.S, while research from 4 (4.8%) other countries (Australia, The Netherlands, New Zealand and Sweden) was reported in one paper each. Most papers (96.4%) reported cross-sectional data, with the rest reporting longitudinal data. The sampling procedures used in most papers were non-representative (51.8%), and most of the remaining papers (47.0%) used representative sampling procedures. Most papers (57.8%) reported recruitment from settings not related to healthcare, with a minority (38.6%) reporting recruitment from healthcare settings (e.g., hospitals, clinics). Another 3 papers (3.6%) reported recruitment from both types of settings.
The total sample size of participants included in this review is 250,850 (range: 57–46,956). This number relates to participants included in analyses of racism and HSU from 70 studies. It was calculated after resolving potential duplication in multiple papers reporting the same study or data source. Where a study was reported in multiple papers only the largest N from these papers was used. Papers tended to report relatively large sample sizes: 42.2% reported sample sizes larger than 1,000 participants. Another 19.3% reported sample sizes ranging from 301 to 1,000 participants, while the remaining papers (38.5%) reported sample sizes of up to 300 participants.
Most papers (69.9%) did not focus on participants with any specific health or medical conditions, while 12.0% reported data from diabetes patients, 7.2% from HIV patients, and 2.4% each from patients with hypertension, heart conditions and osteoarthritis. Most papers included both men and women (73.5%), and most focused on adults only (85.5%). Over three quarters of papers (77.1%) included some or only African/Black American participants. Other commonly studied racial/ethnic groups included White/European Americans (48.2%), Hispanic/Latino/a Americans (41.0%), and Asian Americans (21.7%). Indigenous people (American and non-American) were included in 10.8% of papers.
The most commonly reported exposure instruments were the Everyday Discrimination Scale (EDS) (reported in 15.7% of papers), Experiences of Discrimination (EOD) (14.5%), Racism in Health Care Index (8.4%), and Discrimination in Medical Settings (DMS) (6.0%). Exposure measures using single item/s were reported in 39.8% of papers, and another 39.8% of papers reported exposure measures with 2–8 items. Exposures comprising 9 or more items were reported in 22.9% of papers. Most papers (83.1%) used measures of direct exposure to racism, and 16.9% of papers used measures of indirect, group exposure. Most papers used instruments that did not specify the exposure timeframe (55.4%), while 32.5% of papers used instruments that measured lifetime exposure to racism, and 20.5% of papers used instruments that used an exposure timeframe of 12-months. Exposures were interviewer-administered in 71.1% of papers, and self-administered by participants in 22.9% of papers. Most papers (59.0%) included exposure measures that focused on exposure to racism in healthcare settings (i.e., at least half their items were about healthcare), and 48.2% included exposure measures not focused on racism in healthcare settings. Due to several papers reporting multiple participant racial/ethnic groups, and different types of exposure and outcome measures, percentages of papers may not add to 100%.
Among HSU-E outcomes, satisfaction with health services and perceived quality of care (SAT) was reported in 18.1% of papers, followed by trust in healthcare system and professionals (TRUST; 14.5%), and communication and relationships with health service professionals (COM; 12.0%). Among HSU-U outcomes, the most frequently reported outcome was having had examinations, tests, screening and/or checks (EXAM), reported in 33.7% of papers. This was followed by having followed prescriptions, recommended treatments and behaviours, and having taken medications and vaccinations (UPTAKE; 21.7%), visits to health professionals (VP; 20.5%), having insurance and/or healthcare (INS; 12.0%), delaying/not getting healthcare (DELAY; 9.6%), and visits and admissions to hospitals and emergency departments (VH; 7.2%).
Meta-analysis
The meta-analysis includes 59 papers that report data from 52 studies. It comprises 191 unadjusted associations between racism and HSU outcomes. Overall, the meta-analysis aspect of this study uses data from 167,063 participants.
Mean weighted effect sizes for the associations between racism and HSU outcomes are presented in Table 2. Forest plots are presented for the main outcome groups, HSU-E and HSU-U (see Figs 2 and 3). For all HSU-E outcomes, mean weighted effect sizes were significant and in the expected direction, indicating a negative association between racism and HSU-E outcomes. For the combined outcome group HSU-E the mean weighted effect size was OR = 0.351 (95% CI [0.236,0.521], k = 19). Effect sizes were similar for individual HSU-E outcome groups. The largest mean weighted effect size was for TRUST (OR = 0.312, 95% CI [0.165,0.589], k = 10), followed by COM (OR = 0.369, 95% CI [0.150,0.909], k = 7), and SAT (OR = 0.421, 95% CI [0.314,0.564], k = 9).
The effect size for the combined outcome group HSU-U was non-significant (OR = 0.937, 95% CI [0.843,1.042], k = 41). Among individual outcome groups, significant effect sizes were recorded for DELAY (OR = 0.430, 95% CI [0.357,0.519], k = 3) and for UPTAKE (OR = 0.700, 95% CI [0.541,0.907], k = 12). For other individual HSU-U outcomes, effect sizes did not reach significance. This included INS (OR = 0.886, 95% CI [0.561,1.399], k = 7), EXAM (OR = 0.980, 95% CI [0.881,1.090], k = 17), VP (OR = 1.091, 95% CI [0.930,1.279], k = 13), and VH (OR = 1.375, 95% CI [0.905,2.089], k = 4).
Funnel plots were fairly symmetrical for all outcomes with the exception of SAT, where studies were concentrated in the lower left part and upper right part of the plot. Egger’s regression intercept was statistically significant for SAT, and non-significant for other outcomes. Using trim-and-fill procedures, 3 studies were imputed for SAT. Imputing resulted in a minor reduction in the effect size (adjusted from OR = 0.421 to OR = 0.516, 95% CI [0.395,0.676]), which remained significant, indicating that the impact of bias is likely to be trivial. Rosenthal’s failsafe N for the outcome UPTAKE was 47 studies, which with an average effect size of zero would render the effect non-significant. Since this value is smaller than the failsafe N criterion of 5k + 10, it indicates that the significant effect for UPTAKE may be an artifact of bias. For other significant results, failsafe N was well above this criterion.
Moderation analysis
We examined whether associations between racism and HSU outcomes were moderated by participants having specific health/medical conditions and by the setting where racism was experienced (healthcare focused vs. non-healthcare focused). Analyses were run per outcome group, where at least two levels of the moderator each included 5 or more studies. Data were sufficient for examining the impact of having health/medical conditions on associations between racism and the outcome groups HSU-E and HSU-U. Having health/medical conditions significantly moderated the effect of racism on HSU-E. The effect size was stronger for studies focused on participants with specific health/medical conditions compared with studies of participants without specific conditions or where no specific conditions were reported (Q(1) = 4.13, p = 0.042). Having health/medical conditions did not significantly moderate the association between racism and HSU-U. Data were also sufficient for examining the impact of the setting where racism was experienced on associations between racism and the outcome group HSU-U, as well as the individual outcomes EXAM, UPTAKE and VP, yet setting did not significantly moderate the associations between racism and these outcomes.
Vote-counting analysis
The review includes 9 papers (reporting data from 7 studies) that altogether contain 33 associations between racism and HSU outcomes that adjust for age, gender and race, often alongside additional covariates. Several papers reported multiple associations. For racism and HSU-E outcomes, 5 papers reported 12 associations, all of which showed a negative relationship between racism and HSU-E. Ten of these 12 associations (83.3%) were statistically significant. Three papers reported OR point estimates, which ranged between OR = 0.483 and OR = 0.746, and were significant. The main HSU-E outcome group was SAT, for which 7 out of 9 associations (77.8%) were significant and negative. COM and TRUST had 1 and 2 associations with racism, respectively, and all 3 associations were significant and negative.
In addition, 6 papers reported 21 adjusted associations between racism and HSU-U outcomes. Of these, 14 associations were negative (66.7%), and 7 positive. Two of these 21 associations were significant (and negative) (9.5%), while the remaining 19 associations, negative and positive, were non-significant. The 2 significant associations were between racism and DELAY, out of 3 associations for this outcome (66.7%). The remaining 18 associations, between racism and EXAM (13 associations), UPTAKE (2 associations) and VP (3 associations), were all non-significant.
Discussion
We have undertaken what is, to our knowledge, the first systematic review and meta-analysis focused on the relationship between experiences of racism and health service utilisation. We found a total of 83 papers reporting 70 studies, of which 52 studies had sufficient data to be included in a meta-analysis. Attesting to the nascent state of this field, the first paper included in this review was published in 1997, while almost half of the papers were published between 2011–2015, and more than 85% from 2006–2015. Over 95% of papers were from the U.S., suggesting that findings may be of particular interest to scholars and policy makers focused on racism, healthcare and their interconnections in the U.S. at this time of profound social and legislative discussions concerning these areas.
The results of our meta-analysis indicate robust unadjusted associations between racism and HSU experiences. Those experiencing racism had approximately 2 to 3 times the odds of reporting reduced trust in healthcare systems and professionals, lower satisfaction with health services and perceived quality of care, and compromised communication and relationships with healthcare providers. Findings for use of health care (HSU-U) were mixed, and largely non-significant. Experiencing racism increased the odds of delayed care or unmet need, although this outcome was scarcely reported, and increased the odds of not adhering to recommended treatment uptake. However, there was no significant impact of experiencing racism on having health insurance, examinations or visits to health professionals or hospitals, and further analysis indicated that the significant effect for treatment adherence may be caused by publication bias. These findings were supported by vote-counting analyses adjusted for demographic covariates, particularly with regard to more commonly reported outcomes, such as the significant impact of racism on satisfaction with healthcare, and the non-significant association with examinations.
These results suggest that, despite being much more likely to have negative experiences in health services and from healthcare providers, patients experiencing racism are no less likely to access and utilise healthcare. Continued engagement may be a function of need for healthcare, despite compromised quality, as suggested by a moderation effect found in the meta-analysis in which the association between racism and HSU experiences (but not use) was stronger for those with health/medical conditions. This indicates that racism may be a particularly detrimental experience for those most in need of the healthcare system.
In terms of limitations in this growing area of study, less than 5% of studies were conducted outside the U.S., less than 4% utilised longitudinal data, and more than half used non-representative sampling methods. Exposure measures with 9 or more items were reported in less than a quarter of papers and more than half the instruments utilised did not specify an exposure timeframe. Building on a good mix of studies recruiting participants from, and measuring exposure to racism in, either healthcare or other settings, it would be useful for future studies to conduct more research with participants from both healthcare and non-healthcare settings to expand the 3.6% of papers that recruited participants from both types of settings. Although there was no moderation effect of discrimination setting found in our meta-analysis, given how few studies have examined this topic [41, 57, 58, 113], further research is warranted. A more comprehensive analysis of pathways between racism and healthcare, accounting for the multiple, complex roles of patients’ health remains an important future undertaking as well.
There are several limitations to this review. A major limitation concerns our focus on studies published in English, therefore constraining the extent to which our findings may be generalised beyond certain national and linguistic contexts. Another potential limitation of this study is the lack of assessment of studies’ quality. Using critical appraisal tools has been uncommon in meta-analyses of racism and health more generally and remains a challenge in assessing observational studies that use diverse methodologies and measures. By focusing on published studies, this study may reduce the likelihood of including lower quality studies. However, we acknowledge that there remains a possibility that differential study quality may impact the association between racism and healthcare utilisation. This review focuses on self-reported experiences of racism rather than on other types of racism. While, as we show, such experiences may be significant in their impact on healthcare experiences and service utilisation, we encourage future research to also review, synthesise and meta-analyse studies that define racism in other ways, including ecological, experimental and other measures of racism where racism is defined by the researcher.
This systematic review and meta-analysis demonstrates a need for more longitudinal studies using probability-based sampling approaches that comprehensively measure both exposure to racism and a range of relevant health service utilisation outcomes over aetiologically-relevant timeframes. They also signal the dearth of research conducted outside the U.S. and call for additional exploration of the applicability of current findings across various national contexts and diverse healthcare systems. This research also justifies renewed efforts to reduce racism in healthcare settings, targeting both bias among providers [119, 120] and institutional efforts to improve the cultural competency of healthcare systems [121–124].
Supporting information
S1 Appendix. Search strategy for MEDLINE (adapted for other databases as needed).
https://doi.org/10.1371/journal.pone.0189900.s001
(PDF)
Acknowledgments
We would like to thank Melody Velasquez-Tan for her assistance in reviewing and with data extraction.
References
- 1. Ahmed S, Shommu NS, Rumana N, Barron GR, Wicklum S, Turin TC. Barriers to access of primary healthcare by immigrant populations in Canada: a literature review. Journal of immigrant and minority health. 2016 Dec 1;18(6):1522–40. pmid:26364053
- 2. Brondolo E, Gallo LC, Myers HF. Race, racism and health: disparities, mechanisms, and interventions. Journal of behavioral medicine. 2009 Feb 1;32(1):1–8. pmid:19089605
- 3. Fiscella K, Sanders MR. Racial and ethnic disparities in the quality of health care. Annual review of public health. 2016 Mar 18;37:375–94. pmid:26789384
- 4.
Ministry of Health. Tatau kahukura: Māori health chart book. 3rd ed. Wellington: Ministry of Health; 2015.
- 5.
Smedley BE, Stith AY, Nelson AR. Unequal treatment: Confronting ethnic and racial disparities in health care. Washington, DC: Institute of Medicine; 2003.
- 6.
Smith TB, Trimble JE. Mental health service utilization across race: A meta-analysis of surveys and archival studies. In: Smith TB, Trimble JE, editors. Foundations of multicultural psychology: Research to inform effective practice. Washington, DC: American Psychological Association; 2016, pp. 67–94.
- 7. Dovidio JF, Penner LA, Albrecht TL, Norton WE, Gaertner SL, Shelton JN. Disparities and distrust: the implications of psychological processes for understanding racial disparities in health and health care. Social science & medicine. 2008 Aug 31;67(3):478–86.
- 8. Klonoff EA. Disparities in the provision of medical care: an outcome in search of an explanation. Journal of behavioral medicine. 2009 Feb 1;32(1):48. pmid:19127421
- 9. Musa D, Schulz R, Harris R, Silverman M, Thomas SB. Trust in the health care system and the use of preventive health services by older black and white adults. American journal of public health. 2009 Jul;99(7):1293–9. pmid:18923129
- 10. Saha S, Arbelaez JJ, Cooper LA. Patient–physician relationships and racial disparities in the quality of health care. American journal of public health. 2003 Oct;93(10):1713–9. pmid:14534227
- 11. Shavers VL, Fagan P, Jones D, Klein WM, Boyington J, Moten C, et al. The state of research on racial/ethnic discrimination in the receipt of health care. American Journal of Public Health. 2012 May;102(5):953–66. pmid:22494002
- 12. Paradies Y, Truong M, Priest N. A systematic review of the extent and measurement of healthcare provider racism. Journal of general internal medicine. 2014 Feb 1;29(2):364–87. pmid:24002624
- 13. Paradies YC. Defining, conceptualizing and characterizing racism in health research. Critical Public Health. 2006 Jun 16(2):143–57.
- 14. Paradies Y, Ben J, Denson N, Elias A, Priest N, Pieterse A, et al. Racism as a determinant of health: a systematic review and meta-analysis. PloS one. 2015 Sep 23;10(9):e0138511. pmid:26398658
- 15. Williams DR, Mohammed SA. Racism and health I: pathways and scientific evidence. American Behavioral Scientist. 2013 Aug;57(8):1152–73.
- 16. van Ryn M, Burgess DJ, Dovidio JF, Phelan SM, Saha S, Malat J, et al. The impact of racism on clinician cognition, behavior, and clinical decision making. Du Bois review: social science research on race. 2011 Apr;8(1):199–218. pmid:24761152
- 17. Williams DR, Mohammed SA. Discrimination and racial disparities in health: evidence and needed research. Journal of behavioral medicine. 2009 Feb 1;32(1):20–47. pmid:19030981
- 18. Adegbembo AO, Tomar SL, Logan HL. Perception of racism explains the difference between Blacks' and Whites' level of healthcare trust. Ethnicity & Disease. 2006 Jan 1;16(4):792–8.
- 19. Van Houtven CH, Voils CI, Oddone EZ, Weinfurt KP, Friedman JY, Schulman KA, et al. Perceived discrimination and reported delay of pharmacy prescriptions and medical tests. Journal of General Internal Medicine. 2005 Jul 1;20(7):578–83. pmid:16050850
- 20. Hall WJ, Chapman MV, Lee KM, Merino YM, Thomas TW, Payne BK, et al. Implicit racial/ethnic bias among health care professionals and its influence on health care outcomes: a systematic review. American journal of public health. 2015 Dec;105(12):e60–76. pmid:26469668
- 21. Maina IW, Belton TD, Ginzberg S, Singh A, Johnson TJ. A decade of studying implicit racial/ethnic bias in healthcare providers using the implicit association test. Social Science & Medicine. 2017 May 4. pmid:28532892
- 22. Richman LS, Lattanner MR. Self-regulatory processes underlying structural stigma and health. Social Science & Medicine. 2014 Feb 28;103:94–100.
- 23. Richman LS, Kohn-Wood LP, Williams DR. The role of discrimination and racial identity for mental health service utilization. Journal of Social and Clinical Psychology. 2007 Oct;26(8):960–81.
- 24. Pascoe EA, Richman LS. Perceived Discrimination and Health: A Meta-Analytic Review. Psychological Bulletin. 2009; 135(4):531–54. pmid:19586161
- 25.
McCracken MO. Endnote X7.1. 2013.
- 26. Albert MA, Ravenell J, Glynn RJ, Khera A, Halevy N, de Lemos JA. Cardiovascular risk indicators and perceived race/ethnic discrimination in the Dallas Heart Study. American heart journal. 2008 Dec 31;156(6):1103–9. pmid:19033005
- 27. Anyon Y, Ong SL, Whitaker K. School-based mental health prevention for Asian American adolescents: Risk behaviors, protective factors, and service use. Asian American Journal of Psychology. 2014 Jun;5(2):134.
- 28. Armstrong K, Putt M, Halbert CH, Grande D, Schwartz JS, Liao K, et al. Prior experiences of racial discrimination and racial differences in health care system distrust. Medical Care. 2013 Feb;51(2):144. pmid:23222499
- 29. Auslander WF, Thompson SJ, Dreitzer D, Santiago JV. Mothers' satisfaction with medical care: perceptions of racism, family stress, and medical outcomes in children with diabetes. Health & Social Work. 1997 Aug 1;22(3):190–9.
- 30. Banks AD, Dracup K. Factors associated with prolonged prehospital delay of African Americans with acute myocardial infarction. American Journal of Critical Care. 2006 Mar 1;15(2):149–57. pmid:16501134
- 31. Benjamins MR. Race/ethnic discrimination and preventive service utilization in a sample of whites, blacks, Mexicans, and Puerto Ricans. Medical care. 2012 Oct 1;50(10):870–6. pmid:22643195
- 32. Benjamins MR, Whitman S. Relationships between discrimination in health care and health care outcomes among four race/ethnic groups. Journal of Behavioral Medicine. 2013 Mar. pmid:23456249
- 33. Benkert R, Peters RM, Clark R, Keves-Foster K. Effects of perceived racism, cultural mistrust and trust in providers on satisfaction with care. Journal of the National Medical Association. 2006 Sep;98(9):1532. pmid:17019925
- 34. Bird ST, Bogart LM. Perceived race-based and socioeconomic status (SES)-based discrimination in interactions with health care providers. Ethnicity & Disease. 2001;11(3):554–63.
- 35. Bird ST, Bogart LM, Delahanty DL. Health-related correlates of perceived discrimination in HIV care. AIDS Patient care and STDs. 2004 Jan 1;18(1):19–26. pmid:15006191
- 36. Blanchard J, Lurie N. R-E-S-P-E-C-T: patient reports of disrespect in the health care setting and its impact on care. J Fam Pract. 2004 Sep;53(9):721–730. pmid:15353162
- 37. Boarts JM, Bogart LM, Tabak MA, Armelie AP, Delahanty DL. Relationship of race-, sexual orientation-, and HIV-related discrimination with adherence to HIV treatment: a pilot study. Journal of behavioral medicine. 2008 Oct 1;31(5):445–51. pmid:18726151
- 38. Bogart LM, Wagner GJ, Galvan FH, Klein DJ. Longitudinal relationships between antiretroviral treatment adherence and discrimination due to HIV-serostatus, race, and sexual orientation among African–American men with HIV. Annals of Behavioral Medicine. 2010 Oct 1;40(2):184–90. pmid:20552416
- 39. Bogart LM, Landrine H, Galvan FH, Wagner GJ, Klein DJ. Perceived discrimination and physical health among HIV-positive Black and Latino men who have sex with men. AIDS and Behavior. 2013 May 1;17(4):1431–41. pmid:23297084
- 40. Burgess DJ, Ding Y, Hargreaves M, Van Ryn M, Phelan S. The association between perceived discrimination and underutilization of needed medical and mental health care in a multi-ethnic community sample. Journal of Health Care for the Poor and Underserved. 2008;19(3):894–911. pmid:18677077
- 41. Casagrande SS, Gary TL, LaVeist TA, Gaskin DJ, Cooper LA. Perceived discrimination and adherence to medical care in a racially integrated community. Journal of general internal medicine. 2007 Mar 1;22(3):389–95. pmid:17356974
- 42. Chen D, Yang TC. The pathways from perceived discrimination to self-rated health: an investigation of the roles of distrust, social capital, and health behaviors. Social science & medicine. 2014 Mar 31;104:64–73.
- 43. Cho H, Kim I, Velez-Ortiz D. Factors associated with mental health service use among Latino and Asian Americans. Community mental health journal. 2014 Nov 1;50(8):960–7. pmid:24659219
- 44. Clay OJ, Roth DL, Safford MM, Sawyer PL, Allman RM. Predictors of overnight hospital admission in older African American and Caucasian Medicare beneficiaries. Journals of Gerontology Series A: Biomedical Sciences and Medical Sciences. 2011 May 12;66(8):910–6.
- 45. Crawford ND, Jones CP, Richardson LC. Understanding racial and ethnic disparities in colorectal cancer screening: Behavioral Risk Factor Surveillance System, 2002 and 2004. Ethnicity & disease. 2010 Sep 1;20(4):359.
- 46. Crawley LM, Ahn DK, Winkleby MA. Perceived medical discrimination and cancer screening behaviors of racial and ethnic minority adults. Cancer Epidemiology and Prevention Biomarkers. 2008 Aug 1;17(8):1937–44.
- 47. Cuffee YL, Hargraves JL, Rosal M, Briesacher BA, Schoenthaler A, Person S, et al. Reported racial discrimination, trust in physicians, and medication adherence among inner-city African Americans with hypertension. American journal of public health. 2013 Nov;103(11):e55–62. pmid:24028222
- 48. Dailey AB, Kasl SV, Holford TR, Jones BA. Perceived racial discrimination and nonadherence to screening mammography guidelines: results from the race differences in the screening mammography process study. American Journal of Epidemiology. 2007 Mar 10;165(11):1287–95. pmid:17351294
- 49. Ford CL, Daniel M, Earp JA, Kaufman JS, Golin CE, Miller WC. Perceived everyday racism, residential segregation, and HIV testing among patients at a sexually transmitted disease clinic. American journal of public health. 2009 Apr;99(S1):S137–43.
- 50. Fowler-Brown A, Ashkin E, Corbie-Smith G, Thaker S, Pathman DE. Perception of racial barriers to health care in the rural South. Journal of Health Care for the Poor and Underserved. 2006;17(1):86–100. pmid:16520516
- 51. Gizlice Z, Ngui EM. Relationships between health and perceived unequal treatment based on race: results from the 2002 North Carolina BRFSS Survey. InState Center for Health Statistics, North Carolina Department 2004 Sep.
- 52. Gonzales KL, Harding AK, Lambert WE, Fu R, Henderson WG. Perceived experiences of discrimination in health care: a barrier for cancer screening among American Indian women with type 2 diabetes. Women's Health Issues. 2013 Jan;23(1):e61–7. pmid:23312714
- 53. Gonzales KL, Lambert WE, Fu R, Jacob M, Harding AK. Perceived racial discrimination in health care, completion of standard diabetes services, and diabetes control among a sample of American Indian women. The Diabetes Educator. 2014 Nov;40(6):747–55. pmid:25249597
- 54. Greer TM, Brondolo E, Brown P. Systemic racism moderates effects of provider racial biases on adherence to hypertension treatment for African Americans. Health Psychology. 2014 Jan;33(1):35–42. pmid:23730720
- 55. Hagiwara N, Penner LA, Gonzalez R, Eggly S, Dovidio JF, Gaertner SL, et al. Racial attitudes, physician–patient talk time ratio, and adherence in racially discordant medical interactions. Social Science & Medicine. 2013 Jun 30;87:123–31.
- 56. Halim ML, Yoshikawa H, Amodio DM. Cross-generational effects of discrimination among immigrant mothers: Perceived discrimination predicts child's healthcare visits for illness. Health Psychology. 2012. pmid:22390736
- 57. Hammond WP. Psychosocial correlates of medical mistrust among African American men. American journal of community psychology. 2010 Mar 1;45(1–2):87–106. pmid:20077134
- 58. Harris R, Cormack D, Tobias M, Yeh LC, Talamaivao N, Minster J, et al. Self-reported experience of racial discrimination and health care use in New Zealand: results from the 2006/07 New Zealand Health Survey. American journal of public health. 2012 May;102(5):1012–9. pmid:22420811
- 59. Hausmann LR, Jeong K, Bost JE, Ibrahim SA. Perceived discrimination in health care and use of preventive health services. Journal of general internal medicine. 2008a Oct 1;23(10):1679–84. pmid:18649109
- 60. Hausmann LR, Jeong K, Bost JE, Ibrahim SA. Perceived discrimination in health care and health status in a racially diverse sample. Medical care. 2008b Sep;46(9):905–14. pmid:18725844
- 61. Hausmann LR, Jeong K, Bost JE, Kressin NR, Ibrahim SA. Perceived racial discrimination in health care: a comparison of Veterans Affairs and other patients. American journal of public health. 2009 Nov;99(S3):S718–24.
- 62. Hausmann LR, Kressin NR, Hanusa BH, Ibrahim SA. Perceived racial discrimination in health care and its association with patients' healthcare experiences: does the measure matter?. Ethnicity & disease. 2010 Dec 1;20(1):40–7.
- 63. Hausmann LR, Hannon MJ, Kresevic DM, Hanusa BH, Kwoh CK, Ibrahim SA. Impact of perceived discrimination in health care on patient-provider communication. Medical care. 2011 Jul;49(7):626–33. pmid:21478769
- 64. Hausmann LR, Kwoh CK, Hannon MJ, Ibrahim SA. Perceived racial discrimination in health care and race differences in physician trust. Race and Social Problems. 2013 Jun 1;5(2):113–20.
- 65. Hoyo C, Yarnall KS, Skinner CS, Moorman PG, Sellers D, Reid L. Pain predicts non-adherence to pap smear screening among middle-aged African American women. Preventive medicine. 2005 Aug 31;41(2):439–45. pmid:15917039
- 66. Insaf TZ, Jurkowski JM, Alomar L. Sociocultural factors influencing delay in seeking routine health care among Latinas: a community-based participatory research study. Ethnicity and Disease. 2010 Mar 1;20(2):148–54. pmid:20503895
- 67. Irvin R, Wilton L, Scott H, Beauchamp G, Wang L, Betancourt J, et al. A study of perceived racial discrimination in Black men who have sex with men (MSM) and its association with healthcare utilization and HIV testing. AIDS and Behavior. 2014 Jul 1;18(7):1272–8. pmid:24569888
- 68. Jacobs EA, Rathouz PJ, Karavolos K, Everson-Rose SA, Janssen I, Kravitz HM, et al. Perceived discrimination is associated with reduced breast and cervical cancer screening: the Study of Women's Health Across the Nation (SWAN). Journal of Women's Health. 2014 Feb 1;23(2):138–45. pmid:24261647
- 69. Jamieson LM, Steffens M, Paradies YC. Associations between discrimination and dental visiting behaviours in an Aboriginal Australian birth cohort. Australian and New Zealand journal of public health. 2013 Feb 1;37(1):92–3. pmid:23379814
- 70. Jang Y, Kim G, Chiriboga DA. Health, healthcare utilization, and satisfaction with service: Barriers and facilitators for older Korean Americans. Journal of the American Geriatrics Society. 2005 Sep 1;53(9):1613–7. pmid:16137296
- 71. Kaphingst KA, Goodman M, Pandya C, Garg P, Stafford J, Lachance C. Factors affecting frequency of communication about family health history with family members and doctors in a medically underserved population. Patient education and counseling. 2012 Aug 31;88(2):291–7. pmid:22197261
- 72. Keller SC, Silberberg M, Hartmann KE, Michener JL. Perceived discrimination and use of health care services in a North Carolina population of Latino immigrants. Hispanic Health Care International. 2010 Mar 1;8(1):4–13.
- 73. Kelso GA, Cohen MH, Weber KM, Dale SK, Cruise RC, Brody LR. Critical consciousness, racial and gender discrimination, and HIV disease markers in African American women with HIV. AIDS and Behavior. 2014 Jul 1;18(7):1237–46. pmid:24077930
- 74. LaVeist TA, Nickerson KJ, Bowie JV. Attitudes about racism, medical mistrust, and satisfaction with care among African American and white cardiac patients. Medical Care Research and Review. 2000 Nov;57(1_suppl):146–61.
- 75. Lamkaddem M, Essink-Bot ML, Devillé W, Foets M, Stronks K. Perceived discrimination outside health care settings and health care utilization of Turkish and Moroccan GP patients in the Netherlands. The European Journal of Public Health. 2011 Sep 5;22(4):473–8. pmid:21893505
- 76. López‐Cevallos DF, Harvey SM, Warren JT. Medical Mistrust, Perceived Discrimination, and Satisfaction With Health Care Among Young‐Adult Rural Latinos. The Journal of Rural Health. 2014 Sep 1;30(4):344–51. pmid:24576017
- 77. Lyles CR, Karter AJ, Young BA, Spigner C, Grembowski D, Schillinger D, et al. Provider factors and patient-reported healthcare discrimination in the Diabetes Study of California (DISTANCE). Patient education and counseling. 2011 Dec 31;85(3):e216–24. pmid:21605956
- 78. Mandelblatt JS, Edge SB, Meropol NJ, Senie R, Tsangaris T, Grey L, et al. Predictors of long-term outcomes in older breast cancer survivors: perceptions versus patterns of care. Journal of Clinical Oncology. 2003 Mar 1;21(5):855–63. pmid:12610185
- 79. Moore AD, Hamilton JB, Knafl GJ, Godley PA, Carpenter WR, Bensen JT, et al. The influence of mistrust, racism, religious participation, and access to care on patient satisfaction for African American men: the North Carolina-Louisiana Prostate Cancer Project. Journal of the National Medical Association. 2013a Mar 1;105(1):59–68. pmid:23862297
- 80. Moore AD, Hamilton JB, Pierre-Louis BJ, Jennings BM. Increasing access to care and reducing mistrust: Important considerations when implementing the patient-centered medical home in Army health clinics. Military medicine. 2013b Mar;178(3):291–8. pmid:23707116
- 81. Mouton CP, Carter-Nolan PL, Makambi KH, Taylor TR, Palmer JR, Rosenberg L, et al. Impact of perceived racial discrimination on health screening in black women. Journal of health care for the poor and underserved. 2010 Feb;21(1):287–300. pmid:20173270
- 82. Nguyen DD, Ho KH, Williams JH. Social determinants and health service use among racial and ethnic minorities: Findings from a community sample. Social work in health care. 2011 May 1;50(5):390–405. pmid:21614731
- 83. Padela AI, Murrar S, Adviento B, Liao C, Hosseinian Z, Peek M, et al. Associations between religion-related factors and breast cancer screening among American Muslims. Journal of immigrant and minority health. 2015 Jun 1;17(3):660–9. pmid:24700026
- 84. Peek ME, Nunez-Smith M, Drum M, Lewis TT. Adapting the everyday discrimination scale to medical settings: reliability and validity testing in a sample of African American patients. Ethnicity & disease. 2011a;21(4):502.
- 85. Peek ME, Wagner J, Tang H, Baker DC, Chin MH. Self-reported racial/ethnic discrimination in healthcare and diabetes outcomes. Medical care. 2011 Jul;49(7):618–25. pmid:21478770
- 86. Piette JD, Bibbins-Domingo K, Schillinger D. Health care discrimination, processes of care, and diabetes patients’ health status. Patient education and counseling. 2006 Jan 31;60(1):41–8. pmid:16332469
- 87. Pullen E, Perry B, Oser C. African American women's preventative care usage: the role of social support and racial experiences and attitudes. Sociology of health & illness. 2014 Sep 1;36(7):1037–53.
- 88. Sellers SL, Bonham V, Neighbors HW, Amell JW. Effects of racial discrimination and health behaviors on mental and physical health of middle-class African American men. Health Education & Behavior. 2009 Feb;36(1):31–44.
- 89. Shariff-Marco S, Klassen AC, Bowie JV. Racial/ethnic differences in self-reported racism and its association with cancer-related health behaviors. American Journal of Public Health. 2010 Feb;100(2):364–74. pmid:20019302
- 90. Sheppard VB, Wang J, Yi B, Harrison TM, Feng S, Huerta EE, et al, Latin American Cancer Research Coalition. Are health-care relationships important for mammography adherence in Latinas?. Journal of general internal medicine. 2008 Dec 1;23(12):2024–30. pmid:18839258
- 91. Sheppard VB, Williams KP, Wang J, Shavers V, Mandelblatt JS. An examination of factors associated with healthcare discrimination in Latina immigrants: the role of healthcare relationships and language. Journal of the National Medical Association. 2014;106(1):15–22. pmid:26744111
- 92. Slaughter-Acey JC, Caldwell CH, Misra DP. The influence of personal and group racism on entry into prenatal care among-African American women. Women's Health Issues. 2013 Dec 31;23(6):e381–7. pmid:24041828
- 93. Sorkin DH, Ngo-Metzger Q, De Alba I. Racial/ethnic discrimination in health care: impact on perceived quality of care. Journal of General Internal Medicine. 2010 May 1;25(5):390–6. pmid:20146022
- 94. Spencer MS, Chen J. Effect of discrimination on mental health service utilization among Chinese Americans. American Journal of Public Health. 2004 May;94(5):809–14. pmid:15117705
- 95. Spencer MS, Chen J, Gee GC, Fabian CG, Takeuchi DT. Discrimination and mental health–related service use in a national study of Asian Americans. American Journal of Public Health. 2010 Dec;100(12):2410–7. pmid:20299649
- 96. Tanner AE, Reboussin BA, Mann L, Ma A, Song E, Alonzo J, et al. Factors influencing health care access perceptions and care-seeking behaviors of immigrant Latino sexual minority men and transgender individuals: baseline findings from the HOLA intervention study. Journal of health care for the poor and underserved. 2014 Nov;25(4):1679–97. pmid:25418235
- 97. Thorburn S, Bogart LM. African American women and family planning services: perceptions of discrimination. Women & health. 2005 Dec 5;42(1):23–39.
- 98. Valdovinos C, Penedo FJ, Isasi CR, Jung M, Kaplan RC, Giacinto RE, et al. Perceived discrimination and cancer screening behaviors in us Hispanics: the Hispanic community health study/study of Latinos sociocultural ancillary study. Cancer Causes & Control. 2015. pmid:26498194
- 99. Vina ER, Hausmann LR, Utset TO, Masi CM, Liang KP, Kwoh CK. Perceptions of racism in healthcare among patients with systemic lupus erythematosus: a cross-sectional study. Lupus science & medicine. 2015 Aug 1;2(1):e000110.
- 100. Wagner J, Abbott G. Depression and depression care in diabetes. Diabetes Care. 2007 Feb 1;30(2):364–6. pmid:17259510
- 101. Wagner GJ, Bogart LM, Galvan FH, Banks D, Klein DJ. Discrimination as a key mediator of the relationship between posttraumatic stress and HIV treatment adherence among African American men. Journal of behavioral medicine. 2012 Feb 1;35(1):8–18. pmid:21318411
- 102. Walls ML, Gonzalez J, Gladney T, Onello E. Unconscious biases: racial microaggressions in American Indian health care. The Journal of the American Board of Family Medicine. 2015 Mar 1;28(2):231–9. pmid:25748764
- 103. Wamala S, Merlo J, Boström G, Hogstedt C. Perceived discrimination, socioeconomic disadvantage and refraining from seeking medical treatment in Sweden. Journal of Epidemiology & Community Health. 2007 May 1;61(5):409–15.
- 104. Weech-Maldonado R, Hall A, Bryant T, Jenkins KA, Elliott MN. The relationship between perceived discrimination and patient experiences with health care. Medical care. 2012 Sep;50(9 0 2):S62–8. pmid:22895233
- 105. Woodward AT. Discrimination and help-seeking: Use of professional services and informal support among African Americans, Black Caribbeans, and non-Hispanic Whites with a mental disorder. Race and Social Problems. 2011 Oct 1;3(3):146–59.
- 106.
Borenstein M, Hedges LV, Higgins JP, Rothstein HR: Comprehensive Meta-analysisVersion 2.2.057. Biostat: Englewood, NJ; 2010.
- 107. Dolezsar CM, McGrath JJ, Herzig AJM, Miller SB. Perceived Racial Discrimination and Hypertension: A Comprehensive Systematic Review. Health Psychology. 2014; 33(1):20–34. pmid:24417692
- 108. Voils CI, Crandell JL, Chang Y, Leeman J, Sandelowski M. Combining adjusted and unadjusted findings in mixed research synthesis. Journal of evaluation in clinical practice. 2011 Jun 1;17(3):429–34. pmid:21040243
- 109.
Cooper HM. Synthesizing research: A guide for literature reviews. 3rd ed. Thousand Oaks, CA.: Sage; 1998.
- 110. Hedges L, Vevea J. Fixed- and random-effects models in meta-analysis. Psychological Methods. 1998; 3:486–504.
- 111. Pieterse AL, Todd NR, Neville HA, Carter RT. Perceived Racism and Mental Health Among Black American Adults: A Meta-Analytic Review. Journal of Counseling Psychology. 2012; 59(1):1–9. pmid:22059427
- 112. Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J PersSoc Psychol. 1986; 51(6):1173–82.
- 113. Kelaher MA, Ferdinand AS, Paradies Y. Experiencing racism in health care: the mental health impacts for Victorian Aboriginal communities. The Medical journal of Australia. 2014 Jul 7;201(1):44–7. pmid:24999898
- 114. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. Bmj. 1997 Sep 13;315(7109):629–34. pmid:9310563
- 115. Quintana SM, Minami T. Guidelines for meta-analysis of counseling psychology research. Counseling Psychologist. 2006; 34:839–77.
- 116. Rosenthal R. The file drawer problem and tolerance for null results. Psychological Bulletin. 1979; 86(3):638–41.
- 117. Duval S, Tweedie R. Trim and fill: a simple funnel plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000a; 56:455–63. pmid:10877304
- 118. Duval S, Tweedie R. A nonparametric “trim and fill” method of accounting for publication bias in metaanalysis. J AmStat Assoc. 2000b; 96:89–98.
- 119. Byrne A, Tanesini A. Instilling new habits: addressing implicit bias in healthcare professionals. Advances in Health Sciences Education. 2015 Dec 1;20(5):1255–62. pmid:25771742
- 120. White AA, Logghe HJ, Goodenough DA, Barnes LL, Hallward A, Allen IM, et al. Self-Awareness and Cultural Identity as an Effort to Reduce Bias in Medicine. Journal of Racial and Ethnic Health Disparities. 2017 Mar 24:1–16.
- 121.
Butler M, McCreedy E, Schwer N, Burgess D, Call K, Przedworski J, et al. Improving cultural competence to reduce health disparities. Comparative Effectiveness Reviews, No. 170. Rockville, MD: Agency for Healthcare Research and Quality; 2016 Mar.
- 122. Degrie L, Gastmans C, Mahieu L, de Casterlé BD, Denier Y. How do ethnic minority patients experience the intercultural care encounter in hospitals? a systematic review of qualitative research. BMC medical ethics. 2017 Jan 19;18(1):2. pmid:28103849
- 123. Jongen CS, McCalman J, Bainbridge RG. The implementation and evaluation of Health Promotion Services and Programs to improve Cultural Competency: A Systematic Scoping Review. Frontiers in public health. 2017;5: 24. pmid:28289677
- 124. Salway S, Mir G, Turner D, Ellison GT, Carter L, Gerrish K. Obstacles to “race equality” in the English National Health Service: Insights from the healthcare commissioning arena. Social Science & Medicine. 2016 Mar 31;152:102–10.