Most studies reporting ethnic disparities in the quality of healthcare come from developed countries and rely on observational methods. We conducted the first experimental study to evaluate whether health providers in Peru provide differential quality of care for family planning services, based on the indigenous or mestizo (mixed ethnoracial ancestry) profile of the patient. In a crossover randomized controlled trial conducted in 2012, a sample of 351 out of the 408 public health establishments in Metropolitan Lima, Peru were randomly assigned to receive unannounced simulated patients enacting indigenous and mestizo profiles (sequence-1) or mestizo and then indigenous profiles (sequence-2), with a five week wash-out period. Both ethnic profiles used the same scripted scenario for seeking contraceptive advice but had distinctive cultural attributes such as clothing, styling of hair, make-up, accessories, posture and patterns of movement and speech. Our primary outcome measure of quality of care is the proportion of technical tasks performed by providers, as established by Peruvian family planning clinical guidelines. Providers and data analysts were kept blinded to the allocation. We found a non-significant mean difference of -0·7% (p = 0·23) between ethnic profiles in the percentage of technical tasks performed by providers. However we report large deficiencies in the compliance with quality standards of care for both profiles. Differential provider behaviour based on the patient's ethnic profiles compared in the study did not contribute to deficiencies in family planning outcomes observed. The study highlights the need to explore other determinants for poor compliance with quality standards, including demand and supply side factors, and calls for interventions to improve the quality of care for family planning services in Metropolitan Lima.
Citation: Planas M-E, García PJ, Bustelo M, Carcamo CP, Martinez S, Nopo H, et al. (2015) Effects of Ethnic Attributes on the Quality of Family Planning Services in Lima, Peru: A Randomized Crossover Trial. PLoS ONE10(2): e0115274. https://doi.org/10.1371/journal.pone.0115274
Academic Editor: Sharon Cameron, NHS lothian and University of Edinburgh, UNITED KINGDOM
Received: June 16, 2014; Accepted: November 19, 2014; Published: February 11, 2015
Copyright: © 2015 Planas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The Inter-American Development Bank (www.iadb.org) supported this work (Grant No RG-K1241). MB, SM, HN, JR, MFM and AM are affiliated to the institution that sponsored the study and had a role in the design, analysis, interpretation, and writing of the report. The corresponding author had full access to all the data in the study and all authors made the decision to submit for publication.
Competing interests: The authors have declared that no competing interests exist.
Ethnic inequalities in health outcomes, access to and utilization of healthcare have been reported in Peru.[1,2] However there are very few studies examining how ethnicity affects the quality of healthcare services received by patients. While observational studies have collected patients’ perceptions of ethnic discrimination in healthcare services,[3,4] to date no experimental data has been gathered on the mechanisms that may drive such perceptions. Furthermore, international literature has reported how health providers contribute to creating ethnic disparities across a wide range of clinical services,[5,6] including family planning (FP), however there is little evidence in the context of a developing country such as Peru.
Through the provision of contraceptive information and services, FP allows individuals and couples to anticipate and attain their desired number of children and the spacing and timing of their births. There is evidence, mostly in the United States, indicating that contraception service providers make different recommendations according to ethnicity/race, with ethnic minorities more likely to report being pressured to limit their family size, and to receive counseling about sterilization and other highly effective contraceptive methods.[7–9] There is also a growing body of literature which suggests that even when providers report egalitarian beliefs and no intention to discriminate, it is possible to observe bias, discrimination or prejudice regarding ethnicity/race. If FP providers systematically discriminate based on the ethnicity of a patient, they may contribute to ethnic disparities in the unmet need for contraceptive methods and in the disadvantage experienced when women are unable to control their fertility as desired.[11,12]
In Peru, after years of contradictory policy approaches in which health providers were either discouraged from delivering modern contraceptives or pressured to perform non-voluntary sterilizations, particularly to poor and indigenous women, the Ministry of Health (MoH) issued clinical guidelines for FP in 2004 endorsing reproductive and sexual rights, as well as gender and diversity equality.[14–16] There are nevertheless continued ethnic disparities between indigenous and non-indigenous women in unmet needs for contraceptive methods (9.4% and 6.5%, respectively), and in use of modern contraceptives (21.9% and 34.7%, respectively). It is unclear, however, whether these ethnic differences could be explained by women’s cultural preferences and behaviors, healthcare system factors, or service provider behavior. This study aims to evaluate whether health providers in Peru might be contributing to ethnic disparities in the provision of FP services, by comparing providers’ adherence to national FP guidelines.
To evaluate guideline tasks performed by health providers during consultation, this study uses simulated patients (SPs), that is, individuals carefully recruited and trained to act as real patients. Our study is the first randomized controlled trial using SPs in face-to face interactions that managed to circumvent potential biases arising from unobserved heterogeneity. In the tradition of conventional audit tests in labor economics, these studies have evaluated ethnic or racial disparities assigning auditors to pairs (e.g. one of each ethnicity or race), and matching them in equivalent characteristics. Such a design makes it difficult to assure that other unobserved idiosyncratic characteristics beside ethnicity are not affecting outcomes. Recent audit studies addressed this limitation by randomizing ethnic/racial attributes within each quality pair in tests using photographs and surnames sent in résumés as ethnoracial proxies, and in Implicit Association Tests, but to our knowledge this is the first time it is implemented using a SP technique that assesses face-to-face interactions with health providers. Furthermore, the study is the first of its kind in experimentally testing how health providers might contribute to creating ethnic disparities in healthcare in developing countries.
Materials and Methods
Study design and participants
We undertook a two period, crossover randomized controlled trial, with 1:1 allocation ratio to evaluate whether patients’ ethnic characteristics trigger differences in the quality of FP services in Metropolitan Lima, the capital of Peru. Lima is a melting pot of ethnoracial populations, representing the rich diversity of the country, where 51% of the population self identifies as mestizo (mixed ethnoracial ancestry), 34% indigenous Quechua, 5% indigenous Aymara, 4% Amazonian ethnic groups, 3% white, 1% black and 2% other.
The study was conducted during September 5 and November 27, 2012 in a sample of 351 health establishments operated by the MoH, which offer FP services provided by midwives. From a total of 408 MoH establishments in Lima, we excluded six specialized hospitals that did not offer FP services, 13 small health posts which did not provide care to a sufficiently large number of patients to enable the SP to pass undetected, and 16 health centres where we recruited midwives to assist in the study’s validation procedures and training. The eligible MoH establishments participating in the study are therefore 17 non-specialized hospitals and 334 health centers (Fig. 1).
The intervention consisted of unannounced SP visiting health establishments as indigenous Quechua and mestizo clients, seeking contraceptive advice following a standardized script. The study protocol was approved on September 5, 2012 by the Institutional Review Board (IRB) at Universidad Peruana Cayetano Heredia. The protocol for this trial and supporting CONSORT checklist are available as supporting information (see S1 Protocol and S1 CONSORT Checklist). The IRB exempted midwives from informed consent given that the study involved no more than minimal risk, did not adversely affect their rights and welfare, and could not practically be carried out without the waiver. The protocol was published, and registered with ClinicalTrials.gov (NCT01885858). Since the researchers initially involved in the study were economists and anthropologists, and within their disciplinary fields it is neither mandatory nor a common practice to register trials, we registered the study trial on June 15, 2013 after being informed of the specific standards for clinical trials and the related journal’s editorial policies in the medical field. The authors confirm that all ongoing and related trials for this intervention are registered.
Ethnic profiles. The distinctive cultural attributes of ethnic profiles manipulated in the experiment were defined after a qualitative study, further adjusted during training, and later validated in a pilot study and a post-trial survey with a representative sample of midwives working in MoH FP services in Lima (see Planas et al.). Since ethnicity is a multidimensional construct and its validity is context-driven,[23,24] we relied on midwives perceptions to identify the salient attributes they use to distinguish indigenous from mestizo clients. These attributes were culturally appropriate clothing, styling of hair, make-up, accessories, posture, and patterns of movement and speech. Accent was perceived as a salient attribute but we did not manipulate it since it was difficult to learn with realism and consistency within the timeframe of the study. Instead, we used Quechua accent as a criterion for recruiting the SPs. Given the interplay between racial and ethnic attributes,[25,26] we recruited SPs with phenotypic characteristics that made the distinctive cultural attributes relevant for midwives to distinguish indigenous from mestizo clients (see Planas et al.). In order to manipulate ethnicity, while holding all other aspects of the patient constant (such as phenotype, physical attractiveness and attitudes), the same SP half the times sought FP services enacting an indigenous profile while the other half she did so enacting a mestizo profile (see Figs. 2 and 3).
The indigenous profile wore long braids, no make-up, an lliclla (a traditional woven cloth that resembles a shawl), a woven cardigan, loose pants, her patterns of speech were slower, and her posture and movement more rigid than the mestizo profile. The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish her photograph.
The mestizo profile wore a pony tail or loose hair, make-up, a vest made of polar fleece, tight pants, and culturally salient accessories, her patterns of speech were faster, and her posture and movement less rigid than the indigenous profile. The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish her photograph.
The post-trial validation exercise confirmed that we successfully manipulated attributes that led local midwives to correctly infer the ethnic profile of the SP (S1 Table), that our indigenous and mestizo profiles were amongst the most common patient types visiting MoH FP services in Lima (S1 Fig.), and that extreme indigenous and lighter mestizo or white patients were rare (S2 Fig.).
Script. Based on the work by León et al., a script was developed for a new user of FP services interested in the possibility of using pills as her contraception method. During each FP visit SPs enacted a standardized script, introducing them as new user of FP services, low-income, uninsured, who did not complete secondary school, did not want more children for a few years (neither her nor her husband or partner), did not trust natural FP methods, and lacked experience with modern contraceptives. Her choice of method, if asked, was the pill. The only elements of the script that varied between ethnic profiles, if prompted, were information about birthplace and length of time living in Lima, since based on validation exercises long-time Lima residents preserving indigenous markers could be suspect. In addition, the script provided SPs excuses to avoid physical examination.
Randomization, masking and blinding
We used a computer generated randomization schedule and permuted blocks of four (Microsoft Excel 2007) to assign health establishments to receive SPs enacting either indigenous and then mestizo profiles (sequence 1) or mestizo and then indigenous profiles (sequence 2) in two periods (Fig. 3). To help conceal the study, visits to the same establishment were conducted at least 5 weeks apart. A masked epidemiologist (CC) generated the allocation sequence, and while the data bank was open, only the investigator in charge of data collection (MEP) was aware of the assignment. Field supervisors and SPs were aware of the ethnic profile to be performed up to a week in advance. Because of the nature of the experiment, ethnic profiles had to be revealed to health providers. Yet since providers were unaware of the consultation’s purpose, they were effectively blinded to the experiment. Data analysis was also performed blind as to the arm allocation of the SP visits.
The order of health establishment visits was selected through probability multi-stage sampling. In the first stage, health centres were divided into three areas according to geographic proximity. In the second stage, the order of visits was randomized within each of the twelve healthcare networks in Lima. SPs were divided into three field teams, each led by one supervisor and assigned to one of the three areas with an ordered list of health establishments and a rotation period of six weeks. Turns were allocated systematically and groups of two establishments were assigned sequentially to SPs on the same team.
Of 132 female applicants recruited to act as SPs, ten aged between 25 and 35, with higher education degrees (most of them midwives) and with desirable phenotype, accent, cognitive and interpersonal skills successfully completed a two-week training program (see Planas et al.). During the training we were assisted by an experienced actor and by 3 midwives who were recruited to act as supervisors and had previously received a two-day training on research ethics, project and monitoring procedures and data collection.
During fieldwork data was collected using Magpi, a mobile phone based application for data collection and transfer. Within the first 30 minutes after the FP consultation, SPs recorded whether or not the provider performed the guideline tasks on a checklist that required yes-no responses, as well as the cost and time spent to get the consultation.
Supervisors met with SPs before they visited the health establishments to verify correct characterization of the assigned ethnic profiles, and conducted daily exit-interviews to confirm that data had been correctly entered, to assess the SP’s judgment of provider performance, to detect potential departures from the script, and provide the SP with feedback. The exit-interview was audio taped and the supervisor sent daily notifications through her mobile confirming each supervision visit and whether the checklist was reported according to protocol. When an inconsistency was detected, it was corrected using printed supervision forms.
The database administrator corrected weekly data entry errors against the information collected through exit-interviews and supervision forms as well as other materials submitted daily by supervisors, such as payment bills, pills and prescriptions. The database administrator presented a weekly report of inconsistencies and incorrect data entries to the research team, which were corrected by checking with the fieldwork supervisor and/or SP. The research team met weekly with supervisors and the data manager to assess fieldwork progress and SP performance.
Considering that national guidelines for FP services are well known among providers, we compared provider’s adherence to these guidelines. The primary outcome of the study is the proportion of guideline technical tasks performed by health providers. This index of technical tasks includes items that relate to four competences: i) identify client’s needs; ii) respond to client’s needs by offering an appropriate range of contraceptive methods and explaining the characteristics of the method of choice; iii) verify client’s understanding of the characteristics of the method of choice; and iv) maintain rapport and schedule a follow-up visit.. A detailed description of the 23 quality measurement tasks related to each of these technical competences has been published in Planas et al..
Secondary outcome measures included: i) proportion of guideline socio-emotional tasks performed by providers, measured by tasks related to guideline skills necessary to establishing a friendly rapport with clients; ii) total length of visit; iii) total cost of the appointment, and; iv) total number of attempts from the first visit to the one when the FP consultation was completed (see Planas et al.).
The impact of the SP’s ethnic profile was estimated as the average difference in outcomes between the indigenous and mestizo profile visits in each center. We estimated a power over 99% to detect 10% differences in this index across 351 health establishments, using a standard deviation of 40, a level of statistical significance of 5% (two-sided). Linear regression analysis was used to control for time (day of the week, time of day), health establishment, and SP fixed effects to capture unobserved patient-specific heterogeneity (e.g. interviewing ability, physical attractiveness). A final specification includes a vector of provider and health establishment characteristics, such as age, gender, and ethnicity of providers, observed by the SP at the time of the visit. Our dataset is available as supporting information (see S1 Data).
Of the initial 351 health establishments selected, 12 had to be replaced because they did not offer FP services, were located in extremely unsafe neighborhoods, were visited with the wrong ethnic profile or notification of the checklist did not reach the server (Fig. 1). While health establishments were balanced by design, we could not guarantee that the same provider was observed during the two visits. However, based on provider characteristics collected during the interviews, it appears that providers did not vary systematically between SP profiles (S2–S3 Tables).
Table 1 reports the main results of the study. We find no statistically significant differences in the index of technical tasks, our primary measure of quality, based on the ethnic profile of patients. Results are similar in multivariable regression analysis (S4 Table). However, 37% compliance with standards of care is strikingly low for both ethnic profiles. Disaggregating the technical task quality index by competence in Table 2 shows that providers comply on average with only 14 percent of the tasks related with competence ii: respond to client’s need by offering the appropriate range of contraceptive options, and explaining characteristics of the method of choice. Average compliance with competencies i, iii, and iv ranges between 48 and 54 percent.
Results for secondary measures of quality tell a similar story. Table 3 shows no differences by ethnic profile on the quality index of socio-emotional tasks, though relative to technical tasks, providers score relatively high, performing on average 75 percent of the suggested guidelines. These results were confirmed in the multivariable regression analysis (S5 Table). Similarly, Table 4 shows no differences in the total cost and duration of the visit. On average, patients spend four Peruvian Soles ($1.40 US dollars) for a supposedly free consultation, and take 120 minutes from the moment they arrive at the establishment to the moment they leave the FP consultation. The FP consultation lasts on average 13 minutes, so 90% of time is spent waiting and on paperwork. Finally, SPs required on average 1.5 visits to the health establishment (on different days) before receiving a FP consultation. It is worth noting that this is the only statistic for which we find significant differences across ethnic profiles. Nonetheless, beyond statistical significance, the magnitude of such difference is too small (1.5 vs. 1.4 visits).
We conducted the first randomized controlled SP study to assess disparities in the provision of care based on the ethnic profile of patients in Lima, Peru. In contrast with observational evidence of ethnoracial discrimination in FP services located in Andean regions of Peru,[3,4] we do not detect systematic differences in the quality of care received in Lima by the ethnic profiles manipulated in the experiment. However, we do find alarming low levels of quality standards overall. On average, only 37% of technical tasks required by Peruvian FP guidelines are conducted, and compliance with key competencies such as offering the appropriate range of methods and explaining the method of choice are even lower. Furthermore, we documented that fees are charged, averaging $1.4 dollars for supposedly free services. To the extent that indigenous women are poorer, or have different health service preferences, expectations and needs, these deficient practices may act as barriers to access.
This study’s methodological approach, with random assignment of ethnic profiles, overcomes several limitations of previous experimental studies manipulating ethnicity/race to assess treatment outcomes and provider's management strategies in health care settings. First, by sending SPs to request FP services alternating randomly between indigenous and mestizo profiles, but using the exact same script, the study design controls for potential confounders from unobserved heterogeneity among pairs in a non-experimental settings. To our knowledge this study is the first randomized controlled trial using a SP technique that assesses face-to-face interactions in clinical settings that managed to circumvent potential biases arising from unobserved heterogeneity.
Second, by implementing pre-trial and post-trial validation exercises, we assure that midwives providing FP services in Lima correctly interpreted the constructed ethnic profiles. Third, service providers were unaware of the purpose of the visit, thus avoiding the Hawthorne effect and other biases related to announcing the SPs visits that are also inherent in other data collection strategies, such as direct patient observations, provider vignettes or patient exit surveys, where the presence of an observer or interviewer allows providers to improve or modify their usual behavior. Finally, we implemented rigorous quality control procedures to standardize the enacting of ethnic profiles and in data collection. Our experiment is also unique in terms of external validity, including 702 observations covering over 85% of health establishments in Lima.
Nonetheless, our study design has several limitations that are worth noting. Controlling for Hawthorne effects and blinding service providers to the intended treatment reduces our ability to collect midwife characteristics and to know whether the same midwife provided services to both ethnic profiles. We did not attempt to identify health providers in order to guarantee no more than minimal risk to providers and as a condition for the IRB's approval of the waiver of consent. Despite this, our results show that observed characteristics in both groups were successfully balanced, suggesting the absence of systematic sorting of midwives within health establishments based on a patient’s ethnic profile.
Second, asking the same SP to alternate ethnic profiles limited us to a specific and relatively short range of the ethnoracial continuum of characteristics of women that frequently visit family planning services in Lima, as perceived by midwives (see S1–2 Fig.). It cannot be excluded that not having manipulated accent in the experiment might have moved the ethnic profiles closer to each other, even if SPs were trained to minimize the salience of the standardized accent by giving short answers and by answering only if the provider asked specific questions. Furthermore, conducting the experiment required salient and credible ethnic traits of frequent users of MoH FP services in Lima, which excluded extreme indigenous and white phenotypes. Thus, our ethnic profiles might have achieved different results had they been set further apart. That our SPs passed unnoticed during the 702 visits attests to the realism of the constructed profiles and of the SPs interpretation.
Third, we trained SPs to be verbally passive and only answer the provider when he/she asks a specific question, giving short answers, avoiding chitchat, complaints and confrontational attitudes at any service point/station. It cannot be excluded that this standardized passivity contributed to the low quality of care observed in the study.
Our findings suggest that while the quality of FP services does not differ systematically based on the ethnic profile of our SPs, interventions are needed to improve quality of care for all patients in Lima. We stress caution in extrapolating this study’s findings to the state of all ethnic disparities in FP services in Lima or other parts of the country, since we examined a specific range of the ethnoracial continuum of characteristics of women that frequently visit family planning services in Lima.
Significant debate has revolved around the question of whether ethnicity can be reliably measured given the variety of ethnic dimensions and the challenges posed by the fact that their validity is context-driven. In Peru ethnic categories are porous and the boundary between indigenous and mestizo is particularly unstable given the extended Lamarckian mutable environmental theories of heredity and the supposedly egalitarian promise of the ideology of mestizaje (racial and cultural mixture).[28,29] In this context, our study examined validly and reliably ethnic differences for a population of FP patients with low-income and education living in Lima. Further experimental research on the impact of ethnicity on the quality of care, manipulating alternative ethnic attributes, in different clinical settings and across other regions, is merited.
S1 Data. All data analyzed in this manuscript is provided in .xls format.
S1 Fig. Validation exercise to assess how indigenous are the SPs as perceived by midwives.
S2 Fig. Validation exercise to assess how often midwives provide FP services to women resembling our SPs.
S1 Protocol. Study protocol approved by the Institutional Review Board at Universidad Peruana Cayetano Heredia (English and original Spanish versions).
S1 Table. Validation exercise to assess whether midwives correctly inferred the ethnicity of the SPs.
S2 Table. Health clinics descriptive statistics reported by SPs.
S3 Table. Health provider descriptive statistics reported by SPs.
S4 Table. Differences in the technical task index using multivariate analysis.
We are grateful to Mijail Garvich, Violeta Noa and Patricia Mallma for their valuable contributions to pre- and post-trial procedures and to the acquisition and management of data. We also thank the simulated patients and monitoring personnel who collected and entered the data. Also we thank participants of the internal seminar at the IADB (Washington DC) and of the seminar ‘Exploring Ethnic Disparities in the Quality of Healthcare in Family Planning Services in Peru’ (Lima) for their useful comments. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the Inter-American Bank and its affiliated organizations, or those of the Executive Directors of Inter-American Bank or the governments they represent.
Conceived and designed the experiments: MEP PG MB CC SM HN JR MFM AM. Performed the experiments: MEP PG MB CC SM HN JR MFM AM. Analyzed the data: MEP MB SM HN JR. Contributed reagents/materials/analysis tools: MEP MB SM HN JR. Wrote the paper: MEP PG MB CC SM HN JR MFM AM. Conceived the study: AM. Discussed, critically revised, and approved the study protocol: MEP PG MB CC SM HN JR MFM AM. Were responsible for the organisation and conduct of the trial: MEP PG CC. Supervised the study: MB SM HN MFM AM. Was responsible for the statistical analysis: JR. Contributed to data analysis: MEP MB SM HN. Drafted the first version of the report: MEP MB. Discussed and approved the final version of the report for publication: MEP PG MB CC SM HN JR MFM AM.
- 1. Benavides M, Mena M, Ponce C (2010) Estado de la niñez indígena en el Perú. UNICEF, INEI. Lima. Available: http://www.unicef.org/lac/Estado_de_la_Ninez_Indigena_190810%281%29.pdf. Accessed 16 November 2013.
- 2. Valdivia M (2011) Etnicidad como determinante de la inequidad en salud materno-infantil en el Perú. In: Hernández Bello A, Rico de Sotelo C, editors. Protección social en salud en América Latina y el Caribe: investigación y políticas. Bogota: Pontificia Universidad Javeriana. pp. 121–157. pmid:25370654
- 3. Yon C (2005) Hablan las mujeres andinas: preferencias reproductivas y anticoncepción. Lima: Movimiento Manuela Ramos. 310 p. pmid:25275211
- 4. Valdivia N (2012) La discriminación en el Perú y el caso de los servicios de salud: resultados de un estudio cualitativo en el Valle del Mantaro. In: Sanborn C, editor. La discriminación en el Perú: balance y desafíos. Lima: Centro de Investigación de la Universidad del Pacífico. pp. 85–111. pmid:25593793
- 5. Smedley BD, Stith AY, Nelson AR, editors (2003) Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. Washington DC: National Academies Press. 782 p. pmid:25057689
- 6. Shavers VL, Fagan P, Jones D, Klein WMP, Boyington J, et al. (2012) The state of research on racial/ethnic discrimination in the receipt of health care. Am J Public Health 102: 953–966. pmid:22494002
- 7. Dehlendorf C, Rodriguez MI, Levy K, Borrero S, Steinauer J (2010) Disparities in family planning. Am J Obstet Gynecol 202: 214–220. pmid:20207237
- 8. Becker D, Tsui AO (2008) Reproductive health service preferences and perceptions of quality among low-income women: racial, ethnic and language group differences. Perspect Sex Reprod Health 40: 202–211. pmid:19067933
- 9. Dehlendorf C, Ruskin R, Grumbach K, Vittinghoff E, Bibbins-Domingo K, et al. (2010) Recommendations for intrauterine contraception: a randomized trial of the effects of patients’ race/ethnicity and socioeconomic status. Am J Obstet Gynecol 203: 319.e1–e319.e8. pmid:20598282
- 10. Sabin J, Nosek BA, Greenwald A, Rivara FP (2009) Physicians’ implicit and explicit attitudes about race by MD race, ethnicity, and gender. J Health Care Poor Underserved 20: 896–913. pmid:19648715
- 11. Cleland J, Conde-Agudelo A, Peterson H, Ross J, Tsui A (2012) Contraception and health. The Lancet 380: 149–156. .
- 12. Stenberg K, Axelson H, Sheehan P, Anderson I, Gülmezoglu AM, et al. (2013) Advancing social and economic development by investing in women’s and children’s health: a new Global Investment Framework. The Lancet 383: 1333–1354. .
- 13. Cáceres C, Cueto M, Palomino N (2008) Policies around sexual and reproductive health and rights in Peru: Conflict, biases and silence. Glob Public Health 3: 39–57. pmid:19288358
- 14. Ministerio de Salud (2004) Guías Nacionales de Atención Integral de la Salud Sexual y Salud Reproductiva. Lima: Ministerio de Salud; Dirección General de Salud de las Personas and Estrategia Sanitaria de Salud Sexual y Reproductiva. 272 p. pmid:18792306
- 15. Ministerio de Salud (2005) Norma Técnica de Planificación Familiar. Lima: Ministerio de Salud; Dirección General de Salud de las Personas and Estrategia Sanitaria de Salud Sexual y Reproductiva. 96 p.
- 16. Ministerio de Salud (2007) Manual de Orientación y Consejería en Salud Sexual y Reproductiva. Lima: Ministerio de Salud; Dirección General de Salud de las Personas and Estrategia Sanitaria de Salud Sexual y Reproductiva. 58 p.
- 17. Instituto Nacional de Estadística e Informática (2011) Encuesta Demográfica y de Salud Familiar 2011. Available: http://proyectos.inei.gob.pe/endes/2011/Bddatos%5CBase%20de%20Datos. Accessed 26 November 2013.
- 18. List JA, Rasul I (2011) Field Experiments in Labor Economics. In: Ashenfelter O, Card D, editors. Handbook of Labor Economics. Elsevier, Vol. Volume 4, Part A. pp. 103–228. Available: http://www.sciencedirect.com/science/article/pii/S0169721811004084. Accessed 12 June 2013.
- 19. Heckman JJ (1998) Detecting Discrimination. J Econ Perspect 12: 101–116. .
- 20. National Research Council (2004) Measuring Racial Discrimination. Washington, D.C.: The National Academies Press. 340 p.
- 21. Department of Health and Human Services (2009) Basic HHS Policy for Protection of Human Research Subjects. Code of Federal Regulations Title 45 Part 46. Available: http://www.hhs.gov/ohrp/humansubjects/guidance/45cfr46.html#46.116. Accessed 25 November 2013.
- 22. Planas ME, García PJ, Bustelo M, Carcamo CP, Ñopo HR, et al. (2014) Using standardized simulated patients to measure ethnic disparities in family planning services in Peru: Study protocol and pre-trial procedures of a crossover randomized trial. Washington, DC: Inter-American Development Bank. Available: http://publications.iadb.org/handle/11319/6387. Accessed 26 March 2014. pmid:25596557
- 23. Bradby H (2003) Describing Ethnicity in Health Research. Ethn Health 8: 5–13. pmid:12893581
- 24. Aspinall PJ (2011) The utility and validity for public health of ethnicity categorization in the 1991, 2001 and 2011 British Censuses. Public Health 125: 680–687. pmid:21907364
- 25. Wade P (1997) Race And Ethnicity In Latin America. Pluto Press. 164 p.
- 26. De la Cadena M (2000) Indigenous Mestizos: The politics of Race and Culture in Cusco, Peru, 1919–1991. Durham: Duke University Press.
- 27. Leon F, Lundgren R, Jennings V (2008) Provider selection of evidence-based contraception guidelines in service provision: A study in India, Peru, and Rwanda. Eval Health Prof: 3–21. pmid:18156443
- 28. Stepan N (1991) The Hour of Eugenics: Race, Class and Nation in Latin America. Ithaca, N.Y.: Cornell University Press. 210 p.
- 29. Portocarrero G (2007) Racismo y mestizaje y otros ensayos. Lima: Congreso del Perú. 405 p. pmid:25506957