Figures
Abstract
Perceptions of gender inequality may motivate people to take action against inequality given its negative impact on various domains of people’s everyday lives. Thus, it is crucial to develop reliable measures that consider the multidimensional nature of gender inequalities. In this research, we propose and assess the psychometric properties of the Multidimensional Gender Inequality Perception Scale (MuGIPS). This is a self-reported measure of perceived gender inequality in four domains: health, violence, household work and caregiving, and public sphere and power. Exploratory and confirmatory factor analyses were conducted to test the validity and reliability of the MuGIPS with Spanish participants in three samples (N = 1733). The analyses revealed that the MuGIPS had a good internal consistency and showed four factors associated with gender inequality in the four specified domains. Moreover, scores in all the dimensions positively correlated with feminist identity and feminist ideology, as much as with some attitudinal variables. In contrast, results showed a negative correlation with system-justifying ideologies. The MuGIPS shows adequate reliability and validity for measuring the perception of gender inequality in the health, violence, household work and caregiving, and public sphere and power domains among Spanish university and general population samples.
Citation: Schwartz-Salazar S, García-Sánchez E, Martínez R, Rodríguez-Bailón R (2024) Development and validation of the Multidimensional Gender Inequality Perception Scale (MuGIPS). PLoS ONE 19(4): e0301755. https://doi.org/10.1371/journal.pone.0301755
Editor: César Leal-Costa, Murcia University, Spain, SPAIN
Received: November 10, 2023; Accepted: March 21, 2024; Published: April 18, 2024
Copyright: © 2024 Schwartz-Salazar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript, its Supporting Information files and mentioned links in the manuscript which include data base, Supporting Information, Questionnaires and code for analysis (https://osf.io/xrds6/?view_only=644f1a013ba34bc0bc9150c1fe26f92d).
Funding: The present research was financially supported by Grant PID2022-140252NB-I00 funded by MICIU/AEI/10.13039/501100011033 and by ERDF/EU and Grant PID2019-105643GBI00 funded by MICIU/AEI/10.13039/501100011033 and by ERDF/EU, which were awarded to the last author, RRB, and grant FPU18/02033 funded by MCIN/AEI/ 10.13039/501100011033 awarded to the first author, SSS. The funders didn't play any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Gender inequalities have diminished in recent decades alongside the rise of feminist and social movements [1, 2]. Simultaneously, awareness of gender inequalities and aggressions faced by women in their daily lives has grown, exemplified by global feminist mobilizations such as “Me Too” and the Spanish movement “Hermana, yo sí te creo” (Sister, I believe you) [3, 4]. Nevertheless, gender-based inequalities, which especially affect women, persist across various domains of everyday life. International institutions and associations emphasize the imperative of reducing current inequalities and preventing the reversal of the progress made to date [1, 5]. Importantly, one factor that could hold back gender equality is people’s misperceptions of inequalities between men and women. Perceptions of inequality have been proven to be one of the main factors that motivate individuals to reduce inequality, especially economic inequality [6]. To assess similar processes regarding gender inequality, researchers need to count on reliable perceived gender inequality instruments that account for the multidimensionality of gender inequality. However, to our knowledge, there are only a few scales that focus on measuring the perception of gender inequality, without measuring at the same time other constructs, across different domains of everyday life. In addition, there are no measures of gender inequality that include the dimensions used in the most recent indexes of objective gender inequality indicators. Therefore, our research aimed to fill this gap by proposing and evaluating the psychometric properties of a new instrument, the Multidimensional Gender Inequality Perception Scale (MuGIPS), and subsequently test whether this perception is related to other variables of interest for gender inequality reduction. This instrument assesses the extent to which respondents believe gender differences exist between men and women across various domains of everyday life (health, violence, household work and caregiving, education, paid job and economics, and power and representation) within a specific society.
Gender inequality stems from stereotyped social and cultural roles and refers to the unequal treatment or opportunities given to individuals based on their gender, primarily disadvantaging women, and manifesting in various forms [7]. Thus, gender inequality is a multidimensional phenomenon that can affect various domains of everyday life. The multidimensionality of gender inequality is reflected in indicators such as the Gender Inequality Index (with three domains: reproductive health, empowerment, and the labour market [8]) and the Gender Equality Index [5], which assesses gender inequality levels in 6 core domains (work, money, knowledge, time, power, and health) and 2 additional domains (violence and intersecting inequalities).
In addition to the structural inequalities captured by indicators, perceptions of inequality can be extremely important in predicting people’s responses to inequality [6, 9–12], as well as other psychological variables related to subjective wellbeing [13, 14]. However, the literature on perceptions of inequality has mostly focused on economic disparities, often overlooking the importance of gender inequalities as a multidimensional phenomenon. Nonetheless, we believe that understanding the implications and consequences of gender inequalities across multiple domains, such as health, caregiving and household tasks, work and public life participation, and gender violence, is crucial.
Furthermore, gender-based health inequalities are noteworthy. While life expectancy for women tends to be higher compared to men, it does not necessarily indicate better overall health [15]. Medical textbooks are gender-biased [16], and women are underrepresented in the study of diseases and drug trials [17]. Additionally, there is a tendency to misdiagnose women for certain diseases usually attributed to men (see Yentl Syndrome [18]) and a lack of studies and diagnosis of diseases that specifically affect women [19]. Moreover, violence against women is another significant dimension of gender inequality, with studies highlighting higher rates of workplace harassment [20] and intimate partner violence against women compared to men [21]. In the household work and caregiving domain, women traditionally assume more caregiving responsibilities, leading to increased barriers in balancing personal and professional realms, as well as impacting leisure time and health [5, 22]. Also, it is relevant to highlight gender inequalities in domains closely tied to the traditionally male-associated public sphere, including education, paid jobs and economics, and power and representation [23]. Despite increased female enrolment in education, horizontal segregation persists in the career choices for men and women (e.g., STEM), as well as vertical segregation concerning the positions they hold within companies, organisations, and institutions [8, 24]. This inequality is also linked to the gender pay gap [25] and the underrepresentation of women in politics [26].
Regardless of the importance of multidimensionality in understanding inequality, existing measures for gender inequality perception often overlook its diverse manifestations across various domains. For instance, some instruments only consider gender inequality in a single or just a few domains, such as income gaps or occupational differences [27, 28]. Moreover, some measures consist of general quantitative questions about perceived gender inequality (e.g., “Do you think that, in general, men and women are treated equally in your country?” [29]) or employ single indicators combining different dimensions and using only a “yes/no” response format (e.g., “Do men and women enjoy equal status in their family and society?” [30]). Other instruments tend to mix perceived gender inequality with other variables focus on respondents’ personal experiences, beliefs and sexist ideologies; or account for different dimensions that do not correspond to the dimensions used in objective indexes’ indicators [31], for example, leaving aside the health dimension. Our research overcomes these limitations by providing a measure with appropriate psychometric properties that address the multidimensionality of gender inequality perceptions. In this regard, first, the MuGIPS offers a multidimensional perspective, covering classic domains such as income, socio-political representation, and unpaid caregiving work inequalities; while adding relevant domains like health, violence, and education. These dimensions align with the included in most of the recent indexes of objective gender inequality indicators. Second, we provide a valid measure for the Spanish context in which there are no similar instruments. Third, we examine the relationship between gender inequality perceptions and other relevant variables such as political attitudes and individual differences. This instrument could be used to assess how much gender inequality people perceive, and especially how much they underestimate it as much as it correlates with other variables specifically related to inequality reduction and wellbeing.
To summarize, in the current research, we aimed to (a) create a comprehensive and multidimensional instrument to measure the perceived gender inequality across various everyday life domains (i.e., health, violence, household work and caregiving, paid job and economics, education, and power and representation) and (b) test the instrument’s psychometric properties (i.e. exploring and confirming the measure’s structure, assessing the measurement invariance between men and women, and collecting evidence of the scale’s reliability and validity in the Spanish context), which implied examining the relationships between perceived gender inequality and demographics, ideological, identity, and attitudinal variables.
Methods
Participants
We conducted three studies with different samples comprised of Spanish participants (Ntotal = 1,733) aged 18 to 73 years (Mage = 27.57; SDage = 10.71), of which 59.6% were women, and 65.89% university students (see Table 1 for subsamples’ demographics; additional demographics in S1 Table).
Instruments
The measures included in this research are the following:
Multidimensional Gender Inequality Perception Scale (MuGIPS).
This measure, developed for the present research and used across the three samples, evaluates perceived gender inequality. Inspired by the Gender Equality Index by the EIGE [5], the MuGIPS was designed to cover six domains in which gender inequalities are observed (health, violence, household work and caregiving, paid job and economics, education, and power and representation). Participants indicated how often several situations of inequality occur in the context of their country. The MuGIPS has a 7-point Likert response format ranging from 1 (never) to 7 (always).
To develop this instrument, we defined the construct of perceived gender inequality as "being aware of the existence of differences between women and men in terms of roles, opportunities, and outcomes in different domains of life (health, violence, household work and caregiving, education, paid job and economics, and power and representation) within a given society" and generated an item pool. Subsequently, we submitted our definition and items to evaluation by 12 experts (66.6% women) in social psychology, inequality, gender issues and psychometrics. These experts evaluated the construct and each item’s (a) representativeness of the construct, (b) representativeness of the inequality domain, (c) degree of belonging to the selected domain, (d) understanding and (e) clarity, all using a 4-points Likert answer scale from 1 (do not agree at all) to 4 (totally agree). Considering the experts’ advice, we modified and unpacked some items and re-conceptualized some dimensions. As a result, we theoretically organized the resulting items in the mentioned six domains (health, violence, household work and caregiving, paid job and economics, education, and power and representation). Following Polit et al. [32] recommendations, we selected 30 items with a kappa value higher than .70.
Preliminary descriptive and logistic regression analyses (see S1 File) of the MuGIPS were conducted with Sample 1 to identify whether sociodemographic variables were associated with the likelihood of not responding to the items and reduce potential item bias. In this first study, we added a response option, “I prefer not to answer”. We also had a comments section where participants could indicate whether the items were understood, easy to answer, or if they had any other observations, which we used as an indication of the correct functioning of the items. We analyzed item response frequencies (see S2 Table), and combined with descriptive data we used them to detect response patterns and floor and ceiling effects. The mean scores for all items were above 2 and under 6, except for Items 6 and 8, which belong to the Violence dimension. We decided to keep these items for their conceptual, practical, and contextual relevance, given that they are related to sexual and street violence against women, two key aspects of gender inequality and gender violence highlighted in Spanish society [33]. Before conducting exploratory factorial analysis (EFA), we excluded two items because of the high response rate (> 5%) to the answer option “I prefer not to answer”(deleted items 1 and 2), one item because of its low correlation with the rest of the items on the scale (r < .300; deleted item 4), and two more items following the experts’ qualitative criteria–one of them was evaluated as too general (deleted item 5) and the content of a second one seemed to correspond to another item already included in the final selection (deleted item 3). The subsequent EFA, conducted with the 25 final items and Sample 1’s responses, revealed a four-factor structure; with the dimensions of health (r = .74, p < .001), violence (α = .90), and household work and caregiving (α = .82) well represented. The fourth factor, which was reconceptualized and renamed as “public sphere and power” (α = .95), consisted of a conglomerate of the education, economics and paid job, and public sphere and power dimensions. McDonald’s Omega for the scorings in altogether items was appropriate ωt = .97 (α = .97). To detect possible strange behaviours of the items that could affect the validity of the scores obtained, a study of the differential functioning of the items (DIF) in relation to gender and income was performed. We tested the 25 items that were finally selected using Sample 3 data. Using the Lordif package for R software [34] we observed the McFadden pseudo R2 in all items was below .02 allowing us to classify the DIF as negligible according to regular standards (< .13) [35]. The MuGIPS items are presented in Table 2 (for the original version in Spanish see S3 Table). Unless otherwise noted, all variables were calculated as mean scores of the items.
Sexism.
Sexism was measured with the Spanish version of the Ambivalent Sexism Inventory (ASI [36]), comprising 22 items grouped into two subscales: hostile sexism, which acknowledges the view that conceives women as a threat to men and upholds the superiority of men over women (e.g., Women try to gain power by controlling men), and benevolent sexism, which refers to women as fragile, precious, and morally superior compared to men (e.g., Women should be loved and protected by men; α = .92; Sample 3).
Feminist ideology.
The feminist ideology was measured through the Knowledge and Attitudes Toward Feminism scale (IMCAF [37]), an instrument developed in the Spanish context that accounts for the beliefs, knowledge, and attitudes that respondents have towards equality between men and women and feminism as a socio-political movement and ideology. This scale includes 17 items grouped in two subscales: knowledge about feminism (e.g., "Feminism" is the opposite of "machismo") and attitudes toward feminism (e.g., To me, feminism is something negative; α = .91; Sample 3).
Feminist identification.
We used a translated short version of the Multicomponent Ingroup Identification Scale [38] to measure feminist identification. As done in various research concerning the Spanish population [39], we used three items from the solidarity subscale (e.g., I feel solidarity with feminists), three items from the centrality subscale (e.g., The fact that I am a feminist is an important part of my identity), and an extra general item (i.e., I identify with feminists) to assess to what extent participants feel they are similar to feminists and how important it is to be a feminist for them (α = .96; Sample 3).
Social dominance orientation.
The social dominance orientation variable was assessed with a translated version [40] of the short SDO7 Scale by Ho et al. [41]. It is composed of 8 items that measure the endorsement of domination, acceptance of hierarchies, and preference for inequality between groups (e.g., Some groups of people are simply inferior to other groups; α = .75; Sample 3).
Meritocratic beliefs.
The meritocratic beliefs were measured with an instrument developed by Lalonde et al. [42] translated into Spanish. Participants indicated to what extent they agree with 6 different meritocratic affirmations about the belief that individual talent and effort determine the outcomes (e.g., Effort is key to success; α = .91; Sample 3).
Beliefs in a Just World.
The Belief in a Just World is a measure by Dalbert [43], that has 6 items in total measuring whether participants think people get what they deserve (e.g., In general, people get what they deserve; α = .81; Sample 3).
Attitudes towards affirmative actions.
The attitudes towards affirmative action variable was measured by using the adapted version by Moya and Expósito [44] of the Attitudes toward Affirmative Action scale [45], which includes 3 items about initiatives that promote the inclusion and wellbeing of women in the workplace and economics (e.g., Are you in favour of equal opportunity programs for women; α = .92; Sample 3).
Collective action to reduce gender inequality.
The collective action to reduce gender inequality was measured with an 8-item adaptation from the scale used by Jiménez-Moya [46]. Participants were asked: To what extent would you be willing to participate in the following action? The scale includes items such as Sign an online petition to reduce gender inequality, with higher scoring indicating greater support for mobilization to confront inequalities between men and women (α = .93; Sample 3).
The response format for all these instruments is a 7-point Likert scale, in which participants indicate the extent of their agreement with each item. This scale ranges from 1 (strongly disagree) to 7 (totally agree). For all instruments, a mean score was calculated.
Threat to men’s collective interest.
To assess the perceived threat to men’s collective interest derived from affirmative action measures we used Moya and Expósito’ [44] version of the Men’s Collective Interest scale [45]. The scale consists of 6 items divided into 3 affirmations (e.g., Affirmative action programs disadvantage men, compared to women, in terms of their chances of getting a job) and 3 questions (e.g., To what extent are you convinced that the implementation of these programs gives women greater opportunities for promotion and advancement?). For affirmations, the response ranges from 1 (totally disagree) to 7 (totally agree). For question-items, the response scale goes from 1 (not convinced at all) to 7 (totally convinced). After reverse scoring, an index with the sum of the 6 items (affirmations plus questions) was calculated. Higher scores indicate a higher sense of threat to men’s collective interest (α = .67; Sample 3).
Sociodemographics.
Finally, across the three samples, participants provided information about their gender, age, nationality, mother tongue, sexual orientation, political orientation (ranging from 1 = far-left to 7 = far-right), occupation, educational level (ranging from 1 = none to 9 = PhD), income, number of family members, and subjective socioeconomic status [47] (ranging from 1 = lowest socioeconomic status position to 10 = highest socioeconomic status position).
Procedure
Participants were reached through university e-mail services (Samples 1, 2 and 3) and social media networks (including Twitter, Instagram, WhatsApp, and Facebook; Samples 1 and 2). Samples 1 and 2 were collected concurrently between 30 November 2022 and 31 January 2023. This data was split into a group of university students (Sample 1) and a group of non-students. Sample 3 was collected from 7 to 31 March 2023. Participation in the study was voluntary and questionnaires were completed online. Participants signed an online informed consent before taking the survey and were prompted to answer the questions as honestly as possible given that there were no correct or incorrect answers. Participants entered a drawing for a 50-euro prize for responding to the survey. At the end of the questionnaire, they were debriefed and thanked for their collaboration. No identifying information was collected. These studies were approved by the Ethical Committee of the University of Granada (Approval N° 969/CEIH/2023) following the Declaration of Helsinki and were preregistered (https://osf.io/xrds6/?view_only=644f1a013ba34bc0bc9150c1fe26f92d).
Data analysis
To examine the structure of the MuGIPS, we conducted analyses on R version 4.0.4. and R Studio [48], with psych, lavaan, and sjPlot R packages [49–51].
Additionally, we performed correlation and regression analyses to test the discriminant validity of the instrument. The items for each measure across Samples were highly consistent, indicating enough reliability according to Cronbach’s alpha and McDonald’s Omega. We conducted an exploratory factor analysis (EFA) to examine the reliability and underlying dimensionality of the scale (Sample 1). Confirmatory factor analysis (CFA) was used to test the robustness of the factorial structure (Sample 2), and regression analyses were conducted to evaluate the relationships between the scale and sociodemographic and attitudinal variables, as well as model invariance. Finally, we tested the MuGIPS’ discriminant validity by conducting a correlational analysis and with the Heterotrait-Monotrait Ratio of Correlations (HTMT [52]; Sample 3).
The collected data, codebook and supporting information are available at https://osf.io/xrds6/?view_only=644f1a013ba34bc0bc9150c1fe26f92d
Results
Descriptive statistics
Table 3 displays the descriptive statistics of the items and reliability scores for Samples 1 and 2. The skewness values were generally acceptable (between -2 and +2 [53]) for all items, except for item 8 in Sample 1 (skew = - 2.20). This, together with the kurtosis of the same item in Samples 1 and 2, suggests a strong consensus regarding women being sexually assaulted to a greater extent than men in Spanish society. Similarly, an elevated kurtosis is observed for item 11 (“Women suffer more violence than men in intimate partner relationships”) in Sample 1.
Exploratory factor analysis (EFA)
The data showed suitable properties to perform EFA (KMO = .97; Bartlett’s test, χ2(300) = 12865.45 p < .001). Parallel analysis suggested a four-factor structure explaining a total of 64% of the variance across dimensions (health 9%, violence 14%, household work and caregiving 10%, and public sphere and power 30%).
A first-order EFA was conducted with Sample 1 (N = 673) using the final selection of 25 items. According to the Mardia test (Skewness = 8503.06, p < 0.001; Kurtosis = 58.12, p < 0.001), our data showed a non-normal distribution. To handle non-normality [54], we employed a robust maximum likelihood method with robust standard errors. Factor loadings for the tested items are shown in Fig 1. With the exception of item 19, saturation was equal to or higher than .40 for all items, exclusively in their respective dimensions, when using an oblimin rotation. Item 19, which addresses intersecting domains of time, domestic and labour, showed low factor loadings in the public sphere and power dimension and the household work and caregiving dimension. This could be explained by the item’s intersectional nature. Considering that the item had a greater factor load in the public sphere and power dimension, we included it in this factor.
In sample 1, the items were consistently related and provided appropriate reliability for scores in MuGIPS (α = .97; ωt = .97) according to regular standards (i.e. α > = .7, and ωt > = .7) [55, 56]. For the health dimension, consisting of two items, a correlation index was calculated (r = .74, p < .001). The violence (α = .90; ω = .90), household work and caregiving (α = .82; ω = .82), and public sphere and power dimensions (α = .95; ω = .95) demonstrated a good internal consistency. The reliability indexes for scores in each item were higher than α = .95 (see Table 3). Overall, these indexes indicate acceptable reliability.
Confirmatory factorial analysis (CFA)
The model derived from the EFA was assessed through CFA in Sample 2. A four-factor model, consisting of 25 items, was fitted using the maximum likelihood estimation with robust standard errors, not assuming a multivariate normality distribution given the Mardia test results (Skewness = 6742.44, p < 0.001; Kurtosis = 39.76, p < 0.001). As shown in Table 3, data regarding skewness and kurtosis for each item in Sample 2 did not present serious normality deviations.
To test the model’s consistency and confirm the MuGIPS’ structure, we considered the following fit indexes [57]: Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), Error of Root Mean Square Approximation (RMSEA), and Standardized Root Mean Square Residuals (SRMR). The four-factor model presents an adequate fit across all tested indices (χ2(224) = 621.064, p < .001, CFI = .953, TLI = .946, RMSEA (90% CI) = .060 (.053,—.067), SRMR = .038, AIC = 29472.2, BIC = 29684.4); and showed better adjustment than the single-factor model and second-order factor model (see S4 Table), confirming the structure proposed by the EFA.
Measurement invariance
To assess the invariance of our model, we looked at adjustment indices for different models, using the four-factor model confirmed with Sample 2 as the base model (see Fig 2). Subsequently, we tested the adjustment for men and women separately, followed by configural and metric invariance tests. As recommended by Cheung and Rensvold [58], none of the four models tested and compared to the base model had a change greater than .01 in CFI. This implies that the model’s structure and loading pattern are consistent for both men and women, with each item contributing similarly to the latent construct in both groups (see Table 4). We did not find scalar invariance between men and women, possibly due to the nature of the measured construct, in which women are expected to score differently because of their experienced gender-based inequality and discrimination.
Correlates of the MuGIPS
We employed a Multiple Indicators of Multiple Causes (MIMIC) model, using age, gender, political orientation, income, subjective socioeconomic status, and educational level as predictors of the four MuGIPS factors. We found that women and left-wing supporters had a higher perception of gender inequality regarding health (Bgender = .57, p < .001, CI95% [.316, .820]; Bpolitical orientation = -.39; p < .001; CI95% [-.469, -.318]), public sphere and power (Bgender = .65; p < .001; CI95% [.446, .864]; Bpolitical orientation = -.34; p < .001; CI95% [-.417, -.263]), and household work and caregiving (Bgender = .49; p < .001; CI95% [.304, .680]; Bpolitical orientation = -.23; p < .001; CI95% [-.306, -.152]). Lastly, scores in the violence dimension were higher for younger people (Bage = -.01; p = .003; CI95% [-.019, -.004]), women (Bgender = .34; p < .001; CI95% [.159, .514]), people leaning toward left-wing political orientation (Bpolitical orientation = -.28; p < .001; CI95% [-.345, -.210]) and those with higher income (Bincome = .04; p = .025; CI95% [.004, .067]).
Relationship with other variables and discriminant validity
To obtain further evidence of the MuGIPS’s validity, we conducted a series of bivariate correlations between the total scale score and the subfactors scores with various ideological, identity, attitudinal, and demographic variables. As shown in Table 5, all dimensions of the MuGIPS positively correlated with each other and the total score. Additionally, these dimensions and total scoring negatively correlated to ambivalent sexism, beliefs in a just world (BJW), social dominance orientation (SDO), meritocratic beliefs, and threat to men’s collective interest by affirmative action. Moreover, all dimensions of perceived gender inequality negatively correlated with participants’ political orientation, indicating that left-wing voters tended to perceive more gender inequality. However, the MuGIPS and each of its dimensions positively correlated with feminist ideology and feminist identity, support for collective action to reduce gender inequality, attitudes towards affirmative action, subjective socioeconomic status, and gender. Regarding age, it negatively correlated only with the violence dimension,–i.e., younger participants perceive higher gender inequality regarding the violence men and women experience. Respondents’ income negatively correlated with all perceived gender inequality dimensions except for the health domain. Finally, the educational level did not correlate significantly with any of the MuGIPS scores. We calculated the mean differences in the MuGIPS by the categorical demographics (gender, sexual orientation, educational level and family annual income; See S2 File). We found that women perceive gender inequality to a greater extent than men. Bisexual people also perceive more gender inequality than heterosexual people. Lastly, people with lower incomes are more sensitized than people with somewhat higher annual incomes.
Given the high correlations found between the MuGIPS and the rest of the measured variables, we implemented an additional discriminant validity test by using the Heterotrait-Monotrait Ratio of Correlations (HTMT) [52]. All HTMT indexes were lower than .85, the threshold suggested in the literature [59–61] to assume that gender inequality perception as measured by the MuGIPS was different from ambivalent sexism (HTMT = .48), feminist ideology (HTMT = .69), feminist identity (HTMT = .71), support for collective action to confront gender inequality (HTMT = .76), attitudes towards affirmative action (HTMT = .74) and threat to men’s collective interest (HTMT = .75). This is, perceived gender inequality measured by the MuGIPS differs from other similar constructs already validated in the psychosocial literature.
Discussion
Research on inequality perception has primarily focused on perceived economic inequality, showing the relevance of the perceptions of inequality [6] in relation to support for its reduction [9] as well as ideological [62, 63] and wellbeing variables [13, 14]. However, research specifically addressing the perception of gender inequality itself is sparser. Existing studies are approached either from a qualitative or a quantitative perspective but are limited to the study of only some of the domains in which inequality occurs [27–29] or use a dichotomous response scale [30]. Moreover, some studies examine the perception of gender inequality but intermingled with other constructs such as sexism [31]. As a result, the findings obtained from such studies cannot be solely attributed to the perception of gender inequality. Additionally, they often do not include the various domains in which inequality manifests, or the results are not easily comparable either among participants or to the dimensions included in the objective indicators.
The main aim of the present research was to address a gap in the literature by introducing the Multidimensional Gender Inequality Perception Scale (MuGIPS), a novel instrument with robust psychometric properties for both women and men, which assesses gender inequality perception in the Spanish context. The MuGIPS comprises 25 items that evaluate various domains in which gender inequality is observed including health, violence, household work and caregiving, and public sphere and power (education, paid job and economics, and power and representation). These domains correspond to the dimensions established in some of the most complete objective indicators of gender inequality available to date [5].
The MuGIPS demonstrated strong evidence of content validity, internal validity, and validity based on its relationships with other variables. Content validity was assessed through an expert panel evaluation of the construct and the items, whereas internal validity was confirmed through EFA and CFA, following the classical test theory [64]. The analyses confirmed the internal structure of the scale, which consists of four factors. Three factors (health, violence, and household work and caregiving) have been theorized since the beginning of the instrument construction. The fourth factor emerged as a conglomerate of the theorized dimensions of education, paid jobs and economics, and power and representation. This conglomerate was reconceptualized and renamed the “public sphere and power” domain, corresponding to the historical division between the public and private spheres that feminism has long criticised [65].
The four factors identified through the EFA and confirmed in the CFA largely account for the variance in the participants’ responses. Additionally, the scale showed good fit indices and adequate internal consistency. Regarding the equivalence for both women and men, our data demonstrated metric and configural invariance. The lack of scalar invariance could be attributed to the nature of the construct, as gender inequality tends to affect women more significantly and harshly. Thus, as expected and confirmed by our data, women perceive more gender inequality, possibly due to their increased exposure to and impact from it [15], or because of women’s higher empathy and prosocial behaviour under certain conditions [66–68]. In this regard, the MIMIC model indicates that women and left-wing political leanings perceive more gender inequality across domains, and younger people perceive more gender inequality in the violence domain specifically. Age differences could account for the ability of the wide variety of recent awareness-raising campaigns, interventions, and laws [69–71] developed against gender violence to resonate with young people. However, it is still important to include other areas of gender inequality in these policies and interventions, which are also, in general, less known and less perceived. For its part, correlations between political orientation and feminism have been extensively documented. Even though feminist beliefs are not necessarily an intrinsic belief of left-wing movements, nor are feminist orientations only necessarily based on left-wing political orientation (see neoliberal feminism [72]; feminist identification and other feminism-related variables are frequently strongly associated with left-wing voters and more liberal political orientations (vs. conservative) [73] as our results also demonstrate.
We further enhanced the MuGIPS’s validation through its relationships with various validated instruments of diverse natures (ideological, identity, attitudinal, and sociodemographic). Notably, there was a positive relationship between the MuGIPS and feminist identification and ideology, as well as support for collective action to confront gender inequality and affirmative action measures. These results, together with the negative relationship between MuGIPS scores and system-justifying ideologies (meritocratic beliefs, SDO, and BJW) and age, show a strong consistency between perceived gender inequality levels and participants’ belief systems. These findings highlight the potential significance of perceived gender inequality in reducing gender inequality, akin to findings in studies on perceived economic inequality [62]. Moreover, it empirically reinforces the idea of perceived gender inequality as a characteristic closely related to feminism [74], highlighting the idea of feminism and gender inequality awareness as streams of social change (vs. system-justifying ideologies) and challenges to the status quo [75].
In summary, our manuscript contributes to the existing knowledge on perceptions of gender inequality by addressing previous gaps in the literature in at least three key ways. First, it provides a new instrument designed to assess perceived gender inequality: the MuGIPS. The scale focuses on gender inequality in four domains (health, violence, household work and caregiving, and power and public sphere), advancing shortcomings detected in previous scales that mix perceived gender inequality with other constructs or do not account for the dimensions affected by gender inequality. Thus, MuGIPS can help researchers to assess perceptions of gender inequality more accurately from a broader perspective. Second, the scale’s psychometric properties were robust across samples including, men and women, university students, and the general population. Thus, the scale is reliable for measuring gender inequality perceptions across different social groups. Additionally, to our knowledge, the MuGIPS is the first instrument with these characteristics to be fully developed in Spanish and following the open science principles. Third, we demonstrate that gender inequality perception differs from other relevant variables concerning gender issues, such as feminist ideology and identification or support for collective action. In this line, the MuGIPS could expand the knowledge regarding gender inequality perception by providing a reliable measure to assess gender inequality awareness and be useful for assessing the effectiveness of interventions promoting gender equality.
As a limitation, it is important to note that although factorially and in terms of reliability, the scale seems to behave adequately, there is a certain imbalance between the representation of each domain within the instrument. For example, the health dimension finally had only two items, which could compromise to some extent the reliability of this dimension. Moreover, future studies may use a test-retest approach to strengthen the reliability and reproducibility of the scores, as much as Item Response Theory to delve deeper item discrimination and generalizability. Nevertheless, the development and validation of the MuGIPS could contribute to a holistic study of gender inequalities by encompassing different domains in which gender inequality can be observed using respondents’ perceptions of inequality within the society and social circles in which they reside as a reference. The current research, with its potential impact on inequality reduction, could inspire future studies, especially given the link between perceived gender inequality and support for collective action. Forthcoming research could evaluate factors that promote perceptions of gender inequality as measured by the MuGIPS and other factors such as emotions [76] or attitudes toward empowerment [77], that may enhance the relationship between the MuGIPS and actions to reduce gender inequality in different settings. Thus, given the dramatic consequences of gender inequality [15–26], we believe that this instrument might be relevant to developing and improving intervention strategies to increase awareness of gender inequality and, especially, evaluate its effectiveness. Moreover, measuring various variables and selecting different outcomes related to gender inequality, as well as other psychosocial phenomena such as subjective wellbeing, status anxiety, or motivation to address gender and other inequalities, would help provide more information regarding the place of gender inequality perception, and therefore our instrument, in the nomological network [78]. It would also be necessary to explore the relationship between the levels of perceived inequality and levels of actual gender inequality. Future studies could explore the validation of the scale in English and other languages, as well as its adaptation to various cultural contexts, fostering cross-national and cross-cultural understanding of gender inequality perception.
In conclusion, the MuGIPS not only represents a significant step forward in understanding gender inequality perceptions, but also includes factors that have been largely overlooked (e.g., health) and have now been identified as sources of inequality. Additionally, the instrument has been validated in the Spanish context, offering a valuable contribution beyond the traditionally dominant Anglo-centric research landscape.
Supporting information
S1 Table. Characteristics and sociodemographic data of Samples 1–3.
https://doi.org/10.1371/journal.pone.0301755.s001
(PDF)
S2 Table. Frequencies in item response for Samples 1 and 2.
https://doi.org/10.1371/journal.pone.0301755.s002
(PDF)
S3 Table. Final version of the MuGIPS’ items in Spanish (original).
https://doi.org/10.1371/journal.pone.0301755.s003
(PDF)
S4 Table. Adjustment indexes for models tested with Confirmatory Factor Analysis (CFA).
https://doi.org/10.1371/journal.pone.0301755.s004
(PDF)
S2 File. Mean differences in MuGIPS by demographics.
https://doi.org/10.1371/journal.pone.0301755.s006
(PDF)
References
- 1.
United Nations. The Sustainable Development Goals Report 2022 [Internet]. UNStats 2022. [Cited 2023 Ago 21]. Available from: https://unstats.un.org/sdgs/report/2022/
- 2. UNICEF. Gender equality: Equal rights and opportunities for girls and boys help all children fulfil their potential. [Internet]. [cited 2023 Ago 21]. Available from: https://www.unicef.org/gender-equality
- 3. Abrisketa OG, Abrisketa MG. “It’s Okay, Sister, Your Wolf-Pack Is Here”: Sisterhood as Public Feminism in Spain. Signs: Journal of Women in Culture and Society 2020;45(4):931–953. https://doi.org/10.1086/707801
- 4. Jaffe AE, Cero I, DiLillo D. The #MeToo movement and perceptions of sexual assault: College students’ recognition of sexual assault experiences over time. Psychol Violence 2021;11(2):209–218. pmid:34970465
- 5. European Institute for Gender Equality. Gender Equality Index. [Internet] 2021. [Cited 2023 Ago 21]. Available from: https://eige.europa.eu/gender-equality-index/2021
- 6. Willis GB, García-Sánchez E, Sánchez-Rodríguez Á, García-Castro JD, Rodríguez-Bailón R. The psychosocial effects of economic inequality depend on its perception. Nature Reviews Psychology 2022;1(5):301–309.
- 7.
Lorber J. Gender inequality. Feminist theories and politics. Los Angeles, CA: Roxbury; 2001.
- 8.
United Nations Human Development Reports. Gender Inequality Index (GII). [Internet] [cited 2023 Sep 1]. Available from: https://hdr.undp.org/data-center/thematic-composite-indices/gender-inequality-index#/indicies/GII
- 9. García-Castro JD, Rodríguez-Bailón R, Willis GB. Perceiving economic inequality in everyday life decreases tolerance to inequality. J Exp Soc Psychol 2020;90:104019. https://doi.org/10.1016/j.jesp.2020.104019
- 10. Gimpelson V, Treisman D. Misperceiving inequality. Economics & Politics 2018;30(1):27–54. https://doi.org/10.1111/ecpo.12103
- 11. Hauser OP, Norton MI. (Mis)perceptions of inequality. Curr Opin Psychol 2017;18:21–25. pmid:29221507
- 12. Jetten J, Peters K, Álvarez B, et al. Consequences of Economic Inequality for the Social and Political Vitality of Society: A Social Identity Analysis. Polit Psychol 2021;42(S1):241–266. https://doi.org/10.1111/pops.12800
- 13. Vezzoli M, Valtorta RR, Mari S, Durante F, Volpato C. Effects of objective and subjective indicators of economic inequality on subjective well-being: Underlying mechanisms. J Appl Soc Psychol 2023;53(2):85–100. https://doi.org/10.1111/jasp.12928
- 14. Melita D, Rodríguez-Bailón R, Willis GB. Does income inequality increase status anxiety? Not directly, the role of perceived upward and downward mobility. British Journal of Social Psychology 2023;62(3):1453–1468. pmid:36929602
- 15.
Criado Perez C. Invisible women: Data bias in a world designed for men. New York: Abrams Press; 2019.
- 16. Dijkstra AF, Verdonk P, Lagro-Janssen ALM. Gender bias in medical textbooks: examples from coronary heart disease, depression, alcohol abuse and pharmacology. Med Educ 2008;42(10):1021–1028. pmid:18761614
- 17. Marts SA, Keitt S. Foreword: a historical overview of advocacy for research in sex-based biology. 2004; p. v–xiii. https://doi.org/10.1016/S1569-2558(03)34024-X
- 18. Healy B. The Yentl Syndrome. New England Journal of Medicine 1991;325(4):274–276. https://doi.org/10.1056/nejm199107253250408
- 19. Hudson N. The missed disease? Endometriosis as an example of ‘undone science’. Reprod Biomed Soc Online 2022;14:20–27. https://doi.org/10.1016/j.rbms.2021.07.003
- 20. International Labour Organization. Experiences of violence and harassment at work [Internet]. 2022 [Cited 2023 Sep 8]. 54 p. https://doi.org/10.54394/IOAX8567
- 21.
Reidy DE , D’Inverno AS, Bogen KW, Swahn MH, Jacobs GM. Masculinity and Violence Against Women from a Social-Ecological Perspective: Implications for Prevention. In: Handbook of Interpersonal Violence and Abuse Across the Lifespan. Cham: Springer International Publishing, 2022; p. 2353–2374. https://doi.org/10.1007/978-3-319-62122-7
- 22. Cerrato J, Cifre E. Gender Inequality in Household Chores and Work-Family Conflict. Front Psychol 2018;9. pmid:30123153
- 23. Prokhovnik R. Public and Private Citizenship: From Gender Invisibility to Feminist Inclusiveness. Fem Rev 1998;60(1):84–104. https://doi.org/10.1080/014177898339406
- 24.
Clarke HM. Gender Stereotypes and Gender-Typed Work. In: Zimmermann K, editor. Handbook of Labor, Human Resources and Population Economics. Cham: Springer International Publishing, 2020; p. 1–23. https://doi.org/10.1007/978-3-319-57365-6_21-1
- 25. United Nations. UN News: Closing gender pay gaps is more important than ever [Internet]. 2022.[Cited 2023 Sep 1]. Available from: https://news.un.org/en/story/2022/09/1126901
- 26. UN Women. Facts and figures: Women’s leadership and political participation [Internet] 2023. [Cited 2023 Sep 5]. Available from: https://www.unwomen.org/en/what-we-do/leadership-and-political-participation/facts-and-figures
- 27. Davis NJ, Robinson R V. Men’s and Women’s Consciousness of Gender Inequality: Austria, West Germany, Great Britain, and the United States. Am Sociol Rev 1991;56(1):72.
- 28. Ngo H, Foley S, Wong A, Loi R. Who gets more of the pie? Predictors of perceived gender inequity at work. Journal of Business Ethics 2003;45(3):227–241. https://doi.org/10.1023/A:1024179524538
- 29.
Wulansari SA. Gender inequality perception: A comparative study of women in Japan and Indonesia. Research & Information Center of Asian Studies (RICAS). 2013. https://ricas.ioc.u-tokyo.ac.jp/aasplatform/achivements/pdf/2013_ab_16.pdf
- 30. Zhang J, Xu H. The Effects of Religion, Superstition, and Perceived Gender Inequality on the Degree of Suicide Intent: A Study of Serious Attempters in China. OMEGA—Journal of Death and Dying 2007;55(3):185–197. pmid:18214067
- 31. Gurieva SD, Kazantseva T V, Mararitsa L V, Gundelakh OE. Social Perceptions of Gender Differences and the Subjective Significance of the Gender Inequality Issue. Psychology in Russia: State of the Art [homepage on the Internet] 15(2):2022. Available from: pmid:36699713
- 32. Polit DF, Beck CT, Owen S V. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health 2007;30(4):459–467. pmid:17654487
- 33. Ferrer-Perez VA, Delgado-Alvarez C, Sánchez-Prada A, Bosch-Fiol E, Ferreiro-Basurto V. Street sexual harassment: experiences and attitudes among young Spanish people. Int J Environ Res Public Health. 2021;18(19):10375. https://www.mdpi.com/1660-4601/18/19/10375 pmid:34639675
- 34. Choi SW, Gibbons LE, Crane PK. lordif: An R Package for Detecting Differential Item Functioning Using Iterative Hybrid Ordinal Logistic Regression/Item Response Theory and Monte Carlo Simulations [Internet]. J Stat Softw. 2011;39. http://www.jstatsoft.org/
- 35.
Zumbo BD. A handbook on the theory and methods of differential item functioning (DIF). Ottawa: National Defense Headquarters; 1999.
- 36. Expósito F, Moya MC, Glick P. Sexismo ambivalente: medición y correlatos. Rev Psicol Soc 1998;13(2):159–169.
- 37. García Jiménez M, Cala Carrillo MJ, Trigo Sánchez ME. Conocimiento y actitudes hacia el feminismo [Knowledge and attitudes toward feminism]. FEMERIS: Revista Multidisciplinar de Estudios de Género 2016;1(1/2):95–112. https://e-revistas.uc3m.es/index.php/FEMERIS/article/view/3229
- 38. Leach CW, Zomeren M van, Zebel S, et al. Group-level self-definition and self-investment: A hierarchical (multicomponent) model of in-group identification. J Pers Soc Psychol 2008;95(1):144–165. pmid:18605857
- 39. Estevan-Reina L, Lemus S de, Megías JL. Feminist or Paternalistic: Understanding Men’s Motivations to Confront Sexism. Front Psychol 2020;10. pmid:32010028
- 40. Silván-Ferrero M del P, Bustillos A. Adaptación de la escala de orientación a la dominancia social al castellano: Validación de la Dominancia Grupal y la Oposición a la Igualdad como factores subyacentes. Rev Psicol Soc 2007;22(1):3–15. http://dx.doi.org/10.1174/021347407779697485
- 41. Ho AK, Sidanius J, Kteily N, et al. The nature of social dominance orientation: Theorizing and measuring preferences for intergroup inequality using the new SDO₇ scale. J Pers Soc Psychol 2015;109(6):1003–1028. https://doi.org/10.1037/pspi0000033
- 42. Lalonde RN, Doan L, Patterson LA. Political Correctness Beliefs, Threatened Identities, and Social Attitudes. Group Processes & Intergroup Relations 2000;3(3):317–336. https://doi.org/10.1177/1368430200033006
- 43. Dalbert C. The world is more just for me than generally: About the personal belief in a just world scale’s validity. Soc Justice Res 1999;12(2):79–98. :1022091609047
- 44. Moya M, Expósito F. Nuevas formas, viejos intereses: neosexismo en varones españoles. [New ways, old interests: neosexism in Spanish men]. Psicothema 2001;13(4):643–649. https://www.psicothema.com/pi?pii=492
- 45. Tougas F, Brown R, Beaton AM, Joly S. Neosexism: Plus Ça Change, Plus C’est Pareil. Pers Soc Psychol Bull 1995;21(8):842–849. https://doi.org/10.1177/0146167295218007
- 46. Jiménez-Moya G. Challenging social inequality: different routes to resistance in the face of in-group legitimization. 2014. https://doi.org/10.1177/0146167295218007
- 47. Adler NE, Epel ES, Castellazzo G, Ickovics JR. Relationship of subjective and objective social status with psychological and physiological functioning: Preliminary data in healthy white women. Health Psychology 2000;19(6):586–592. pmid:11129362
- 48.
R Core Team. R: A language and environment for statistical computing (Version 4.2.3) [Statistical Software]. Vienna, Austria: R Foundation for Statistical Computing; 2022. Available form: https://www.R-project.org/
- 49. Lüdecke D. sjPlot: Data Visualization for statistics in Social Science. [R package version 2.8.13]. 2023. Available from: https://CRAN.R-project.org/package=sjPlot
- 50. Revelle W. psych: Procedures for Psychological, Psychometric, and Personality Research. [R package version 2.3.3]. 2023. Available from: https://CRAN.R-project.org/package=psych
- 51. Rosseel Y. lavaan: An R Package for Structural Equation Modeling. J Stat Softw 2012;48(2). https://doi.org/10.18637/jss.v048.i02
- 52. Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Mark Sci. 2015;43:115–135. https://doi.org/10.1007/s11747-014-0403-8
- 53.
Gravetter FJ, Wallnau LB. Statistics for the behavioral sciences. Boston, MA: Cengage Learning; 2017.
- 54.
Brown TA. Confirmatory factor analysis for applied research. New York: The Guilford Press; 2015.
- 55. Streiner DL. Starting at the beginning: An introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80(1):99–103. pmid:12584072
- 56. McNeish D. Thanks coefficient alpha, we’ll take it from here. Psychol Methods. 2018 Sep 1;23(3):412–33. pmid:28557467
- 57. Abad F, Olea J, Ponsoda V, García C. Medición en ciencias sociales y de la salud [Measurement in social and health sciences]. Síntesis, 2011.
- 58. Cheung GW, Rensvold RB. Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Struct Equ Modeling 2002;9(2):233–255. https://doi.org/10.1207/S15328007SEM0902_5
- 59. Gold AH, Malhotra A, Segars AH. Knowledge Management: An Organizational Capabilities Perspective. J Manag Inf Syst. 2001;18(1):185–214. https://doi.org/10.1080/07421222.2001.11045669
- 60. Teo TSH, Srivastava SC, Jiang L. Trust and electronic government success: An empirical study. Journal of Management Information Systems. 2008;25(3):99–132. https://doi.org/10.2753/MIS0742-1222250303
- 61.
Kline RB. Principles and Practice of Structural Equation Modeling. Guilford Publications; 2023.
- 62. García-Sánchez E, Toorn J Van der, Rodríguez-Bailón R, Willis GB. The Vicious Cycle of Economic Inequality: The Role of Ideology in Shaping the Relationship Between “What Is” and “What Ought to Be” in 41 Countries. Soc Psychol Personal Sci 2019;10(8):991–1001. http://doi.org/10.1177/1948550618811500
- 63. Rodriguez-Bailon R, Bratanova B, Willis GB, Lopez-Rodriguez L, Sturrock A, Loughnan S. Social Class and Ideologies of Inequality: How They Uphold Unequal Societies. Journal of Social Issues. 2017; 73(1):99–116. http://doi.wiley.com/10.1111/josi.12206
- 64.
Bandalos DL, Little TD. Measurement theory and applications for the Social Sciences. New York, N.Y: The Guilford Press; 2018.
- 65. Gavison R. Feminism and the Public/Private Distinction. Stanford Law Rev 1992;45(1):1. https://doi.org/10.1207/S15328007SEM0902_5
- 66. Espinosa MP, Kovářík J. Prosocial behavior and gender. Front Behav Neurosci 2015;9. pmid:25926783
- 67. Löffler CS, Greitemeyer T. Are women the more empathetic gender? The effects of gender role expectations. Current Psychology 2023;42(1):220–231.
- 68. Xiao SX, Hashi EC, Korous KM, Eisenberg N. Gender differences across multiple types of prosocial behavior in adolescence: A meta‐analysis of the prosocial tendency measure‐revised (PTM‐R). J Adolesc 2019;77(1):41–58. pmid:31648167
- 69.
Organic Act of Protection Measures against Gender Violence. 2009. https://violenciagenero.igualdad.gob.es/definicion/pdf/Ley_integral_ingles.pdf
- 70.
Government office against gender-based violence for a society free of gender-based violence [Internet]. [cited 2024 Feb 1]. Available from: https://violenciagenero.igualdad.gob.es/en/sensibilizacionConcienciacion/home.htm
- 71. Wathen CN, MacMillan HL. Interventions for Violence Against Women: Scientific Review. JAMA. 2003;289(5):589–600. pmid:12578492
- 72. Rottenberg C. The Rise of Neoliberal Feminism. Cultural Studies 2014;28(3):418–437. https://doi.org/10.1080/09502386.2013.857361
- 73. Bettencourt KEF, Vacha-Haase T, Byrne ZS. Older and Younger Adults’ Attitudes Toward Feminism: The Influence of Religiosity, Political Orientation, Gender, Education, and Family. Sex Roles 2011;64(11–12):863–874. https://doi.org/10.1007/s11199-011-9946-z
- 74. Klatch RE. The formation of feminist consciousness among left and right wing activists of the 1960s. Gender & Society 2001;15(6):791–815. https://www.jstor.org/stable/3081903
- 75. Mikołajczak G, Becker JC, Iyer A. Women who challenge or defend the status quo: Ingroup identities as predictors of progressive and reactionary collective action. Eur J Soc Psychol 2022;52(4):626–641. https://doi.org/10.1002/ejsp.2842
- 76. Iyer A, Ryan MK. Why do men and women challenge gender discrimination in the workplace? The role of group status and in-group identification in predicting pathways to collective action. Journal of Social Issues 2009;65(4):791–814. https://doi.org/10.1111/j.1540-4560.2009.01625.x
- 77. Hamza Shuja K, Aqeel M, Raza Khan K. Psychometric development and validation of attitude rating scale towards women empowerment: across male and female university population in Pakistan. 5(2020):405–420.
- 78. Cronbach LJ, Meehl PE. Construct Validity in Psychological Tests. Psychol Bull 1955;52(4):281. pmid:13245896