Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Exploring inclusiveness towards immigrants as related to basic values: A network approach

  • Hadi Sam Nariman ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    hadi.sam.nariman@ppk.elte.hu

    Affiliations Doctoral School of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary, Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary

  • Lan Anh Nguyen Luu,

    Roles Supervision

    Affiliation Faculty of Education and Psychology, ELTE Eötvös Loránd University, Budapest, Hungary

  • Márton Hadarics

    Roles Supervision

    Affiliation Department of Social Psychology, ELTE Eötvös Loránd University, Budapest, Hungary

Abstract

Using the 9th round of European Social Survey (ESS), we explored the relationship between Europeans’ basic values and their attitudes towards immigrants. Employing a latent class analysis (LCA), we classified the respondents based on three items capturing the extent to which participants would support allowing three groups of immigrants to enter and live in their countries: immigrants of same ethnic groups, immigrants of different ethnic groups, and immigrants from poorer countries outside Europe. Four classes of Europeans with mutually exclusive response patterns with respect to their inclusive attitudes towards immigrants were found. The classes were named Inclusive (highly inclusive), Some (selective), Few (highly selective), and Exclusive (highly exclusive). Next, using a network technique, a partial correlation network of 10 basic human values was estimated for each class of participants. The four networks were compared to each other based on three network properties namely: global connectivity, community detection, and assortativity coefficient. The global connectivity (the overall level of interconnections) between the 10 basic values was found to be mostly invariant across the four networks. However, results of the community detection analysis revealed a more complex value structure among the most inclusive class of Europeans. Further, according to the assortativity analysis, as expected, for the most inclusive Europeans, values with similar motivational backgrounds were found to be interconnected most strongly to one another. We further discussed the theoretical and practical implications of our findings.

Introduction

Immigration is still among the most controversial topics in the Western political sphere. On the one hand, right-wing parties and populist leaders center their rhetoric around anti-immigration sentiments (see e.g., [1,2]), and on the other hand, anti-immigration attitudes are a significant motive behind supporting and voting for right-wing parties (e.g., [36]). In recent years, the number of immigration-related research has significantly increased, perhaps partly due to the above-mentioned reasons.

The interplay between a variety of contextual and individual level factors has been argued to explain anti-immigrant attitudes and opposition to immigration. Poor economic condition of the host society [7], anti-immigration media portrayals [810], immigration-related restrictive policies [11,12], regional origin of migrants [13], and immigrants’ actual population size [14] are among the contextual factors on mobilizing anti-immigrant attitudes. Among the individual level predictors of anti-immigrant attitudes are perceived economic threat and competition [15,16], perceived cultural threat [17,18], perceived threat vis-à-vis safety and security [1921], nativist perception of national identity [22,23], ideological orientations such as right-wing authoritarianism and social dominance orientation [24], stereotypical judgements [25,26], low degrees of personality traits such as openness to experience and agreeableness[27], perceived size of immigrants’ population [28], low degree of interpersonal trust [29,30], and low degree of trust in national institutions [31] (for an overview see also [32]). Furthermore, tapping into a more positive aspect of immigration, it is noteworthy that groups of immigrants who are economically and culturally perceived as less threatening and more beneficial (e.g., immigrants from western societies vs. asylum seekers) receive more positive evaluations from the members of the host society [33,34].

In addition to the factors outlined above, it is also well-documented that the individual differences on basic personal values are strongly related to the endorsement of positive or negative attitudes and behaviors towards minority group members in general and immigrants in particular (see below). In the present study, using nationally representative samples, we draw on Schwartz’s [35] well-established and cross-culturally validated [36] value map, as related to Europeans’ inclusive attitudes towards immigrants. By inclusive attitudes, we mean the extent to which one would support allowing three groups of immigrants to enter their country—immigrants of same ethnic groups, immigrants of different ethnic groups, and immigrants from poorer countries outside Europe.

Applying a network method, the objective of this study is to explore and compare the dynamic structure of the basic personal values held by different classes of Europeans with qualitatively different inclusive attitudes towards immigrants. Our study, therefore, comprises two analytical phases. First, a person-centered method (latent class analysis) is applied for the classification of the respondents. Second, partial correlation networks are estimated to further investigate the dynamic structure of the basic personal values for each distinct class found in the first phase of the analyses. Below we discuss the relationship between personal values and attitude towards immigrants as well as both of the analytical approaches in more detail.

Basic personal values and anti-immigrant attitudes

Values are defined as “desirable transsituational goals, varying in importance, that serve as guiding principles in the life of a person or other social entity” [37, p. 21]. They are abstract and superordinate standards that determine individuals’ worldviews, attitudes, and behaviors in a vast array of more specific situations and contexts [35,38]. Schwartz [35], proposes a comprehensive value system into a circular dynamic of 10 basic personal values, representing the adjacent values capturing more similar motivational states and the values distant from each other to be motivationally more dissimilar or even antagonistic (see Fig 1, adapted from [39]).

thumbnail
Fig 1. Schwartz value circle depicting the relations between 10 values and several value groupings [35,40].

https://doi.org/10.1371/journal.pone.0260624.g001

The circumplex structure of the Schwartz’s values allow them to be categorized into 4 higher-order value types; Openness to change (Hedonism, Stimulation, Self-direction), Conservation (Security, Conformity, Tradition), Self-Transcendence (Universalism, Benevolence), and Self-Enhancement (Achievement, Power) (See supplementary material for the conceptual definitions of the 10 basic values). A pair of opposing value types (openness to change vs. conservation and self-enhancement vs. self-transcendence); in turn form two higher-order dimensions of values. Openness to change values focus on independence and seeking new experience and ideas in life, opposing conservation values that refer to the motivational goals of protecting social norms and traditions. On the other dimension, self-transcendence values tap into the well-being of other people, opposing self-enhancement values that focus on one’s own personal interests and welfare [35]. The 10 basic values can also be grouped into two other alternative higher-order value dimensions. Either as Social Focus (self-transcendence, conservation) versus Personal Focus (openness to change and self-enhancement), or Self-Protection (self-enhancement, conservation) versus Growth (openness to change, self-transcendence) [40]. In what follows, the emphasis of this article is on the latter distinction, between self-protection and growth categories, as two motivationally opposing higher-order value types.

Furthermore, empirical investigations have well-documented that self-protection value types positively and growth value types negatively relate to anti-immigrant attitudes (see e.g., [34,4145]).

Person-centered approach

Person-centered methods treat the individuals and not the variables as the units of analysis. This allows researchers to raise questions which cannot be answered by the more traditional variable-centered methods. By having at least two indicators (i.e., observed variables), it is possible to investigate whether there exist unobserved latent classes or subgroups of individuals whose response patterns are unique and qualitatively distinct from each other [46]. Classifying respondents into a set of mutually exclusive classes, for example, makes it possible to investigate what factors precede class membership, what the consequences are, and how class membership relates to demographic as well as contextual correlates. Person-centered methods can be especially useful and highly informative as long as the data represent the corresponding population. By a representative sample one would be more confident that the nature of the classes as well as their association with other constructs correspond to those of the population of interest (For an overview on person-centered approach in social psychological research see [47]). A person-centered method, therefore, is suitable for the first phase of our analyses. That whether there exist distinct classes of Europeans with meaningfully different response patterns regarding their inclusive attitudes towards the three groups of immigrants.

Person-centered methods have been recently applied in intergroup relation research. For example, Adelman and Verkuyten [48], found four distinct profiles with combinations of prejudice against Muslims and the level of participants’ tolerance on different Muslim practices (e.g., celebrating Islamic holidays in public). Through a variable-centered method, for instance, it was possible to regress the acceptance of Muslim practices on prejudice against Muslims. By a person-centered method, apart from finding profiles of people who were both prejudiced and against Muslim practices, they also found profiles of respondents who objected against some Muslim practices while not being particularly prejudiced. Another example is a study by Sibley et al. [49], where they found five distinct constellations of right-wing authoritarianism (RWA) and social dominance orientation (SDO). Among the five, three classes were found to be low, mild, or moderate on both SDO and RWA. In line with the assumption made by Altemeyer [50], they also found two other classes of respondents: authoritarian followers (Low SDO and High RWA) and authoritarian leaders (High SDO and low RWA). While the positive correlation between SDO and RWA is well-documented (e.g., [51]), by applying a person-centered method, was it possible to find profiles of respondents being low in SDO but high in RWA or the other way around.

With regards to the present study, instead of applying a person-centered method, one possibility was to divide the participants arbitrarily. For example, based on median splits, it is possible to create classes of participants with all the possible combinations of high, moderate, and low levels of the indicator variables. However, since we used nationally representative samples, as mentioned above, one could be more confident that the response patterns found by the person-centered technique would be consistent with those of the corresponding population (European population in the case of the current paper). Further, research indicates that splitting the data by median would increase the risk of power loss and the emergence of spurious effects (see [52]).

Network analysis

Network methods are a suitable technique for conceptualizing a number of psychological variables as a complex system in which every single variable is in direct associations with all the other variables. Unlike a latent model, for example, that assumes the observed variables to measure the latent variable equivalently, networks allow picturing the dynamic of all the existing unique and direct pairs of interconnections [53]. More traditional correlation-based research is often parsimonious and uses a limited number of variables for analysis. Modeling a relatively larger number of variables as a network, enables researchers to have a more comprehensive picture of all the interrelationships. Network methods have been recently employed in multiple domains of psychological research, investigating, for instance, personality traits [54], mental disorders [55], and stereotype structure [56]. More specifically, attitudes towards immigrants have been also investigated through network models (see e.g., [25,57]).

Nodes and edges are the most primary constituent elements of a network. Typically, in psychological models, nodes are a set of observed variables and edges the direct and unique statistical associations (i.e., partial correlations) between every possible pair of edges [58].

Connectivity is another basic network property that refers to the extent to which the nodes within a network are interconnected. In psychological networks, connectivity refers to the level of causal interdependencies between a set of nodes. The stronger the interconnection between two nodes, the more likely it is that changes to one node will also result in changes to the other. This is because as two cognitive components are strongly related to each other they need to maintain consistency, so changes to one cognitive component (smoking causes cancer or not?) should lead to changes to the other (should I smoke or not?) and vice versa [5961]. Thus, in strongly connected networks, the nodes yield stronger level of causal effect on each other, while in weakly connected networks they would behave more accidentally and less dependent upon the impact of one another (for a detailed overview on the relationship between network connectivity and causality in network science and its integration with psychological networks see [62]). Furthermore, previous research shows that as one holds a strong attitude, different kinds of one’s evaluations on the corresponding attitude object, are more strongly interconnected or causally interdependent. In other words, the connectivity between an attitude’s underlying components (i.e., cognitive, affective, and behavioral) predicts attitude strength towards the attitude object (see the Causal Attitude Network (CAN) model, [63]). For example, the connectivity between a set of anti-Roma evaluations was found to be stronger for those who held stronger attitude towards the Roma people [64]. Moreover, a group of nodes being strongly interconnected, manifests their belonging to a similar state [62]. Global connectivity, for instance, as one measurement of network connectivity, refers to the absolute sum of all the (partial) correlation coefficients within a network.

As mentioned above, Schwartz [35] proposes the 10 basic values in a circular structure suggesting a dynamic of relations between the values. Network analysis, hence, would be an efficient method to representing and further investigating this dynamic. An extensive body of research has tested the relationship between the 10 basic values and intergroup attitudes (cf. supra). In the current study, we go beyond by exploring the relationships between the 10 basic values, estimated as partial correlation networks, for different classes of Europeans with unique inclusive strategies towards immigrants.

It is worth noting that person-centered methods are typically applied in exploratory research. Network methods have been recently used in exploratory papers as well (see for example [6567]). In spite of the exploratory nature of our study, however, we hold two main hypotheses.

Concerning the person-centered analysis, although there are no theory-driven explanations regarding the exact number and nature of the classes, we follow previous research on expecting a number of classes aligned along a spectrum from the most inclusive to the most exclusive. For example, Morselli and Passini [68], found six profiles of Europeans (using the 6th round of ESS data) on inclusiveness towards immigrants and protest against institutional authority—ranging from inclusive protestors to exclusive protestors. Our first assumption, therefore, is that there is a continuum of distinct typologies of individuals’ inclusiveness towards immigrants from the most inclusive to the most exclusive.

Moreover, a recent study found that compared to conservatives, in the network of liberals’ moral values, the interconnections within each set of more egalitarian (i.e., individualizing) and less egalitarian (i.e., binding) moral values was stronger than the interactions between them [69] (for an overview on binding and individualizing moral values see [70]). That is to say, in the liberal moral system, the values within each of the individualizing or binding categories, were found to be more interconnected while the interconnections between them was comparatively weaker. Past research shows that individualizing moral values negatively and binding moral values positively associate with intergroup prejudice (see eg., [7173]). Also, compared to conservatives, liberals tend to express lesser degree of generalized prejudice [74] and evaluate different outgroups more positively (e.g., [7577]. One, therefore, may argue that liberals evaluate the outgroup more positively, employing a set of strongly interconnected individualizing moral values, and their evaluation is more independent from the causal effect of other binding moral values. It is also worth pointing out that, generally, individualizing moral values are related to growth value types and binding moral values are related to self-protection value types (see for example [78]). Thus, our second hypothesis is that in the most inclusive group’s value network, the interconnections within each set of more egalitarian (i.e., growth) and less egalitarian (i.e., self-protection) basic values are the strongest and the interconnections between them are the weakest.

Data and methods

Our study is based on nationally representative interview-based survey data using the 9th round of European Social Survey (ESS), edition 1.2, collected in 2018. Verbal informed consents were obtained from all participants prior to the interviews being conducted. A total of 19 European countries participated in the data collection process: Austria, Belgium, Bulgaria, Cyprus, Czechia, Estonia, Finland, France, Germany, Hungary, Ireland, Italy, Netherlands, Norway, Poland, Serbia, Slovenia, Switzerland, and United Kingdom. Since we were interested in the adult population, out of the initial number of participants (N = 36015), we removed 1070 participants because they were under eighteen years old. Overall, 34945 participants (Mage = 51.6, SD = 18.1; 52.9% women) were included in the analyses. Table 1 reports the sample sizes and the descriptive statistics for the participants’ age and gender per country.

thumbnail
Table 1. Sample sizes and descriptive statistics for age and gender by country.

https://doi.org/10.1371/journal.pone.0260624.t001

Measures

The indicator variables used in the classification procedure (latent class analysis) are three items measuring respondents’ support for allowing three groups of immigrants to enter their countries: (1) “To what extent do you think [country] should allow people of the same race or ethnic group as most [country]’s people to come and live here?” (2) “How about people of a different race or ethnic group from most [country] people?” (3) “How about people from the poorer countries outside Europe?”. All the three items were measured on a four-point scale (1 = Allow many to come and live here; 2 = Allow some; 3 = Allow a few; 4 = Allow none). In order to avoid possible misclassification of the respondents, we also controlled for the effects of a number of covariates namely political ideology, interest in politics, anti-immigrant evaluations, personal values, and participants’ demographic characteristics (gender, age, and education).

Political ideology was measured on an 11-point scale (“In politics people sometimes talk of “left” and “right”. Where would you place yourself on this scale, where 0 means the left and 10 means the right?”).

Interest in polities was measured on a four-point scale (“How interested would you say you are in politics?”) from very interested (1) to not at all interested (4).

Anti-immigrant attitudes were measured by economic threat perception (“Would you say it is generally bad or good for [country]’s economy that people come to live here from other countries?”), symbolic threat perception (“Would you say that [country]’s cultural life is generally undermined or enriched by people coming to live here from other countries?”), and a more general anti-immigrant attitude (“Is [country] made a worse or a better place to live by people coming to live here from other countries?”). All the three items were 11-point scales form Bad for the economy/Cultural life undermined/Worse place to live (0) to Good for the economy/Cultural life enriched/Better place to live (10) respectively.

Personal values were measured by the 21‐item Portrait Values Questionnaire (PVQ‐21, [79]). Each item portrays a person for whom a certain motivational value type is important and asks the respondent about the extent to which they find themselves similar, from Very much like me (1) to Not like me at all (6). For instance, “[She]He thinks it is important that every person in the world should be treated equally. [She]He believes everyone should have equal opportunities in life.”, is one of the items tapping into universalism. Each of the 10 basic values was measured by two items—universalism by three. The 10 basic values, therefore, were first used as the covariates for classifying the participants, and later they were estimated as partial correlation networks to picture the dynamic of each group’s personal values.

Latent class analysis

Using Mplus software, version 8 [80], we applied a latent class analysis, a model-based person-centered method, to classify the respondents on the basis of their inclusiveness towards immigrants—using the three items mentioned above. Since apart from detecting the latent classes, we were also interested in the effect of our covariates on the participants’ class membership, we used a 3-step latent class method suggested by [81]. It is suitable for both detecting the latent classes, based on class membership probabilities, as well as controlling for the effect of covariates in determining the classes. Employing this method, first, the latent class model is estimated only based on the indicator variables. In the second step the most likely class membership variable is generated. And in the third step the class membership variable is regressed on the covariates, while also any potential misclassification occurred in the second step is fixed (see also [82]). In addition to the covariates mentioned above, we also created 18 country dummies (Slovenia as the reference group) to account for the country effects.

Further, since the three-step method is sensitive to missing values (on the covariates) and to avoid listwise deletion of the observations, the dataset was imputed. The proportion of the missing values was under 5 per cent for all the items used in the study ranging from 0% to 4.2% (except for political ideology with 13.8% missing values). Following [83], we applied a two-level multiple imputation technique, taking into account the participants’ being nested into their countries—assuming the data to be missing at random.

In order to find the best model solution, we first built a 2-class model, and increased the number of classes up to a 6-class model and compared the 5 models with each other. We decided on the best model solution based on statistical criteria, parsimony, and interpretability [84]. Four statistical criteria were used: Bayesian Information Criterion (BIC), Akaike’s Information Criterion (AIC), entropy, and the Vuong–Lo–Mendell–Rubin likelihood ratio (VLMR) test. The entropy value ranges from 0 to 1, the closer it is to 1, to a higher extent it indicates reliability of the classification, and separability between the classes [85]. The VLMR test compares the k-class model with the k-1-class model and provides a p-value to test whether the k-class model fits the data significantly better [86].

Moreover, to refrain from the impact of sampling biases on the classification of the respondents, the data was weighted. Because the sample sizes for each country are similar but the population sizes are different, the data was weighted by population to avoid the overrepresentation of smaller countries. We also weighted the data by design, correcting for the fact that the likelihood of the respondents to be represented in the data varies by country (see [87]).

Network analysis

The 10 basic values were estimated as partial correlation networks for each class of the respondents we found in the previous stage. After having checked for the accuracy of the edge weights, the networks were explored and compared based on global connectivity, community detection, and assortativity coefficient.

Network estimation.

To estimate the networks, for each class, the correlations between the 10 basic values were computed and inverted into partial correlations to obtain all the existing unique and direct statistical associations. We used ggmModSelect function in R from “qgraph” package [88]. The function first runs the graphical least absolute shrinkage and selection operator (glasso) algorithm for estimating 100 different network models with 100 different tuning parameters. Next, glasso fits the networks on unregularized Gaussian graphical models (GGM) and choses the best model based on BIC. Lastly, glasso adds and removes edges until it finds the model with the best BIC value.

Global connectivity.

The global connectivity of the networks was computed and compared to each other using the R package “NetworkComparisonTest” (NCT) [89]). Permutations tests, with 1000 iterations, were run to check whether the overall level of interconnections is invariant across the networks.

Community detection.

A community (or cluster) is a group of nodes that are densely connected to each other and are more weakly connected to other nodes in the network. It is, therefore, possible that different sets of highly connected nodes form a number of sub-networks within the network. To find the communities in the networks we used Walktrap algorithm from the “igraph” R package [90].

Assortativity coefficient.

As mentioned above we assumed that in the network of the most inclusive class, the interactions between growth and self-protection value types would be the weakest and the interactions within each category would be the strongest. In order to test our assumption, first, using R package “assortnet” [91], we computed assortativity coefficient that quantifies the extent to which groups of nodes (growth vs. self-protection) within a network tend to be interacting within rather than between each other [92]. The assortativity coefficient ranges from -1 to 1 and values closer to 1 reflect the stronger tendency of nodes to interact within-group rather than between-group. Next, using r package “boot” [93] we compared the networks by calculating 95% confidence intervals obtained from 1000 bootstrap resamples.

Network stability.

Prior to the main analyses, we performed a bootstrapping technique, checking for the accuracy of the edge weights. Using R package “bootnet” [58], bootstrapped confidence intervals around the edge weights were obtained from 1000 draws. A network is considered having accurate and therefore interpretable edge weights if the confidence intervals indicate low variabilities (see [58]).

Results

Latent class analysis

Table 2 summarizes the model fit comparisons between the 5 models. Compared to the 2-class and 3-class models, the 4-class model solution was found to be better fitting the data in terms of the statistical criteria. Only the entropy of the 3-class model (.92) was similar to that of the 4-class model (.91), while other statistical criteria showed significant improvement of the 4-class model fit. Further, in spite of the slight decrease of the AIC and BIC values in the 5-class and 6-class models, VLMR test showed that increasing the number of classes higher than 4 does not significantly improve the model fit. Moreover, compared to the 4-class model, the entropy value in the 5-class model solution (.79) and 6-class model solutions (.74) dropped sharply. Hence, we chose the 4-class model as the best in fitting the data, parsimoniousness, and interpretability.

thumbnail
Table 2. Model fit comparisons from 2-class to 6-class model solutions.

https://doi.org/10.1371/journal.pone.0260624.t002

As can been seen in Table 3, in the 4-class model, the probabilities of the respondents’ answers showed that in each class the majority of the respondents fall into one of the four categories of the three indicator variables. As mentioned above the four categories were: allow many, allow some, allow a few, and allow none. In each class the respondents were found to be consistent on their inclusiveness towards the three groups of immigrants. Therefore, supporting our first assumption, one class was found to be the most inclusive regarding all the three immigrant groups, one found to be the most exclusive, and the other two were found to be selective. We named the 4 classes as Inclusive (N = 4607), Some (N = 14399), Few (N = 10987), and Exclusive (N = 4952) (see the supplementals for the descriptive statistics and the correlations between the variables for each class).

thumbnail
Table 3. The probabilities of the participants’ responses on their inclusive towards immigrants by class membership.

https://doi.org/10.1371/journal.pone.0260624.t003

Table 4 reports the results of the multinomial logistic regressions for class membership predicted by the covariates (with the Inclusive class as the reference category). Exclusive class members were found to be significantly more interested in politics, while political interest did not predict Some and Few class memberships significantly. Moreover, political conservatism and the three items tapping into threat perception significantly predicted Exclusive, Few, and Some class memberships. Moreover, concerning the self-protection value types, the importance of security and tradition negatively predicted Exclusive, Few, and Some class memberships. Conformity negatively predicted only the Exclusive class membership, and achievement negatively predicted only the Some class membership. Moreover, power did not associate with the three class memberships compared to the Inclusive class. Regarding the growth value types, benevolence and universalism positively predicted Exclusive, Few, and Some class memberships. Hedonism, stimulation, and self-direction were not found to be predictive of the participants class memberships. Regarding the demographic variables, participants’ gender (women as the reference category) significantly and negatively associated with the Few and Some class memberships and age positively predicted the membership of the Exclusive, Few, and Some classes. Further, the level of participants’ education negatively and significantly predicted the Exclusive and Few class memberships (see also S6 Table in the supplementals for the demographic characteristics of each class).

thumbnail
Table 4. Results of multinomial logistic regressions for predicting class membership by the covariates (Inclusive class as the reference category).

https://doi.org/10.1371/journal.pone.0260624.t004

Before proceeding to the next stage of the analyses we also performed a series of independent sample t-tests to compare the four classes based on political ideology, interest in politics, perceived threat towards immigrants, and the 10 basic values. The results showed that the four classes (Inclusive, Some, Few, and Exclusive) ranged from the most liberal and least interested in politics to the most conservative and most interested in politics respectively and all the differences were statistically significant. The four classes were also significantly different from each other regarding the three items measuring threat perception, with the Inclusive class to be the lowest on threat perception (i.e., Inclusive < Some < Few < Exclusive). Similarly, the extent to which the respondents found growth value types important, ranged from the highest for the Inclusive class to the lowest for the Exclusive class (Some and Few in between, respectively). This pattern was exactly the opposite concerning the self-protection value types. Only, regarding achievement, no significant difference was found in none of the comparisons. Also, the difference between the Few and Exclusive groups on tradition was not found to be significant (see the supplementals for the t-test results).

Network analysis

Four networks were estimated based on the respondents’ 10 basic values (see Fig 2). For each network, out of 45 possible edges, we checked for the number of non-zero edges (Inclusive = 33, Some = 39, Few = 38, and Exclusive = 38).

thumbnail
Fig 2. Partial correlation networks estimated for the 4 classes found in the LCA.

Red lines depict negative partial correlations, and the green lines represent positive partial correlations. Node with the same color belong to the same community. The thickness of the lines represents the magnitude of the correlation coefficients. SD = Self-Direction; ST = Stimulation; HE = Hedonism; AC = Achievement; PO = Power; SE = Security; CO = Conformity; TR = Tradition; BE = Benevolence; UN = Universalism.

https://doi.org/10.1371/journal.pone.0260624.g002

Global connectivity.

The global connectivity scores were found to be more or less similar across the 4 networks (Inclusive = 5.16; Some = 5.14; Few = 5.31; Exclusive = 5.34). The results of the permutation tests showed that, out of 6 possible comparisons only the Few-Some difference was found to be significant (Inclusive vs. Some: diff = .02, p = .92; Inclusive vs. Few: diff = .15, p = .19; Inclusive vs. Exclusive: diff = .18, p = .06; Some vs. Few: diff = .16, p = .02; Some vs. Exclusive: diff = .20, p = .05; Few vs. Exclusive: diff = .03, p = .72).

Community detection.

As Fig 2 represents, the community detection analysis showed that in Some, Few, and Exclusive networks, personal focus values vs. social focus values formed 2 large separate communities. While the nodes in Inclusive network tended to form 4 communities, highly corresponding to the four higher order value types: openness to change, self-transcendence, self-enhancement, and conservation. The only slight difference was that self-direction clustered with self-transcendence values: universalism and benevolence.

Assortativity coefficient.

The differences between the 4 networks on the assortativity coefficient were all above chance (Inclusive: r = .81, 95% CI [.79, .84]; Some: r = .66, 95% CI [.64, .67]; Few: r = .51, 95% CI [.48, .53]; Exclusive: r = .39, 95% CI [.35, .43]). Our second hypothesis was therefore supported, that compared to other networks, in Inclusive network, the interconnections within the growth value types and within the self-protection value types was the strongest, and the interconnections between the two categories was the weakest.

Network stability.

The stability analyses showed that all the networks were stable and therefore interpretable regarding their edge weights. That is to say, the confidence intervals around the edge weights showed small variabilities, meaning that the edge weight accuracy was attained across all the 4 networks (figures visualizing the confidence intervals around the edge weights can be found in the supplementals).

Discussion

Using Latent class analysis, we analyzed the 9th round of ESS data, and found 4 mutually exclusive classes of Europeans with meaningfully distinct inclusive attitudes towards the three groups of immigrants: from the same ethnic background, from different ethnic backgrounds, and from poorer countries outside Europe.

The results suggest that all the four classes share generalized attitudes towards immigrants ranging from being highly inclusive to being highly exclusive. In other words, even though one could expect finding classes of respondents with the combination of high, moderate, and low degrees of inclusive attitudes, the results revealed that respondents (in each class) weakly differentiated between the three groups of immigrants. Our results, therefore, may appear to be at odds with the fact that attitudes towards members of different outgroups spring from distinct cognitive, ideological, and motivational sources (see e.g., [94,95]). The reason behind the pattern of our results, however, might be that all the three types of immigrants may have already been perceived as low-status groups (as opposed to Western white expats for instance), that in turn elicited generalized attitudes towards them. The nature of that generalized attitude, whatever it is, may be what matters, that as discussed above, stems from the interplay between multiple factors including one’s basic personal values.

Community detection analysis revealed that Inclusive Europeans’ value structure seems to be the most complex, as opposed to Some, Few, and Exclusive Europeans, whose value structures are more simply divided into two large communities (social focus vs. personal focus). In the case of Inclusive class members however, the 10 basic values configured four separate communities, corresponding to the 4 higher-order value types proposed by Schwartz [35]: openness to change, conservation, self-transcendence, and self-enhancement. The only difference was that self-direction, instead of clustering with stimulation and hedonism, clustered with universalism and benevolence. As shown in Fig 1, self-direction value is adjacent to universalism, and after all, it is theoretically assumed to be motivationally close to universalism and benevolence (all belong to growth value types).

One explanation may be that Inclusive class members’ more complex value structure (in the sense of the number of communities) enables them to base their judgement on outgroup members through more egalitarian values (e.g., universalism and benevolence), that is less dependent on the causal effects of values tapping into opposing motivational goals (e.g., tradition, conformity). This highly resonates with the prevailing consensus in the literature that cognitive complexity is related both to lower degree of conservatism (see [96]) and more favorable intergroup attitudes [97,98]. Integrative complexity for example, captures the extent to which one both differentiates between opposing perspectives and integrates them into a coherent whole [99]. Inclusive network seems to be the most complex in this sense, as we see that 4 sets of values are differentiated from each other and integrated into four separate sets of values. Regarding the other three networks, however, in a less sophisticated manner, the two large communities consist of motivationally conflicting values. Future investigation is needed to directly test the relationship between the number and the nature of clusters in attitude networks and different forms of cognitive style including cognitive complexity.

Furthermore, the level of assortativity between the two categories of values (growth and self-protection) found for each class of respondents supplemented the results of the community detection analysis. As expected, the assortativity analysis showed that in the case of Inclusive class, values are more strongly interconnected within either growth value types or self-protection value types and the relationship between the two categories is comparatively weaker. In other words, regarding the most inclusive individuals, the values’ effects on each other are more confined within the limit of either more egalitarian or less egalitarian value types. This may imply that in terms of the inclusive individuals, values from dissimilar motivational goals, are less causally dependent upon each other, that in turn enables them to evaluate outgroup members on the basis of one’s universal concerns, more free from the restricting influence of ingroup interests. Moreover, the results showed that the global connectivity score (the overall level of interconnections), was found to be mostly invariant across the networks, implying that what makes the difference is the unique configuration of the 10 values for each class.

Prior research has documented that one’s intergroup attitudes are strongly reflected in the level of importance they place on holding certain value types (e.g., growth vs. self-protection). Theoretically speaking, the present study contributes to the literature in the field, by showing that people’s intergroup attitudes are also expressed in how their personal values tend to be interconnected. Moreover, among several prejudice reduction intervention strategies, cognitive and emotional training as well as moral and value education have been argued to be effective tools on combating intergroup prejudice (see [100,101]). Thus, one possible practical implication of the current study may be, for the future research, to investigate if promoting complex thinking in respect of one’s personal values would lead to more egalitarian intergroup attitudes. In other words, a prejudice reduction strategy may involve promoting conscious consideration of opposing perspectives with respect to one’s personal values and examining whether this in turn results in a more complex value structure and a more favorable attitude towards the outgroup members. Our study concludes that mapping the dynamic structure of basic human values or moral codes in relation to intergroup attitudes can provide informative conceptual frameworks as well as effective practical strategies to fight intergroup prejudice.

Supporting information

S1 Fig. Confidence intervals around the edge weights (Exclusive class).

https://doi.org/10.1371/journal.pone.0260624.s001

(TIF)

S2 Fig. Confidence intervals around the edge weights (Few class).

https://doi.org/10.1371/journal.pone.0260624.s002

(TIF)

S3 Fig. Confidence intervals around the edge weights (Some class).

https://doi.org/10.1371/journal.pone.0260624.s003

(TIF)

S4 Fig. Confidence intervals around the edge weights (Inclusive class).

https://doi.org/10.1371/journal.pone.0260624.s004

(TIF)

S1 Table. Conceptual definitions of the 10 basic values.

https://doi.org/10.1371/journal.pone.0260624.s005

(DOCX)

S2 Table. Descriptive statistics and correlation between variables (Inclusive class).

https://doi.org/10.1371/journal.pone.0260624.s006

(DOCX)

S3 Table. Descriptive statistics and correlation between variables (Some class).

https://doi.org/10.1371/journal.pone.0260624.s007

(DOCX)

S4 Table. Descriptive statistics and correlation between variables (Few class).

https://doi.org/10.1371/journal.pone.0260624.s008

(DOCX)

S5 Table. Descriptive statistics and correlation between variables (Exclusive class).

https://doi.org/10.1371/journal.pone.0260624.s009

(DOCX)

S6 Table. Demographic information of the four classes.

https://doi.org/10.1371/journal.pone.0260624.s010

(DOCX)

S7 Table. The proportion of class membership conditioned by country.

https://doi.org/10.1371/journal.pone.0260624.s011

(DOCX)

References

  1. 1. Norris P, Inglehart R. Cultural backlash: Trump, Brexit, and authoritarian populism. Cambridge University Press; 2019 Feb 14.
  2. 2. Vachudova MA. Populism, Democracy, and Party System Change in Europe. Annual Review of Political Science. 2021 May 11;24:471–98.
  3. 3. Dennison J. How issue salience explains the rise of the populist right in Western Europe. International Journal of Public Opinion Research. 2020;32(3):397–420.
  4. 4. Edgell P. An agenda for research on American religion in light of the 2016 election. Sociology of Religion. 2017 Mar 1;78(1):1–8.
  5. 5. Lubbers M, Coenders M. Nationalistic attitudes and voting for the radical right in Europe. European Union Politics. 2017 Mar;18(1):98–118.
  6. 6. Schaffner BF, MacWilliams M, Nteta T. Explaining white polarization in the 2016 vote for president: The sobering role of racism and sexism. InConference on the US Elections of 2016 (pp. 8–9).
  7. 7. Cochrane C, Nevitte N. Scapegoating: Unemployment, far-right parties and anti-immigrant sentiment. Comparative European Politics. 2014 Jan;12(1):1–32.
  8. 8. Matthes J, Schmuck D. The effects of anti-immigrant right-wing populist ads on implicit and explicit attitudes: A moderated mediation model. Communication Research. 2017 Jun;44(4):556–81.
  9. 9. Schemer C. The influence of news media on stereotypic attitudes toward immigrants in a political campaign. Journal of Communication. 2012 Oct 1;62(5):739–57.
  10. 10. Wirz DS, Wettstein M, Schulz A, Müller P, Schemer C, Ernst N, Esser F, Wirth W. The effects of right-wing populist communication on emotions and cognitions toward immigrants. The International Journal of Press/Politics. 2018 Oct;23(4):496–516.
  11. 11. Green EG, Visintin EP, Sarrasin O, Hewstone M. When integration policies shape the impact of intergroup contact on threat perceptions: a multilevel study across 20 European countries. Journal of Ethnic and Migration Studies. 2020 Feb 17;46(3):631–48.
  12. 12. Schlueter E, Masso A, Davidov E. What factors explain anti-Muslim prejudice? An assessment of the effects of Muslim population size, institutional characteristics and immigration-related media claims. Journal of ethnic and migration studies. 2020 Feb 17;46(3):649–64.
  13. 13. Máté D, Sarihasan I, Popp J, Oláh J. The role of regional differences in immigration: the case of OECD countries. Economics & Sociology. 2018 Jul 1;11(3):190–206.
  14. 14. Ceobanu AM, Escandell X. Comparative analyses of public attitudes toward immigrants and immigration using multinational survey data: A review of theories and research. Annual review of sociology. 2010 Aug 11;36:309–28.
  15. 15. Card D, Dustmann C, and Preston I. ‘Understanding Attitudes to Immigration: The Migration and Minority Module of the First European Social Survey’, 2005, 45.
  16. 16. Fussell E. Warmth of the welcome: Attitudes toward immigrants and immigration policy in the United States. Annual review of sociology. 2014 Jul 30;40:479–98. pmid:26966338
  17. 17. Schmuck D, Matthes J. How anti-immigrant right-wing populist advertisements affect young voters: Symbolic threats, economic threats and the moderating role of education. Journal of Ethnic and Migration Studies. 2015 Aug 24;41(10):1577–99.
  18. 18. Schmuck D, Matthes J. Effects of economic and symbolic threat appeals in right-wing populist advertising on anti-immigrant attitudes: The impact of textual and visual appeals. Political Communication. 2017 Oct 2;34(4):607–26.
  19. 19. Esses VM, Hamilton LK, Gaucher D. The role of attitudes in migration. InThe Handbook of Attitudes 2018 Oct 10 (pp. 455–487). Routledge.
  20. 20. Hartman TK, Stocks TV, McKay R, Gibson-Miller J, Levita L, Martinez AP, et al. The authoritarian dynamic during the COVID-19 pandemic: Effects on nationalism and anti-immigrant sentiment. Social Psychological and Personality Science. 2021 Jan 11:1948550620978023.
  21. 21. Landmann H, Gaschler R, Rohmann A. What is threatening about refugees? Identifying different types of threat and their association with emotional responses and attitudes towards refugee migration. European Journal of Social Psychology. 2019 Dec;49(7):1401–20.
  22. 22. Pehrson S, Green EG. Who we are and who can join us: National identity content and entry criteria for new immigrants. Journal of Social Issues. 2010 Dec;66(4):695–716.
  23. 23. Taniguchi H. National identity, cosmopolitanism, and attitudes toward immigrants. International Sociology. 2021 Aug 26:0268580921994517.
  24. 24. Roy S, Neumann CS, Jones DN, Gari A, Šram Z. Psychopathic propensities contribute to social dominance orientation and right-wing authoritarianism in predicting prejudicial attitudes in a large European sample. Personality and Individual Differences. 2021 Jan 1;168:110355.
  25. 25. Grigoryev D, Fiske ST, Batkhina A. Mapping ethnic stereotypes and their antecedents in Russia: the stereotype content model. Frontiers in psychology. 2019 Jul 16;10:1643. pmid:31379677
  26. 26. Lee TL, Fiske ST. Not an outgroup, not yet an ingroup: Immigrants in the stereotype content model. International Journal of Intercultural Relations. 2006 Nov 1;30(6):751–68.
  27. 27. Talay L, De Coninck D. Exploring the link between personality traits and European attitudes towards refugees. International Journal of Intercultural Relations. 2020 Jul 1;77:13–24.
  28. 28. Gorodzeisky A, Semyonov M. Perceptions and misperceptions: actual size, perceived size and opposition to immigration in European societies. Journal of Ethnic and Migration Studies. 2020 Feb 17;46(3):612–30.
  29. 29. Mitchell J. Social trust and anti-immigrant attitudes in Europe: a longitudinal multi-level analysis. Frontiers in sociology. 2021 Apr 9;6:73. pmid:33898552
  30. 30. Pellegrini V, De Cristofaro V, Salvati M, Giacomantonio M, Leone L. Social Exclusion and Anti-Immigration Attitudes in Europe: The mediating role of Interpersonal Trust. Social Indicators Research. 2021 Jun;155(2):697–724.
  31. 31. Danaj A, Lazányi K, Bilan Y. Perceptions and implications of immigration in France-economic, social, political and cultural perspectives. Economics & Sociology. 2018 Jul 1;11(3):226–47.
  32. 32. Esses VM. Prejudice and discrimination toward immigrants. Annual Review of Psychology. 2021 Jan 4;72:503–31. pmid:32916080
  33. 33. Tartakovsky E, Walsh SD. Are some immigrants more equal than others? Applying a threat-benefit model to understanding the appraisal of different immigrant groups by the local population. Journal of Ethnic and Migration Studies. 2020 Dec 1;46(19):3955–73.
  34. 34. Walsh SD, Tartakovsky E. Personal Value Preferences, Threat-Benefit Appraisal of Immigrants and Levels of Social Contact: Looking Through the Lens of the Stereotype Content Model. Frontiers in psychology. 2021 Mar 4;12:477. pmid:33746831
  35. 35. Schwartz SH. Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. InAdvances in experimental social psychology 1992 Jan 1 (Vol. 25, pp. 1–65). Academic Press.
  36. 36. Davidov E. Testing for comparability of human values across countries and time with the third round of the European Social Survey. International Journal of Comparative Sociology. 2010 Jun;51(3):171–91.
  37. 37. Schwartz SH. Are there universal aspects in the structure and contents of human values?. Journal of social issues. 1994 Jan;50(4):19–45.
  38. 38. Rokeach M. The nature of human values. Free press; 1973.
  39. 39. Magun V, Rudnev M, Schmidt P. Within-and between-country value diversity in Europe: A typological approach. European Sociological Review. 2015 Aug 24;32(2):189–202.
  40. 40. Schwartz SH. Les valeurs de base de la personne: théorie, mesures et applications. Revue française de sociologie. 2006;47(4):929–68.
  41. 41. Beierlein C, Kuntz A, Davidov E. Universalism, conservation and attitudes toward minority groups. Social Science Research. 2016 Jul 1;58:68–79. pmid:27194652
  42. 42. Davidov E, Seddig D, Gorodzeisky A, Raijman R, Schmidt P, Semyonov M. Direct and indirect predictors of opposition to immigration in Europe: individual values, cultural values, and symbolic threat. Journal of Ethnic and Migration Studies. 2020 Feb 17;46(3):553–73.
  43. 43. Gusciute E, Mühlau P, Layte R. All Welcome Here? Attitudes towards Muslim Migrants in Europe. International Migration. 2020 Dec 25.
  44. 44. Schwartz SH, Caprara GV, Vecchione M. Basic personal values, core political values, and voting: A longitudinal analysis. Political psychology. 2010 Jun;31(3):421–52.
  45. 45. Wolf LJ, Weinstein N, Maio GR. Anti-immigrant prejudice: Understanding the roles of (perceived) values and value dissimilarity. Journal of personality and social psychology. 2019 Nov;117(5):925. pmid:30667255
  46. 46. Bauer DJ, Shanahan MJ. Modeling complex interactions: Person-centered and variable-centered approaches. Modeling contextual effects in longitudinal studies. 2007 Mar 21:255–83.
  47. 47. Osborne D, Sibley CG. Identifying “types” of ideologies and intergroup biases: Advancing a person-centred approach to social psychology. European Review of Social Psychology. 2017 Jan 1;28(1):288–332.
  48. 48. Adelman L, Verkuyten M. Prejudice and the acceptance of Muslim minority practices. Social Psychology. 2019 Aug 20. pmid:32566033
  49. 49. Sibley CG, Bergh R, Satherley N, Osborne D, Milojev P, Greaves LM, Huang Y, Townrow CS, Faapoi A, Yogeeswaran K, Hawi D. Profiling authoritarian leaders and followers. TPM-Testing, Psychometrics, Methodology in Applied Psychology. 2019;26(3):401–17.
  50. 50. Altemeyer B. The other “authoritarian personality”. InAdvances in experimental social psychology 1998 Jan 1 (Vol. 30, pp. 47–92). Academic Press.
  51. 51. Roccato M, Ricolfi L. On the correlation between right-wing authoritarianism and social dominance orientation. Basic and applied social psychology. 2005 Sep 1;27(3):187–200.
  52. 52. MacCallum RC, Zhang S, Preacher KJ, Rucker DD. On the practice of dichotomization of quantitative variables. Psychological methods. 2002 Mar;7(1):19. pmid:11928888
  53. 53. Schmittmann VD, Cramer AO, Waldorp LJ, Epskamp S, Kievit RA, Borsboom D. Deconstructing the construct: A network perspective on psychological phenomena. New ideas in psychology. 2013 Apr 1;31(1):43–53.
  54. 54. Costantini G, Epskamp S, Borsboom D, Perugini M, Mõttus R, Waldorp LJ, Cramer AO. State of the aRt personality research: A tutorial on network analysis of personality data in R. Journal of Research in Personality. 2015 Feb 1;54:13–29.
  55. 55. Fried EI, van Borkulo CD, Cramer AO, Boschloo L, Schoevers RA, Borsboom D. Mental disorders as networks of problems: a review of recent insights. Social Psychiatry and Psychiatric Epidemiology. 2017 Jan 1;52(1):1–0. pmid:27921134
  56. 56. Sayans‐Jiménez P, van Harreveld F, Dalege J, Rojas Tejada AJ. Investigating stereotype structure with empirical network models. European Journal of Social Psychology. 2019 Apr;49(3):604–21.
  57. 57. Phua DY, Leong CH, Hong Y. Heterogeneity in national identity construct: Example of Singapore using network analysis. International Journal of Intercultural Relations. 2020 Sep 1;78:20–32.
  58. 58. Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods. 2018 Feb;50(1):195–212. pmid:28342071
  59. 59. Festinger L. A theory of cognitive dissonance. Stanford university press; 1957.
  60. 60. Gawronski B, Strack F. Cognitive consistency as a basic principle of social information processing.
  61. 61. Heider F. The psychology of cognitive organization.
  62. 62. Dalege J, Borsboom D, Van Harreveld F, Van den Berg H, Conner M, Van der Maas HL. Toward a formalized account of attitudes: The Causal Attitude Network (CAN) model. Psychological review. 2016 Jan;123(1):2. pmid:26479706
  63. 63. Dalege J, Borsboom D, van Harreveld F, van der Maas HL. A network perspective on attitude strength: Testing the connectivity hypothesis. Social Psychological and Personality Science. 2019 Aug;10(6):746–56.
  64. 64. Sam Nariman H, Hadarics M, Kende A, Lášticová B, Poslon XD, Popper M, Boza M, Ernst-Vintila A, Badea C, Mahfud Y, O’Connor A. Anti-Roma bias (stereotypes, prejudice, behavioral tendencies): A network approach toward attitude strength. Frontiers in psychology. 2020 Sep 30;11:2071. pmid:33101101
  65. 65. Abacioglu CS, Isvoranu AM, Verkuyten M, Thijs J, Epskamp S. Exploring multicultural classroom dynamics: A network analysis. Journal of school psychology. 2019 Jun 1;74:90–105. pmid:31213234
  66. 66. Bhushan N, Mohnert F, Sloot D, Jans L, Albers C, Steg L. Using a Gaussian graphical model to explore relationships between items and variables in environmental psychology research. Frontiers in psychology. 2019 May 9;10:1050. pmid:31143150
  67. 67. Verschoor M, Albers C, Poortinga W, Böhm G, Steg L. Exploring relationships between climate change beliefs and energy preferences: A network analysis of the European Social Survey. Journal of Environmental Psychology. 2020 Aug 1;70:101435.
  68. 68. Morselli D, Passini S. Exclusive and inclusive protest in Europe: Investigating values, support for democracy, and life conditions. Journal of Community & Applied Social Psychology. 2018 May;28(3):123–41.
  69. 69. Turner-Zwinkels FM, Johnson BB, Sibley CG, Brandt MJ. Conservatives’ moral foundations are more densely connected than liberals’ moral foundations. Personality and Social Psychology Bulletin. 2021 Feb;47(2):167–84. pmid:32452297
  70. 70. Graham J, Haidt J, Nosek BA. Liberals and conservatives rely on different sets of moral foundations. Journal of personality and social psychology. 2009 May;96(5):1029. pmid:19379034
  71. 71. Hadarics M, Kende A. Moral foundations of positive and negative intergroup behavior: Moral exclusion fills the gap. International Journal of Intercultural Relations. 2018 May 1;64:67–76.
  72. 72. Kugler M, Jost JT, Noorbaloochi S. Another look at moral foundations theory: Do authoritarianism and social dominance orientation explain liberal-conservative differences in “moral” intuitions?. Social Justice Research. 2014 Dec;27(4):413–31.
  73. 73. Van de Vyver J, Houston DM, Abrams D, Vasiljevic M. Boosting belligerence: How the July 7, 2005, London bombings affected liberals’ moral foundations and prejudice. Psychological science. 2016 Feb;27(2):169–77. pmid:26674127
  74. 74. McFarland S. Authoritarianism, social dominance, and other roots of generalized prejudice. Political Psychology. 2010 Jun;31(3):453–77.
  75. 75. Bowman JW, West K. Brexit: The influence of motivation to respond without prejudice, willingness to disagree, and attitudes to immigration. British Journal of Social Psychology. 2021 Jan;60(1):222–47.
  76. 76. Löw A, Puzić S, Matić Bojić J. Anti-immigrant prejudice in a post-socialist context: the role of identity-based explanations. Ethnic and racial studies. 2020 Dec 25:1–20.
  77. 77. Terrizzi JA Jr, Shook NJ, Ventis WL. Disgust: A predictor of social conservatism and prejudicial attitudes toward homosexuals. Personality and individual differences. 2010 Oct 1;49(6):587–92.
  78. 78. Feldman G. Personal values and moral foundations: Examining relations and joint prediction of moral variables. Social Psychological and Personality Science. 2021 Jul;12(5):676–86.
  79. 79. Schwartz SH. Value orientations: Measurement, antecedents and consequences across nations. Measuring attitudes cross-nationally: Lessons from the European Social Survey. 2007 Apr 2;169:204.
  80. 80. Muthén L, Muthén B. Mplus (Version 8)[computer software].(1998–2017). Los Angeles, CA: Muthén & Muthén. 2017.
  81. 81. Vermunt JK. Latent class modeling with covariates: Two improved three-step approaches. Political analysis. 2010 Sep 21;18(4):450–69.
  82. 82. Asparouhov T, Muthén B. Auxiliary variables in mixture modeling: Three-step approaches using M plus. Structural equation modeling: A multidisciplinary Journal. 2014 Jul 3;21(3):329–41.
  83. 83. Asparouhov T, Muthén B. Multiple imputation with Mplus. MPlus Web Notes. 2010 Sep 29:238–46.
  84. 84. Nylund-Gibson K, Choi AY. Ten frequently asked questions about latent class analysis. Translational Issues in Psychological Science. 2018 Dec;4(4):440.
  85. 85. Ramaswamy V, DeSarbo WS, Reibstein DJ, Robinson WT. An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing science. 1993 Feb;12(1):103–24.
  86. 86. Lo Y, Mendell NR, Rubin DB. Testing the number of components in a normal mixture. Biometrika. 2001 Oct 1;88(3):767–78.
  87. 87. ESS methodology [Internet]. Weighting | European Social Survey (ESS). [cited 2021Mar3]. Available from: https://www.europeansocialsurvey.org/methodology/ess_methodology/data_processing_archiving/weighting.html.
  88. 88. Epskamp S, Cramer AO, Waldorp LJ, Schmittmann VD, Borsboom D. qgraph: Network visualizations of relationships in psychometric data. Journal of statistical software. 2012 May 24;48:1–8.
  89. 89. Van Borkulo CD, Boschloo L, Kossakowski J, Tio P, Schoevers RA, Borsboom D, Waldorp LJ. Comparing network structures on three aspects: A permutation test. Manuscript submitted for publication. 2017 Mar;10.
  90. 90. Csardi G, Nepusz T. The igraph software package for complex network research. InterJournal, complex systems. 2006 Jan 11;1695(5):1–9.
  91. 91. Farine DR. Measuring phenotypic assortment in animal social networks: weighted associations are more robust than binary edges. Animal Behaviour. 2014 Mar 1;89:141–53.
  92. 92. Newman ME. Mixing patterns in networks. Physical review E. 2003 Feb 27;67(2):026126. pmid:12636767
  93. 93. Canty A, Ripley B. Package ‘boot’. Bootstrap Functions. CRAN R Proj. 2017 Jul 30.
  94. 94. Duckitt J. A dual-process cognitive-motivational theory of ideology and prejudice. InAdvances in experimental social psychology 2001 Jan 1 (Vol. 33, pp. 41–113). Academic Press.
  95. 95. Fiske ST, Cuddy AJ, Glick P, Xu J. A model of (often mixed) stereotype content: competence and warmth respectively follow from perceived status and competition. Journal of personality and social psychology. 2002 Jun;82(6):878. pmid:12051578
  96. 96. Jost JT, Federico CM, Napier JL. Political ideology: Its structure, functions, and elective affinities. Annual review of psychology. 2009 Jan 10;60:307–37. pmid:19035826
  97. 97. De Zavala AG, Cislak A, Wesolowska E. Political conservatism, need for cognitive closure, and intergroup hostility. Political Psychology. 2010 Aug;31(4):521–41.
  98. 98. Golec A, Federico CM. Understanding responses to political conflict: Interactive effects of the need for closure and salient conflict schemas. Journal of personality and social psychology. 2004 Dec;87(6):750. pmid:15598104
  99. 99. Tetlock PE. Cognitive style and political ideology. Journal of Personality and social Psychology. 1983 Jul;45(1):118.
  100. 100. Paluck EL, Green DP. Prejudice reduction: What works? A review and assessment of research and practice. Annual review of psychology. 2009 Jan 10;60:339–67. pmid:18851685
  101. 101. Paluck EL, Porat R, Clark CS, Green DP. Prejudice reduction: Progress and challenges. Annual review of psychology. 2021 Jan 4;72:533–60. pmid:32928061