Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Non-response in a national health survey in Germany: An intersectionality-informed multilevel analysis of individual heterogeneity and discriminatory accuracy

  • Philipp Jaehn ,

    Roles Conceptualization, Formal analysis, Methodology, Visualization, Writing – original draft, Writing – review & editing

    philipp.jaehn@mhb-fontane.de

    Affiliation Institute of Social Medicine and Epidemiology, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany

  • Emily Mena,

    Roles Methodology, Writing – review & editing

    Affiliations Department of Social Epidemiology, Institute of Public Health and Nursing Research, University of Bremen, Bremen, Germany, Health Sciences Bremen, University of Bremen, Bremen, Germany

  • Sibille Merz,

    Roles Writing – review & editing

    Affiliation Institute of Social Medicine and Epidemiology, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany

  • Robert Hoffmann,

    Roles Resources, Writing – review & editing

    Affiliation Department of Epidemiology and Health Monitoring, Robert Koch-Institute, Berlin, Germany

  • Antje Gößwald,

    Roles Resources, Writing – review & editing

    Affiliation Department of Epidemiology and Health Monitoring, Robert Koch-Institute, Berlin, Germany

  • Alexander Rommel,

    Roles Writing – review & editing

    Affiliation Department of Epidemiology and Health Monitoring, Robert Koch-Institute, Berlin, Germany

  • Christine Holmberg,

    Roles Conceptualization, Funding acquisition, Supervision, Writing – review & editing

    Affiliations Institute of Social Medicine and Epidemiology, Brandenburg Medical School Theodor Fontane, Brandenburg an der Havel, Germany, Faculty of Health Sciences, Joint Faculty of the Brandenburg University of Technology Cottbus–Senftenberg, the Brandenburg Medical School Theodor Fontane and the University of Potsdam, Brandenburg an der Havel, Germany

  • on behalf of the ADVANCE GENDER study group

    Membership of the ADVANCE GENDER study group is listed in the Acknowledgments.

Abstract

Background

Dimensions of social location such as socioeconomic position or sex/gender are often associated with low response rates in epidemiological studies. We applied an intersectionality-informed approach to analyze non-response among population strata defined by combinations of multiple dimensions of social location and subjective health in a health survey in Germany.

Methods

We used data from the cross-sectional sample of the German Health Interview and Examination Survey for Adults (DEGS1) conducted between 2008 and 2011. Information about non-responders was available from a mailed non-responder questionnaire. Intersectional strata were constructed by combining all categories of age, sex/gender, marital status, and level of education in scenario 1. Subjective health was additionally used to construct intersectional strata in scenario 2. We applied multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) to calculate measures of discriminatory accuracy, proportions of non-responders among intersectional strata, as well as stratum-specific total interaction effects (intersectional effects). Markov chain Monte Carlo methods were used to estimate multilevel logistic regression models.

Results

Data was available for 6,534 individuals of whom 36% were non-responders. In scenario 2, we found weak discriminatory accuracy (variance partition coefficient = 3.6%) of intersectional strata, while predicted proportions of non-response ranged from 20.6% (95% credible interval (CI) 17.0%-24.9%) to 57.5% (95% CI 48.8%-66.5%) among intersectional strata. No evidence for intersectional effects was found. These results did not differ substantially between scenarios 1 and 2.

Conclusions

MAIHDA revealed that proportions of non-response varied widely between intersectional strata. However, poor discriminatory accuracy of intersectional strata and no evidence for intersectional effects indicate that there is no justification to exclusively target specific intersectional strata in order to increase response, but that a combination of targeted and population-based measures might be appropriate to achieve more equal representation.

Introduction

Representativeness is a crucial element of external validity of epidemiological studies, especially if studies aim at estimating disease frequency or measures of population impact within specific societies [1, 2]. Descriptive comparisons of the study population with the target population aid the identification of population groups for which research results might be less representative. Current guidelines in epidemiology suggest the comparison of social, demographic and health-related features between study and target population [1, 3, 4]. We argue that a critical reflection of participants’ social location from an intersectional perspective could serve as an important framework for describing representativeness of population-based studies. Social location has been defined as an individual’s location in relations of hierarchy and power at a specific time and in a specific social context [5]. Dimensions of social location are inter alia socioeconomic position, race/ethnicity, sex/gender, place of residence, religion, social capital, age, sexuality or (dis)ability [5, 6].

The concept of intersectionality was developed by Black feminist scholars during the 1980s and 1990s [5]. Unique lived realities and experiences of discrimination against African-American women that were incomparable to either discrimination against white women or Black men were used as a starting point to develop the theoretical framework [7]. Intersectionality posits that social systems of power are mutually constituting and reinforcing [8]. An intercategorical intersectional perspective focuses, thereby, on combinations of multiple dimensions of social location [9]. These combinations, or intersectional strata, are conceptualised to be incomparable to one another [10]. Thus, intersectionality expands traditional analytic frameworks of epidemiology that focus either on single dimensions of social location or on mutually adjusted associations [11]. Besides social location, intersectionality may focus on social identity or on social processes such as discrimination [11].

Study participation has been suggested to be context-specific [1, 12, 13]. However, it is feasible to draw a summary of dimensions of social location that have been associated with study participation across different contexts and study designs. In population-based surveys, ethnic minority status, low income, low level of education and young and old age were associated with lower response proportions [1416]. Furthermore, male sex, low socioeconomic status, being an unskilled worker, having no children and being unmarried were associated with low study participation in cross-sectional and cohort designs [13, 1719].

Finally, associations of single dimensions of social location with study participation might vary across categories of further dimensions of social location. In a population-based cohort study in Germany, for example, men living in a steady partnership showed a higher response rate compared to men not living in a steady partnership, while response rates among women did not differ according to partnership status [20]. Study participation was comprehensively examined in the GAZEL study, an occupational cohort study conducted in France [13]. In GAZEL, a sampling frame with information about several social and demographic characteristics was available for all non-participants [13]. The authors found good evidence for interaction of employment grade with year of birth, level of education and number of children when investigating study participation [13]. This suggests that an intersectionality-informed perspective on study participation might be informative to uncover differential patterns of response and to mirror social complexity in such analyses [5, 10].

Finally, intersectional Multilevel Analysis of Individual Heterogeneity and Discriminatory Accuracy (MAIHDA) has recently been developed to inform quantitative data analysis by an intercategorical intersectional framework [2123]. Main goals of MAIHDA are to estimate measures of discriminatory accuracy, measures of disease frequency, and stratum-specific total interaction effects (so-called intersectional effects) when using multiple dimensions of social location to build intersectional strata [21, 24, 25]. Evaluations of this method regarding complementarity with intersectional theory as well as statistical properties have been published recently [2428].

In this study, we applied MAIHDA to investigate the association of intersectional strata with non-response using data of a large cross-sectional health interview and examination survey in Germany. We operationalised intersectional strata as combinations of age, sex/gender, marital status, and level of education (scenario 1). Besides social location, health status is an important predictor of study participation [16, 18, 19, 29]. Therefore, we chose to include subjective health in addition to dimensions of social location in scenario 2 of MAIHDA.

Materials and methods

Study design and population

We used data of the cross-sectional German Health Interview and Examination Survey for Adults (DEGS1) carried out 2008 through 2011 [3032]. The DEGS1 sample consisted of participants of the German National Health Interview and Examination Survey (GNHIES98) conducted in 1998 and an extension sample that was drawn from population registers [3234]. We only included participants of the extension sample and excluded all individuals who participated in GNHIES98 (N = 4,055), because we aimed at estimating study participation in a sample that most likely had not had prior experience with health research.

DEGS1 followed a two-stage stratified cluster sampling design. The target population with respect to cross-sectional analyses were residents of Germany aged 18 to 79 years. In the first stage of the sampling strategy, 180 communities were sampled from a sampling frame of all communities in Germany stratified by federal state and type of community. Community types in Germany are classified according to population density, grade of urbanisation and administrative borders [35]. Of those communities, 120 were sampled for GNHIES98 and 60 were additionally drawn for DEGS1 using probability proportional to community size sampling in both situations. These communities represented the primary sampling units (PSUs). Within each PSU, simple random samples of individuals were drawn from population registers stratified by 10-year age groups. As the study population of GNHIES98 grew approximately 10 years older until DEGS1, a new cross-sectional sample was drawn in the youngest 10-year age group. The study design of DEGS1 is described in detail elsewhere [30, 31].

Overall, 11,008 people were invited to participate in DEGS1 for the first time. 4,193 participated, 5,754 did choose not to participate (non-responders), and the remainder were quality neutral losses. 2,342 of all 5,754 non-responders (42%) responded to a non-responder survey [32]. One person, who participated initially in DEGS1 withdrew consent. Correspondingly, our final sample consisted of 6,534 people (Fig 1).

The purpose of DEGS1 was to obtain representative estimates of disease burden, prevalence of diseases and risk factors, disability and health care utilisation for the German population. During fieldwork, trained health professionals visited study sites successively. Information about non-responders was obtained from a non-responder survey, conducted by mail, telephone and in person during (failed) participant recruitment. Interview data in this study were collected using self-administered questionnaires and computer-assisted questionnaires (CAPI). Questionnaires were available in German, Russian, Turkish, Serbo-Croatian and English [3032].

Variables

Being a non-responder in the sample of DEGS1 was defined as the outcome of interest. Non-responders were individuals who completed the non-responder survey but did not participate in the DEGS1 study. Responders were individuals who visited one of the study centres to participate in DEGS1 [32].

The studied dimensions of social location were age, sex/gender, marital status, and level of education. Age was classified into three age groups (18–39, 40–59 and 60–79 years). For all other variables binary categories were chosen. Categories of sex/gender were “female” and “male”. Having no degree of secondary education or a grade IX lower secondary degree (“Hauptschulabschluss”) were defined as “low level of education”. Having any other degree was defined as “high level of education”. Marital status was classified as “being married” or “not being married”. Not being married included being single, divorced, or widowed. Finally, subjective health was measured on a Likert scale in five categories (very good, good, moderate, bad, very bad). The responses “very good” and “good” were categorised as “good subjective health”, while the other responses were categorised as “moderate or bad subjective health”.

Classifications were chosen in order to yield both meaningful categories and sufficiently large numbers of observations within each intersectional stratum. Intersectional strata were obtained by forming all possible combinations of categories of age, sex/gender, marital status and level of education (3x2x2x2 = 24) (scenario 1). These intersectional strata were additionally stratified by subjective health, rendering 48 strata (scenario 2). The inclusion of subjective health in this analysis is in line with the concept of intersectionality, since healthy bodies or psychological distress might well be related to social privilege or stigma [3638]. As subjective health might represent a location in social power hierarchies, we would argue that an inclusion in this analysis is warranted. Additionally, subjective health has frequently been associated with study participation [16, 18, 19]. To underscore that subjective health could be a disputable dimension of social location and to estimate changes of results after the inclusion of subjective health, we conducted the two scenarios of the analysis that are described above.

Statistical methods

We calculated descriptive statistics and univariable associations of all single dimensions of social location and subjective health with being a non-responder in DEGS1. Odds ratios, 95% confidence intervals and p-values from likelihood-ratio tests were calculated using random intercepts logistic regression with PSUs as random effects to account for clustered sampling.

MAIHDA was used to estimate proportions of non-responders within intersectional strata, measures of discriminatory accuracy and intersectional effects. MAIHDA uses a multilevel modelling approach where intersectional strata are modelled as level two random effects. The method has been originally developed for linear regression [2123] and was subsequently applied to logistic regression [39]. We followed the approach proposed by Axelsson-Fisk et al. for multilevel logistic regression [39]. Therefore, random intercepts logistic regression models were used where individuals were cross-classified in intersectional strata and PSUs. PSUs were included to account for the clustered sampling design.

We applied two scenarios of intersectional MAIHDA. In scenario 1, we used the predefined 24 intersectional strata, which were built by age, sex/gender, marital status and level of education. In scenario 2, we used the predefined 48 intersectional strata which were built by all dimensions of social location of scenario 1 and subjective health. We used data with complete observations of all five variables that were used to build intersectional strata (N = 6,432).

Subsequently, for both scenario 1 and 2, a null model was compared to a model including fixed effects of the single variables used to construct intersectional strata [21]. To do so, we fit a null model that included a term for the intercept, no fixed effects but intersectional strata as well as PSUs as cross-classified random effects. Next, single variables used to build intersectional strata were included as fixed effects in addition to all parameters of the null model. Fixed effects in scenario 1 were age, sex/gender, marital status and level of education. Subjective health was added as fixed effect in scenario 2. These models were used to calculate four quantities of interest: (A) measures of discriminatory accuracy for intersectional strata, (B) the proportion of variance explained by adding fixed effects, (C) proportions of non-responders within intersectional strata, and (D) total interaction effects (intersectional effects) for each intersectional stratum.

To estimate measures of discriminatory accuracy of intersectional strata, variance partition coefficients (VPCs) were calculated for both null models and models including fixed effects [39]: (1) where σuj represents the variance of intersectional strata and σuk the variance of PSUs of the respective model. VPCs give the proportion of variance attributable to variance between intersectional strata and have been argued to represent discriminatory accuracy of intersectional strata [24].

To estimate the proportion of variance explained by adding fixed effects, the proportional change in variance (PCV) of intersectional strata between null model and model including fixed effects was calculated [39]: (2) where σuj(1) represents the variance of intersectional strata in the null model and σuj(2) represents the variance of intersectional strata in the model including fixed effects. The PCV represents the proportion of the total between-stratum variance of intersectional strata of the null model that is explained after having added all fixed effects (39). The lower the PCV, the higher the amount of “unexplained” variance, which can be due to interaction effects or to omitted variable bias [21].

Finally, the model including fixed effects was used to calculate total predicted proportions of non-responders within each intersectional stratum. Therefore, predicted log odds of non-response based on estimated fixed effects and random effects were calculated for each intersectional stratum. The predicted log odds were transformed to proportions using the inverse logit function.

To calculate intersectional effects within each intersectional stratum, predicted proportions of non-responders based on fixed effects alone were calculated for each intersectional stratum [21]. Log odds of non-response based on fixed effects were also transformed to proportions using inverse logits. Finally, intersectional effects were derived by subtracting predicted proportions of non-responders based on fixed effects alone from total predicted proportions of non-responders in both scenarios [39]. The transformation from log odds to proportions yields intersectional effects that are deviations from predictions of additive combinations of the fixed effects [39].

All MAIHDA models were estimated using Markov Chain Monte Carlo (MCMC) methods. We used the MCMCglmm package (version 2.29) in R (version 3.6.0). MCMCglmm has been shown to perform comparable to other statistical programs for cross-classified multilevel logistic regression models [40]. We used weakly informative priors and ran all analyses using 50,000 iterations with a burn-in period of 5,000 and a thinning interval of 50 iterations [39]. MCMC chains were checked graphically for convergence. Point estimates were the means of the respective MCMC chains for each parameter. 95% credible intervals (95% CI) were obtained using the 2.5th and 97.5th percentiles of the respective MCMC chains [39].

Ethics statement

All procedures performed in DEGS1 were in accordance with the ethical standards of the ethics committee of the Charité-Universitätsmedizin Berlin (Reference No. EA2/047/08). Participants of DEGS1 provided written informed consent prior to the interview and examination. This study was part of the joint project AdvanceGender [41]. AdvanceGender was in accordance with the ethical standards of the ethics committee of the Brandenburg Medical School (Reference No. E-01-20180529). All procedures were in accordance with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Results

Among the total sample of DEGS1 used in this study, 36% (2342/6534) were non-responders (Table 1). 39% (2561/6534) of the sample were under the age of 40 years and 31% (2035/6534) were over 60 years. Furthermore, 51% (3356/6534) were female, 45% (2908/6479) were not married, 32% (2088/6473) had a low level of education and 26% (1716/6506) rated their health as moderate or bad. There was strong evidence for an association of age, level of education, marital status and subjective health with non-response (Table 1). Compared to the youngest age group, the odds of non-response were lower in the group of people aged 40 to 59 and higher in the group aged 60 or older. The odds of non-response were furthermore higher when being unmarried, having a low level of education and rating one’s subjective health as moderate or bad compared to the respective reference groups. Odds of non-response among females were 5% lower compared to males, however, there was no evidence for an association between sex/gender and non-response.

thumbnail
Table 1. Study characteristics and univariable associations of dimensions of social location with being a non-responder.

https://doi.org/10.1371/journal.pone.0237349.t001

In scenario 1 of MAIHDA, the smallest number of observations in an intersectional stratum was 66 (23 non-responders). Numbers of observations in each intersectional stratum are displayed in S1 Table. Results for fixed effects indicated elevated odds among unmarried compared to married people and among people with a low compared to people with a high level of education (Table 2). The VPC of the null model was 3.3%. The VPC dropped to 0.8% after adding the fixed effects for age, sex/gender, marital status and level of education. PCV in scenario 1 was 74.4%, indicating that 25.6% of variance was not explained by adding fixed effects. The predicted proportions of non-responders ranged from 23% to 53% (Fig 2). Intersectional effects ranged from -3.0% to 4.8%, all 95% CI of intersectional effects crossed 0% (Fig 3).

thumbnail
Fig 2. Predicted proportions of non-responders for each stratum from scenario 1.

Point estimates are proportions and 95% credible intervals.

https://doi.org/10.1371/journal.pone.0237349.g002

thumbnail
Fig 3. Predicted intersectional effects for each stratum from scenario 1.

Point estimates are proportions and 95% credible intervals. Intersectional strata are ranked by the size of the predicted intersectional effect.

https://doi.org/10.1371/journal.pone.0237349.g003

thumbnail
Table 2. Fixed effects, variance partition coefficients and proportional change of variance (scenarios 1 and 2).

https://doi.org/10.1371/journal.pone.0237349.t002

After having added subjective health to build the intersectional strata (scenario 2), 3 strata had less than 20 observations, but no intersectional stratum had less than 10 observations (S2 Table). Results for fixed effects indicated evidence for elevated odds among people rating their health as moderate or bad compared to people rating their health as good (Table 2). The VPC of the null model was 3.6% and the VPC of the model including fixed effects was 0.9%. The PCV in scenario 2 was 74.8%, indicating that 25.2% of variance was not explained by adding fixed effects. Predicted proportions of non-responders ranged from 20% to 57% (Fig 4). Intersectional effects ranged from -3.6% to 6.4%, all 95% CIs of intersectional effects included 0% (Fig 5). Two intersectional strata showed large intersectional effects. Women aged 60 to 79 years who were unmarried, had low education and rated their health as moderate or bad showed an intersectional effect of 6.3% (95% CI -0.9% to 16.0%). Furthermore, men aged 18 to 39 who were unmarried, had a low level of education and rated their health as good had an intersectional effect of 6.4% (95% CI -1.3% to 15.4%). The predicted proportions of non-responders among these groups were among the highest of all intersectional strata with 51% and 57% respectively.

thumbnail
Fig 4. Predicted proportions of non-responders for each stratum from scenario 2.

Point estimates are proportions and 95% credible intervals. marr.: married, not m.: not married, high ed.: high education, low ed.: low education, bad health: moderate or bad health.

https://doi.org/10.1371/journal.pone.0237349.g004

thumbnail
Fig 5. Predicted intersectional effects for each stratum from scenario 2.

Point estimates are proportions and 95% credible intervals. Intersectional strata are ranked by the size of the predicted intersectional effect.

https://doi.org/10.1371/journal.pone.0237349.g005

Discussion

We investigated non-response to a population-based health survey in Germany using an intersectionality-informed approach. When using age, sex/gender, marital status, level of education and subjective health to build intersectional strata, predicted proportions of non-responders ranged from 20% to 57%. In this scenario we found a VPC of 3.6% indicating low discriminatory accuracy of intersectional strata. About 25% of the variance between intersectional strata could not be explained by adding fixed effects. Adding subjective health did not change the VPC or PCV compared to a scenario excluding subjective health. We did not find evidence for intersectional effects of any particular intersectional stratum in both scenarios as all CI of intersectional effects crossed 0. However, the intersectional effect for women aged 60 to 79 years who were unmarried, had low education and rated their health as moderate or bad and the intersectional effect for men aged 18 to 39 who were unmarried, had a low level of education and rated their health as good were relatively large with intersectional effects of 6.3% and 6.4% respectively.

42% of all non-responders participated in the non-responder survey of DEGS1 [32]. Thus, there remains uncertainty whether data gathered from non-responders is representative for all non-responders. To assess this possible selection bias, we compared proportions of sex/gender, marital status and level of education among responders in DEGS1 to census data for Germany (S1 Appendix). Compared to these census data, men, people not in marriage, and people with a low level of education are underrepresented in DEGS1. Data on subjective health was not available from the census and proportions of age groups could not be compared due to the stratified sampling of DEGS1 [30]. These crude comparisons indicate that our results are not generalizable to the German population, however, our results may allow conclusions about the directions of over- or underrepresentation.

We chose three categories for age, because previous studies suggested a low response among very young and very old people in Germany [20, 42]. The characteristics age, sex/gender and level of education were frequently used in recent quantitative intersectional analyses [21, 22, 39, 4345]. Instead of marital status, previous studies used cohabitation or civil status [39, 43, 45, 46]. Both measures probably crudely operationalise social support, however, they might capture different aspects of this broad concept [47]. A further important dimension of social location in Germany is race/ethnicity or migration [48]. Information on nationality, which is not comparable to race/ethnicity, was available in the data, however, the number of people with non-German nationality in our sample (N = 516) was too low to construct intersectional strata with sufficient numbers of observations in each stratum.

Finally, subjective health has not been included in intersectional MAIHDA so far. We chose to include a measure on subjective health separately in a second scenario, because it was consistently described as a strong predictor of study participation and because interaction of subjective health with intersectional strata might be suggestive for selection bias [16, 1820]. Furthermore, we would argue that subjective health is related to social privilege or stigma, because it measures both mental and psychological well-being [36, 37, 49, 50]. Therefore, an inclusion of subjective health in an intersectionality-informed analysis might be justified. Finally, unchanged PCVs between scenario 1 and 2 suggest that adding subjective health does not increase variance unexplained by additive fixed effects. Furthermore, no additional intersectional effects were revealed in scenario 2.

MAIHDA is a new method that is still to be tested in simulation studies and real world applications. We adopted recently proposed methods for cross-classified multilevel logistic regression in MAIHDA [22, 39]. Sample size in this study is sufficient to estimate a multilevel model since 3 of 48 strata had less than 20 observations in scenario 2 and all strata had over 30 observations in scenario 1 [51]. Nonetheless, our sample size might be at the lower boundary of scenarios in which MAIHDA is advantageous over single level models [21, 25]. We used a cross-classified regression analysis to account for the clustered sampling design of DEGS1. Cross-classified MAIHDA could, furthermore, be used to separate geographical from socioeconomic influences, which was beyond the scope of the present analysis. However, promising approaches to incorporate contextual-level determinants in MAIHDA have been published recently [44].

Compared to single-level intersectional analyses, the risk of a type one error is reduced in MAIHDA by precision-weighting of intersectional strata [26]. However, in presence of interaction between fixed effects, precision-weighting performs less well than in regular applications of multilevel modelling [26]. Furthermore, estimates of fixed effects in MAIHDA are different from fixed effects in single level models as they are derived from precision-weighted grand means instead of population means [25, 27]. A grand mean in MAIHDA is the mean of means of intersectional strata [25]. A major advantage of MAIHDA is the estimation of measures of discriminatory accuracy besides traditional comparison of population averages [24]. Interpreting measures of discriminatory accuracy together with population averages enables more comprehensively informed decisions about suitable public health action to address an issue under study [24].

It has been emphasised that MAIHDA is a tool to descriptively explore or map outcomes of interest across intersectional strata, which we considered a suitable and innovative approach for our research question [21]. Crucially, MAIHDA models remain parsimonious when investigating multiple combinations of social characteristics and are easier to interpret than for example single level models with multiple interaction terms [21]. Estimates of intersectional effects are displayed as deviations from predictions of additive main effects, which is in line with the proposition of intersectionality [11, 21]. Furthermore, comparisons to a master category are avoided in MAIHDA as no reference groups are used to estimate intersectional effects [21]. MAIHDA visualises combinations of privileged and oppressed social locations, which contributes to avoid essentialism and prioritising any system of oppression over the other [10]. Finally, MAIHDA is a convenient method when researchers aim to err on the conservative side [22].

To our knowledge, this is the first study to present an intersectionality-informed quantitative analysis of study participation. Previous research has suggested that associations of single dimensions of social location with study participation might differ when combined with further dimensions [13, 20]. An intersectionality-informed perspective might contribute to capture these differential patterns of non-response more comprehensively. Results from the fixed effects of our MAIHDA models agree with previous research suggesting that people with a lower level of education, who are unmarried or report worse self-rated health show low response proportions [13, 16, 19]. Research on study participation from Germany suggested that young men and old women might be participating less frequently in epidemiological studies [20, 42]. Our result of high proportions of non-responders among multiply marginalised old women and young men are in line with these findings. However, as all CIs of intersectional effects included zero, there was little statistical evidence for well-known patterns of interaction such as the interaction of sex/gender and age.

An intersectionality-informed approach to the relationship of social location with study participation opens up several perspectives that cannot be addressed by conventional analyses. First, low VPCs in our study illustrated that intersectional strata have low discriminatory accuracy as it has been suggested that VPCs between 1% and 5% are poor [39]. Hence, these characteristics may not be suited to predict study participation. Low VPCs also indicate that heterogeneity within intersectional strata is high. As no strong evidence for intersectional effects could be found, our results indicate that there is no justification to exclusively target specific intersectional strata in order to increase response, but that a combination of targeted and population-based measures might be appropriate to achieve more equal representation [24]. Finally, the total proportion of variance between intersectional strata that was not explained by fixed effects was substantial with 25%, suggesting the presence of complex interactions between all included variables. We presented a first attempt to capture this complexity. However, our results should be confirmed in further research before generalizable conclusions can be drawn.

Conclusions

We need a more complex understanding of study participation having in mind the steadily decreasing participation in population-based studies and increasing diversity of contemporary societies. Selection bias occurs in descriptive epidemiology if sub-groups of a population that suffer from a high disease burden are underrepresented. This scenario might apply for populations at the intersection of multiple axes of oppression, because, besides being at high risk for many diseases, marginalised groups have been excluded from health research and often choose not to participate in studies [52]. An intersectional framework might be an important first step to consider the multiplicity of systems of privilege and oppression when investigating participation and representativeness of population-based studies. Our results show that MAIHDA may be suited to operationalise an intersectionality-informed analysis of non-response and we suggest to conduct further analyses in order to add evidence to this topic.

Supporting information

S1 Table. Number of observations within intersectional strata, predicted proportions of non-responders and intersectional effects of scenario 1.

Intersectional strata are ranked by predicted proportions of non-responders.

https://doi.org/10.1371/journal.pone.0237349.s001

(DOCX)

S2 Table. Number of observations within intersectional strata, predicted proportions of non-responders and intersectional effects of scenario 2.

Intersectional strata are ranked by predicted proportions of non-responders.

https://doi.org/10.1371/journal.pone.0237349.s002

(DOCX)

S1 Appendix. Comparison of the cross-sectional sample of DEGS1 with census data.

https://doi.org/10.1371/journal.pone.0237349.s003

(DOCX)

Acknowledgments

We would like to thank all participants of DEGS1 and of the non-responder survey of DEGS1. Moreover, we would like to thank all members of the joint project AdvanceGender for their contribution in reviewing and discussing the conceptualisation and statistical methodology of this study.

ADVANCE GENDER study group:

University of Bremen, Institute of Public Health and Nursing Research, Department of Social Epidemiology (Gabriele Bolte, Emily Mena), Robert Koch Institute (Alexander Rommel, Anke-Christine Saß, Kathleen Pöge, Sarah Strasser), Brandenburg Medical School Theodor Fontane, Institute of Social Medicine and Epidemiology (Christine Holmberg, Sibille Merz, Philipp Jaehn).

References

  1. 1. Porta M. A dictionary of epidemiology. New York, NY: Oxford university press, p. 247; 2014.
  2. 2. Rothman KJ, Gallacher JE, Hatch EE. Why representativeness should be avoided. Int J Epidemiol. 2013;42(4):1012–4. pmid:24062287
  3. 3. International Committee of Medical Journal Editors. Recommendations for the Conduct, Reporting, Editing and Publication of Scholarly Work in Medical Journals. 2018 [accessed 03.06.2019]. Available from: http://www.ICMJE.org, accessed 03.06.2019.
  4. 4. Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Int J Surg. 2014;12(12):1500–24. pmid:25046751
  5. 5. Anthias F. Hierarchies of social location, class and intersectionality: Towards a translocational frame. Int Sociol. 2012;28(1):121–38.
  6. 6. Oliver S, Kavanagh J, Caird J, Lorenc T, Oliver K, Harden A. Health promotion, inequalities and young people’s health (EPPI-Centre report no. 1611). London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2008 [accessed 06.02.2019]. Available from: https://eppi.ioe.ac.uk/cms/Default.aspx?tabid=2410, accessed 06.02.2019.
  7. 7. Crenshaw K. Demarginalizing the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory and Antiracist Politics. Univ Chic Leg Forum. 1989;Vol. 1989(Article 8):139–67.
  8. 8. Bowleg L. The problem with the phrase women and minorities: intersectionality-an important theoretical framework for public health. Am J Public Health. 2012;102(7):1267–73. pmid:22594719
  9. 9. McCall L. The Complexity of Intersectionality. Signs (Chic). 2005;Vol. 30(No. 3):1772–800.
  10. 10. Hankivsky O. Women's health, men's health, and gender and health: implications of intersectionality. Soc Sci Med. 2012;74(11):1712–20. pmid:22361090
  11. 11. Bauer GR. Incorporating intersectionality theory into population health research methodology: challenges and the potential to advance health equity. Soc Sci Med. 2014;110:10–7. pmid:24704889
  12. 12. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53. pmid:17553702
  13. 13. Goldberg M, Chastang JF, Leclerc A, Zins M, Bonenfant S, Bugel I, et al. Socioeconomic, demographic, occupational, and health factors associated with participation in a long-term epidemiologic survey: a prospective study of the French GAZEL cohort and its target population. Am J Epidemiol. 2001;154(4):373–84. pmid:11495861
  14. 14. Ahlmark N, Algren MH, Holmberg T, Norredam ML, Nielsen SS, Blom AB, et al. Survey nonresponse among ethnic minorities in a national health survey—a mixed-method study of participation, barriers, and potentials. Ethn Health. 2015;20(6):611–32. pmid:25411892
  15. 15. Howcutt SJ, Barnett AL, Barbosa-Boucas S, Smith LA. Patterns of response by sociodemographic characteristics and recruitment methods for women in UK population surveys and cohort studies. Women & health. 2018;58(4):365–86.
  16. 16. Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J. Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol. 2003;13(2):105–10. pmid:12559669
  17. 17. Silva Junior SH, Santos SM, Coeli CM, Carvalho MS. Assessment of participation bias in cohort studies: systematic review and meta-regression analysis. Cad Saude Publica. 2015;31(11):2259–74. pmid:26840808
  18. 18. Drivsholm T, Eplov LF, Davidsen M, Jorgensen T, Ibsen H, Hollnagel H, et al. Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health. 2006;34(6):623–31. pmid:17132596
  19. 19. Shahar E, Folsom AR, Jackson R. The effect of nonresponse on prevalence estimates for a referent population: insights from a population-based cohort study. Atherosclerosis Risk in Communities (ARIC) Study Investigators. Ann Epidemiol. 1996;6(6):498–506. pmid:8978880
  20. 20. Stang A, Moebus S, Dragano N, Beck EM, Möhlenkamp S, Schmermund A, et al. Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf Recall Study: Identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005;20:489–96. pmid:16121757
  21. 21. Evans CR, Williams DR, Onnela J-P, Subramanian SV. A multilevel approach to modeling health inequalities at the intersection of multiple social identities. Soc Sci Med. 2018;203:64–73. pmid:29199054
  22. 22. Evans CR. Adding interactions to models of intersectional health inequalities: Comparing multilevel and conventional methods. Soc Sci Med. 2019;221:95–105. pmid:30578943
  23. 23. Evans CR. Modeling the intersectionality of processes in the social production of health inequalities. Soc Sci Med. 2019;Apr(226):249–53.
  24. 24. Merlo J. Multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) within an intersectional framework. Soc Sci Med. 2018;203:74–80. pmid:29305018
  25. 25. Evans CR, Leckie G, Merlo J. Multilevel versus single-level regression for the analysis of multilevel information: The case of quantitative intersectional analysis. Soc Sci Med. 2020;Jan(245):112499.
  26. 26. Bell A, Holman D, Jones K. Using Shrinkage in Multilevel Models to Understand Intersectionality. Methodology. 2019;15(2):88–96.
  27. 27. Lizotte DJ, Mahendran M, Churchill SM, Bauer GR. Math versus meaning in MAIHDA: A commentary on multilevel statistical models for quantitative intersectionality. Soc Sci Med. 2020;Jan(245):112500.
  28. 28. Bauer GR, Scheim AI. Advancing quantitative intersectionality research methods: Intracategorical and intercategorical approaches to shared and differential constructs. Soc Sci Med. 2019;226:260–2. pmid:30914246
  29. 29. Hoffmann W, Latza U, Baumeister SE, Brünger M, Buttmann-Schweiger N, Hardt J, et al. Guidelines and recommendations for ensuring Good Epidemiological Practice (GEP): a guideline developed by the German Society for Epidemiology. Eur J Epidemiol. 2019;34(3):301–17. pmid:30830562
  30. 30. Scheidt-Nave C, Kamtsiuris P, Gosswald A, Holling H, Lange M, Busch MA, et al. German health interview and examination survey for adults (DEGS)—design, objectives and implementation of the first data collection wave. BMC Public Health. 2012;12:730. pmid:22938722
  31. 31. Gosswald A, Lange M, Dolle R, Holling H. [The first wave of the German Health Interview and Examination Survey for Adults (DEGS1): participant recruitment, fieldwork, and quality management]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2013;56(5–6):611–9. pmid:23703477
  32. 32. Kamtsiuris P, Lange M, Hoffmann R, Schaffrath Rosario A, Dahm S, Kuhnert R, et al. Die erste Welle der Studie zur Gesundheit Erwachsener in Deutschland (DEGS1). Stichprobendesign, Response, Gewichtung und Repräsentativität. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2013;56(5–6):620–30. pmid:23703478
  33. 33. Bellach BM, Knopf H, Thefeld W. [The German Health Survey. 1997/98]. Gesundheitswesen. 1998;60 Suppl 2:S59–68.
  34. 34. Thefeld W, Stolzenberg H, Bellach BM. [The Federal Health Survey: response, composition of participants and non-responder analysis]. Gesundheitswesen. 1999;61 Spec No:S57-61.
  35. 35. Aschpurwis + Behrens GmbH. BIK Regionen. Ballungsräume, Stadtregionen, Mittel-/ Unterzentrengebiete. Methodenbeschreibung zur Aktualisierung 2010 [in German]. Hamburg: Aschpurwis + Behrens GmbH; 2010.
  36. 36. O'Hara L, Gregg J. The war on obesity: a social determinant of health. Health promotion journal of Australia: official journal of Australian Association of Health Promotion Professionals. 2006;17(3):260–3.
  37. 37. Persmark A, Wemrell M, Zettermark S, Leckie G, Subramanian SV, Merlo J. Precision public health: Mapping socioeconomic disparities in opioid dispensations at Swedish pharmacies by Multilevel Analysis of Individual Heterogeneity and Discriminatory Accuracy (MAIHDA). PLoS One. 2019;14(8):e0220322. pmid:31454361
  38. 38. Winker G, Degele N. Intersektionalität: Zur Analyse sozialer Ungleichheiten [in German]. Bielefeld: transcript Verlag; 2015.
  39. 39. Axelsson Fisk S, Mulinari S, Wemrell M, Leckie G, Perez Vicente R, Merlo J. Chronic Obstructive Pulmonary Disease in Sweden: An intersectional multilevel analysis of individual heterogeneity and discriminatory accuracy. SSM Popul Health. 2018;4:334–46. pmid:29854918
  40. 40. Li B, Lingsma HF, Steyerberg EW, Lesaffre E. Logistic random effects regression models: a comparison of statistical packages for binary and ordinal outcomes. BMC Med Res Methodol. 2011;11:77. pmid:21605357
  41. 41. Pöge K, Rommel A, Mena E, Holmberg C, Sass AC, Bolte G. [AdvanceGender-Joint project for sex/gender-sensitive and intersectional research and health reporting]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2019;62(1):102–7. pmid:30498848
  42. 42. Latza U, Stang A, Bergmann M, Kroke A, Sauer S, Holle R, et al. Zum Problem der Response in epidemiologischen Studien in Deutschland (Teil I). Gesundheitswesen. 2004;67(05):326–36.
  43. 43. Hernandez-Yumar A, Wemrell M, Abasolo Alesson I, Gonzalez Lopez-Valcarcel B, Leckie G, Merlo J. Socioeconomic differences in body mass index in Spain: An intersectional multilevel analysis of individual heterogeneity and discriminatory accuracy. PLoS One. 2018;13(12):e0208624. pmid:30532244
  44. 44. Evans CR. Reintegrating contexts into quantitative intersectional analyses of health inequalities. Health Place. 2019;60:102214. pmid:31563833
  45. 45. Wemrell M, Mulinari S, Merlo J. Intersectionality and risk for ischemic heart disease in Sweden: Categorical and anti-categorical approaches. Soc Sci Med. 2017;177:213–22. pmid:28189024
  46. 46. Kiadaliri A, Englund M. Intersectional inequalities and individual heterogeneity in chronic rheumatic diseases: An intersectional multilevel analysis. Arthritis care & research. 2019:[Epub ahead of print].
  47. 47. Hutchison C. Social support: factors to consider when designing studies that measure social support. J Adv Nurs. 1999;29(6):1520–6. pmid:10354249
  48. 48. Razum O, Wenner J. Social and health epidemiology of immigrants in Germany: past, present and future. Public Health Rev. 2016;37:4. pmid:29450046
  49. 49. Pinquart M. Correlates of subjective health in older adults: a meta-analysis. Psychology and aging. 2001;16(3):414–26. pmid:11554520
  50. 50. Wu S, Wang R, Zhao Y, Ma X, Wu M, Yan X, et al. The relationship between self-rated health and objective health status: a population-based study. BMC Public Health. 2013;13(1):320.
  51. 51. McNeish DM, Stapleton LM. The Effect of Small Sample Size on Two-Level Model Estimates: A Review and Illustration. Educ Psychol Rev. 2014;28(2):295–314.
  52. 52. Larson E. Exclusion of Certain Groups from Clinical Research. Image J Nurs Sch. 1994;26(3):185–90. pmid:7989060