7 Dec 2017: The PLOS ONE Staff (2017) Correction: Interactive and Independent Associations between the Socioeconomic and Objective Built Environment on the Neighbourhood Level and Individual Health: A Systematic Review of Multilevel Studies. PLOS ONE 12(12): e0189552. https://doi.org/10.1371/journal.pone.0189552 View correction
The research question how contextual factors of neighbourhood environments influence individual health has gained increasing attention in public health research. Both socioeconomic neighbourhood characteristics and factors of the built environment play an important role for health and health-related behaviours. However, their reciprocal relationships have not been systematically reviewed so far. This systematic review aims to identify studies applying a multilevel modelling approach which consider both neighbourhood socioeconomic position (SEP) and factors of the objective built environment simultaneously in order to disentangle their independent and interactive effects on individual health.
The three databases PubMed, PsycINFO, and Web of Science were systematically searched with terms for title and abstract screening. Grey literature was not included. Observational studies from USA, Canada, Australia, New Zealand, and Western European countries were considered which analysed simultaneously factors of neighbourhood SEP and the objective built environment with a multilevel modelling approach. Adjustment for individual SEP was a further inclusion criterion.
Thirty-three studies were included in qualitative synthesis. Twenty-two studies showed an independent association between characteristics of neighbourhood SEP or the built environment and individual health outcomes or health-related behaviours. Twenty-one studies found cross-level or within-level interactions either between neighbourhood SEP and the built environment, or between neighbourhood SEP or the built environment and individual characteristics, such as sex, individual SEP or ethnicity. Due to the large variation of study design and heterogeneous reporting of results the identification of consistent findings was problematic and made quantitative analysis not possible.
There is a need for studies considering multiple neighbourhood dimensions and applying multilevel modelling in order to clarify their causal relationship towards individual health. Especially, more studies using comparable characteristics of neighbourhood SEP and the objective built environment and analysing interactive effects are necessary to disentangle health impacts and identify vulnerable neighbourhoods and population groups.
Citation: Schüle SA, Bolte G (2015) Interactive and Independent Associations between the Socioeconomic and Objective Built Environment on the Neighbourhood Level and Individual Health: A Systematic Review of Multilevel Studies. PLoS ONE 10(4): e0123456. https://doi.org/10.1371/journal.pone.0123456
Academic Editor: Toshiyuki Ojima, Hamamatsu University School of Medicine, JAPAN
Received: August 6, 2014; Accepted: March 3, 2015; Published: April 7, 2015
Copyright: © 2015 Schüle, Bolte. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: S.A. Schüle receives a doctoral scholarship within the framework of the Junior Research Group Salus, which is funded by the foundation ‘Fritz und Hildegard Berg-Stiftung’ within the ‘Stifterverband für die Deutsche Wissenschaft e.V.’, Essen, Germany. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Since the late 1990s an increasing number of epidemiological studies have analysed whether the socioeconomic, built, social or ethnic neighbourhood environment have an independent effect on individual health outcomes or health-related behaviours [1, 2]. There is an overall conclusion that underlying mechanisms of the association between neighbourhood environments and health are quite complex and both mediating and interacting mechanisms should be considered. Therefore, various conceptual models were developed describing pathways explaining associations between neighbourhood context and individual health [2–9].
For a better systematization of possible connections between neighbourhood characteristics and individual health a distinction between compositional and contextual effects is widely established in the literature. A compositional effect is present if health differences between neighbourhoods are attributed to individual characteristics, the so-called composition of neighbourhood residents, such as individual health behaviours, health status or individual socioeconomic position (SEP). The term contextual effect is used if variables at the neighbourhood level, such as features of the built or social environment, have an effect on individual health outcomes while adjusting for possible confounders at the individual level to avoid an ecological fallacy [10–12]. This more abstract distinction has also been discussed critically in the literature . However, it provides a good basis for suggesting conceptual pathways in which ways neighbourhood context can affect individual health.
To separate out potential contextual neighbourhood effects from individual effects a multilevel modelling approach is an appropriate analytic strategy addressing such issues. Multilevel modelling offers the possibility to sort out how much variance of health outcomes between neighbourhoods is related to individual factors and how much is explained by contextual factors on the neighbourhood level. A multilevel model combines data on at least two hierarchical levels: aggregated variables on the neighbourhood level (2nd level) and variables on the individual level from residents within the neighbourhood (1st level). Thus, simultaneous examinations of independent effects of each level and interactions within and across levels on individual health outcomes are possible while accounting for the potential dependency of individual observations sharing the same characteristics of higher level variables [11, 14].
Systematic reviews showed that most neighbourhood studies focused on factors of neighbourhood SEP from aggregated census data. They analysed whether neighbourhood SEP has a contextual effect on individual health while simultaneously adjusting for individual socio-demographic characteristics. Many of these studies found out that a low neighbourhood SEP was independently associated with poor health, such as increased mortality risk, poor self-rated health, depressive symptoms, low birth weight or cardiovascular risk factors [15–22]. Evidence from these studies raised the question which underlying factors explain independent associations between neighbourhood SEP and individual health. Many studies hypothesized that poor neighbourhoods are exposed to a poor built environment, such as air pollution, lack of green space or an unhealthy food environment. Thus, an integrated consideration of neighbourhood SEP, built environmental factors and socioeconomic factors on the individual level is needed to explore underlying mechanisms how neighbourhood SEP and the built environment are connected and associated with health.
The term ‘built environment’ can be systematically differentiated from the term ‘natural environment’. Both terms belong to the physical environment. Schulz and Northridge define the built environment as that part of the physical environment which “encompass all of the buildings, spaces, and products that are created or significantly modified by people (…)” (Page 456) . In urban environments none of the environment is natural because even parks including natural components, such as green space or water, are to some extent created or modified by people, and can be assigned to the built environment, too. Thus, the built environment covers many dimensions in an urban context, such as land use, transportation systems, services, public resources, zoning regulations or building characteristics . The built environment can be measured subjectively or objectively. Subjective measures are mostly self-reported perceptions conducted in survey questionnaires. Objective measures can be either collected in the field or obtained from existing land use data in Geographic Information Systems (GIS). Systematic reviews focusing on the evidence how factors of the built environment influence health indicated the increasing importance of this neighbourhood dimension [25–29]. These reviews considered primarily cardiovascular risk factors, such as overweight or low physical activity. Though studies of the built environment gave partly inconsistent results, all reviews concluded that the built environment can significantly impact individual health.
The links between neighbourhood SEP and exposures from the built environment and health are captured by the environmental justice framework. A conceptual model derived from this framework contains two main hypothetical pathways how socioeconomic position, environmental exposures and health are connected: The first hypothesis states that environmental exposures are social unequally distributed (exposure variation by SEP), the second hypothesis states that neighbourhoods or individuals with a low SEP are more vulnerable to environmental exposures .
Both neighbourhood SEP and built environmental factors play a significant role for explaining health inequalities between neighbourhoods. However, to the best of our knowledge a systematic review focusing on to what extent both characteristics of neighbourhood SEP and the built environment are simultaneously considered in epidemiological neighbourhood studies, and how they interact with each other or with individual characteristics has not been carried out so far.
The overall goal of this systematic review is to identify epidemiological studies with a multilevel modelling approach considering characteristics of neighbourhood SEP and the objective built environment simultaneously in order to disentangle their independent or interactive effects on individual health outcomes.
The primary research questions is, how characteristics of neighbourhood SEP and the objective built environment are associated with individual health outcomes or health-related behaviours if both dimensions are considered simultaneously in multilevel modelling. Secondary, the review summarizes knowledge on interactions between neighbourhood SEP, the built environment and individual SEP.
The three databases PubMed, PsycINFO, and Web of Science were searched on the 5th of November 2013. The research question, search strategy and inclusion criteria were developed before the review process. There is no registered protocol reference number, however. Search terms were generated for title and abstract screening in order to identify neighbourhood studies with a multilevel modelling approach considering both socioeconomic and built environmental factors. In order to identify synonyms for the terms ‘neighbourhood’, ‘built environment’, ‘socioeconomic environment’ and ‘multilevel modelling’, the terminology in already existing reviews and their cited studies dealing with these topics were additionally considered. In PubMed terms of Medical Subject Headings were taken into account (Table 1). Title and abstracts were screened by two reviewers independently with predefined inclusion criteria. A third reviewer was consulted if there was disagreement. If one of the inclusion criteria could not be clearly identified in the abstract, the full text of the record was analysed for eligibility by one reviewer. An explicit search on grey literature was not performed because the review focused on observational epidemiological studies applying advanced statistical modelling which are most likely to be found in scientific journals. However, to take into account potential publication bias, we did not limit our analysis on papers published in peer-reviewed journals. References of finally included records were additionally checked. Neighbourhood studies applying a multilevel modelling approach are a relatively recent study type. Therefore, we did not restrict our search to a specific time period.
As suggested by Krieger et al. the term ‘socioeconomic position’ (SEP) is used. The term ‘SEP’ combines actual economic and social resources with prestige-based characteristics which relatively position individuals, households and neighbourhoods in society [31, 32].
The following inclusion criteria were applied:
- Observational studies applying multilevel modelling and considering factors of the neighbourhood environment as higher level variables. Studies focusing exclusively on other environments were excluded, such as the school or work environment. Moreover, studies taking into account subjects from clinical settings or focusing on study populations with health problems were also excluded. Clinical trials and intervention studies were excluded, too.
- Studies from USA, Canada, Australia, New Zealand and Western European Countries
- Physical or mental health outcomes, or health-related behaviours measured at the individual level.
- Simultaneous consideration of at least one characteristic of neighbourhood SEP from the whole neighbourhood population and at least one objective measure of the built environment in one multilevel model. Studies were excluded if neighbourhood SEP was only considered as an adjustment variable.
- Measures of the objective built environment. Papers were excluded which considered only measures of the perceived built environment. Studies showed that there is low to moderate agreement between objective and perceived measures of the built environment [33, 34]. Moreover, studies which assessed the neighbourhood built environment via observational methods with trained staff were also excluded due to limitations in validity .
- Adjustment for at least one individual socioeconomic factor. Ethnicity alone was not considered as a sufficient indicator for socioeconomic position . Therefore, studies considering only specific ethnic population samples were also excluded.
Each included study was described in a summary table and coded related to: outcome, population sample, country, considered factors of neighbourhood SEP and the objective built environment, and individual and further contextual factors. Because the review focused on neighbourhood SEP and the objective built environment, other considered neighbourhood characteristics in the study, such as measures of crime, social capital, residential stability, perceived built environment or segregation were indicated also in the last column (Table 2).
In a qualitative analysis independent and interactive effects of the built environment and neighbourhood SEP towards individual health outcomes were visualized in four tables grouped by similar health outcomes or health-related behaviours. All variables with a p-value <0.05 in the final multilevel model were reported as statistically significant. No quantitative assessment for risk of bias in individual studies was performed. However, in each study sample size, number of observations per neighbourhood and total number of considered neighbourhood clusters were checked, because simulation studies showed that small sample sizes in multilevel studies result in biased effect estimates [37–40]. The review was conducted in accordance to the PRISMA statement (S1 Table) .
After removing of duplicates 858 records were taken into account for abstract screening. 686 records were excluded based on abstracts and titles. There was a disagreement on 14 abstracts resulting in an agreement of 91.4% between the two independent reviewers. 172 records were included into full text analysis, and 24 of them met all inclusion criteria. Nine studies were additionally identified through the analysis of references from the 24 papers selected by full text analysis. These nine studies also underwent abstract screening and full text analysis. Finally, 33 studies were considered for qualitative analysis (Fig 1).
The diagram describes the information flow containing number of identified records, included and excluded records, and the reasons why records were excluded. The diagram was adapted from the PRISMA statements .
Description of studies and sample size assessment
Except of one study, all had a cross-sectional study design and most of them were conducted in the United States (Table 2). Seven studies investigated exclusively outcomes measuring various forms of physical activity [42–48]. One of these seven studies analysed people 45 years or older  and one used data from adolescents aged 13–15 years . The other five analysed an adult population sample.
Six studies examined exclusively measures indicating overweight or obesity either directly with the Body Mass Index (BMI) as a continuous variable or with BMI thresholds for overweight or obesity [49–54]. Two of them used data from older adults [49, 50].
Five studies analysed both measures of physical activity and overweight [55–59] including one study which considered additionally mental and physical quality of life, and depressive symptoms . One of these studies used data from students aged 13–16 years .
Four studies investigated how neighbourhood context was associated with perinatal health outcomes [60–63] and one longitudinal study focused on child accidents and injuries in children aged 0–5 years . Five studies analysed self-rated health or self-reported health problems [65–69], and two of them considered a population sample 55 years or older [67, 68]. One study focused exclusively on stress , one on smoking , one on heavy alcohol consumption  and two on objectively measured coronary artery calcification in adults aged 45–75 years [73, 74].
Regarding characteristics of neighbourhood SEP 16 studies calculated an index capturing various socioeconomic characteristics of the neighbourhood population [47, 49–52, 54–57, 65–72]. The others used single indicators of neighbourhood SEP, such as measures of income, education, poverty or unemployment.
The objective built environment was described with a variety of measures. Indices for walkability, land use mix and urbanity were calculated. Single land use types were also considered, such as retail, recreational areas, restaurants, fast food outlets, cultural and education institutions, or health and human services. Environmental pollution, such as from traffic or waste sites, was mainly investigated in studies focusing on perinatal health, mental health or self-rated health. Eleven studies calculated built environmental measures on the individual level [49, 51, 57, 60–63, 71–74], such as individual distances from residential addresses to shops or main roads.
There was a great heterogeneity concerning sample size both of individual observations and neighbourhood clusters. Sample size ranged from 637 to 425,752 individual observations and the number of considered neighbourhood clusters ranged from 24 up to 4,604 neighbourhoods. Unfortunately, only a minority of included studies gave detailed descriptive information about the number of observations per neighbourhood. Referring to simulation studies performed on sample sizes for multilevel models, most of the reviewed studies showed a sufficient size of neighbourhoods and individual observations [37–40]. However, due to missing information in many studies about the range of individual observations within neighbourhood clusters we could not assess whether these effect estimates could be biased.
Associations between socioeconomic and built environments and physical activity
Two studies detected associations between neighbourhood SEP and physical activity independent from the built environment and individual factors (Table 3). In the first study a high neighbourhood income was negatively associated with walking for transport and positively with motorized transport , and in the second a high neighbourhood education was positively associated with various measures of walking . One study found an interaction between neighbourhood SEP and sex : The positive association between a high neighbourhood SEP and physical activity was mitigated for men.
Seven studies detected associations between the built environment and physical activity measures independent from neighbourhood SEP and individual factors. Three found a positive association between a walkability index and walking behaviours and physical activity [43, 45, 59]. Moreover, a walkability index was inversely associated with motorized transport . One study detected an unexpected positive association between a walkability index and self-reported sitting behaviour and objectively measured sedentary time . Urbanity was positively associated with utilitarian walking and negatively with recreational walking . One study detected an independent positive association between number of restaurants and bars and regular exercise . A further study analysing physical activity in students found a negative association between a calculated compactness index and sport participation and a positive association between number of sport facilities and sport participation .
Most studies considering single land use types, such as retail or recreational areas, found no associations. In five studies interactions were detected. Studies showed that associations between recreational land use, retail or availability of restaurants varied by sex or ethnicity [55–57]. One study showed a positive association between park areas and leisure time physical activity only for women . An inverse association between green space and overall physical activity was observed only for men . The same study showed a positive association between number of restaurants and overall physical activity only for women and a positive association between number of convenience stores and overall physical activity only for men. A third study demonstrated a positive association between number of markets and utilitarian walking only for non-Hispanic whites, a negative association between street connectivity and recreational walking only for African Americans, and a negative association between block length and recreational walking was slightly stronger for non-Hispanic whites .
One study detected two interactions: One between a walkability index and individual reported reasons why people choose their neighbourhood and another between the walkability index and education. There was a positive association between a walkability index and walking for transport only for people who choose their neighbourhood because of a good perceived neighbourhood environment (closeness to job, school, shops, services or good perceived walkability) and only for people with 12 or more years of education . In a second study neighbourhood income moderated the association between walkability and physical activity. A positive association between walkability and two outcomes of average activity level and moderate-to-vigorous physical activity was only significant in low income neighbourhoods .
Associations between socioeconomic and built environments and overweight
Eight of eleven studies showed significant associations between indicators of neighbourhood SEP and BMI, overweight or obesity independent from individual and built environmental factors (Table 4). Three studies found a negative association between a high neighbourhood SEP and BMI, overweight or obesity [49, 50, 52]. Two found a positive association between a low neighbourhood SEP and BMI [51, 54]. A high neighbourhood income was negatively associated with BMI and obesity , a low neighbourhood income was positively associated with BMI and obesity , and a low neighbourhood education was positively associated with BMI .
Two studies on overweight showed interactions between neighbourhood SEP and individual characteristics. One study found out that an unexpected inverse association between a low neighbourhood SEP and overweight or obesity was only significant for men . A further study detected a negative association between a high neighbourhood SEP and BMI only for non-Hispanic whites .
Seven studies detected significant associations between built environmental factors and measures of overweight independent from neighbourhood SEP and individual characteristics. Two studies detected an independent inverse association between measures of street connectivity and BMI or obesity [52, 58] and one of them showed a positive association between distances to parks and obesity . Low walkability was positively associated with overweight or obesity in one study . There was a negative association between density of sport facilities in a one mile radius around home address and BMI . A further study found an unexpected negative association between number of restaurants and overweight or obesity . A further study showed a positive association between number of restaurants and BMI, however, the total number of restaurants included also fast food outlets .
In six studies interactions were shown. A negative association between street connectivity, number of parks in a one mile radius around the home address and BMI was only significant for non-Hispanic whites  and an inverse association between air pollution and obesity was only significant for women . One study showed a significant positive association between number of convenience stores, fast food restaurants, park areas and overweight or obesity only for women . A further study detected that a positive association between fast food outlets and BMI was mitigated for car owners .
There was a negative association between proximity to ethnic markets and supermarkets from home address and BMI only for women and, on the other hand, a positive association between neighbourhood density of grocery stores and BMI also only for women . A further study detected a significant positive association between number of specialty stores and overweight or obesity only for women, too. The same study found an inverse association between green space and overweight or obesity for women and a positive association for men, however. Moreover, a significant positive association between summer outdoor facilities and the two outcomes of overweight and obesity was also only detected for women .
Associations between socioeconomic and built environments and health outcomes and health-related behaviours
Most studies detected significant associations between neighbourhood SEP and health outcomes or health-related behaviours (Table 5). Six studies found significant associations between neighbourhood SEP and individual health outcomes or health-related behaviours independent from the built environment and individual characteristics. A high neighbourhood income was positively associated with physical quality of life . One study found a positive association between a high neighbourhood SEP and heavy alcohol consumption . A further study detected a positive association between neighbourhood unemployment and artery calcification . There was an inverse association between a low neighbourhood SEP and a health score derived from self-reported health problems. Higher values of the score indicated better health . Neighbourhood unemployment was positively associated with bad self-rated health . One study which analysed disability in people aged 55 or older detected a negative association between a high neighbourhood SEP and minor reported body limitations .
Three studies detected associations between built environmental factors and health outcomes independent from neighbourhood SEP and individual factors. A walkability index was inversely associated with mental quality of life and positively with more depressive symptoms . One study found a negative association between traffic and a health score calculated from self-reported health problems. Higher values of the score indicated better health . In another study waste sites and traffic were positively associated with reported day-to-day stress .
In eight studies factors of neighbourhood SEP or the built environment interacted with individual characteristics. There was a positive association between a low neighbourhood SEP and reported heart problems only for women aged 55 years or older . One study detected that an inverse association between a high neighbourhood SEP and number of smoked cigarettes per day was stronger for residents with a higher individual SEP . Neighbourhood unemployment interacted both with sex and traffic in a further study. For men there was a positive association between neighbourhood unemployment and artery calcification with an individual distance to the next major road <100 meter from their home address. Unexpectedly, a positive association between neighbourhood unemployment and artery calcification was significant for women with a distance to the next major road >100 meter . Another study found a positive association between neighbourhood unemployment and bad self-rated health only for women . One study considered neighbourhood SEP as a moderator on the association between individual reported stress and a calculated health score from self-reported health problems. Higher values of the score indicated better health. The negative association between higher reported stress and a higher health score was mitigated in areas with a high neighbourhood SEP and stronger in areas with present residual waste operations . In a further study, a positive association between a low neighbourhood SEP and self-reported limitations in daily activities from people aged 55 or older was only significant for men .
In the only identified study on smoking, the positive association between convenience store density per square mile and number of smoked cigarettes per day was mitigated for individuals with a higher SEP and, in contrast, was stronger in neighbourhoods with a high SEP. A positive association between number of convenience stores in a one mile radius around home address and number of smoked cigarettes was also stronger in neighbourhoods with a high SEP. Furthermore, a negative association between distance to convenience stores from home address and number of smoked cigarettes per day was stronger in neighbourhoods with a high SEP .
One study found a positive association between distance to a major road ≤50 m from home address and artery calcification only for men . One study on self-rated health showed a positive significant association between a lower food score and bad self-rated health only for men. Lower values of three other scores (bank/building society score, physical environment score, health service score) were significantly positively associated with bad self-rated health only for women . A further study exploring the same built environmental variables found out that a low physical environment score was positively associated with bad self-rated health and was stronger for non-working study participants .
Associations between socioeconomic and built environments and perinatal outcomes and child health
Most studies on perinatal health found interactive associations (Table 6). Only one study showed that a high neighbourhood income was independently positively associated with birth weight and negatively with small for gestational age . A further study on child accidents and injuries did not find an association either of neighbourhood unemployment nor the built environment .
One study gave an interaction between neighbourhood SEP and maternal risk factors. The overall inverse association between neighbourhood poverty and lower birth weight was stronger for individuals with rare maternal risk factors .
Regarding the built environment mostly traffic-related measures were analysed. Only one study found an independent negative association between air pollutants and birth weight . All other built environmental factors interacted with neighbourhood SEP or individual factors or were not significant. One study detected a positive association between distance to highways from home address, percentage of open space and birth weight only for mothers with a high education . In one study a positive association between proximity to highways and three outcomes of preterm birth, low birth weight, and small for gestational age was only significant in neighbourhoods with a high neighbourhood income. Moreover, the positive association between proximity to highways from home address and the two outcomes of preterm birth and low birth weight were only significant for mothers with a university education . However, in a further study a positive association between distance weighted traffic density and preterm birth was only significant in neighbourhoods with a low SEP index in winter time .
This systematic review identified and qualitatively analysed studies applying multilevel modelling which simultaneously considered characteristics of neighbourhood SEP and the objective built environment and analysed their effects on individual health outcomes or health-related behaviours.
Sixteen studies found associations between neighbourhood SEP and individual health independent from built environmental and individual characteristics. Fourteen studies showed associations between built environmental characteristics and individual health independent from neighbourhood SEP and individual characteristics. In seven studies simultaneous independent associations of neighbourhood SEP and the objective built environment were identified. Twenty-one studies showed cross-level or within-level interactions either between neighbourhood SEP and the built environment, or between neighbourhood SEP and individual characteristics, or between the built environment and individual characteristics.
Although we grouped our studies by similar health outcomes, a systematic assessment to what extend neighbourhood SEP and the built environment influenced individual health and health-related behaviour independently and dependently from each other or were modified by individual characteristics was difficult. The most frequently analysed outcomes were measures of physical activity and overweight. A lower neighbourhood SEP was mostly associated with higher BMI, overweight, obesity, bad self-rated health or artery calcification independent from built environmental and individual factors [51, 53, 54, 59, 65, 66, 74]. However, most studies analysing measures of physical activity did not find associations between neighbourhood SEP and measures of physical activity. Objective built environmental metrics indicating higher walkability were often associated with measures of higher individual physical activity independent from neighbourhood SEP and individual factors [43, 45, 59].
This review showed that interactions play an important role. Individual characteristics, such as sex, ethnicity or individual SEP, often modified associations between neighbourhood SEP or the objective built environment and individual health. However, it became not clear how neighbourhood SEP and built environmental characteristics interacted with sex. There were characteristics of the built environment and neighbourhood SEP from which only women´s or men´s health benefited or suffered [50, 51, 55, 56, 67–69, 73, 74]. No systematic findings which specific factors of neighbourhood SEP or the built environment are more harmful to men´s or women´s health could be detected.
Various moderating associations of neighbourhood SEP on associations between the built environment and health were identified. Some studies observed an impact of a health promoting built environment only in neighbourhoods with a low SEP . On the other hand there were studies demonstrating that associations between factors of a higher built environmental burden and poor health or negative health behaviours were only significant or stronger in neighbourhoods with a high SEP [62, 71]. In contrast, one study found out that only individuals living in a low SEP neighbourhoods were affected by higher built environmental burdens .
A variety of measures both of socioeconomic and built environments were studied which may partly explain mixed results. Especially concerning metrics and definitions of built environmental variables, there was a great heterogeneity. The majority of all studies calculated weighted numbers of various facilities, such as stores, sport and recreational facilities, parks, or restaurants. There was a great variety concerning the weights that were used. The most used weights were: fixed number of residents, number of neighbourhood residents, neighbourhood size or square kilometre, distance based buffer around each individual´s home address, or the centroid of the neighbourhood. Moreover, many studies calculated indices, mostly derived from factor analysis. The number and kind of built environmental variables contained in these scores was too heterogeneous for drawing comparisons. The only comparable index across studies was the walkability index. A minority of studies calculated distance based measures, such as to main roads, stores or parks. Distances were calculated either from individual home addresses or from neighbourhood centroids. The limited comparability across studies is consistent with previous systematic reviews, which focused either on a specific health outcome or exclusively on one neighbourhood environmental dimension [18, 21, 26, 28].
A further explanation for inconsistent results could be that built environments and socioeconomic neighbourhood structures vary across countries and continents. Besides that, these variations can be shaped by country specific social and housing policies on the neighbourhood level.
Studies were included which considered at least one individual socioeconomic factor, one factor of neighbourhood SEP and one of the objective built environment. However, apart from sex and age, studies varied by the number of included individual and contextual variables that might explain mixed results, too. Individual data on health behaviours, such as smoking or nutrition, and family status (e.g. marital status) were in some studies additionally considered. Many studies included also factors of the social environment, such as crime or characteristics of social capital in the neighbourhood. Individual and contextual characteristics may mediate associations on the pathway between neighbourhood SEP and individual health or between built environmental factors and individual health. The study by Reading et al. is an example where individual factors completely mediated the association between neighbourhood context and child accidents .
A first limitation is that our qualitative analysis only visualized significance or non-significance and direction of associations or interactions and did not make any comparisons on strength of the associations. The operationalization of variables was too heterogeneous across studies to perform meaningful quantitative comparisons. A second limitation is that our search code was mainly based on title and abstract screening. Besides that the Medical Subject Headings used in the PubMed database may not correspond to selected keywords by authors. Therefore, our search strategy was maybe not sensitive enough and could not identify all relevant studies. To reduce this limitation, we checked all references of included studies. We assumed that there were no relevant studies in grey literature. Therefore, we did not perform a separate search in sources of grey literature. Our assumption was sustained by the fact that we could not identify relevant grey literature which was cited in included studies.
The main strength of this review is that we exclusively focused on studies which considered both characteristics of neighbourhood SEP and the objective built environment simultaneously in multilevel models with the additional consideration of individual factors. We were able to analyse how these two neighbourhood dimensions were interrelated and interacted with individual variables. This systematic interaction analysis on both the neighbourhood and the individual level revealed new insight which role these dimensions play in epidemiological neighbourhood research and identified where further research is needed. A further strength is that the systematic search was not restricted to specific health outcomes or age and population groups. As a result, we could identify for which health outcomes, health-related behaviours or population groups evidence is lacking or results are most inconsistent.
Recommendations for future research
Based on our results we suggest the following recommendations for future research: Firstly, the consideration of more than one environmental neighbourhood dimension is important for generating more evidence on how socioeconomic, built and social neighbourhood characteristics are associated with individual health. It offers the possibility to analyse mediating and interacting pathways. There is still a lack of knowledge to what extent the built environment mediates effects of neighbourhood SEP on individual health. Being aware of potential reciprocal relationships between neighbourhood SEP and the built environment provides a better basis analysing interactions with individual characteristics, such as sex, individual SEP or health behaviours. Increasing knowledge about the health impact of the built environment will contribute to the reconnection of urban planning and public health. There is an upcoming call in public health sciences that for a sustainable healthy city development there is a need for updating and refreshing the connection between urban planning and public health [24, 75]. Moreover, conceptual models from the scientific field of risk assessment with a specific focus on different forms of vulnerability and cumulative environmental exposures on the individual and neighbourhood level may provide a good basis for identifying synergies between vulnerability analysis in epidemiology and cumulative risk assessment [76, 77].
Secondly, there is a need to adhere to guidelines on how results from multilevel modelling should be reported. One key feature of multilevel models is that they are able to sort out variance components both on the neighbourhood and individual level which provide important information how individual health varies between and within neighbourhoods and how much of these variance can be explained by contextual factors. However, to give a systematic overview about variance components and to draw conclusions on how much of the built and socioeconomic environment contributes to health disparities was impossible in this review, because some studies reported measures on variance components and some not. Already existing glossaries and tutorials about multilevel modelling, which support a better reporting of multilevel results should receive more attention [12, 78, 79].
Thirdly, in some studies it was not clear what kind of cross-level or within-level interactions was analysed. Therefore, we encourage researchers to systematically report if and which cross-level and within-level interactions were analysed regardless of their statistical significance. Moreover, most studies did not provide descriptive statistics about sample sizes of individual observations per neighbourhood cluster which is important for assessing potential bias of effect or variance estimates. Publishing such statistical information would make quantitative comparisons of multilevel models across studies easier.
Fourthly, our review revealed a great heterogeneity of metrics and definitions of variables describing the built environment. The only and most consistent index across studies was the walkability index. More of such standardized indices measuring the built environment would increase comparability across studies. The application of GIS which are increasingly used in public health research can facilitate this development especially when distance based measures are developed.
Fifthly, all of our identified studies, except of one, were cross-sectional and therefore results should be interpreted with caution. There is a need of conducting studies with a longitudinal design to prevent the problem of reverse causation.
Finally, more studies considering both environmental dimensions are needed which focus on children, because they are more vulnerable to environmental burdens than other population groups . Moreover, there is a lack of studies analysing how neighbourhood SEP and built environmental factors influence mental health outcomes, such as depression, or health-related risk behaviours, such as smoking or alcohol consumption.
This systematic review showed that a simultaneous consideration of neighbourhood SEP, built environmental characteristics and individual factors is important for analysing pathways how neighbourhood context influence individual health outcomes and health-related behaviours. There is a need for comparable studies considering multiple neighbourhood dimensions and analysing interactive and mediating processes both between contextual factors and individual characteristic and between contextual factors itself because our review identified mixed results. For an integrated analysis of both aggregated neighbourhood SEP and built environmental factors a multilevel modelling approach is appropriate because it allows to consider individual factors concurrently. This study design can generate more evidence to what extent the built environment mediates associations between neighbourhood SEP and health, and how individual characteristics, such as sex or individual SEP, act as effect modifiers in order to identify vulnerable neighbourhoods and population groups.
We would like to express our gratitude to Tanja Brüchert and Josephine Göldner for assistance in title and abstract screening. Furthermore, we would like to thank the members of the Junior Research Group Salus (Jufo-Salus), especially Heike Köckler, Rehana Shrestha, Lisa Waegerle, Ursula Hemetek and Raphael Sieber, for their valuable comments on the first draft of this review.
Jufo-Salus (Junior Research Group “The City as a healthy living environment independent of social inequalities”): TU Dortmund University, Faculty of Spatial Planning, Department of Urban and Regional Planning, Dortmund, Germany (Sabine Baumgart, Heike Köckler, Andrea Rüdiger, Raphael Sieber, Lisa Waegerle); University of Bremen, Faculty of Human and Health Sciences, Institute of Public Health and Nursing Research, Department of Social Epidemiology, Bremen, Germany (Gabriele Bolte, Ursula Hemetek, Steffen Schüle); University of Applied Sciences Fulda, Faculty of Caring and Health, Public Health Institute, Department of Health Promotion, Fulda, Germany (Beate Blättner, Ursula Hemetek); University of Twente, Faculty of Geo-Information Science and Earth Observation (ITC), Department of Urban and Regional Planning and Geo-Information Management, Enschede, Netherlands (Johannes Flacke, Rehana Shrestha).
Conceived and designed the experiments: SAS. Performed the experiments: SAS. Analyzed the data: SAS. Contributed reagents/materials/analysis tools: SAS GB. Wrote the paper: SAS GB.
- 1. Diez Roux AV. Investigating neighborhood and area effects on health. Am J Public Health. 2001;91(11):1783–9. pmid:11684601
- 2. Diez Roux AV, Mair C. Neighborhoods and health. Biology of Disadvantage: Socioeconomic Status and Health. 2010;1186:125–45.
- 3. Schreier HM, Chen E. Socioeconomic status and the health of youth: a multilevel, multidomain approach to conceptualizing pathways. Psychol Bull. 2013;139(3):606–54. pmid:22845752
- 4. Chaix B. Geographic life environments and coronary heart disease: a literature review, theoretical contributions, methodological updates, and a research agenda. Annu Rev Public Health. 2009;30:81–105.
- 5. Daniel M, Moore S, Kestens Y. Framing the biosocial pathways underlying associations between place and cardiometabolic disease. Health Place. 2008;14(2):117–32. pmid:17590377
- 6. Voigtlander S, Mielck A, Razum O. [Impact of small-area context on health: proposing a conceptual model]. Gesundheitswesen. 2012;74(11):702–9. pmid:22012567
- 7. Bernard P, Charafeddine R, Frohlich KL, Daniel M, Kestens Y, Potvin L. Health inequalities and place: a theoretical conception of neighbourhood. Soc Sci Med. 2007;65(9):1839–52. pmid:17614174
- 8. Robert SA. Socioeconomic Position and Health: The Independent Contribution of Community Socioeconomic Context. Annu Rev Sociol. 1999 25:489–516.
- 9. Schulz AJ, Kannan S, Dvonch JT, Israel BA, Allen A, James SA, et al. Social and physical environments and disparities in risk for cardiovascular disease: the healthy environments partnership conceptual model. Environ Health Perspect. 2005;113(12):1817–25. pmid:16330371
- 10. Duncan C, Jones K, Moon G. Context, composition and heterogeneity: using multilevel models in health research. Soc Sci Med. 1998;46(1):97–117. pmid:9464672
- 11. Diez Roux AV. Bringing context back into epidemiology: variables and fallacies in multilevel analysis. Am J Public Health. 1998;88(2):216–22. pmid:9491010
- 12. Diez Roux AV. A glossary for multilevel analysis. J Epidemiol Community Health. 2002;56(8):588–94. pmid:12118049
- 13. Macintyre S, Ellaway A, Cummins S. Place effects on health: how can we conceptualise, operationalise and measure them? Soc Sci Med. 2002;55(1):125–39. pmid:12137182
- 14. Diez Roux AV. Multilevel analysis in public health research. Annu Rev Public Health. 2000;21:171–92. pmid:10884951
- 15. Riva M, Gauvin L, Barnett TA. Toward the next generation of research into small area effects on health: a synthesis of multilevel investigations published since July 1998. J Epidemiol Community Health. 2007;61(10):853–61. pmid:17873220
- 16. Sellstrom E, Bremberg S. The significance of neighbourhood context to child and adolescent health and well-being: a systematic review of multilevel studies. Scand J Public Health. 2006;34(5):544–54. pmid:16990166
- 17. Meijer M, Rohl J, Bloomfield K, Grittner U. Do neighborhoods affect individual mortality? A systematic review and meta-analysis of multilevel studies. Soc Sci Med. 2012;74(8):1204–12. pmid:22365939
- 18. Metcalfe A, Lail P, Ghali WA, Sauve RS. The association between neighbourhoods and adverse birth outcomes: a systematic review and meta-analysis of multi-level studies. Paediatr Perinat Epidemiol. 2011;25(3):236–45. pmid:21470263
- 19. Pickett KE, Pearl M. Multilevel analyses of neighbourhood socioeconomic context and health outcomes: a critical review. J Epidemiol Community Health. 2001;55(2):111–22. pmid:11154250
- 20. Black JL, Macinko J. Neighborhoods and obesity. Nutr Rev. 2008;66(1):2–20. pmid:18254880
- 21. Mair C, Diez Roux AV, Galea S. Are neighbourhood characteristics associated with depressive symptoms? A review of evidence. J Epidemiol Community Health. 2008;62(11):940–6. pmid:18775943
- 22. Leal C, Chaix B. The influence of geographic life environments on cardiometabolic risk factors: a systematic review, a methodological assessment and a research agenda. Obes Rev. 2011;12(3):217–30. pmid:20202135
- 23. Schulz A, Northridge ME. Social determinants of health: Implications for environmental health promotion. Health Educ Behav. 2004;31(4):455–71. pmid:15296629
- 24. Northridge ME, Sclar ED, Biswas P. Sorting out the connections between the built environment and health: A conceptual framework for navigating pathways and planning healthy cities. J Urban Health. 2003;80(4):556–68. pmid:14709705
- 25. Van Holle V, Deforche B, Van Cauwenberg J, Goubert L, Maes L, Van de Weghe N, et al. Relationship between the physical environment and different domains of physical activity in European adults: a systematic review. BMC Public Health. 2012;12:807. pmid:22992438
- 26. Feng J, Glass TA, Curriero FC, Stewart WF, Schwartz BS. The built environment and obesity: a systematic review of the epidemiologic evidence. Health Place. 2010;16(2):175–90. pmid:19880341
- 27. Galvez MP, Pearl M, Yen IH. Childhood obesity and the built environment. Curr Opin Pediatr. 2010;22(2):202–7. pmid:20090524
- 28. Ding D, Sallis JF, Kerr J, Lee S, Rosenberg DE. Neighborhood environment and physical activity among youth a review. Am J Prev Med. 2011;41(4):442–55. pmid:21961474
- 29. Renalds A, Smith TH, Hale PJ. A Systematic Review of Built Environment and Health. Fam Community Health. 2010;33(1):68–78. pmid:20010006
- 30. Bolte G, Pauli A, Hornberg C. Environmental Justice: Social Disparities in Environmental Exposures and Health: Overview. In: Jerome ON, editor. Encyclopedia of Environmental Health. Burlington: Elsevier; 2011. p. 459–70.
- 31. Krieger N. A glossary for social epidemiology. J Epidemiol Community Health. 2001;55(10):693–700. pmid:11553651
- 32. Krieger N, Williams DR, Moss NE. Measuring social class in US public health research: concepts, methodologies, and guidelines. Annu Rev Public Health. 1997;18:341–78. pmid:9143723
- 33. Kirtland KA, Porter DE, Addy CL, Neet MJ, Williams JE, Sharpe PA, et al. Environmental measures of physical activity supports: perception versus reality. Am J Prev Med. 2003;24(4):323–31. pmid:12726870
- 34. Ball K, Jeffery RW, Crawford DA, Roberts RJ, Salmon J, Timperio AF. Mismatch between perceived and objective measures of physical activity environments. Preventive medicine. 2008;47(3):294–8. pmid:18544463
- 35. Schaefer-McDaniel N, Caughy MO, O'Campo P, Gearey W. Examining methodological details of neighbourhood observations and the relationship to health: a literature review. Soc Sci Med. 2010;70(2):277–92. pmid:19883966
- 36. Shaw M, Galobardes B, Lawlor DA. The handbook of inequality and socioeconomic position: concepts and measures. Bristol: Policy; 2007. 238 p.
- 37. Bell BA, Morgan GB, Kromrey JD, Ferron JM. The Impact of Small Cluster Size on Multilevel Models: A Monte Carlo Examination of Two-Level Models with Binary and Continuous Predictors. JSM. 2010:4057–67.
- 38. Austin PC. Estimating Multilevel Logistic Regression Models When the Number of Clusters is Low: A Comparison of Different Statistical Software Procedures. International Journal of Biostatistics. 2010;6(1).
- 39. Maas CJM, Hox JJ. Sufficient Sample Sizes for Multilevel Modeling. Methodology. 2005;1(3):86–92.
- 40. Moineddin R, Matheson FI, Glazier RH. A simulation study of sample size for multilevel logistic regression models. BMC Med Res Methodol. 2007;7.
- 41. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535. pmid:19622551
- 42. Van Dyck D, Cardon G, Deforche B, Owen N, Sallis JF, De Bourdeaudhuij I. Neighborhood Walkability and Sedentary Time in Belgian Adults. Am J Prev Med. 2010;39(1):25–32. pmid:20547277
- 43. Van Dyck D, Cardon G, Deforche B, Sallis JF, Owen N, De Bourdeaudhuij I. Neighborhood SES and walkability are related to physical activity behavior in Belgian adults. Prev Med. 2010;50 Suppl 1:S74–S9. pmid:19751757
- 44. Riva M, Gauvin L, Apparicio P, Brodeur JM. Disentangling the relative influence of built and socioeconomic environments on walking: the contribution of areas homogenous along exposures of interest. Soc Sci Med. 2009;69(9):1296–305. pmid:19733426
- 45. Sundquist K, Eriksson U, Kawakami N, Skog L, Ohlsson H, Arvidsson D. Neighborhood walkability, physical activity, and walking behavior: The Swedish Neighborhood and Physical Activity (SNAP) study. Soc Sci Med. 2011;72(8):1266–73. pmid:21470735
- 46. De Meester F, Van Dyck D, De Bourdeaudhuij I, Deforche B, Sallis JF, Cardon G. Active living neighborhoods: is neighborhood walkability a key element for Belgian adolescents? BMC Public Health. 2012;12:7. pmid:22216923
- 47. Wen M, Zhang X. Contextual effects of built and social environments of urban neighborhoods on exercise: A multilevel study in Chicago. Am J Health Promot. 2009;23(4):247–54. pmid:19288846
- 48. Owen N, Cerin E, Leslie E, duToit L, Coffee N, Frank LD, et al. Neighborhood walkability and the walking behavior of Australian adults. Am J Prev Med. 2007;33(5):387–95. pmid:17950404
- 49. Moore K, Diez Roux AV, Auchincloss A, Evenson KR, Kaufman J, Mujahid M, et al. Home and work neighbourhood environments in relation to body mass index: the Multi-Ethnic Study of Atherosclerosis (MESA). J Epidemiol Community Health. 2013;67(10):846–53. pmid:23868527
- 50. Grafova IB, Freedman VA, Kumar R, Rogowski J. Neighborhoods and Obesity in Later Life. Am J Public Health. 2008;98(11):2065–71. pmid:18799770
- 51. Wang MC, Kim S, Gonzalez AA, MacLeod KE, Winkleby MA. Socioeconomic and food-related physical characteristics of the neighbourhood environment are associated with body mass index. J Epidemiol Community Health. 2007;61(6):491–8. pmid:17496257
- 52. Wen M, Kowaleski-Jones L. The built environment and risk of obesity in the United States: Racial-ethnic disparities. Health Place. 2012;18(6):1314–22. pmid:23099113
- 53. Ross NA, Tremblay S, Khan S, Crouse D, Tremblay M, Berthelot JM. Body mass index in urban Canada: neighborhood and metropolitan area effects. Am J Public Health. 2007;97(3):500–8. pmid:17267734
- 54. Inagami S, Cohen DA, Brown AF, Asch SM. Body mass index, neighborhood fast food and restaurant concentration, and car ownership. J Urban Health. 2009;86(5):683–95. pmid:19533365
- 55. Prince SA, Kristjansson EA, Russell K, Billette J- M, Sawada MC, Ali A, et al. Relationships between neighborhoods, physical activity, and obesity: A multilevel analysis of a large Canadian city. Obesity. 2012;20(10):2093–100. pmid:22262164
- 56. Prince SA, Kristjansson EA, Russell K, Billette JM, Sawada M, Ali A, et al. A multilevel analysis of neighbourhood built and social environments and adult self-reported physical activity and body mass index in Ottawa, Canada. Int J Environ Res Public Health. 2011;8(10):3953–78. pmid:22073022
- 57. Scott MM, Dubowitz T, Cohen DA. Regional differences in walking frequency and BMI: what role does the built environment play for Blacks and Whites? Health Place. 2009;15(3):882–7. pmid:19345134
- 58. Slater SJ, Ewing R, Powell LM, Chaloupka FJ, Johnston LD, O'Malley PM. The association between community physical activity settings and youth physical activity, obesity, and body mass index. J Adolesc Health. 2010;47(5):496–503. pmid:20970085
- 59. Sallis JF, Saelens BE, Frank LD, Conway TL, Slymen DJ, Cain KL, et al. Neighborhood built environment and income: examining multiple health outcomes. Soc Sci Med. 2009;68(7):1285–93. pmid:19232809
- 60. Williams BL, Pennock-Roman M, Suen HK, Magsumbol MS, Ozdenerol E. Assessing the impact of the local environment on birth outcomes: a case for HLM. J Expo Sci Environ Epidemiol. 2007;17(5):445–57. pmid:17164825
- 61. Zeka A, Melly SJ, Schwartz J. The effects of socioeconomic status and indices of physical environment on reduced birth weight and preterm births in Eastern Massachusetts. Environ Health. 2008;7(34). pmid:18593476
- 62. Genereux M, Auger N, Goneau M, Daniel M. Neighbourhood socioeconomic status, maternal education and adverse birth outcomes among mothers living near highways. J Epidemiol Community Health. 2008;62(8):695–700. pmid:18621954
- 63. Ponce NA, Hoggatt KJ, Wilhelm M, Ritz B. Preterm birth: The interaction of traffic-related air pollution with economic hardship in Los Angeles neighborhoods. Am J Epidemiol. 2005;162(2):140–8. pmid:15972941
- 64. Reading R, Jones A, Haynes R, Daras K, Emond A. Individual factors explain neighbourhood variations in accidents to children under 5 years of age. Soc Sci Med. 2008;67(6):915–27. pmid:18573579
- 65. Cummins S, Stafford M, Macintyre S, Marmot M, Ellaway A. Neighbourhood environment and its association with self rated health: evidence from Scotland and England. J Epidemiol Community Health. 2005;59(3):207–13. pmid:15709080
- 66. Matthews SA, Yang T-C. Exploring the role of the built and social neighborhood environment in moderating stress and health. Ann Behav Med. 2010;39(2):170–83. pmid:20300905
- 67. Freedman VA, Grafova IB, Rogowski J. Neighborhoods and chronic disease onset in later life. Am J Public Health. 2011;101(1):79–86. pmid:20299643
- 68. Freedman VA, Grafova IB, Schoeni RF, Rogowski J. Neighborhoods and disability in later life. Soc Sci Med. 2008;66(11):2253–67. pmid:18329148
- 69. Stafford M, Cummins S, Macintyre S, Ellaway A, Marmot M. Gender differences in the associations between health and neighbourhood environment. Soc Sci Med. 2005;60(8):1681–92. pmid:15686801
- 70. Yang TC, Matthews SA. The role of social and built environments in predicting self-rated stress: A multilevel analysis in Philadelphia. Health Place. 2010;16(5):803–10. pmid:20434389
- 71. Chuang YC, Cubbin C, Ahn D, Winkleby MA. Effects of neighbourhood socioeconomic status and convenience store concentration on individual level smoking. J Epidemiol Community Health. 2005;59(7):568–73. pmid:15965140
- 72. Pollack CE, Cubbin C, Ahn D, Winkleby M. Neighbourhood deprivation and alcohol consumption: does the availability of alcohol play a role? Int J Epidemiol. 2005;34(4):772–80. pmid:15737966
- 73. Dragano N, Hoffmann B, Mobus S, Moehlenkamp S, Stang A, Verde PE, et al. Traffic exposure and subclinical cardiovascular disease: is the association modified by socioeconomic characteristics of individuals and neighbourhoods? Results from a multilevel study in an urban region. Occup Environ Med. 2009;66(9):628–35. pmid:19293166
- 74. Dragano N, Hoffmann B, Stang A, Moebus S, Verde PE, Weyers S, et al. Subclinical coronary atherosclerosis and neighbourhood deprivation in an urban region. Eur J Epidemiol. 2009;24(1):25–35. pmid:18931923
- 75. Corburn J. Confronting the challenges in reconnecting urban planning and public health. Am J Public Health. 2004;94(4):541–6. pmid:15053998
- 76. deFur PL, Evans GW, Hubal EAC, Kyle AD, Morello-Frosch RA, Williams DR. Vulnerability as a function of individual and group resources in cumulative risk assessment. Environ Health Perspect. 2007;115(5):817–24. pmid:17520073
- 77. Levy JI. Is Epidemiology the Key to Cumulative Risk Assessment? Risk Anal. 2008;28(6):1507–13. pmid:18793279
- 78. Merlo J, Chaix B, Yang M, Lynch J, Rastam L. A brief conceptual tutorial on multilevel analysis in social epidemiology: interpreting neighbourhood differences and the effect of neighbourhood characteristics on individual health. J Epidemiol Community Health. 2005;59(12):1022–8. pmid:16286487
- 79. Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P, et al. A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health. 2006;60(4):290–7. pmid:16537344
- 80. Tamburlini G. Children’s special vulnerability to environmental health hazards: an overview. 2002. In: Children’s health and environment: a review of evidence A joint report from the European Environment Agency and the WHO Regional Office for Europe Environmental Issue Report No 29 [Internet]. Copenhagen: European Environment Agency; [18–28]. Available from: http://www.euro.who.int/document/e75518.pdf.