Figures
Abstract
Many factors affect the risks for neurodevelopmental maladies such as autism spectrum disorders (ASD) and intellectual disability (ID). To compare environmental, phenotypic, socioeconomic and state-policy factors in a unified geospatial framework, we analyzed the spatial incidence patterns of ASD and ID using an insurance claims dataset covering nearly one third of the US population. Following epidemiologic evidence, we used the rate of congenital malformations of the reproductive system as a surrogate for environmental exposure of parents to unmeasured developmental risk factors, including toxins. Adjusted for gender, ethnic, socioeconomic, and geopolitical factors, the ASD incidence rates were strongly linked to population-normalized rates of congenital malformations of the reproductive system in males (an increase in ASD incidence by 283% for every percent increase in incidence of malformations, 95% CI: [91%, 576%], p<6×10−5). Such congenital malformations were barely significant for ID (94% increase, 95% CI: [1%, 250%], p = 0.0384). Other congenital malformations in males (excluding those affecting the reproductive system) appeared to significantly affect both phenotypes: 31.8% ASD rate increase (CI: [12%, 52%], p<6×10−5), and 43% ID rate increase (CI: [23%, 67%], p<6×10−5). Furthermore, the state-mandated rigor of diagnosis of ASD by a pediatrician or clinician for consideration in the special education system was predictive of a considerable decrease in ASD and ID incidence rates (98.6%, CI: [28%, 99.99%], p = 0.02475 and 99% CI: [68%, 99.99%], p = 0.00637 respectively). Thus, the observed spatial variability of both ID and ASD rates is associated with environmental and state-level regulatory factors; the magnitude of influence of compound environmental predictors was approximately three times greater than that of state-level incentives. The estimated county-level random effects exhibited marked spatial clustering, strongly indicating existence of as yet unidentified localized factors driving apparent disease incidence. Finally, we found that the rates of ASD and ID at the county level were weakly but significantly correlated (Pearson product-moment correlation 0.0589, p = 0.00101), while for females the correlation was much stronger (0.197, p<2.26×10−16).
Author Summary
Disease clusters are defined as geographically compact areas where a particular disease, such as a cancer, shows a significantly increased rate. It is presently unclear how common such clusters are for neurodevelopmental maladies, such as autism spectrum disorders (ASD) and intellectual disability (ID). In this study, examining data for one third of the whole US population, the authors show that (1) ASD and ID display strong clustering across US counties; (2) counties with high ASD rates also appear to have high ID rates, and (3) the spatial variation of both phenotypes appears to be driven by environmental, and, to a lesser extent, economic incentives at the state level.
Citation: Rzhetsky A, Bagley SC, Wang K, Lyttle CS, Cook EH Jr, Altman RB, et al. (2014) Environmental and State-Level Regulatory Factors Affect the Incidence of Autism and Intellectual Disability. PLoS Comput Biol 10(3): e1003518. https://doi.org/10.1371/journal.pcbi.1003518
Editor: Firas H. Kobeissy, University of Florida, United States of America
Received: September 25, 2013; Accepted: February 1, 2014; Published: March 13, 2014
Copyright: © 2014 Rzhetsky et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by NIH grants 1P50MH094267, U01HL108634-01, and Lever Award from the Chicago Biomedical Consortium. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Autism spectrum disorders (ASD) are a collection of chronic, complex neuropsychiatric diseases with well-characterized comorbidities and increasing apparent prevalence [1]. With few and limited effective treatments and considerable financial burden, its etiology remains a scientific puzzle. Evidence suggests that autism is highly heritable and clustered within families; consequently, much scientific attention has been dedicated to the discovery of predisposing genetic factors [2]–[7]. There is also evidence for environmental influences, such as prenatal exposure to pesticides or valproate, but it is challenging to account systematically for these factors because they are mostly undocumented. In addition, there are numerous factors that could affect or distort the observed variation in temporal and spatial disease prevalence: evolving diagnostic criteria, socioeconomic, legal, and cultural incentives for diagnosis [8], changing environmental exposures, and the accumulation of genetic burden in the growing human population. However, the relative importance of all these putative causal factors and confounders on ASD prevalence, the nature of interactions between contributing factors, and the underlying biological mechanisms, remain unclear.
Along these lines, geospatial clustering of ASD has been observed in California [9], [10], Texas [11], [12], North Carolina [13] and Utah [14]. Clustering could indicate the existence of localized risk factors, such as environmental toxins [15] or maternal education [13]. However, studies to date have focused primarily on within-state patterns and socioeconomic predictors, such as the level of parental education, the controversial financial incentives induced by state policies for special-education services, and broad environmental indicators. Now, the increasing availability of large administrative clinical datasets, with national coverage and fine spatial granularity, along with data on possible causal and confounding factors, provides an opportunity to compare the magnitudes of these and other factors within a unified mathematical framework.
Here, we report a mixed-effect Poisson regression analysis of the spatial incidence patterns of ASD and, for comparison, intellectual disability (ID). The data was derived from a very large insurance claims database containing nearly 100 million patients in the United States, which was augmented with census data to introduce additional county-level covariates that captured socioeconomic, demographic, and environmental effects. We present strong statistical evidence for environmental and legal factors driving the apparent spatial heterogeneity of both phenotypes, while documented socioeconomic factors and population structure have much weaker effects.
Results
We analyzed the strength of disparate factors on the apparent incidence rates of ASD and ID by computationally interrogating insurance claims for approximately one third of the US population, using a bivariate-response, three-level, mixed-effects Poisson regression model with 50 free parameters, 44 of which correspond to the fixed effects of known factors while the remaining 6 account for the variance and covariance among the random effects (see Methods). The bivariate outcomes modeled by these parameters were the incidence counts for the ASD and ID phenotypes, tabulated separately for males and females in 3,111 counties, nested within 50 states (plus the District of Columbia) and adjusted for population size.
The results are summarized in Figures 1–5 and Table 1: We observed clear spatial clusters for both ASD and ID. The raw data analyzed prior to complex modeling (see Figure 1) indicated that putative environmental variables were strongly predictive of rates of ASD and ID across the US. This trend persisted after the analysis was corrected for confounding variables using mixed-effect Poisson regression, see Figures 2–5. We found that ASD in males (normalized by county population) has a county-level mean rate of 0.1% per male of any age. The distribution of rates across counties is skewed: the median is 0.023% while maximum observed value is 5.2%. Similarly, for ID, the average rate over the whole country is 0.024% per any male, 0.025% per any female. The maximum per county per person rate reached 0.9% and 0.58% for males and females, respectively. Furthermore, for males, the rates of ASD and ID at the county level were weakly but significantly correlated (Pearson product-moment correlation 0.0589, p = 0.00101), while for females the correlation was much stronger (0.197, p<2.26×10−16). The estimated Poisson rates of incidence produced by model-based inference are shown in Figure 2. When direct comparison was possible, we compared our conclusions with those of prior studies ([9]–[14], see Table 2) and found that they were consistent.
Plots for females look essentially identical, but the absolute rate of incidence is lower (data not shown). The predictor variables shown here are male congenital malformations of reproductive system (ConGenM), viral infections in males of any age (Viral_M), congenital malformations excluding malformations of the genitals in males, CongMrepM, and spontaneous abortion (spont_abort).
The asterisks indicate the level of significance of individual regression coefficients; see the figure key and Table 1.
In the figures we color-coded the Empirical Bayes estimates of the state-level random effects, separately for ASD and ID. County- and state-level random effects model the unknown factors that vary geographically and govern differences in county-specific disease rates after accounting for all fixed effects (see Methods).
In the figures we color-coded the Empirical Bayes estimates of the state-level random effects, separately for ASD and ID. While county-specific random effects are directly comparable within the same state, comparison of these effects across different states is not meaningful, because each state-specific random effect determines the baseline disease rate for each county in the corresponding state, and these baseline rates vary across states.
Accumulating evidence [16]–[28] suggests that the rate of birth malformations, especially of those affecting the reproductive system in newborn boys [17], adjusted for population size and structure, could serve as an indicator of average parental exposure to toxins within a geographic unit. After controlling for ethnicity, gender, and socioeconomic factors, the strongest predictor of ASD was the rate of male congenital malformations of the reproductive system, used as an approximate measurement for exposure to teratogens, based on extensive epidemiological evidence ([16], [17], see Figure 3 and Discussion). Every additional percent incidence of male congenital malformations of the reproductive system was predictive of a 283% increase in the rate of the ASD incidence (95% confidence interval, CI: [91%, 576%], p<6×10−5). Similarly, non-reproductive congenital male malformations accounted for a 31.8% ASD rate increase (CI: [12%, 52%], p<6×10−5). In contrast, male congenital malformations of the reproductive system were barely significantly predictive for ID (94%, CI: [1%, 250%], p = 0.0383). However, the effect of non-reproductive congenital malformations in males on ID incidence was statistically significant and strong: an increase of 43% (CI: [23%, 67%], p<6×10−5). Another variable significantly affecting both ASD and ID was population-adjusted incidence of viral infections in males (Table 1, Figure 3, and Discussion). Moreover, comorbidity analysis demonstrated that male children with ASD are 5.53 times more likely to have congenital genital malformations than unaffected males (odds ratio 95% CI [5.22, 5.87], p<2.2×10−16, Fisher's exact test).
Male congenital malformations of the reproductive system are subdivided in the ICD9 taxonomy [29], which was used to encode the data in this analysis, into unspecified malformations, hypospadias (abnormally placed external urethral orifice), epispadias (the urethra does not develop into a full tube), micropenis, congenital chordees and undescended testicles. The US average incidence rate for all male congenital malformations of reproductive system was 0.2687% per male of any age group; of these 18% were hypospadias (0.049% rate), 6% congenital chordees (0.0161% rate), 1% micropenis (0.00275% rate), and 0.083% epispadias (0.00227% rate). The rest of the malformations were in the unspecified category; undescended testicles were not encoded explicitly. Per-county rates of hypospadias and congenital chordees were significantly correlated with each other (Pearson's r = 0.34, 95% CI [0.31, 0.372], p<2.2×10−16), as were hypospadias and epispadias (r = 0.066, 95% CI [0.031, 0.101], p = 0.00022). The highest per county rates of malformations were 2.4% (all male genital malformations), 1.1% (hypospadias), 0.91% (chordees), 1.1% (epispadias), and 0.23% (micropenis). There were counties with no reported malformations (zero apparent rate). All discussed groups of malformations were significantly correlated with autism rates. Female birth malformations of reproductive system, variable ConGenF, showed very similar disease-specific predictive behavior to the congenital male malformations of reproductive system, variable ConGenM. The female malformations were predictive of an increase in both ASD and ID, but the magnitude of the statistical effect associated with this factor was much smaller than ConGenM, although highly correlated.
Both ASD and ID showed significant gender-specific incidence effects, with males affected more frequently than females; this was more extreme for ASD (Table 1 and Figure 3). Using ethnicity variables to account for genetic heterogeneity of the US population, corrected for socioeconomic factors, such as the mean county-specific income, we found the incidence of the two diseases significantly varied across ethnic groups (Table 1), with Pacific Islanders, for example, having significantly lower risk for both diseases. The per capita income of the county was weakly positively correlated with the incidence rates for both diseases: the income variable was associated with 3.2% rate increase per every additional $1,000 of income above the country average for ASD (CI: [2.3%, 4.2%], p<6×10−5) and a 2.7% rate increase for ID (CI: [1.8%, 3.7%], p<6×10−5). Other important socioeconomic predictors included the percentage of urban population in a county; a one percent increase in urbanization predicted about a 3% increase in ASD and ID incidence (Table 1). Our analysis also indicated that state-specific laws [30], [31] had a large but only marginally significant effect on the incidence rates of ASD and ID (Table 1, Figure 1). The strictest form of diagnostic evaluation (variable Eval, the state-mandated diagnosis of autism or autism spectrum disorders by a pediatrician or clinician for consideration in the special education system) was predictive of a considerable decrease in ASD and ID incidence rates, 98.6% (CI: [28%, 99.99%], p = 0.02475) and 99% (CI: [68%, 99.99%], p = 0.00637) respectively.
Discussion
By analyzing the spatial incidence patterns of autism and intellectual disability drawn from insurance claims for nearly one third of the total US population, we found strong statistical evidence that environmental factors drive the apparent spatial heterogeneity of both phenotypes while economic incentives and population structure appear to have relatively large albeit weaker effects. The strongest predictors for autism were associated with the environment: congenital malformations of the reproductive system in males (an increase in ASD incidence by 283% for every per cent of increase in the incidence of malformations), non-reproductive congenital malformations (31.8% ASD rate increase), and viral infections in males (19% ASD rate increase). For ID we observed similar but weaker effects: 93% increase of ID rate for every per cent of increase in congenital malformations of the reproductive system in males, 43% increase for per cent of non-reproductive congenital malformations, and 23% for viral infections in males.
We highlight the role of male congenital genitourinary malformations as an approximate measurement of environmental exposure to unmeasured developmental risk factors, including toxins. Some infants are born with congenital malformations with unknown genetic etiology–not explained by known Mendelian mutations or detectable chromosomal aberrations. At least a fraction of such birth defects may be due to parental exposure to environmental insults. The environmental factors implicated so far include pesticides [18], [19], environmental lead [20], sex hormone analogs [21], [22], medications [23], plasticizers [24], and other synthetic molecules [25]. More generally, the risk of congenital birth defects is statistically linked to parental occupation [26]–[28]. There is a statistically significant increase in birth defects associated with some maternal occupations (janitor, maid, landscaper), and significant decrease associated with others (non-preschool teacher) [27], [28]. It is very likely that the list of environmental factors potentially affecting development of human embryo is large and yet predominantly undocumented; correspondingly, detailed statistics on these factors do not exist.
It is known that some birth malformations are caused by de novo genetic events, such as large copy number variants that have been found to increase the risk for ASD by approximately 400% [32]. Single-gene deletions, for example, involving CHD7 are known to cause CHARGE syndrome [33], [34] associated with genital abnormalities and putatively associated with ASD [35]. However, these genetic events may have currently poorly identified environmental triggers, and 70 to 80% of male congenital malformations of the reproductive system have no clear genetic causes [36]. Instead, they appear to be driven by specific environmental insults that were not serious enough to lead to more serious adverse events during pregnancy, such as spontaneous abortion. Therefore, in this study, we used the rate of birth malformations as a surrogate measure for environmental burden.
The hypospadias of the male urethra can arise during early embryonic development, specifically weeks 9–12 (p. 206 in [36]). This window corresponds to the time when cell division and migration takes place in brain development. Furthermore, maternal exposure to estrogen and estrogen analogs in animal models affects both brain and genital development in male progeny (p. 206 in [36]), and small physical malformations appear enriched in autistic children compared to healthy children [37].
Following similar logic, in addition to causing birth defects, environmental toxins, such as pesticides [38], [39] can substantially weaken the human immune system, especially in men, which results in more frequent infections. (The rates of female viral infections were highly correlated with male viral infections; these can serve a somewhat weaker fixed effect predictor, data not shown.) This suggests that per capita rate of viral infection, when socioeconomic and other biological factors have been controlled for, may serve as another environmental indicator, although specifics of the causal, biological mechanisms remain unresolved. In our analysis we found that the rate of viral infection in males was significant for both ASD and ID, see Table 1.
Importantly, the effect of state-level regulations involving ASD appeared relatively large in magnitude (over 98% ASD and ID rate decrease) but with a wide confidence interval and inconsistent effects across states, resulting in only marginal significance. Furthermore, our estimates of random effects at the state and county levels, see Figure 2, suggest that additional yet unknown confounder factors exist at both state and county levels, as is evident from the clear state boundaries seen in Figure 2.
As with other statistical analyses (see Table 3), significant associations are not necessarily causal. Identified predictor variables may reflect underlying mechanisms, or may be correlated with unmeasured causal factors. However, we have included variables, such as the rate of birth malformations and male viral infections, that have well-documented environmental causes. Overall, this increases our confidence in their scientific relevance. Furthermore, because we have controlled for many county-level socioeconomic variables, strong state-specific effects are almost certainly rooted in legal and regulatory differences that exist at this level.
Our results have implications for the ongoing scientific quest for the etiology of neurodevelopmental disorders. We provide evidence that routinely expanding the scope of inquiry to include environmental, demographic and socioeconomic factors, and governmental policies at a broad scale in a unified geospatial framework. It appears that detailed documentation of environmental factors should be recorded and used in genetic analyses of ASDs and failure to do so risks omitting important information about possibly strong confounders.
Materials and Methods
Ethics statement
Our analysis involved de-identified patient data and was approved by the University of Chicago Institutional Review Board.
Our multi-level, mixed-effects model predicted the incidence of ASD and ID conditional on several individual-level, county-level, and state-level covariates. For the regression analysis described below, we used county level variables to predict disease rate. In the analysis of the comorbidity between congenital malformations and ASD or ID, we used patient-level data.
Data
We used the Truven Health Analytics MarketScan Commercial Claims and Encounters Database to provide geocoded diagnosis counts by gender. This database spans the years 2003 to 2010 and consists of approved commercial health insurance claims for between 17.5 and 45.2 million people annually, with linkage across years, yielding a total of approximately 105 million patient records. (Note that, consistent with low prevalence of both phenotypes, only a small proportion of individuals described in this enormous dataset were diagnosed with either ASD or ID.) This national database contains information contributed by well over 100 insurance carriers and large self-insuring companies. We scanned approximately 4.6 billion inpatient and outpatient service claims and identified almost 6 billion diagnostic codes. After removing duplicates, almost 1.3 billion diagnostic codes were found to be associated with over 99.1 million individuals, yielding approximately 12.89 unique diagnostic codes per individual. Claims were de-identified, that is, all patient-level personal information was redacted, and geocoded at the county level by Truven, and thus, this did not require any additional processing on the authors' part.
The MarketScan insurance claims dataset is not a random sample of the USA population. This is because compilation of this dataset required reaching agreements between Truven and numerous individual insurance providers to share data, and the insurance providers inherently had uneven and non-random coverage of geographic areas. It is possible, therefore, that the dataset carries traces of hidden correlations imposed by the data collection method. Furthermore, while the entire USA is well represented in the data, it is possible that coverage across geographic areas is not perfectly proportional to population density.
Statistical analysis
We framed our analysis as a mixed-effect regression model for Poisson-distributed count data [40], independently implemented in SuperMix [41], lme4 [42], [43], MCMCglmm [44], and GLLAMM [45], [46]. The choice of the Poisson model was motivated by the countable nature of data and the rarity of the disease incidence events.
The model parameters were estimated using a joint statistical inference as follows. Most of the parameters (44 out of 50) were real-valued coefficients representing regression weights of individual factors, such as average income in county, percentage of ethnic groups, per cent of urban and poor population, see Table 1. The factors that are a priori suspected to be relevant to disease incidence and are deliberately included into the model, are referred to in the mixed effect model formalism as the fixed effects. In addition, the model included zero-centered and normally distributed random effects, uncorrelated for the same disease between a county and the encapsulating state, but geographically correlated between two diseases, see equations below and Figures 4 and 5. The six parameters associated with the random effects included the variances and covariances for the state- and county-level random effects (see Table 2 and equations below). Note that the random effects themselves were not parameters, but Gaussian zero-centered random variables.
Fixed effects by design have stochastic but predictable influence on data, while random effects describe zero-centered random influence, not captured by the fixed effects. Below we present more formal formulation of the model.
Fixed-effect variables
The Truven database was augmented with US census data [30] consisting of county-level measurements for a variety of socioeconomic, demographic, and geospatial factors. Our fixed-effect county-level covariates were gender, Gender, average per capita income, Income, percent ethnicity (separately for American Indians, AmInd, Asians, Asian, White Hispanics, WHisp, White non-Hispanics, W, Black Hispanics, BHisp, Black non-Hispanics, B, and Pacific Islanders, Pacific), and the proportions of various socioeconomic groups (poor, Poor, urban, Urban, insured, Insured). Our county-level environmental indicators used as fixed-effect covariates (normalized by county population size) comprised congenital malformations excluding malformations of the genitals (separately for females and males, CongMrepF and CongMrepM, respectively), congenital malformations of the genitals (separately for females and males, ConGenF and ConGenM, respectively), viral infections (separately for females and males, Viral_F and Viral_M, respectively), ectopic pregnancy (ect_pr), abnormal conception (abnormal_concept), spontaneous abortion(spont_abort), and multiple gestations (mult_gest). The county-level environmental indicators were extracted from the Truven database and normalized by county population, separately for males and females.
To account for variation in policies for special education eligibility and reimbursement, we used four variables derived by hand-coding the state policies for eligibility in special education programs under the Individuals with Disabilities Education Act [31] with categorical variables: (i) CFR, to indicate whether state criteria met (−1) or, alternatively, exceeded Code of Federal Regulation requirements (1), (ii) DSM, to indicate whether state criteria mentioned all of the criteria from the Diagnostic and Statistical Manual of Mental Disorders (−1, if no, and 1, if yes), (iii) ASD, to indicate whether Autism Spectrum Disorder criteria were mentioned in the state criteria (−1 if no, 1 if yes), and (iv) Eval, to indicate the degree of diagnostic rigor required by the state (−1, −2, 1, 2). Details of the coding are described in the abbreviations. All predictor variables were mean-centered.
Assumptions of the model
The assumptions of the Poisson regression model [40] were as follows. First, we assumed that the data, corresponding to the observed counts of people within each county diagnosed with either ASD or ID, were generated by a Poisson process, with rate (λijkl) varying over counties,where: θ is a vector of all 50 model parameters, (b, Σ). The observed counts of disease incidence (the response variable yijkl) was defined as the number of disease cases per county for ASD (k = 1) and ID (k = 2). Subscripts i and ij were used to indicate a state and a county nested within that state, and subscript l to indicate gender. The second assumption was that the logarithm of Poisson rate (λijkl) was expressed as a linear combination of fixed and random effects.
Here matrix Xk is the design matrix for the fixed effects associated with disease k; bk is the corresponding vector of unknown regression weights; zk is a design matrix for random effects; vk is the vector of random effects; vik, vijk, are i-state- and ij-county-specific random effects for disease k. The fixed-effect design matrix is simply a matrix of county-specific zero-centered properties, such as the mean income, or proportions of ethnic groups. The design matrix z has a very simple form: entries of 1 for random effects of a given county and corresponding state, and zeros in all other cells. Nijkl is a state-, county-, disease- and gender-specific offset—the total number of people with a specified gender living within a given county.
The third assumption was that data was hierarchical: the zero-centered random effects were independently introduced at i-state and ij-county levels. However, the random effects associated with the two diseases (1 and 2) were geographically correlated,where σ2ik, and σ2ijk, are variances of state-level and county-level random effects for disease k and ri, and rij are correlation coefficients for random effects for diseases 1 and 2 at the state and county levels, correspondingly.
Together these assumptions define the following likelihood for the given ij-county, i-state, l-gender and k-disease:The full log-likelihood is obtained by summing the individual log-likelihoods specific to each yijkl over all possible indices.
While estimates varied slightly across different implementations of the model and estimation approaches, the major trends were identical across all. Here we present the results of the Markov chain Monte Carlo/Empirical Bayes analysis. The estimation methods and starting parameter values varied considerably across the implementations. For example, SuperMix started with finding an analytical solution of the fixed-effect part of the equations and then estimated parameters for the full model involving random effects. The Markov chain Monte Carlo-based GLLAMM started with a random set of parameter guesses and then rather quickly discovered the high-probability area of parameter values.
Confounders
We tested several putative confounding variables, such as county-specific median mother's age at childbirth, and the proportion of county population in the childbearing age. While these variables produced statistically significant fixed-effect coefficients, they did not affect the relationship between the outcome variable and the compound environmental predictor variables as would be expected if these added variables were true confounders.
Acknowledgments
The authors are grateful to David Blair, Christiann Frazier, Ravinesh Kumar, Diane Lauderdale, Rita Rzhetsky, and Kevin White for numerous comments that significantly improved the manuscript.
Author Contributions
Conceived and designed the experiments: AR RDG. Performed the experiments: AR KW. Analyzed the data: AR CSL SCB KW. Contributed reagents/materials/analysis tools: CSL SCB KW. Wrote the paper: AR SCB RBA EHC RDG.
References
- 1. Croen LA, Grether JK, Hoogstrate J, Selvin S (2002) The changing prevalence of autism in California. J Autism Dev Disord 32: 207–215.
- 2. Rudie JD, Hernandez LM, Brown JA, Beck-Pancer D, Colich NL, et al. (2012) Autism-associated promoter variant in MET impacts functional and structural brain networks. Neuron 75: 904–915.
- 3. Berg JM, Geschwind DH (2012) Autism genetics: searching for specificity and convergence. Genome Biol 13: 247.
- 4. Celestino-Soper PB, Violante S, Crawford EL, Luo R, Lionel AC, et al. (2012) A common X-linked inborn error of carnitine biosynthesis may be a risk factor for nondysmorphic autism. Proc Natl Acad Sci U S A 109: 7974–7981.
- 5. Sanders SJ, Murtha MT, Gupta AR, Murdoch JD, Raubeson MJ, et al. (2012) De novo mutations revealed by whole-exome sequencing are strongly associated with autism. Nature 485: 237–241.
- 6. Iossifov I, Ronemus M, Levy D, Wang Z, Hakker I, et al. (2012) De novo gene disruptions in children on the autistic spectrum. Neuron 74: 285–299.
- 7. Ellison JW, Rosenfeld JA, Shaffer LG (2013) Genetic basis of intellectual disability. Annu Rev Med 64: 441–450.
- 8. Greene JP (2002) Effects of Funding Incentives on Special Education Enrollment. Civic Report 32.
- 9. King MD, Bearman PS (2011) Socioeconomic Status and the Increased Prevalence of Autism in California. Am Sociol Rev 76: 320–346.
- 10. Van Meter KC, Christiansen LE, Delwiche LD, Azari R, Carpenter TE, et al. (2010) Geographic distribution of autism in California: a retrospective birth cohort analysis. Autism Res 3: 19–29.
- 11. Lewandowski TA, Bartell SM, Yager JW, Levin L (2009) An evaluation of surrogate chemical exposure measures and autism prevalence in Texas. J Toxicol Environ Health A 72: 1592–1603.
- 12. Sturmey P, James V (2001) Administrative prevalence of autism in the Texas school system. J Am Acad Child Adolesc Psychiatry 40: 621.
- 13. Hoffman K, Kalkbrenner AE, Vieira VM, Daniels JL (2012) The spatial distribution of known predictors of autism spectrum disorders impacts geographic variability in prevalence in central North Carolina. Environ Health 11: 80.
- 14. Pinborough-Zimmerman J, Bilder D, Bakian A, Satterfield R, Carbone PS, et al. (2011) Sociodemographic risk factors associated with autism spectrum disorders and intellectual disability. Autism Res 4: 438–448.
- 15. Becerra TA, Wilhelm M, Olsen J, Cockburn M, Ritz B (2013) Ambient air pollution and autism in Los Angeles county, California. Environ Health Perspect 121: 380–386.
- 16.
United States Environmental Protection Agency (2013) Birth Defects Prevalence and Mortality EPA http://cfpub.epa.gov/eroe/index.cfm?fuseaction=detail.viewInd&lv=list.listbyalpha&r=239796&subtop=381.
- 17. Brent RL (2004) Environmental causes of human congenital malformations: the pediatrician's role in dealing with these complex clinical problems caused by a multiplicity of environmental and genetic factors. Pediatrics 113: 957–968.
- 18. Garcia AM, Fletcher T, Benavides FG, Orts E (1999) Parental agricultural work and selected congenital malformations. Am J Epidemiol 149: 64–74.
- 19. Garry VF, Harkins ME, Erickson LL, Long-Simpson LK, Holland SE, et al. (2002) Birth defects, season of conception, and sex of children born to pesticide applicators living in the Red River Valley of Minnesota, USA. Environ Health Perspect 110 Suppl 3: 441–449.
- 20. Sallmen M, Lindbohm ML, Anttila A, Taskinen H, Hemminki K (1992) Paternal occupational lead exposure and congenital malformations. J Epidemiol Community Health 46: 519–522.
- 21. Hook EB (1992) Cardiovascular birth defects and prenatal exposure to female sex hormones: a reevaluation of data reanalysis from a large prospective study. Teratology 46: 261–266.
- 22. Hook EB (1994) Cardiovascular birth defects and prenatal exposure to female sex hormones: a reevaluation of data reanalysis from a large prospective study. Teratology 49: 162–166.
- 23. Reitnauer PJ, Callanan NP, Farber RA, Aylsworth AS (1997) Prenatal exposure to disulfiram implicated in the cause of malformations in discordant monozygotic twins. Teratology 56: 358–362.
- 24. Jiang JT, Sun WL, Jing YF, Liu SB, Ma Z, et al. (2011) Prenatal exposure to di-n-butyl phthalate induces anorectal malformations in male rat offspring. Toxicology 290: 322–326.
- 25. Lawson CC, Schnorr TM, Whelan EA, Deddens JA, Dankovic DA, et al. (2004) Paternal occupational exposure to 2,3,7,8-tetrachlorodibenzo-p-dioxin and birth outcomes of offspring: birth weight, preterm delivery, and birth defects. Environ Health Perspect 112: 1403–1408.
- 26. Irgens A, Kruger K, Skorve AH, Irgens LM (2000) Birth defects and paternal occupational exposure. Hypotheses tested in a record linkage based dataset. Acta Obstet Gynecol Scand 79: 465–470.
- 27. Herdt-Losavio ML, Lin S, Chapman BR, Hooiveld M, Olshan A, et al. (2010) Maternal occupation and the risk of birth defects: an overview from the National Birth Defects Prevention Study. Occup Environ Med 67: 58–66.
- 28. Lin S, Herdt-Losavio ML, Chapman BR, Munsie JP, Olshan AF, et al. (2013) Maternal occupation and the risk of major birth defects: a follow-up analysis from the National Birth Defects Prevention Study. Int J Hyg Environ Health 216: 317–323.
- 29.
WHO (2010) International Classification of Diseases (ICD), http://www.who.int/classifications/icd/en/.
- 30.
U.S.A. Health Resources and Services Administration (2013) The Area Health Resources Files, http://www.arf.hrsa.gov/.
- 31. MacFarlane JR, Kanaya T (2009) What Does it Mean to be Autistic? Inter-state Variation in Special Education Criteria for Autism Services. Journal of Child and Family Studies 18: 662–669.
- 32. Collaborators (32) (2012) Prevalence of autism spectrum disorders–Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. MMWR Surveill Summ 61: 1–19.
- 33. Cho HJ, Song MH, Choi SY, Kim J, Lee J, et al. (2013) Genetic analysis of the CHD7 gene in Korean patients with CHARGE syndrome. Gene 517: 164–168.
- 34. Palumbo O, Palumbo P, Stallone R, Palladino T, Zelante L, et al. (2013) 8q12.1q12.3 de novo microdeletion involving the CHD7 gene in a patient without the major features of CHARGE syndrome: case report and critical review of the literature. Gene 513: 209–213.
- 35. O'Roak BJ, Vives L, Girirajan S, Karakoc E, Krumm N, et al. (2012) Sporadic autism exomes reveal a highly interconnected protein network of de novo mutations. Nature 485: 246–250.
- 36.
Baskin LS (2004) Hypospadias and genital development. New York: Kluwer Academic/Plenum Publishers. xiv: , 258 p. p.
- 37. Ozgen HM, Hop JW, Hox JJ, Beemer FA, van Engeland H (2010) Minor physical anomalies in autism: a meta-analysis. Mol Psychiatry 15: 300–307.
- 38.
Repetto RC, Baliga SS (1996) Pesticides and the immune system: the public health risks. Washington, DC: World Resources Institute. ix: , 103 p. p.
- 39. Moore A, Enquobahrie DA (2011) Paternal occupational exposure to pesticides and risk of neuroblastoma among children: a meta-analysis. Cancer Causes Control 22: 1529–1536.
- 40.
Hedeker DR, Gibbons RD (2006) Longitudinal data analysis. Hoboken, N.J.: Wiley-Interscience. xx: , 337 p. p.
- 41.
Hedeker DR, Gibbons RD (2013) SuperMix, http://www.ssicentral.com/supermix/.
- 42.
Bates D, Maechler M, Bolke B (2013) lme4: Linear mixed-effects models using S4 classes, R package version 0.999999-2,http://CRAN.R-project.org/package=lme4.
- 43.
R Core Team (2013) R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing.
- 44. Hadfield JD (2010) MCMC Methods for Multi-Response Generalized Linear Mixed Models: The MCMCglmm R Package. Journal of Statistical Software 33: 1–22.
- 45.
StataCorp. (2013) Stata Statistical Software: Release 13, StataCorp LP, Stata Statistical Software: Release 13, StataCorp LP,http://www.stata.com/.
- 46.
Rabe-Hesketh S, Skrondal A, Pickles A (2013) GLLAMM: Generalized Linear Latent And Mixed Models, http://www.gllamm.org/.