Technology advances have promoted gene-based sequencing studies with the aim of identifying rare mutations responsible for complex diseases. A complication in these types of association studies is that the vast majority of non-synonymous mutations are believed to be neutral to phenotypes. It is thus critical to distinguish potential causative variants from neutral variation before performing association tests. In this study, we used existing predicting algorithms to predict functional amino acid substitutions, and incorporated that information into association tests. Using simulations, we comprehensively studied the effects of several influential factors, including the sensitivity and specificity of functional variant predictions, number of variants, and proportion of causative variants, on the performance of association tests. Our results showed that incorporating information regarding functional variants obtained from existing prediction algorithms improves statistical power under certain conditions, particularly when the proportion of causative variants is moderate. The application of the proposed tests to a real sequencing study confirms our conclusions. Our work may help investigators who are planning to pursue gene-based sequencing studies.
Citation: Zhang L, Pei Y-F, Li J, Papasian CJ, Deng H-W (2010) Improved Detection of Rare Genetic Variants for Diseases. PLoS ONE5(11): e13857. https://doi.org/10.1371/journal.pone.0013857
Editor: Peter Heutink, VU University, Netherlands
Received: June 10, 2010; Accepted: September 30, 2010; Published: November 8, 2010
Copyright: © 2010 Zhang et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The study was partially supported by Xi'an Jiaotong University. The investigators of this work also benefited from support of the grants from the National Science Foundation of China, National Institutes of Health (R01 AR050496, R21 AG027110, R01 AG026564, P50 AR055081 and R21 AA015973), Huo Ying Dong Education Foundation, Hunan Province, and the Ministry of Education of China. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Genotyping based genetic association analyses, which are dependent on indirect linkage disequilibrium (LD) mapping, rely on the common disease-common variants (CDCV) hypothesis. The CDCV hypothesis assumes that genetic variants responsible for complex diseases are common in frequency in the human population , , . Despite successful utilization of genome-wide association studies (GWAS) to identify susceptible common variants for a variety of complex diseases , only a modest fraction of phenotypic variation has been accounted for by the identified variants. Therefore, it is reasonable to propose that there are limitations to the CDCV hypothesis, and to consider the alternative common disease-rare variants (CDRV) hypothesis as a complement , , , . In the CDRV hypothesis, phenotypic variation is attributable to multiple variants, each with a low frequency and a small to moderate marginal effect.
Advances in next-generation sequencing technologies , , ,  and the recently launched ‘1000 Genomes Project’  have enhanced our ability to discover rare variants. While knowledge regarding rare variants is becoming increasingly detailed, statistical analyses of rare variants present a number of challenges. Ordinary variant-by-variant methods that are suited for analyses of common variants have a limited capacity to detect rare variants due to their extremely low frequency. Additionally, the high number of tests to be examined reduces statistical power dramatically when correction for multiple testing is taken into account. To circumvent these problems, the analytical strategy of grouping variants has been suggested , , , . Grouping strategy uses genomic regions (e.g. genes, that contain a set of variants) as the unit of analysis. This strategy is advantageous because it enhances the mutation signal as well as reduces the number of tests. Nonetheless, as not all nonsynonymous rare variants within genes are causative, grouping all of them regardless of their functional impact may have the undesirable effect of producing an unsatisfactory signal-to-noise ratio. Therefore, successful use of the grouping strategy is critically dependent upon the ability to distinguish potential causative variants from background population variation prior to analysis.
The potential functional importance of non-synonymous variants, or of the resulting amino acid substitutions, can be studied from a biological perspective. The functional impact of amino acid substitutions can be predicted by specialized algorithms that take into account context information for the specific protein being analyzed , , , , , , , , , . By incorporating information obtained from predicting algorithms into association analyses, potentially causative variants can be preliminarily distinguished from background population variation, thereby improving the efficiency of these analyses.
In this study, we test the association between non-synonymous variants in gene coding regions and disease. In order to determine the relative importance of variants in terms of phenotypic effect, prediction algorithms were extensively utilized to identify functional amino acid substitutions, and we incorporated results from these prediction algorithms into association tests. We aimed to evaluate whether, and to what extent, incorporation of results from these prediction algorithms can improve statistical power for detecting disease associated rare variants. We also evaluated the performance of tests by analyzing a real sequence dataset to demonstrate the utility of the proposed tests.
In figure 1, we outline the steps that we follow to simulate data and perform association test. In what is followed at this section, we will describe each of these steps in details.
Modeling site-frequency spectrum
By focusing on the European population, we simulate the full range frequencies of sequence data using a four-parameter demographic model , . In this model, the shape of the European population history is assumed to start from a constant ancestral population, followed by a population bottleneck with a reduction in effective size, and then by an exponential expansion until to modern population. The four parameters involved are the constant ancestral population size N1, the bottleneck population size Nb, the duration of time T after the bottleneck (measured by generation), and the population growth rate after the bottleneck. In Appendix S1, we outline the formulation of the demographic model and the data we use to estimate its parameters.
Using the inferred demographic model, we simulate the full range allele frequencies of sequence data of a gene coding region to mimic a gene-wise sequencing study. We simulate a gene with L = 1,500 nucleotides by assuming an average length of 500 amino acids for proteins . In accordance with a previous estimation , one third of the simulated variants are assumed to be synonymous mutations, which does not affect gene expression and are not included in our analysis. Of the remaining non-synonymous mutations, previous studies have indicated that the majority are actually background population variation , . We thus set the proportion of causative variants f = 0.2 . However, we also evaluate two other proportions (0.5 and 0.8) for comparison.
Simulating the pool of quantitatively phenotyped individuals
Though we test association with a case/control study design, individuals are sampled from the two tails of the distribution of a quantitatively phenotyped population. This extreme sampling scheme is advantageous because enlarging the size of phenotyped pool alone could improve statistical power to detect the association; this approach has been widely adopted by several well-established sequencing-based association studies , , , . As a baseline, we generate a pool with 50,000 quantitatively phenotyped individuals. Causative variants are randomly selected, and they affect the phenotype in a cumulative matter in that individuals carrying more causative mutations have larger shifts of the phenotypic mean. Specifically, for each individual j, define a causative score , where Ln is the number of non-synonymous rare variants; Il (1 or 0) is the indicator of causative variant, and gjl (0, 1, or 2) is the genotype score at the variant. The relationship between the phenotype and genotype is modeled by a linear regression equationwhere μ is the grand phenotypic mean; ej is the random error which follows a normal distribution with zero mean. The coefficient β is determined by the locus heritability h2, which is defined asAs a baseline, we set h2 to be equal to 0.5%.
When common variants are selected as causative, they affect the phenotype individually by the above linear regression equation. Of the total 0.5% locus heritability, 10% is attributable to common variants.
Sampling extreme phenotyped individuals for sequencing
After the pool of phenotyped individuals is generated, we select individuals with lowest and highest phenotypes for sequencing. As a baseline, we select nu = 1,000 individuals with the lowest phenotypes and label them as control subjects. Similarly, we select nc = 1,000 individuals with the highest phenotypes and label them as case subjects.
Predicting the functional impact of non-synonymous SNPs
Since not all non-synonymous mutations are causative, we add a step to differentiate functional variants from background neutral variation based on the specific amino acid substitutions using existing prediction algorithms, e.g., PolyPhen  and SIFT . We assume that functional variants are all causative. The information obtained from predicting algorithms can be used to generate qualitative (e.g., the variant results in damaged protein) or quantitative (e.g., a continuous score reflecting the degree of impact on protein function) measures. We assume that both measures are available. For simplicity, we take an indicator O as the qualitative measure of being functional (O = 1) or not (O = 0), and we take a probability p () as the quantitative measure, though the bounds 0 and 1 on the range of measure are not required.
The performance of a specific predicting algorithm is measured by its sensitivity, e.g., the probability of correctly identifying a truly functional mutation, and specificity, e.g., the probability of incorrectly classifying a non-functional mutation as a functional one. Assume that the sensitivity and the specificity are and . Specifically, we have , and . Thus, O is simulated from a Bernoulli distribution for causative variants, and from for neutral variants. Given O = 1 or 0, we simulate quantitative measure p from the Uniform distribution U(a, 1) or U(0, a), where a is the threshold to declare a causative variant. We set a = 0.9.
Estimations of sensitivity and specificity are available for most predicting algorithms . The sensitivity ranges from 0.69 to 0.88, and specificity from 0.08 to 0.2. In this study, we set them to average values, e.g., sensitivity to 0.8 and specificity to 0.15, unless otherwise specified.
Individual rare variants, e.g., MAF<1%, provide limited information to detect the association, and an effective approach to analyze them is to group them together , . The first step for analyzing a group of rare variants involves encoding a genotypic score, sj, for each individual j in the group. An infinite number of encoding schemes are available. Here we study three encoding schemes. In the first one, the genotypic score is the sum of individual genotypeswhere Ln is the number of rare non-synonymous variants, and (0, 1, or 2) is the genotype at the lth variant for the jth individual. This encoding scheme is also adopted by a recent study . The second and third schemes involve weighting each variant by its score simulated in the previous section. Denote, for each variant l, pl and ol as the continuous and binary functional measures. The genotypic score is given byfor the second encoding scheme, and is given byfor the third scheme.
Common variants can be analyzed in the combination with grouped rare variants in the above logistic regression model. Denote as the vector of the combination of rare and common variants, where m is the number common variants. The above logistic regression test is rewritten as
We denote tests with the three different encoding schemes as sum test (ST), functional variant weighted continuous sum test (FWCST) and functional variant weighted binary sum test (FWBST).
For comparison, we include two extensive tests that involve grouping rare variants for testing association. The first is the collapsing and its relevant combined multivariate collapsing (CMC) tests . In the collapsing method, genotypic score is an indicator of the presence of rare variantsThe association between the disease status and genotypic score is examined by the Fisher's exact test or test. When common variants are involved, CMC was proposed to test the combination of common and grouped rare variants in a multivariate model, such as Hotelling's T2 test .
The second test is the group-wise weighted sum statistic (GWWS) . In GWWS, the genotypic score is another weighted sum of individual genotypes is assigned so that rarer variants get heavier weights, because rarer variants tend to have a larger effect on phenotype. The association is examined by a rank-sum statistic, and the significance is evaluated by permuting and replicating the test k, e.g., 1000, times.
We evaluate statistical properties, including type-I error rates and power, of various tests by simulation. Type-I error rates are estimated by setting the locus heritability to zero, and power is estimated by setting it to a specified proportion, e.g., 0.5%. Both type-I error rates and power are estimated on 10,000 replicates, where power is defined as the proportion of replicates in which the association is detected at the predefined significance level 1.0E-6. We also study the effects of several influential factors, e.g., the sensitivity and specificity of predicting algorithms, number of variants, and proportion of variants, on power estimates. When evaluating the effect of one particular factor, other parameters will be fixed at base line values.
As an application, we analyze the sequence data produced by Cohen et al. . In their study, the authors sequenced three candidate genes (ABCA1, APOA1, and LCAT) in an initial sample with two groups of individuals to identify mutations that cause low high-density lipoprotein cholesterol (HDL-C) levels. The two groups each comprising 128 individuals were selected from the upper and lower 5% of the distribution of plasma HDL-C levels in the Dallas Heart Study (DHS) (Dallas sample). The authors identified a total number of 29 non-synonymous variants, but only 18 variants that were exclusive to either group were reported. As in , we combined variants of these three genes and analyzed them together. Two variants, each having four alleles in the 64 black individuals (Bayesian posterior frequency 3.8%), were considered as common variants, and the other 16 rare variants were grouped together.
The authors also sequenced the same three genes in a second sample comprising 155 white Canadians who had low levels of HDL-C and 108 who had high levels (Canada sample). A total number of 32 non-synonymous variants were identified, but only 23 variants, which were all rare, were reported and thus were available for us to analyze.
In their analysis, the authors predicted the impact of each variant on maintaining protein function using the predicting algorithm PolyPhen . There are three qualitative measures available from PolyPhen: “benign”, “possibly damaging protein”, and “probably damaging protein”. We take “benign” variants as non-functional, and the other two types as functional. In addition, a position-specific independent counts (PSIC) profile score  from PolyPhen is available as a quantitative measure for each variant, which will be used in this study. Non-sense mutations, e.g., mutations that truncate proteins, could not be predicted by PolyPhen. As non-sense mutations probably change protein function, we category them as functional variants, and assign them the highest quantitative weight among others.
In this section, we first estimated the demographic model by analyzing the real sequence dataset produced by the ENOCDE3 project . Based on the inferred demographic model, we then performed a series of simulation studies to evaluate the performance of several rare variant aimed association tests, including the proposed functional variant weighted continuous sum test (FWCST), binary sum test (FWBST), and sum test without weighting (ST). Two other existing tests, namely combined multivariate collapsing test (CMC)  and group-wise weighted sum statistic test (GWWS) , were also included in our analysis for comparison. We finally re-analyzed the real study reported by Cohen et al. .
Estimating demographic model
The four parameters of demographic model estimated by maximum likelihood estimation are N1 = 20,000, Nb = 14,000, T = 3,300, and = 0.001 (See figure 2 for illustration). N1 and Nb are larger than a previous report by two fold . Given an average 20 years per human generation, the estimated T implies that the bottleneck occurred ∼66,000 years ago (66 kya). This estimation is consistent with the “out-of-Africa” event which presumes that the European branch was expanded from Africa ∼80–40 kya. The estimated effective size of today's population is ∼380,000, much larger than that reported in  (20,000), but smaller than that reported in  (900,000). For neutral variants the estimated allele frequencies from simulations matched quite well with experimental data (figure 3A). Due to the limited number of non-synonymous variants in this dataset, the strength of natural selection could not be evaluated. Instead, using a model with neutral selection, the frequency predicted by simulation for alleles in gene coding regions matched quite well with the experimental data from the ENCODE3 project (figure 3B). This may be because the effect of selection was too weak to be detected by the limited number of available non-synonymous variants.
The constant ancestral population (N1) is followed by a population bottleneck with a reduction of effective size (Nb), and then by an exponentially expansion with T generations, until to the present population (Ne).
Type-I error rates.
As shown in table 1, all methods have reasonable type-I error rates that are close to target levels in all situations that were studied.
Power with proportion of causative variants.
All methods had increased power as the proportion of causative variants increased; their relative performance depended on the proportion (figure 4). When the proportion was lower than 0.7, FWCST and FWBST had the highest power. When the proportion exceeded 0.7, however, the power of ST exceeded that of FWBST. When the proportion was as high as 0.9, the power of ST exceeded that of FWCST, and the power of GWWS exceeded that of FWBST. Comparing FWCST to FWBST, FWBST had higher power when the proportion was below 0.5 but, at levels above 0.5 FWCST had higher power. Comparing ST to GWWS, GWWS had higher power when the proportion was below 0.4 but, at levels above 0.4, ST had higher power. CMC had the lowest power under all tested conditions.
Genotype data of a gene with 1,500 nucleotides are simulated. A pool of 50,000 quantitatively phenotyped individuals is generated, from which 1,000/1,000 individuals with the lowest and highest phenotypes are selected and labeled as control/case subjects. Causative variants explain cumulatively 0.5% of the total phenotypic variation, of which 90% is explained by rare variants, and the remaining 10% by common variants. The sensitivity and specificity of prediction algorithms are set to 0.8 and 0.15, respectively. Power is estimated on 10,000 replicates, defined as the proportion of replicates in which the gene is detected at the significance level 1.0E-6. Abbreviation: FWCST, the proposed functional variant weighted continuous sum test; FWBST, the proposed functional variant weighted binary sum test; ST, the sum test without weighting; GWWS, the group-wise weighted sum test ; CMC, the combined multivariate collapsing test .
Power with predicting sensitivity.
The sensitivity of functional variant prediction is defined as the probability of correctly identifying a truly functional mutation (Functional variants are assumed to be causative/relevant to phenotype). Sensitivity affected the performance of FWCST and FWBST in that power increased with greater sensitivity (figure 5). The relative performance of FWCST and FWBST to other tests also depended on the proportion of causative variants. At low (20%, figure 5A), medium (50%, figure 5B), and high (80%, figure 5C) proportions, their power exceeded that of other tests when sensitivity exceeded approximately 0.4, 0.6, and 0.8, respectively. When sensitivity was low, FWCST was more powerful than FWBST, but power increased more rapidly for FWBST than for FWCST with increasing sensitivity. Consequently, when sensitivity was high, FWBST was more powerful than FWCST. Among the other methods, GWWS and ST had approximately equal power, while the power of CMC was lowest.
Power with predicting specificity.
The specificity of functional variant prediction is defined as the probability of incorrectly classifying a non-functional mutation as a functional one. Specificity affected the performance of FWCST and FWBST in that power decreased with increasing specificity (figure 6). Again, the relative performance among tests depended on the proportion of causative variants. At low proportion (figure 6A), the power of FWCST and FWBST was higher when specificity was lower than ∼0.6. At medium and high proportions (figure 6B&C), the specificity criteria for power improvement was around 0.5 and 0.3, respectively. GWWS and ST had approximately equal power, while that of CMC was lowest.
Power with effective proportion of causative variants.
Since FWCST and FWBST improved power by increasing the effective proportion of causative variants, it is of interest to evaluate their performance when the effective proportion after weighting remains equal to that without weighting. This could occur when the information available does not facilitate selection of true functional variants. To remain the effective proportion equal to that without weighting, the sensitivity and specificity have to be equal (see the Discussion section for the derivation). It was clear that both FWCST and FWBST had lower power than ST (figure 7), implying that uninformative weighting schemes would cause a loss of power. The power of both tests increased with increasing sensitivity. Finally when sensitivity reached 1.0, FWBST was equivalent to ST, but FWCST was still inferior to ST. The power loss was more severe for FWBST than for FWCST in most cases.
Power with gene length.
Gene length affected the performance of different tests quite differently (figure 8). For FWCST and FWBST, power increased with increasing gene length, though the magnitude of this change was minor. For the other tests, however, power decreased with increasing gene length. The power loss was much more severe for CMC than for ST and GWWS. Comparing the two functional variant weighted tests, FWBST was more powerful at low proportion (figure 8A), but had approximately equal power to that FWCST had at the other two proportions (figure 8B and 8C). At low and medium proportions, FWBST and FWCST were most powerful, followed by ST and GWWS, which had approximately equal power, and then by CMC, which had the lowest power. At the high proportion, while all other tests maintained power at high levels, the power of CMC decreased substantially with increasing gene length.
Power with gene effect.
The power of all methods increased with increasing locus heritability (figure 9). Among the tests, FWCST and FWBST were most powerful, followed by GWWS, ST, and CMC. At a low proportion of causative variants (figure 9A), FWCST, FWBST, and GWWS had the ability to detect genes with heritability of 1.5% with nearly 100% power. For ST and CMC, at a low proportion of causative variants, 100% power was achieved at heritability levels of 2.0 and 3.0%, respectively. At high proportions (figure 9C), all tests had nearly 100% power to detect genes with heritability of 1.0% or more, and similar results were obtained at medium proportions (figure 9B) with all tests except CMC, which did not achieve 100% power until heritability reached 1.5%.
Power with phenotyped and sequenced sample size.
Since we simulated a large pool of phenotyped individuals and selected individuals with extreme phenotypes from the pool for sequencing, we investigated the effect of the number of phenotyped and sequenced individuals on power estimation. As shown in table 2, sequencing greater numbers of individuals certainly increased power for all tests, as did increasing the pool of phenotyped individuals. When sequencing 2,000 individuals from a pool of 50,000 phenotyped individuals, the power of FWCST and FWBST was 81% and 87%, respectively, for detecting a gene with 1,500 nucleotides. When the number of phenotyped individuals increased to 100,000, the power of FWCST and FWBST increased to 90% and 92%, respectively, without additional sequencing cost. Comparing the tests, the power of FWCST and FWBST was highest, followed by ST, GWWS, and CMC.
In order to verify the results of our simulation studies, we analyzed the sequence dataset produced by Cohen et al. . When applied to the Dallas sample, FWCST and FWBST had p-values of 4.03E-4 and 4.41E-4, which were higher than that of ST (2.46E-4) and GWWS (7.71E-5), but lower than that of CMC (1.17E-3) (table 3). The inferior performance of FWCST and FWBST compared to ST and GWWS was caused by the fact that of the 3 variants that were exclusive in the control group (high HDL-C), two were predicted to be “damaging protein”, resulting in a specificity rate as high as 0.7. However, this comparison probably created an advantage for un-weighted tests because another 11 variants, that were present in both case and control groups, were not included in the authors' analysis. If these variants, which were likely to be neutral, had been included, the specificity of prediction would be expected to decrease, thereby the relative performance of FWCST and FWBST compared to other tests would be improved.
When applied to the Canada sample, both FWCST and FWBST produced lower p-values (thus likely higher power) (1.97E-4 and 1.46E-5) than those of other tests (ST: 1.35E-3; GWWS: 1.81E-3; CMC: 2.74E-3). In this sample, both variants exclusive to the control group were predicted to be neutral, resulting in a specificity rate as low as zero. Again, the comparison would be fairer if the additional 9 variants, that were present in both case and control groups, had been included for analysis.
In this study, we have proposed and evaluated a novel method to test the association between disease and variants in gene coding regions. Specifically, we incorporated information generated by extensive use of predicting algorithms into group-wise association tests. This was done in order to improve the power of these tests by distinguishing potential causative variants from background neutral variation. We also studied the effects of several influential factors on the performance of the proposed tests. Simulation studies showed that the use of predicting algorithms to identify potentially functional variants improves statistical power under certain conditions, especially when the proportion of functional variants is moderate. Application of the proposed tests to a real sequencing study confirmed the results of our simulation studies.
Association, referring to the correlation between phenotype and genetic variants, can be categorized into indirect and direct associations. With indirect association, the genetic variants to be examined are usually neutral bio-markers, e.g., SNPs, while the causative variants are untyped. In order for indirect association studies to be effective, there must be linkage disequilibrium (LD; i.e., nonrandom association), between these neutral bio-markers and the causative variants. Variant alleles in indirect association usually have no functional biological impact, and are often encoded as 1 or 0 to indicate the presence or absence of a particular allele. With direct association, in contrast, the variants that are examined are assumed to be functional, and not only the presence or absence of a particular allele but also its type (e.g., A, G, C, or T) is informative. This distinction has made analytical approaches for sequencing-based direct association studies different from those used for genotyping-based indirect association studies.
Sequencing genomic regions identifies a greater number of rare variants than that identified by genotyping platforms. The challenge in analyzing rare variants is attributable both to their rarity, and to the fact that a large proportion of these rare variants represent background population variation with no functional impact. While grouping strategies could enlarge mutation signals, the anticipated excess number of neutral variants within the group would decrease signal-to-noise ratios to very low levels. Therefore, it would be highly advantageous to differentiate potential causative variants from neutral ones, prior to association analyses, with the goal of increasing signal-to-noise ratios.
In gene coding regions, the functional impact of a variant can be predicted from protein structure and function, and multiple sequence alignments. Functional variants predicted by existing algorithms distribute differently between disease-affected and normal populations. For example, when applied to a disease-causing mutation database annotated in SwissProt, PolyPhen predicts that ∼82% of all mutations will result in damaged protein . When applied to a control set of between-species substitutions, however, only ∼8% of mutations fall into this category . Several recent sequencing studies provide additional evidence for this relationship between predicted functional variants and phenotype , , , . For example, in the study of Cohen et al. , 17 of 25 non-synonymous SNPs (nsSNPs) identified in the ABCA1 gene in case group are predicted to be “damaging protein”. Given PolyPhen's false positive rate on neutral substitutions being 0.08, the p-value for observing this data from a binomial distribution is as low as 1.30E-13. Similar analysis on nsSNPs in control group (2 of 4 being “damaging protein”) presents a much higher p-value 0.03 . Therefore, predicted functional variants are highly correlated with disease phenotype, which justifies the importance and attests to the feasibility of identifying putative functional variants prior to grouped association analyses.
A variety of algorithms have been proposed to predict the functional impact of amino acid substitutions , , , , , , , , , . Prediction could be based on multiple ortholog sequences, protein structures, and annotation of variants. In our real data analysis, we used PolyPhen  which uses sequence-, structure-, and annotation-based information as input. The benefits of using these prediction algorithms are dependent on the capacity to increase the effective proportion of causative variants, which is highly dependent on the sensitivity and specificity of the algorithm used. For a particular sample with N variants, let f represent the proportion of causative variants, and let and represent the sensitivity and specificity of a particular predicting algorithm. The effective numbers of causative and neutral variants after weighting are thus and , respectively, so that the effective proportion of causative variants after weighting is . When >, it is clear that the effective proportion will be larger than f, and the proposed tests tend to be more powerful. In contrast, the effective number of causative variants decreases from to , thereby reducing power. Therefore, the relative performance of weighted tests reflects the balance of these two opposite effects. When = , the effective proportion remains f, but the effective number is still reduced to . This leads to reduced power, where the power loss gets less severe with increasing , as shown by our simulations. For a particular , the loss of power is influenced by the diversity of weights being assigned. For the binary weighting scheme FWBST where extreme weights (1 or 0) are assigned, power loss is severe. For the continuous weighting scheme, FWCST, where intermediate continuous weights (between 0 and 1) are assigned, power loss gets less severe.
Weighting variants within a group has been proposed by Madsen & Browning , however, their weighting scheme is derived from the sample that is being studied. Specifically, they assigned heavier weights to rarer variants in the control population. The merit of their method relies heavily on the assumption that rarer variants have larger per-allele effects. Violation of this assumption, as observed in the simulations used in this study, would diminish the advantages of their test. In our simulations, GWWS had a greater power than ST, without weighting, only when the proportion of causative variants was low; otherwise, ST actually had a slightly greater power. When prior knowledge that is independent of the sample under investigation is available, GWWS could be inferior to the proposed functional variant weighted tests. Another assumption-related observation is that CMC is generally inferior to the other tests. This observation depends on the underlying biological mechanism for the phenotype. In CMC, individuals with one or more mutations are encoded with the same genetic score. Corresponding to the underlying mechanism of gene expression, it assumes that any single mutation will cause complete loss of protein function, which probably only occurs for non-sense mutations. In our simulations, however, mutations affect phenotype in a cumulative way such that each mutation causes only a partial loss of protein function. This critical difference between their assumption and our simulations may account for the inferior performance of CMC in this study.
Weighting variants based on prior information has also been a research focus for years in common variants based association studies , , , . Among previous studies, Genovese et al.  proposed a general framework that incorporated prior information into genome-wide association studies (GWAS) to overcome the problem of multiple hypothesis testing. In brief, they assigned each SNP a weight so that SNPs with heavier weights were penalized less when using multiple testing corrections. Following their work, Roeder et al.  proposed formulating weights based on previous linkage traces. They divided association p-values by weights that were predefined, and applied the traditional FDR procedure to the weighted p-values. Roeder et al.  also proposed a weighted multiple testing procedure. Later work proposed by Chen and Witte  incorporated various sources of prior information, such as linkage signal, functional category, conservation, and LD, into a Bayesian hierarchical model to reflect the prior likelihood of the SNP being associated. All of these methods were shown to have the ability to improve power of detecting the association assuming that the prior information was correctly specified.
Rare and common variants aimed weightings share, in common, the idea of using prior information to improve power, however they are different in the following aspects. First, common variants are tested individually, and weighting operates on the resulting individual p-values, while rare variants are tested together and weighting operates on individual genotypes. Second, the aim of weighting for common variants is to relieve the problem of multiple hypotheses testing by punishing different tests differently through the weights they are assigned. In contrast the aim of weighting for rare variants is to improve the effective proportion of causative variants within group. Hence, largely speaking, the general goal and detailed specific strategies involved are largely different in rare and common variants aimed weightings.
In this study, we restrict our attention to non-synonymous variants in gene coding regions because these variants have direct functional implications. In principal, the weighting scheme could also be extended to variants in other genomic regions, e.g., gene introns, regulatory regions (enhancer, silencer, and etc.), splicing sites, and ultra-conserved regions, by studying ortholog sequences between and/or within species. However, caution should be taken when studying these non-coding variants, because they have no direct functional meaning in terms of affecting gene expression, and the relationship between their conservation and phenotype may not be well established. A study reported by Ahituv et al.  showed that after deleting four non-coding ultra-conserved elements from the mouse genome, the mice remained viable and fertile, and revealed no abnormalities for a variety of phenotypes that were studied. The effects of these conservative genomic regions in maintaining the normality of species is still being debated, and whether they can be used to direct the selection of causative variants may warrant further consideration. Focusing analyses on gene-coding regions provides a plausible trade-off between sequencing cost and discovery of informative variants, and may be an attractive study design before genome-wide sequencing study becomes widely available , , , , .
In conclusion, we propose that the use of predicting algorithms to distinguish causative variants from background population variation, and incorporation of this information into association tests, can improve statistical power for detecting rare variants that are associated with diseases. This conclusion is supported by both simulation studies and the application of this approach to real sequencing data. Our work may help investigators who are planning to pursue large-scale gene based sequencing studies.
Conceived and designed the experiments: HWD. Performed the experiments: LZ. Analyzed the data: LZ YFP. Wrote the paper: LZ YFP JL CP HWD.
- 1. Risch N, Merikangas K (1996) The future of genetic studies of complex human diseases. Science 273: 1516–1517.N. RischK. Merikangas1996The future of genetic studies of complex human diseases.Science27315161517
- 2. Chakravarti A (1999) Population genetics–making sense out of sequence. Nat Genet 21: 56–60.A. Chakravarti1999Population genetics–making sense out of sequence.Nat Genet215660
- 3. Reich DE, Lander ES (2001) On the allelic spectrum of human disease. Trends Genet 17: 502–510.DE ReichES Lander2001On the allelic spectrum of human disease.Trends Genet17502510
- 4. Hindorff LA, Junkons HA, Mehta JP, Manolio TA (2009) A catalog of published Genome-Wide Association Studies. LA HindorffHA JunkonsJP MehtaTA Manolio2009A catalog of published Genome-Wide Association Studies.National Human Genome Research Institute [online], www.genome.gov/26525384. National Human Genome Research Institute [online], www.genome.gov/26525384.
- 5. Kryukov GV, Pennacchio LA, Sunyaev SR (2007) Most rare missense alleles are deleterious in humans: implications for complex disease and association studies. Am J Hum Genet 80: 727–739.GV KryukovLA PennacchioSR Sunyaev2007Most rare missense alleles are deleterious in humans: implications for complex disease and association studies.Am J Hum Genet80727739
- 6. Pritchard JK (2001) Are rare variants responsible for susceptibility to complex diseases? Am J Hum Genet 69: 124–137.JK Pritchard2001Are rare variants responsible for susceptibility to complex diseases?Am J Hum Genet69124137
- 7. Pritchard JK, Cox NJ (2002) The allelic architecture of human disease genes: common disease-common variant…or not? Hum Mol Genet 11: 2417–2423.JK PritchardNJ Cox2002The allelic architecture of human disease genes: common disease-common variant…or not?Hum Mol Genet1124172423
- 8. Frazer KA, Murray SS, Schork NJ, Topol EJ (2009) Human genetic variation and its contribution to complex traits. Nat Rev Genet 10: 241–251.KA FrazerSS MurrayNJ SchorkEJ Topol2009Human genetic variation and its contribution to complex traits.Nat Rev Genet10241251
- 9. Levy S, Sutton G, Ng PC, Feuk L, Halpern AL, et al. (2007) The diploid genome sequence of an individual human. PLoS Biol 5: e254.S. LevyG. SuttonPC NgL. FeukAL Halpern2007The diploid genome sequence of an individual human.PLoS Biol5e254
- 10. Shendure J, Ji H (2008) Next-generation DNA sequencing. Nat Biotechnol 26: 1135–1145.J. ShendureH. Ji2008Next-generation DNA sequencing.Nat Biotechnol2611351145
- 11. Tucker T, Marra M, Friedman JM (2009) Massively parallel sequencing: the next big thing in genetic medicine. Am J Hum Genet 85: 142–154.T. TuckerM. MarraJM Friedman2009Massively parallel sequencing: the next big thing in genetic medicine.Am J Hum Genet85142154
- 12. Wheeler DA, Srinivasan M, Egholm M, Shen Y, Chen L, et al. (2008) The complete genome of an individual by massively parallel DNA sequencing. Nature 452: 872–876.DA WheelerM. SrinivasanM. EgholmY. ShenL. Chen2008The complete genome of an individual by massively parallel DNA sequencing.Nature452872876
- 13. Siva N (2008) 1000 Genomes project. Nat Biotechnol 26: 256.N. Siva20081000 Genomes project.Nat Biotechnol26256
- 14. Kryukov GV, Shpunt A, Stamatoyannopoulos JA, Sunyaev SR (2009) Power of deep, all-exon resequencing for discovery of human trait genes. Proc Natl Acad Sci U S A 106: 3871–3876.GV KryukovA. ShpuntJA StamatoyannopoulosSR Sunyaev2009Power of deep, all-exon resequencing for discovery of human trait genes.Proc Natl Acad Sci U S A10638713876
- 15. Li B, Leal SM (2008) Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am J Hum Genet 83: 311–321.B. LiSM Leal2008Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data.Am J Hum Genet83311321
- 16. Madsen BE, Browning SR (2009) A groupwise association test for rare mutations using a weighted sum statistic. PLoS Genet 5: e1000384.BE MadsenSR Browning2009A groupwise association test for rare mutations using a weighted sum statistic.PLoS Genet5e1000384
- 17. Morgenthaler S, Thilly WG (2007) A strategy to discover genes that carry multi-allelic or mono-allelic risk for common diseases: a cohort allelic sums test (CAST). Mutat Res 615: 28–56.S. MorgenthalerWG Thilly2007A strategy to discover genes that carry multi-allelic or mono-allelic risk for common diseases: a cohort allelic sums test (CAST).Mutat Res6152856
- 18. Chang H, Fujita T (2001) PicSNP: a browsable catalog of nonsynonymous single nucleotide polymorphisms in the human genome. Biochem Biophys Res Commun 287: 288–291.H. ChangT. Fujita2001PicSNP: a browsable catalog of nonsynonymous single nucleotide polymorphisms in the human genome.Biochem Biophys Res Commun287288291
- 19. Ramensky V, Bork P, Sunyaev S (2002) Human non-synonymous SNPs: server and survey. Nucleic Acids Res 30: 3894–3900.V. RamenskyP. BorkS. Sunyaev2002Human non-synonymous SNPs: server and survey.Nucleic Acids Res3038943900
- 20. Mooney SD, Altman RB (2003) MutDB: annotating human variation with functionally relevant data. Bioinformatics 19: 1858–1860.SD MooneyRB Altman2003MutDB: annotating human variation with functionally relevant data.Bioinformatics1918581860
- 21. Ng PC, Henikoff S (2003) SIFT: Predicting amino acid changes that affect protein function. Nucleic Acids Res 31: 3812–3814.PC NgS. Henikoff2003SIFT: Predicting amino acid changes that affect protein function.Nucleic Acids Res3138123814
- 22. Thomas PD, Campbell MJ, Kejariwal A, Mi H, Karlak B, et al. (2003) PANTHER: a library of protein families and subfamilies indexed by function. Genome Res 13: 2129–2141.PD ThomasMJ CampbellA. KejariwalH. MiB. Karlak2003PANTHER: a library of protein families and subfamilies indexed by function.Genome Res1321292141
- 23. Stitziel NO, Binkowski TA, Tseng YY, Kasif S, Liang J (2004) topoSNP: a topographic database of non-synonymous single nucleotide polymorphisms with and without known disease association. Nucleic Acids Res 32: D520–522.NO StitzielTA BinkowskiYY TsengS. KasifJ. Liang2004topoSNP: a topographic database of non-synonymous single nucleotide polymorphisms with and without known disease association.Nucleic Acids Res32D520522
- 24. Ferrer-Costa C, Gelpi JL, Zamakola L, Parraga I, de la Cruz X, et al. (2005) PMUT: a web-based tool for the annotation of pathological mutations on proteins. Bioinformatics 21: 3176–3178.C. Ferrer-CostaJL GelpiL. ZamakolaI. ParragaX. de la Cruz2005PMUT: a web-based tool for the annotation of pathological mutations on proteins.Bioinformatics2131763178
- 25. Reumers J, Schymkowitz J, Ferkinghoff-Borg J, Stricher F, Serrano L, et al. (2005) SNPeffect: a database mapping molecular phenotypic effects of human non-synonymous coding SNPs. Nucleic Acids Res 33: D527–532.J. ReumersJ. SchymkowitzJ. Ferkinghoff-BorgF. StricherL. Serrano2005SNPeffect: a database mapping molecular phenotypic effects of human non-synonymous coding SNPs.Nucleic Acids Res33D527532
- 26. Yue P, Melamud E, Moult J (2006) SNPs3D: candidate gene and SNP selection for association studies. BMC Bioinformatics 7: 166.P. YueE. MelamudJ. Moult2006SNPs3D: candidate gene and SNP selection for association studies.BMC Bioinformatics7166
- 27. Ng PC, Henikoff S (2006) Predicting the effects of amino acid substitutions on protein function. Annu Rev Genomics Hum Genet 7: 61–80.PC NgS. Henikoff2006Predicting the effects of amino acid substitutions on protein function.Annu Rev Genomics Hum Genet76180
- 28. Adams AM, Hudson RR (2004) Maximum-likelihood estimation of demographic parameters using the frequency spectrum of unlinked single-nucleotide polymorphisms. Genetics 168: 1699–1712.AM AdamsRR Hudson2004Maximum-likelihood estimation of demographic parameters using the frequency spectrum of unlinked single-nucleotide polymorphisms.Genetics16816991712
- 29. Asthana S, Roytberg M, Stamatoyannopoulos J, Sunyaev S (2007) Analysis of sequence conservation at nucleotide resolution. PLoS Comput Biol 3: e254.S. AsthanaM. RoytbergJ. StamatoyannopoulosS. Sunyaev2007Analysis of sequence conservation at nucleotide resolution.PLoS Comput Biol3e254
- 30. Tarpey PS, Smith R, Pleasance E, Whibley A, Edkins S, et al. (2009) A systematic, large-scale resequencing screen of X-chromosome coding exons in mental retardation. Nat Genet 41: 535–543.PS TarpeyR. SmithE. PleasanceA. WhibleyS. Edkins2009A systematic, large-scale resequencing screen of X-chromosome coding exons in mental retardation.Nat Genet41535543
- 31. Sunyaev S, Ramensky V, Koch I, Lathe W 3rd, Kondrashov AS, et al. (2001) Prediction of deleterious human alleles. Hum Mol Genet 10: 591–597.S. SunyaevV. RamenskyI. KochW. Lathe 3rdAS Kondrashov2001Prediction of deleterious human alleles.Hum Mol Genet10591597
- 32. Ahituv N, Kavaslar N, Schackwitz W, Ustaszewska A, Martin J, et al. (2007) Medical sequencing at the extremes of human body mass. Am J Hum Genet 80: 779–791.N. AhituvN. KavaslarW. SchackwitzA. UstaszewskaJ. Martin2007Medical sequencing at the extremes of human body mass.Am J Hum Genet80779791
- 33. Cohen JC, Boerwinkle E, Mosley TH Jr, Hobbs HH (2006) Sequence variations in PCSK9, low LDL, and protection against coronary heart disease. N Engl J Med 354: 1264–1272.JC CohenE. BoerwinkleTH Mosley JrHH Hobbs2006Sequence variations in PCSK9, low LDL, and protection against coronary heart disease.N Engl J Med35412641272
- 34. Cohen JC, Kiss RS, Pertsemlidis A, Marcel YL, McPherson R, et al. (2004) Multiple rare alleles contribute to low plasma levels of HDL cholesterol. Science 305: 869–872.JC CohenRS KissA. PertsemlidisYL MarcelR. McPherson2004Multiple rare alleles contribute to low plasma levels of HDL cholesterol.Science305869872
- 35. Li B, Leal SM (2009) Discovery of rare variants via sequencing: implications for the design of complex trait association studies. PLoS Genet 5: e1000481.B. LiSM Leal2009Discovery of rare variants via sequencing: implications for the design of complex trait association studies.PLoS Genet5e1000481
- 36. Sunyaev SR, Eisenhaber F, Rodchenkov IV, Eisenhaber B, Tumanyan VG, et al. (1999) PSIC: profile extraction from sequence alignments with position-specific counts of independent observations. Protein Eng 12: 387–394.SR SunyaevF. EisenhaberIV RodchenkovB. EisenhaberVG Tumanyan1999PSIC: profile extraction from sequence alignments with position-specific counts of independent observations.Protein Eng12387394
- 37. Birney E, Stamatoyannopoulos JA, Dutta A, Guigo R, Gingeras TR, et al. (2007) Identification and analysis of functional elements in 1% of the human genome by the ENCODE pilot project. Nature 447: 799–816.E. BirneyJA StamatoyannopoulosA. DuttaR. GuigoTR Gingeras2007Identification and analysis of functional elements in 1% of the human genome by the ENCODE pilot project.Nature447799816
- 38. Marth GT, Czabarka E, Murvai J, Sherry ST (2004) The allele frequency spectrum in genome-wide human variation data reveals signals of differential demographic history in three large world populations. Genetics 166: 351–372.GT MarthE. CzabarkaJ. MurvaiST Sherry2004The allele frequency spectrum in genome-wide human variation data reveals signals of differential demographic history in three large world populations.Genetics166351372
- 39. Gorlov IP, Gorlova OY, Sunyaev SR, Spitz MR, Amos CI (2008) Shifting paradigm of association studies: value of rare single-nucleotide polymorphisms. Am J Hum Genet 82: 100–112.IP GorlovOY GorlovaSR SunyaevMR SpitzCI Amos2008Shifting paradigm of association studies: value of rare single-nucleotide polymorphisms.Am J Hum Genet82100112
- 40. Reumers J, Maurer-Stroh S, Schymkowitz J, Rousseau F (2006) SNPeffect v2.0: a new step in investigating the molecular phenotypic effects of human non-synonymous SNPs. Bioinformatics 22: 2183–2185.J. ReumersS. Maurer-StrohJ. SchymkowitzF. Rousseau2006SNPeffect v2.0: a new step in investigating the molecular phenotypic effects of human non-synonymous SNPs.Bioinformatics2221832185
- 41. Chen GK, Witte JS (2007) Enriching the analysis of genomewide association studies with hierarchical modeling. Am J Hum Genet 81: 397–404.GK ChenJS Witte2007Enriching the analysis of genomewide association studies with hierarchical modeling.Am J Hum Genet81397404
- 42. Genovese CR, Roeder K, Wasserman L (2006) False discovery control with p-value weighting. Biometrika 93: 509–524.CR GenoveseK. RoederL. Wasserman2006False discovery control with p-value weighting.Biometrika93509524
- 43. Roeder K, Bacanu SA, Wasserman L, Devlin B (2006) Using linkage genome scans to improve power of association in genome scans. Am J Hum Genet 78: 243–252.K. RoederSA BacanuL. WassermanB. Devlin2006Using linkage genome scans to improve power of association in genome scans.Am J Hum Genet78243252
- 44. Roeder K, Devlin B, Wasserman L (2007) Improving power in genome-wide association studies: weights tip the scale. Genet Epidemiol 31: 741–747.K. RoederB. DevlinL. Wasserman2007Improving power in genome-wide association studies: weights tip the scale.Genet Epidemiol31741747
- 45. Ahituv N, Zhu Y, Visel A, Holt A, Afzal V, et al. (2007) Deletion of ultraconserved elements yields viable mice. PLoS Biol 5: e234.N. AhituvY. ZhuA. ViselA. HoltV. Afzal2007Deletion of ultraconserved elements yields viable mice.PLoS Biol5e234
- 46. Ng SB, Turner EH, Robertson PD, Flygare SD, Bigham AW, et al. (2009) Targeted capture and massively parallel sequencing of 12 human exomes. Nature. SB NgEH TurnerPD RobertsonSD FlygareAW Bigham2009Targeted capture and massively parallel sequencing of 12 human exomes.Nature
- 47. Ng PC, Levy S, Huang J, Stockwell TB, Walenz BP, et al. (2008) Genetic variation in an individual human exome. PLoS Genet 4: e1000160.PC NgS. LevyJ. HuangTB StockwellBP Walenz2008Genetic variation in an individual human exome.PLoS Genet4e1000160
- 48. Ng SB, Buckingham KJ, Lee C, Bigham AW, Tabor HK, et al. (2010) Exome sequencing identifies the cause of a mendelian disorder. Nat Genet 42: 30–35.SB NgKJ BuckinghamC. LeeAW BighamHK Tabor2010Exome sequencing identifies the cause of a mendelian disorder.Nat Genet423035