Genome wide association (GWA) studies, which test for association between common genetic markers and a disease phenotype, have shown varying degrees of success. While many factors could potentially confound GWA studies, we focus on the possibility that multiple, rare variants (RVs) may act in concert to influence disease etiology. Here, we describe an algorithm for RV analysis, RareCover. The algorithm combines a disparate collection of RVs with low effect and modest penetrance. Further, it does not require the rare variants be adjacent in location. Extensive simulations over a range of assumed penetrance and population attributable risk (PAR) values illustrate the power of our approach over other published methods, including the collapsing and weighted-collapsing strategies. To showcase the method, we apply RareCover to re-sequencing data from a cohort of 289 individuals at the extremes of Body Mass Index distribution (NCT00263042). Individual samples were re-sequenced at two genes, FAAH and MGLL, known to be involved in endocannabinoid metabolism (187Kbp for 148 obese and 150 controls). The RareCover analysis identifies exactly one significantly associated region in each gene, each about 5 Kbp in the upstream regulatory regions. The data suggests that the RVs help disrupt the expression of the two genes, leading to lowered metabolism of the corresponding cannabinoids. Overall, our results point to the power of including RVs in measuring genetic associations.
We focus on the problem of detecting multiple rare variants (RVs) that act together to influence disease phenotypes. In considering this problem, we argue that the detection of causal rare variants must necessarily be different from typical single-marker analysis used for common variants and propose a novel algorithm, RareCover, to accomplish this analysis. RareCover combines a disparate collection of RVs, each with very low effect and modest penetrance. Extensive simulations over a range of values for penetrance and population attributable risk (PAR) illustrate the power of our approach over other published methods, including the collapsing and weighted-sum strategies. To showcase the method, we applied RareCover to data from 289 individuals at the extremes of Body Mass Index distribution (NCT00263042), sequenced around the FAAH and MGLL genes. RareCover analysis identified exactly one significantly associated region in each gene, each about 5Kbp in the upstream regulatory regions. The data suggests that the RVs help disrupt the expression of the two genes leading to lowered metabolism of the corresponding endocannabinoids previously linked with obesity. Overall, our results point to the power of including RVs in measuring genetic associations, and suggest that whole genome, DNA sequencing-based association studies investigating RV effects are feasible.
Citation: Bhatia G, Bansal V, Harismendy O, Schork NJ, Topol EJ, Frazer K, et al. (2010) A Covering Method for Detecting Genetic Associations between Rare Variants and Common Phenotypes. PLoS Comput Biol 6(10): e1000954. https://doi.org/10.1371/journal.pcbi.1000954
Editor: Christian von Mering, University of Zurich, Switzerland
Received: January 19, 2010; Accepted: September 8, 2010; Published: October 14, 2010
Copyright: © 2010 Bhatia et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: V. Bafna was supported in part by grant (IIS-0810905). V. Bansal, N.J.S., and E.T. were supported in part by the following grants: U19 AG023122-05; R01 MH078151-03; N01 MH22005, U01 DA024417-01, P50 MH081755-01, R01 AG030474-02, N01 MH022005, R01 HL089655-02, R01 MH080134-03, U54 CA143906-01; UL1 RR025774-03, the Price Foundation, and Scripps Genomic Medicine. This publication was made possible by Grant Number T32 HG002295 from the National Human Genome Research Institute (NHGRI). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The Common Disease, Common Variant (CDCV) hypothesis – postulates that the etiology of common diseases is mediated by commonly occurring genomic variants in a population. This has served as the basis for genome wide association (GWA) studies that test for association between individual genomic markers and the disease phenotype. Using genome-wide panels of common SNPs, GWA studies have been successful in identifying hundreds of statistically significant associations for many common diseases as well as several quantitative traits –. Nevertheless, the success of GWA studies has been mixed. Significant genetic loci have not been detected for several common diseases that are known to have a strong genetic component . Additionally, for many common diseases, associations discovered in GWA studies can account for only a small fraction of the heritability of the disease. While many factors could potentially confound GWA studies, we focus on the possibility that multiple, rare variants may act in concert to influence disease etiology.
The alternative to the CDCV hypothesis, the ‘Common Disease, Rare Variant (CDRV)’ hypothesis has been the topic of much recent debate , and has shown promise in explaining disease etiology in multiple studies. For example, rare variants (RVs) have been implicated in reduced sterol absorption and, consequently, lower plasma levels of LDL ,  and colorectal cancer . While some studies have shown RVs to increase risk, a recent study indicates that RVs also act ‘protectively’, with multiple RVs in renal salt handling genes showing association with reduced renal salt resorption and reduced risk of hypertension . Additionally, rare mutations in IFIH1 have been shown to act protectively against type 1 diabetes .
The aforementioned studies and others focused on re-sequencing of the coding regions of candidate genes using Sanger sequencing (see Table 1 in Schork et al.  for a summary). Recent technological advances in DNA sequencing have made it possible to re-sequence large stretches of a genome in a cost-effective manner. This is enabling large-scale studies of the impact of RVs on complex diseases. However, several properties of rare variants make their genetic effects difficult to detect with current approaches. Bodmer and Bonilla provide an excellent review of the properties of RVs, and the differences between rare, and common variant analysis . As an example, if a causal variant is rare ( MAF ), and the disease is common, then the allele's Population-Attributable-Risk (PAR), and consequently the odds-ratio (OR), will be low. Additionally, even highly penetrant RVs are unlikely to be in Linkage Disequilibrium (LD) with more common genetic variations that might be genotyped for an association study of a common disease. Therefore, single-marker tests of association, which exploit LD-based associations, are likely to have low power. If the CDRV hypothesis holds, a combination of multiple RVs must contribute to population risk. In this case, there is a challenge of detecting multi-allelic association between a locus and the disease.
Methods to detect such associations are only just being developed. A natural approach is a collapsing strategy, where multiple RVs at a locus are collapsed into a single variant. Such strategies have low power when ‘causal’ and neutral RVs are combined (See for example, Li and Leal ). Madsen and Browning have recently proposed a weighted-sum statistic to detect loci in which disease individuals are enriched for rare variants . In their approach, variants are weighted according to their frequency in the unaffected sample, with low frequency variants being weighted more heavily. Each individual is scored as a sum of the weights of the mutations carried. The test then determines if the diseased individuals are weighted more heavily than expected in a null-model. Madsen and Browning show that with of variants in a group being causal and a combined odds ratio , the weighted-sum statistic detects associations with high power. While effective, this approach depends upon the inclusion of high proportion of causal rare variants in the formation of the test statistics and strong penetrance to detect significant association. In their simulations, the PAR of the locus is partitioned equally among all variants, an assumption that may not always hold.
The Combined Multivariate and Collapsing Method (CMC), proposed by Li and Leal, combines variants into groups based upon predefined criteria (e.g. allele frequency, function) . An individual has a ‘1’ for a group if any variant in the group is carried and a ‘0’ otherwise. The CMC approach then considers each of the groups in a multivariate analysis to explain disease risk. This combination of the collapsing approach and multivariate analysis results in an increase of power over single-marker and multiple marker approaches. However, as Li and Leal point out, the method relies on correct grouping of variants. The power is reduced as functional variants are excluded and non-functional variants are included in a group. Assignment of SNPs to incorrect groups may, in fact, decrease power below that attainable through single marker analysis. Indeed, a recent analysis by Manolio and colleagues suggests that new methods might be needed when the causal variants have both low PAR and low penetrance values .
Here, we focus on a model-free method, RareCover, that collapses only a subset of the variants at a locus. Informally, consider a locus encoding a set of rare variants. RareCover associates with a phenotype by measuring the strongest possible association formed by collapsing any subset of variants at . At first glance, such an approach has many problems. First, selecting an optimal subset of SNPs is computationally intensive, scaling as . We show that a greedy approach to selecting the optimal subset scales linearly, making it feasible to conduct associations on a large set of candidate loci.
A second confounding factor is that the large number of different tests at a locus increase the likelihood of false association. The adjustment required to control the type I error could decrease the power of the method. However, extensive simulations show otherwise. Our results suggest that moderately penetrant alleles with small PAR , and moderately sized cohorts ( cases and controls) are sufficient for RareCover to detect significant association. This compares well with the current power of single-marker GWA studies on common variants, and outperforms other methods for RV detection.
We also applied RareCover to the analysis of two genes, FAAH, and MGLL, in the endocannabinoid pathway in a large sequencing study of obese and non-obese individuals. The endocannabinoid pathway is an important mediator of a variety of neurological functions , . Endocannabinoids, acting upon CB1 receptors in the brain, the gastrointestinal tract, and a variety of other tissues, have been shown to influence food intake and weight gain in animal models of obesity. Using a selective endocannabinoid receptor (CB1) antagonist, SR141716 (Rimonanabt; Sanofi-Synthelabo) leads to reduced food intake in mice. Correspondingly, elevation of leptin levels have been shown to decrease concentrations of endogenous CB1 agonists, Anandamide, and 2-AG in mice, thereby reducing food-intake . The FAAH and MGLL enzymes serve as regulators of endocannabinoid signaling in the brain , by catalyzing the hydrolysis of endocannabinoid including anandamide (AEA), and 2-AG. Gene expression studies in lean and obese women show significantly decreased levels of AEA and 2-AG, as well as over-expression of CB1 and FAAH in lean, as opposed to obese women . While evidence points to a genetic association of these loci with obesity, multiple recent studies using common SNPs in the FAAH region have failed to confirm an association –. A Pro129Thr polymorphism was tentatively associated with obesity in a cohort of Europe and and Asian ancestry, but has not been replicated in other data .
We tested the hypothesis that multiple, rare alleles at these loci are associated with obesity. We have used unpublished (submitted) data from Frazer and colleagues, where the FAAH (Kbp) and MGLL (Kbp) regions were re-sequenced using next generation technologies in 148 obese and 150 non-obese individuals taken as extremes of the body mass index distribution from subjects in a large clinical trial (the CRESCENDO cohort, NCT00263042). The resequencing identified a number of common, and rare variants in the region. We applied RareCover to determine if multiple RVs, i.e., allelic heterogeneity, mediated the genetic effects of FAAH and MGLL on obesity. RareCover identified a single region at each locus with permutation adjusted p-values of and . In each case, the significant locus was immediately upstream of the gene, consistent with a regulatory function for the rare variants.
Modeling RV association
We define a locus as a genomic region of fixed size (nucleotides). Let denote the set of RVs in the locus. We abuse notation slightly by using to also denote the locus itself. A case-control study at includes a set of individual genotypes. For genotype , and RV , let denote the number of minor alleles that genotype carries for variant . Extending the notation to subsets, of RVs, define . For a subset , denote a union-variant as follows: individual has the allele if and only if . Otherwise, . The union-variant is a virtual construct that helps combine the effect of multiple RVs. Let (respectively, ) represent the case (respectively, control) status of an individual.
For an individual chosen at random, and , let Xcorr denote an association test statistic between the union-variant and the disease status . Here, we will use Pearson's as the test-statistic, but the method remains unchanged for other measures. Using this notation, the collapsing strategy described by Li and Leal  uses the test-statistic Xcorr to associate a locus with the disease. Instead, we define the association statistic for locus by(1)
The RareCover method
Our method, RareCover, accepts a locus containing a set of RVs in a window of fixed size (nucleotides). It returns the test-statistic, Xcorr , a -value on the statistic, and the subset of RVs that contribute to the union variant. The window size is a parameter. When the input locus is larger than the window size, RareCover looks at overlapping windows of size , where each window is shifted one RV away from the previous window. For each window, the Xcorr statistic is output, along with a non-adjusted -value.
The computation for the Xcorr statistic on a single window is described in the Algorithm below. Given a set of RVs over individuals, the naive computation for computing Xcorr needs computations. A reduction from the MAX-COVER problem can be used to show that the problem is NP-hard, indicating that no provably efficient algorithm is likely . Similar reductions can also be used to show the hardness result for a variety of other proposed association statistics. Therefore, we employ a greedy heuristic that is fast ( computations), and does well in practice. In each step, (see Algorithm), we select the variant that adds the most to the statistic, until no further improvement is possible. On a standard Linux workstation, the computation is fast, about windows per second.
procedure RareCover (S, Q)
Select that maximizes Xcorr
return Xcorr .
The RareCover method for detecting locus association. describes the current subset of ‘causal’ SNPs. Initially is empty. In each iteration, the RV that maximizes the test statistic is chosen, and added to . When the improved statistic is not significantly better than the current statistic (), the method stops, and outputs .
While the test-statistic is a test on the union-variant , significance cannot be computed directly, as is optimized over many possibilities. The multiple-tests will increase the statistic for non-associated loci as well. We compute significance by applying RareCover to permutations of the case-control genotypes.
The number of permuted trials required to achieve genome-wide significance can be large. We make the computation tractable using two ideas: first, empirical tests show that the statistic on correlates tightly with the permutation -value (Figure 1). Note that the saturation at the end is due to limited trials. Let denote the value of Xcorr for a window, . When is less than a pre-determined threshold (), no permutation test is done, as the window is unlikely to be significant. When , the statistic is recomputed after permuting case and control labels (default permutations), and a -value is computed as the fraction of the permuted samples whose Xcorr value matches or exceeds . To save time on this computation, we run permutations in a data-driven fashion. We run a maximum of permutations, but stop as soon as we obtain samples for which the RareCover statistic exceeds .(2)Both, the parameter , and the maximum number of iterations can be adjusted, based on desired level of significance, and the size of the genomic region. Here, we set parameter , which corresponds to a permutation adjusted -value of in Figure 1. This ensures fast computation with no loss of power (See Results).
The mean of the empirical -values (obtained by permuting cases and controls) were plotted against each value of the statistic obtained over many tests over the entire range of simulation parameters, by varying sample size , locus PAR, and penetrance. As is the most significant subset among many possible subsets, the theoretical -value suggested by the distribution cannot be used directly. However, the plot shows that the locus value correlates tightly with the -value, implying that the union statistic can be used to filter the significant windows with no loss of power. The saturation at the ends is due to the number of trial being limited to .
RareCover for genic regions.
RareCover can also be applied to a locus containing a single gene. The definition of a gene varies; it sometimes includes only the coding exons, or it can include all exons including UTRs, and even regulatory regions. While the scanning window approach of RareCover can be applied unchanged for any genic locus, we must correct for multiple windows at a locus. Given a genic locus, we permute cases and controls multiple times and score every window in the locus. Then, the adjusted (locus) -value of a window with Xcorr value is the fraction of all permuted windows in the locus with an Xcorr score of or higher.
RareCover is a model-free approach, and has only parameters: the window size , and a convergence cut-off (see procedure above). Empirical tests by simulation show that the performance is similar despite large variations in window size -Kbp, as well as a choice of . Hence, no explicit training was performed, and the parameters were set to Kbp, and . The performance of RareCover was extensively tested over a wide range of simulation parameters.
Parameters for RV simulation
Consider a locus with a set of rare-variants. Let a subset of RVs be causal, in the sense that a mutation at any increases the likelihood of disease. For an individual, , we use and as short-forms of the events , and , respectively. Similarly, events reflect case-control status for the individual. We work with the following parameters for power calculations:
- Disease prevalence in the population, denoted by .
- Penetrance of the locus, denoted by
- Locus-PAR, denoted by
Note that the PAR for a variant is often described by the following (Ex:Bodmer and Bonilla, 1999 )(3)where is the number of individuals with the phenotype, and is the number of individuals that show the phenotype, but do not have the variant allele. In our terminology
The choice of these parameters is intuitive as we expect an RV to have moderate penetrance, but very low PAR . However, the multiple RVs in have roughly additive effect, leading to moderate locus-PARs. These parameters are tightly related to other, more common measures of locus association, such as the Odds-Ratio (OR), as shown below:To compute , we start with a Bayesian relation for computing the likelihood of a genotype containing a causal RV as(4)Then,(5)and,(6)
Simulating constant sized populations (CP)
We simulate multiple case-control studies over a range . A simulation of individuals begins with the division of the individuals into cases and controls. Once this is done two additional steps take place.
- Generate a set of RVs for the simulated locus containing causal, and neutral RVs.
- Simulate the genotypes for each individual.
We start by generating causal RVs. As RVs do not show high LD, we can model the population by generating each RV independently. We adapt Pritchard's argument that the frequency distribution of rare, deleterious, RVs must follow Wright's model under purifying selection . Therefore, the allele frequencies are sampled according to:(7)where,
- , allelic frequency
- , selection coefficient
- , rate of mutation from normal allele to causal
- , rate of repair from causal allele to normal
We choose . Note that we do not control the number of causal RVs, , directly, in our simulation. Recall thatFurther,Therefore, setting a value for R limits the size of the causal RV.(8)Further, the sampling procedure occasionally generates SNPs with a high individual PAR. These variants would show up as being significant even with a single marker analysis. Therefore, these are discarded. The procedure SimulateRV describes the method to generate causal RVs. To generate neutral RVs, we use Fu's model of allele distributions  on a coalescent, which suggests that the number of mutations that affect individuals in a population with mutation rate is given by . For the purposes of our simulation we use .
For both cases and controls, each RV is sampled independently. For non-causal variants , the probability of picking a minor allele is , for both case and control individuals. To sample alleles from causal SNPs, recall that under the union model, for all . Therefore, the minor allele frequencies are given byWe assume HW equilibrium to sample genotypes for case and control individuals.
Simulating populations with bottleneck and recent expansion (BRE)
Recently, Kryukov and colleagues  described a demographic model that explicitly models European ancestry. The population is assumed to be relatively stable for a long period, but is followed by a bottleneck, and rapid expansion after the bottleneck (about 7500–9000 years ago, with 20–25 years per generation). They validate their model by comparing observed versus predicted allelic frequencies. To this model, they add ‘causal’ (mostly deleterious) mutations using a distribution of selection coefficients from a gamma distribution. The causal alleles are associated with a change in a quantitative trait (QT). The QT values are normally distributed. Individuals carrying any causal mutation have QT values drawn from a Normal distribution with a shifted mean. For Rare variant analysis, individuals are chosen from the lower (Control) and upper (Case) tails of the QT distribution.
For our study, the authors provided us with individual genotypes simulated according to their demographic model, with causal mutations contributing to the following shifts: (Low), (Medium), (High). The highest and lowest , and % of the QT distributions were used for the Case and Control populations. For the % population (500 controls, 500 cases), the locus PAR varied as –. For the % populations, the number of individuals is larger (1000 controls, 1000 cases), but the PAR values decrease to (Low), (Medium), and (High).
Reimplementing alternative strategies
For the purposes of comparison, we reimplemented the collapsing statistic proposed by Li and Leal  as well as the weighted-sum statistic used by Madsen and Browning . Both publications discuss the separation of variants into groups based upon function (i.e. non-synonymous coding SNPs) or other property. However, because we are performing our studies on model free, unannotated data, we do not perform any such grouping.
As a result, the CMC approach proposed by Li and Leal  is equivalent to collapsing all variants in the locus and calculating the association. Li and Leal show that the assignment of variants to functional groups, separately collapsing these groups, and finally performing a multivariate analysis improves power to detect causal loci. However, separation of variants into groups is inexact and the authors show that errors in group assignment can confound tests for significance. Additionally, performing this separation on a genome wide scale may be intractable.
The weighted-sum statistic proposed by Madsen and Browning  is used to detect association between a pre-defined group and a disease state. To compare fairly we defined the group of mutations as all mutations at a locus. We reimplemented the weighting approach based upon allele frequency as well as the sum and ranking approach to determine a score. Finally, we implemented a single-marker test as a bi-allelic -statistic with 1df. The tests were used to score windows over a wide range of simulation parameters to better understand how RareCover performed in comparison to the collapsing, and weighted strategies. For each strategy, a -value of significance was established by doing randomized trials using permuted case and control data. All three methods were run on the same sets of permuted data, and the -values were used to compare. Code for all methods is available upon request from the authors.
MSMB gene resequencing
Recently, Yeager and colleagues  resequenced a Kbp region including the micro-seminoprotein- (MSMB) gene (chr10:–) for prostate cancer cases, controls, plus another CEPH individuals. While the number of individuals is too small to derive rare variants, we used the prediced genotypes supplied by the authors for RV analysis. For this analysis, we used individuals together as controls, and all 284 variants with MAF % were used as input to RareCover.
In a recently submitted study LR-PCR amplicons (Harismendy et al., unpublished) were used to re-sequence Kbp from the FAAH locus (NCBI36 chr1:46621328–46653043) and Kbp from the MGLL locus (NCBI36 chr3:128880456–129037011). A total of individuals were selected for sequencing from two tails of the BMI distribution of the CRESCENDO cohort (http://clinicaltrials.gov/ct/show/NCT00263042). individuals had BMI lower than kg/ and individuals a BMI greater than kg/. DNA sequencing libraries were prepared, and sequenced as previously described in Harismendy, 2009  with the following modifications: sequencing libraries were indexed by nt barcode located downstream of the adapter  and between one and six libraries were loaded per lane of the Illumina GAII instrument. The reads obtained from several lanes were merged, aligned and the variant called using MAQ mapmerge, map and cnsview+SNPfilter options respectively . All samples had an average coverage greater than . Allowing for a minimum coverage of reads and a minimum base quality (Phred ), a raw set of single nucleotides variants (SNVs) were identified in the population. The SNVs were filtered for Hardy Weinberg Equilibrium in the controls () and genotyping rate % of the samples to obtain a final set of SNVs (220 FAAH, 1173 MGLL). Of these, SNVs had MAF , and were selected for RV analysis. The list and location of the RVs identified by RareCover as supporting the association is available in Supplemental Table S1.
We simulated cases and controls for a collection of sample sizes, ranging from to over individuals with equal numbers of cases and controls. The MAF for rare variants ranged from to . Throughout, we assume the disease prevalence in the population to be . The PAR for the locus was set to . The penetrance, was varied in the interval , corresponding to OR values of –. The dependence on parameters is somewhat non-trivial. To see this, note that is a lower bound on relative risk. Reducing would increase the relative risk, only making association easier. In other words if the disease incidence is low, and a causal variant is low frequency, then the presence of the causal variant is a strong indicator of disease status.
The results of the simulation are shown in Figure 2. For each choice of parameters (, and ), case-control studies were sampled as described in Methods. The data-set was tested using RareCover, collapsing, weighted-sum heuristics, as well as single-marker tests.
For each choice of parameters, test cases were simulated. Each test-case was analyzed using methods, and the -value computed using permutations of cases and controls. The score is considered significant only if it is higher than all permuted values. The power of the test is the fraction of test-cases that had a significant score. RareCover dominates the other methods implying greater power over all choice of parameters. For all methods, power increases with an increase in , or sample size.
To enable a fair comparison, the methods were applied to randomizations of the same data-set, obtained by permuting cases and controls. The -value is similar to a False Discovery Rate calculation. The span of a typical human gene is about Kbp, and will contain about rare-variants, implying fewer than distinct windows per gene. If we assume candidate genes for a phenotype, we would have candidate windows. A -value, or FDR of could therefore be considered significant at the genome-wide level. A test score was considered significant if it was higher than each of the permutations, giving the 95% confidence interval of the p-value as . The power of a test for a specific choice of parameters is the fraction of () tests that had a significant score. Consider the sample point in Figure 2, with , and a sample of individuals. The power of RareCover is over , which can be contrasted with the low power of the weighted-sum , and collapsing heuristics. For any choice of parameters, RareCover shows better performance than the other methods.
Our phenotypic model differs somewhat from the one proposed by Madsen and Browning. In their model, the PAR for each causal variant is assumed to be equal, and is equal to the groupwise PAR divided by the number of causal variants. We also applied the tests to this model, using cases, and controls, and groupwise PAR values at . The power of the MB test at these values was computed to be respectively, while the power of RareCover on the data sets is (Supplemental Figure S1).
An advantage of the RareCover approach is that it does not depend upon MAF, or the density of RVs in a region. This is partly because it combines the effects of multiple associating RVs that associate, and discards the RVs that do not associate. By contrast, other methods combine all RVs, albeit with different weights. While RareCover does not recover all of the causal RVs, it always recovered a significant subset of the causal RVs in our simulations. See Figure 3, which summarizes the results for . Let correspond to the simulated, causal RVs, while corresponds to the set returned by RareCover. Thus, corresponds to the fraction of causal RVs recovered. With modest sample size, more than of the RVs are recovered, and help provide a direct interpretation of the genetic association. A somewhat unexpected aspect is that the number of causal RVs, , (and also, ) increases with an increasing sample size. For larger samples, we can recover a larger number of the low frequency variants, and the causal set has a larger mix of low frequency RVs. As we only consider RVs with MAF , the number saturates by K individuals.
Simulated BRE populations
The methods were also applied to the data sets provided by Kryukov et al., as explained in Methods. The cases and controls are chosen from the extremes of a population of phenotyped individuals to reflect current population cohorts. As the locus PARs are very small (–), we work with a nominal -value cut-off of . As before, power is defined as the fraction of 1000 simulations on which the test met the -value cut-off. In addition to the methods, we also plot the power of the true causal mutations to illustrate their small effect.
Figure 4 shows the results upon choosing the %, and % extremes for different levels of phenotypic association. RareCover outperforms other methods over the different tests, and is comparable to the results of selecting the true causal mutations. As suggested previously, increasing PAR values, and population sizes, increase the power of RareCover, as with all methods. However, the power of RareCover does not appear to be affected by the specifics of the demographic simulation.
Simulated population data with quantitative trait (QT) values was provided by Kryukov et al. The QT values are normally distributed. Individuals carrying any causal mutation have QT values drawn from a Normal distribution with a shifted mean. The shift is characterized as Low (), Medium (), and High (). As the locus PAR values are low, power is computed as the fraction of simulations that showed significance at -value . Individuals were chosen from the lower (Control) and upper (Case) tails of the QT distribution. The power of all methods is compared using the % extremes ( cases, controls), and the % ( cases, and controls). RareCover is shown to have the highest power, comparable to the power of the causal mutations.
The allele frequency spectrum of the CP and BRE models is shown in Figure 5. There are significant differences in allele frequency spectra in the two cases. In the CP case, there is a bias in the cases among alleles with lower frequency. High frequency causal variants represent an easier case, as they can be detected by single marker analysis. To eliminate these cases, we discarded high frequency causal variants from the simulations, which partly explains the bias in CP, relative to BRE. In the CP (respectively, BRE) models, the average number of variants per 5Kbp window was (respectively, ), with (respectively, ) causal variants. The performance of RareCover is robust against different demographic models, and depends mainly upon locus PAR, and sample size.
BRE refers to the simulation of population under bottleneck followed by recent expansion from Kryukov et al.; CP refers to the simulation under a constant population size. The allele frequencies in CP are biased toward rare variants in cases, while there is little bias in BRE. The performance of RareCover is robust to data sets with different allele frequency spectra.
The running time of RareCover increases linearly with the number of SNPs, and the number of individuals, as shown in Figure 6. For a population of individuals, the running time time goes from 80ms to 311ms on a standard Linux desktop, as the number of SNPs in the window increases from to . The times shown here do not include the cost of reading and writing the data, which incurs a fixed additional cost (about ms. See Supplemental Figure S2). The total running time is at most that of a single marker test.
As RareCover is a greedy approach, the running time increases linearly with an increase in number of SNPs, and individuals. The running time shown here does not include the time for disk input and output of the data, which incurs a fixed additional cost of ms to each run. The total running time is about twice that of single marker tests.
On the FAAH data ( individuals), the running time for a window of Kbp was computed to be seconds. Consider a genome-wide scan with windows. To achieve genome-wide significance, we would need randomizations for each window, which could be computationally intensive.
However, we run RareCover in two passes, using the Xcorr statistic on the union-variant as a filter (Figure 1). The permutation test is only applied to the fraction of the windows for which the Xcorr statistic exceeds a threshold ().
Therefore the RareCover computation is executed on windows. As discussed in the methods, . For (corresponding to in Figure 1), the total time isIf the number of candidate windows is larger (), and a conservative filter is chosen (corresponding to ), the running time increases to hrs., easily accomplished on a small cluster.
Results on resequencing data
A RareCover analysis of the 284 variants did not identify anything significant. A Kbp window starting at chr10:51253758 has a nominal -value of 0.06. The SNPs selected by RareCover cover 12 cases and control individuals. If we apply RareCover after including common variants, the same region has a nominal -value of due to a common variant that occurs in cases, and controls. This window lies not in MSMB but in a neighboring gene, NCOA4, also a candidate gene for prostate cancer risk . A larger population sequencing will help resolve if this is a true association.
CRESCENDO cohort data.
As described earlier, the CRESCENDO cohort subjects selected for sequencing were individuals at the extremes of BMI distribution. We applied RareCover to overlapping windows of length Kbp over the region (as described in Methods), to analyze the impact of RVs (For the purposes of comparison the performance of all methods can be seen in Supplemental Figure S4). The permutation based -values for two genes are plotted in Figure 7. For both loci, we found a single region of approximately bp, that was enriched in strongly associating variants.
RareCover was used to analyze overlapping windows of Kbp in the re-sequenced region around FAAH. A -value was computed for each window using permutations of cases and controls. Each point corresponds to the -value of a single window starting at that location. The most significant window (described by the box) is Kbp upstream of the FAAH transcription start site. The region is part of an LTR element, which are known to carry regulatory signals, and is enriched in transcription factor binding sites, suggesting a regulatory role for the rare variants.
The FAAH enzyme (1p33) is known to hydrolyze anandamide (AEA), and other fatty acid amides. The region with the most significant association, located upstream of the FAAH transcription start site (TSS), contains RVs. RareCover selected a subset of RVs, with a union-variant that appears in cases, and controls (nominal permutation -value ). The locus specific -value for the window is . Analyzing the locus for functional significance, the locus falls within a retroviral Long-Terminal-Repeat (LTR). Insertion of retroviral elements, followed by adaptation of the viral regulatory elements is a well known mechanism for gene regulation. A recent analysis of the FAAH core promoter (bp upstream) in human T-cells identified a C/EBP site which (through a STAT3 tethering) mediated the leptin regulation of FAAH expression . Surprisingly, the leptin mediated regulation of FAAH was observed in immune cells, but not a model of neuronal cells . Our results suggest that an alternative regulatory region Kbp upstream of the TSS is disrupted by RVs in obese individuals. A scan for transcription factor binding sites reveals many relevant transcription factor binding sites, including one for C/EBP (data not shown).
The enzyme monoacylglycerol lipase (MGLL), encoded by the MGLL gene located on chromosome 3q21.3, is a presynaptic enzyme that hydrolyzes 2-arachidonoylglycerol (2-AG), the most abundant endocannabinoid found in the brain. The RareCover scan on RVs identified a single window enriched with associated RVs. The window lies immediately upstream of the gene, suggesting that the causal RVs have a regulatory function. At the most significant locus (chr3:–, upstream of MGLL TSS), of RVs were selected, with the union RV present in cases, and controls. While the nominal -value is , the locus adjusted -value is at the margin of significance, at . The locus contains a known LINE element and a promoter for RNA polymerase II. Mutations in this promoter could easily interfere with binding affinity for RNA Polymerase II and affect subsequent transcription/translation.
In our analysis, we only considered RVs (MAF ). Harismendy et al. have reported on the connection between common variant, and RV associations in a recently submitted study. Their results suggest that common variants do not identify significant associations in FAAH, but identify regions with significantly associated SNPs at the MGLL locus. LD between the significant common variants and the MGLL union-variant is low, with the highest value of . This suggests that the rare and common variations might have independent, additive effects on the phenotype.
We described a novel method for Rare variant analysis with greatly improved power of detecting associations, relative to other published methods. RareCover utilizes the specific properties of RVs as compared to common variants, and applies a greedy approach to picking a subset of RVs, that best associate with the phenotype. It is a natural extension of previous methods, which either collapsed all RVs at a locus, or collapsed them after weighting different SNPs differently. Our algorithm is similar in orientation to the greedy solutions for the combinatorial problems of identifying set-cover and test-cover (See for example, Lovasz ). However, it is specifically designed for case-control analysis. The power of the method is extensively analyzed against different values of locus PAR, penetrance, and sample size. RareCover easily outperforms other methods which group, and collapse SNPs. The weighting approaches are reasonable, given that most causal RVs have functional significance, and likely to have moderately high penetrance, which one would not expect in a non-causal RVs. However, a large number of non-causal RVs, even with small weights, can dilute the association of the causal RVs. Also, it is difficult to identify different groupings of RVs, and to set appropriate weights for different groups.
Our application of the method on the CRESCENDO individuals, generates plausible hypotheses on the role of FAAH and MGLL in of obesity. The genetic association of FAAH with obesity is interesting because many previous studies with common variants have failed in identifying significant associations. We investigated the hypothesis that alleleic heterogeneity due to multiple RVs, influences the obesity phenotype. Second, the low LD between RVs and causal variants implies that if an RV is significantly associated, it is likely to have functional significance. Our simulations confirmed that RVs identified by RareCover were enriched in the causal RVs. In analyzing FAAH and MGLL, we identified exactly one small, functionally significant region, at each locus with significant association. This suggests that multiple rare variations help influence the regulation of the two genes. Recently, Sipe and colleagues collected metabolite expression levels on metabolites from severely obese subjects and 48 normal weight subjects . Comparing against our FAAH data, we find that the levels of AEA (anandamide) are highest in obese individuals that carry an RV identified by RareCover, and lowest in individuals that are non-obese, and do not carry the causal RV. As FAAH helps metabolize AEA (anandamide), this result is consistent with the hypothesis of the RVs disrupting FAAH expression. The data on all metabolite expression will be published elsewhere (Harismendy et al., unpublished).
Nevertheless, our study also raises many methodological questions. Our approach is greedy, in that it selects the most discriminating RV at each step. Theoretically, it is possible that a collection of RVs, that are individually less discriminating, are jointly more strongly correlated. In that case, RareCover will not identify them. We implemented an approach based on simulated annealing to find an optimal subset of SNPs. However, in our simulations with the union model, the greedy method worked as well as the more complex optimization, and was significantly faster. Recall that in the simple Union model, the penetrance does not change upon inclusion of additional SNPs, but the PAR increases. Other, more complex models are possible. For example, we could have a threshold model, in which the penetrance increases with a minimum number of rare alleles. Or, we could have additive models, where the penetrance increases as a function of the number of rare alleles. As more re-sequencing data becomes available, these will be the focus of additional investigation. A second issue is that our definition of a locus is set arbitrarily as a window of fixed length, much like in other methods. However, empirical tests with a small range of window-sizes did not significantly change the results. It is possible that a dynamic assignment of the size of the locus could increase power, but at the cost of additional computations.
In this study, we analyze only the rare variants. While the RareCover algorithm can work unchanged with rare and common variants, a correct test for power of such an approach would require a biological model that combines the effect of RV and common variants. It is hard to speculate on such models in the absence of empirical data. However, preliminary results on comparing common and rare variants at the MGLL locus suggest an independent, additive effect.
GWA studies have shown that identifying the genetic basis of disease depends upon many factors. For this reason, algorithms have been devised to deal with population substructure issues, epistatic interactions between loci, as well as rare variant analysis. Our results indicate that RV analysis is useful in many contexts, and novel methods may have to be developed to include the effect of RVs in all of the above.
Madsen and Browning models. RareCover performance on the phenotypic models proposed by Madsen and Browning. In this model, the PAR for each causal variant is assumed to be equal, and is equal to the groupwise PAR divided by the number of causal variants. The power of RareCover and other methods is applied on populations with 1000 cases, and 1000 controls, and groupwise PAR values at 0.02, 0.1, and 0.25.
(0.46 MB TIF)
RareCover running time including I/O. Running time of RareCover as a function of number of individuals, and number of SNPs, including time for input and output of data. The time for input and output dominates when the number of individuals is less than 2000. Otherwise, the time increases linearly with an increase in number of SNPs, and number of individuals.
(1.51 MB TIF)
RareCover on MGLL. Performance of RareCover on MGLL. The most significant window (described by the box) appears upstream of the MGLL gene, near the promoter region.
(0.55 MB TIF)
Method comparison. Performance of RareCover the weighted-sum statistic, and collapsing on the FAAH and MGLL. Some peaks are replicated in only a subset of methods. RareCover is the only method that identifies a significant hit in a region in MGLL containing common variants associated with the disease phenotype. Common variants were excluded from this analysis.
(1.62 MB TIF)
Detailed SNP information for the windows highlighted in Figure 3 and Figure S3. The columns indicate the SNP id, position, and relative risk of each SNP within the selected 5000 bp windows. Case Matches refers to the number of case samples that carry the SNP, and similarly for Control Matches. The worksheets containing raw data give the genotype at each SNP (0,1, or 2) within each 5000 bp window as well as disease status. Individual ids have been removed.
(0.15 MB XLS)
We would like to thank Dr. Gregory Kryukov and Dr. Shamil Sunyaev for kindly providing simulated population genotypes based on demographic models of European populations, and Dr. Quan Chen and Dr. Meredith Yeager for providing the MSMB resequencing data.
Conceived and designed the experiments: G. Bhatia, V. Bafna. Performed the experiments: G. Bhatia, V. Bafna. Analyzed the data: G. Bhatia, O. Harismendy, N.J. Schork, E. J. Topol, K. Frazer, V. Bafna. Wrote the paper: G. Bhatia, O. Harismendy, N.J. Schork, J. Topol, K. Frazer, V. Bafna. Helped with algorithm development and statistical analysis: V. Bansal.
- 1. Lander ES (1996) The new genomics: global views of biology. Science 274: 536–539.ES Lander1996The new genomics: global views of biology.Science274536539
- 2. Pritchard JK, Cox NJ (2002) The allelic architecture of human disease genes: common disease-common variant…or not? Hum Mol Genet 11: 2417–2423.JK PritchardNJ Cox2002The allelic architecture of human disease genes: common disease-common variant…or not?Hum Mol Genet1124172423
- 3. Reich DE, Lander ES (2001) On the allelic spectrum of human disease. Trends Genet 17: 502–510.DE ReichES Lander2001On the allelic spectrum of human disease.Trends Genet17502510
- 4. Consortium TWTCC (2007) Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature 447: 661–678.TWTCC Consortium2007Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls.Nature447661678
- 5. Frayling TM, Timpson NJ, Weedon MN, Zeggini E, Freathy RM, et al. (2007) A common variant in the FTO gene is associated with body mass index and predisposes to childhood and adult obesity. Science 316: 889–894.TM FraylingNJ TimpsonMN WeedonE. ZegginiRM Freathy2007A common variant in the FTO gene is associated with body mass index and predisposes to childhood and adult obesity.Science316889894
- 6. Helgadottir A, Thorleifsson G, Manolescu A, Gretarsdottir S, Blondal T, et al. (2007) A common variant on chromosome 9p21 affects the risk of myocardial infarction. Science 316: 1491–1493.A. HelgadottirG. ThorleifssonA. ManolescuS. GretarsdottirT. Blondal2007A common variant on chromosome 9p21 affects the risk of myocardial infarction.Science31614911493
- 7. McPherson R, Pertsemlidis A, Kavaslar N, Stewart A, Roberts R, et al. (2007) A common allele on chromosome 9 associated with coronary heart disease. Science 316: 1488–1491.R. McPhersonA. PertsemlidisN. KavaslarA. StewartR. Roberts2007A common allele on chromosome 9 associated with coronary heart disease.Science31614881491
- 8. Schork NJ, Murray SS, Frazer KA, Topol EJ (2009) Common vs. rare allele hypotheses for complex diseases. Curr Opin Genet Dev 19: 212–219.NJ SchorkSS MurrayKA FrazerEJ Topol2009Common vs. rare allele hypotheses for complex diseases.Curr Opin Genet Dev19212219
- 9. Cohen JC, Pertsemlidis A, Fahmi S, Esmail S, Vega GL, et al. (2006) Multiple rare variants in NPC1L1 associated with reduced sterol absorption and plasma low-density lipoprotein levels. Proc Natl Acad Sci USA 103: 1810–1815.JC CohenA. PertsemlidisS. FahmiS. EsmailGL Vega2006Multiple rare variants in NPC1L1 associated with reduced sterol absorption and plasma low-density lipoprotein levels.Proc Natl Acad Sci USA10318101815
- 10. Cohen JC, Kiss RS, Pertsemlidis A, Marcel YL, McPherson R, et al. (2004) Multiple rare alleles contribute to low plasma levels of HDL cholesterol. Science 305: 869–872.JC CohenRS KissA. PertsemlidisYL MarcelR. McPherson2004Multiple rare alleles contribute to low plasma levels of HDL cholesterol.Science305869872
- 11. Fearnhead NS, Wilding JL, Winney B, Tonks S, Bartlett S, et al. (2004) Multiple rare variants in different genes account for multifactorial inherited susceptibility to colorectal adenomas. Proc Natl Acad Sci USA 101: 15992–15997.NS FearnheadJL WildingB. WinneyS. TonksS. Bartlett2004Multiple rare variants in different genes account for multifactorial inherited susceptibility to colorectal adenomas.Proc Natl Acad Sci USA1011599215997
- 12. Ji W, Foo JN, O'Roak BJ, Zhao H, Larson MG, et al. (2008) Rare independent mutations in renal salt handling genes contribute to blood pressure variation. Nat Genet 40: 592–599.W. JiJN FooBJ O'RoakH. ZhaoMG Larson2008Rare independent mutations in renal salt handling genes contribute to blood pressure variation.Nat Genet40592599
- 13. Nejentsev S, Walker N, Riches D, Egholm M, Todd JA (2009) Rare variants of IFIH1, a gene implicated in antiviral responses, protect against type 1 diabetes. Science 324: 387–389.S. NejentsevN. WalkerD. RichesM. EgholmJA Todd2009Rare variants of IFIH1, a gene implicated in antiviral responses, protect against type 1 diabetes.Science324387389
- 14. Bodmer W, Bonilla C (2008) Common and rare variants in multifactorial susceptibility to common diseases. Nat Genet 40: 695–701.W. BodmerC. Bonilla2008Common and rare variants in multifactorial susceptibility to common diseases.Nat Genet40695701
- 15. Li B, Leal SM (2008) Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am J Hum Genet 83: 311–321.B. LiSM Leal2008Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data.Am J Hum Genet83311321
- 16. Madsen BE, Browning SR (2009) A groupwise association test for rare mutations using a weighted sum statistic. PLoS Genet 5: e1000384.BE MadsenSR Browning2009A groupwise association test for rare mutations using a weighted sum statistic.PLoS Genet5e1000384
- 17. Manolio TA, Collins FS, Cox NJ, Goldstein DB, Hindorff LA, et al. (2009) Finding the missing heritability of complex diseases. Nature 461: 747–753.TA ManolioFS CollinsNJ CoxDB GoldsteinLA Hindorff2009Finding the missing heritability of complex diseases.Nature461747753
- 18. Di Marzo V, Bifulco M, De Petrocellis L (2004) The endocannabinoid system and its therapeutic exploitation. Nat Rev Drug Discov 3: 771–784.V. Di MarzoM. BifulcoL. De Petrocellis2004The endocannabinoid system and its therapeutic exploitation.Nat Rev Drug Discov3771784
- 19. Di Marzo V (2009) The endocannabinoid system: its general strategy of action, tools for its pharmacological manipulation and potential therapeutic exploitation. Pharmacol Res 60: 77–84.V. Di Marzo2009The endocannabinoid system: its general strategy of action, tools for its pharmacological manipulation and potential therapeutic exploitation.Pharmacol Res607784
- 20. Di Marzo V, Goparaju SK, Wang L, Liu J, Bátkai S, et al. (2001) Leptin-regulated endocannabinoids are involved in maintaining food intake. Nature 410: 822–825.V. Di MarzoSK GoparajuL. WangJ. LiuS. Bátkai2001Leptin-regulated endocannabinoids are involved in maintaining food intake.Nature410822825
- 21. Cravatt BF, Giang DK, Mayfield SP, Boger DL, Lerner RA, et al. (1996) Molecular characterization of an enzyme that degrades neuromodulatory fatty-acid amides. Nature 384: 83–87.BF CravattDK GiangSP MayfieldDL BogerRA Lerner1996Molecular characterization of an enzyme that degrades neuromodulatory fatty-acid amides.Nature3848387
- 22. Engeli S, Böhnke J, Feldpausch M, Gorzelniak K, Janke J, et al. (2005) Activation of the peripheral endocannabinoid system in human obesity. Diabetes 54: 2838–2843.S. EngeliJ. BöhnkeM. FeldpauschK. GorzelniakJ. Janke2005Activation of the peripheral endocannabinoid system in human obesity.Diabetes5428382843
- 23. Jensen DP, Andreasen CH, Andersen MK, Hansen L, Eiberg H, et al. (2007) The functional Pro129Thr variant of the FAAH gene is not associated with various fat accumulation phenotypes in a population-based cohort of 5,801 whites. J Mol Med 85: 445–449.DP JensenCH AndreasenMK AndersenL. HansenH. Eiberg2007The functional Pro129Thr variant of the FAAH gene is not associated with various fat accumulation phenotypes in a population-based cohort of 5,801 whites.J Mol Med85445449
- 24. Emmanuelle Durand E, Lecoeur C, Delplanque J, Benzinou M, Degraeve F, et al. (2008) Evaluating the Association of FAAH Common Gene Variation with Childhood, Adult Severe Obesity and Type 2 Diabetes in the French Population. Obesity Facts 1: 305–309.E. Emmanuelle DurandC. LecoeurJ. DelplanqueM. BenzinouF. Degraeve2008Evaluating the Association of FAAH Common Gene Variation with Childhood, Adult Severe Obesity and Type 2 Diabetes in the French Population.Obesity Facts1305309
- 25. Müller TD, Reichwald K, Brönner G, Kirschner J, Nguyen TT, et al. (2008) Lack of association of genetic variants in genes of the endocannabinoid system with anorexia nervosa. Child Adolesc Psychiatry Ment Health 2: 33.TD MüllerK. ReichwaldG. BrönnerJ. KirschnerTT Nguyen2008Lack of association of genetic variants in genes of the endocannabinoid system with anorexia nervosa.Child Adolesc Psychiatry Ment Health233
- 26. Lieb W, Manning AK, Florez JC, Dupuis J, Cupples LA, et al. (2009) Variants in the CNR1 and the FAAH genes and adiposity traits in the community. Obesity (Silver Spring) 17: 755–760.W. LiebAK ManningJC FlorezJ. DupuisLA Cupples2009Variants in the CNR1 and the FAAH genes and adiposity traits in the community.Obesity (Silver Spring)17755760
- 27. Sipe JC, Waalen J, Gerber A, Beutler E (2005) Overweight and obesity associated with a missense polymorphism in fatty acid amide hydrolase (FAAH). Int J Obes (Lond) 29: 755–759.JC SipeJ. WaalenA. GerberE. Beutler2005Overweight and obesity associated with a missense polymorphism in fatty acid amide hydrolase (FAAH).Int J Obes (Lond)29755759
- 28. Garey MR, Johnson DS (1979) Computers and Intractability: A Guide to the Theory of NP-completeness. W.H. Freeman and Company. MR GareyDS Johnson1979Computers and Intractability: A Guide to the Theory of NP-completenessW.H. Freeman and Company
- 29. Pritchard JK (2001) Are rare variants responsible for susceptibility to complex diseases? Am J Hum Genet 69: 124–137.JK Pritchard2001Are rare variants responsible for susceptibility to complex diseases?Am J Hum Genet69124137
- 30. Fu YX (1995) Statistical properties of segregating sites. Theor Popul Biol 48: 172–197.YX Fu1995Statistical properties of segregating sites.Theor Popul Biol48172197
- 31. Kryukov GV, Shpunt A, Stamatoyannopoulos JA, Sunyaev SR (2009) Power of deep, all-exon resequencing for discovery of human trait genes. Proc Natl Acad Sci USA 106: 3871–3876.GV KryukovA. ShpuntJA StamatoyannopoulosSR Sunyaev2009Power of deep, all-exon resequencing for discovery of human trait genes.Proc Natl Acad Sci USA10638713876
- 32. Yeager M, Deng Z, Boland J, Matthews C, Bacior J, et al. (2009) Comprehensive resequence analysis of a 97 kb region of chromosome 10q11.2 containing the MSMB gene associated with prostate cancer. Hum Genet. M. YeagerZ. DengJ. BolandC. MatthewsJ. Bacior2009Comprehensive resequence analysis of a 97 kb region of chromosome 10q11.2 containing the MSMB gene associated with prostate cancer.Hum Genet
- 33. Harismendy O, Ng PC, Strausberg RL, Wang X, Stockwell TB, et al. (2009) Evaluation of next generation sequencing platforms for population targeted sequencing studies. Genome Biol 10: R32.O. HarismendyPC NgRL StrausbergX. WangTB Stockwell2009Evaluation of next generation sequencing platforms for population targeted sequencing studies.Genome Biol10R32
- 34. Craig DW, Pearson JV, Szelinger S, Sekar A, Redman M, et al. (2008) Identification of genetic variants using bar-coded multiplexed sequencing. Nat Methods 5: 887–893.DW CraigJV PearsonS. SzelingerA. SekarM. Redman2008Identification of genetic variants using bar-coded multiplexed sequencing.Nat Methods5887893
- 35. Li H, Ruan J, Durbin R (2008) Mapping short DNA sequencing reads and calling variants using mapping quality scores. Genome Res 18: 1851–1858.H. LiJ. RuanR. Durbin2008Mapping short DNA sequencing reads and calling variants using mapping quality scores.Genome Res1818511858
- 36. Maccarrone M, Di Rienzo M, Finazzi-Agrò A, Rossi A (2003) Leptin activates the anandamide hydrolase promoter in human T lymphocytes through STAT3. J Biol Chem 278: 13318–13324.M. MaccarroneM. Di RienzoA. Finazzi-AgròA. Rossi2003Leptin activates the anandamide hydrolase promoter in human T lymphocytes through STAT3.J Biol Chem2781331813324
- 37. Maccarrone M, Gasperi V, Fezza F, Finazzi-Agrò A, Rossi A (2004) Differential regulation of fatty acid amide hydrolase promoter in human immune cells and neuronal cells by leptin and progesterone. Eur J Biochem 271: 4666–4676.M. MaccarroneV. GasperiF. FezzaA. Finazzi-AgròA. Rossi2004Differential regulation of fatty acid amide hydrolase promoter in human immune cells and neuronal cells by leptin and progesterone.Eur J Biochem27146664676
- 38. Lovasz L (1975) On the ratio of optimal integral and fractional covers. Discrete Mathematics 13: 383–390.L. Lovasz1975On the ratio of optimal integral and fractional covers.Discrete Mathematics13383390
- 39. Sipe JC, Scott TM, Murray S, Harismendy O, Simon GM, et al. (2010) Biomarkers of endocannabinoid system activation in severe obesity. PLoS ONE 5: e8792.JC SipeTM ScottS. MurrayO. HarismendyGM Simon2010Biomarkers of endocannabinoid system activation in severe obesity.PLoS ONE5e8792