2 Jun 2008: Lapidot M, Mizrahi-Man O, Pilpel Y (2008) Correction: Functional Characterization of Variations on Regulatory Motifs. PLOS Genetics 4(6): 10.1371/annotation/99662172-8f18-4bfb-ad0f-79ed1d69fffd. https://doi.org/10.1371/annotation/99662172-8f18-4bfb-ad0f-79ed1d69fffd View correction
Transcription factors (TFs) regulate gene expression through specific interactions with short promoter elements. The same regulatory protein may recognize a variety of related sequences. Moreover, once they are detected it is hard to predict whether highly similar sequence motifs will be recognized by the same TF and regulate similar gene expression patterns, or serve as binding sites for distinct regulatory factors. We developed computational measures to assess the functional implications of variations on regulatory motifs and to compare the functions of related sites. We have developed computational means for estimating the functional outcome of substituting a single position within a binding site and applied them to a collection of putative regulatory motifs. We predict the effects of nucleotide variations within motifs on gene expression patterns. In cases where such predictions could be compared to suitable published experimental evidence, we found very good agreement. We further accumulated statistics from multiple substitutions across various binding sites in an attempt to deduce general properties that characterize nucleotide substitutions that are more likely to alter expression. We found that substitutions involving Adenine are more likely to retain the expression pattern and that substitutions involving Guanine are more likely to alter expression compared to the rest of the substitutions. Our results should facilitate the prediction of the expression outcomes of binding site variations. One typical important implication is expected to be the ability to predict the phenotypic effect of variation in regulatory motifs in promoters.
A prime mode of control of transcription is the binding of transcription factors to promoter elements. These elements are often imprecise – often more than one, yet typically not all, of the nucleotides may be tolerated. In another field of protein structures, only some of the amino acid substitutions are tolerated. Are there parallels to this situation in transcription motifs? For instance, could substitutions between Adenine and Guanine have relatively little effect on transcription? An experimental approach here is daunting, requiring a library of reporter genes, each under the regulation of a different motif version. Yet genomes contain genes with natural variations on motifs, while micro-array data provide the expression pattern of those genes. We inspected the S. cerevisiae genome to derive nucleotide substitution severity “rules”. We compared the expression of genes containing motifs to the expression of genes that contain motif variations, and assessed how drastically each substitution affected expression. The power of the approach comes from the statistics – we gathered data for thousands of genes and motifs in dozens of growth conditions. We found that not all nucleotide substitutions are equal: e.g. substituting Adenines is more likely to be benign, compared to Guanines. It is possible that the different chemical nature of nucleotides could explain these findings. One future implication of this type of work is that it may aid in predicting which human mutations in promoter elements are more likely to cause a disease by affecting transcription.
Citation: Michal L, Mizrahi-Man O, Pilpel Y (2008) Functional Characterization of Variations on Regulatory Motifs. PLoS Genet 4(3): e1000018. https://doi.org/10.1371/journal.pgen.1000018
Editor: Greg Gibson, North Carolina State University, United States of America
Received: June 25, 2007; Accepted: February 5, 2008; Published: March 7, 2008
Copyright: © 2008 Lapidot et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: YP is an incumbent of the Rothstein Career Development Chair in Genetic Diseases. ML was a Fellow of the Horowitz Foundation for Complexity Sciences. We thank EMBRACE, an EU-funded network of excellence, and the Israel Science Foundation for grant support.
Competing interests: The authors have declared that no competing interests exist.
The regulation of gene expression is mediated mainly through specific interactions of TF proteins with DNA promoter elements. TF binding sites (TFBS) are short (typically of length 6–20 bases) and imprecise; unlike restriction enzymes which recognize unique nucleotide sequences, a single TF protein may interact with a range of related sequences. For most TFs, there appears to be no distinct sequence of nucleotide bases that is shared by all recognized binding sites. However, there are typically clear biases in the distribution of bases that occur at each binding site position. These biases are commonly represented by position weight matrices (PWMs), whose components give the probabilities of finding each nucleotide at each binding site position .
Given the degenerate nature of genuine binding sites, highly similar sites within the same genome may be recognized by the same TF or by distinct TFs. This is also true for the genomes of related species, where slight changes in binding site sequence, occurring throughout evolution, may in some cases maintain the specificity of the site and in others lead to its loss or to the creation of a site targeted by a different TF ,. The desire to distinguish between ‘neutral’ binding site variations, which do not change the recognition range of the site, and ‘functional’ variations, which may affect gene expression by altering protein-DNA interactions, lays at the heart of this work. Such a distinction may have several implications. Firstly, it should greatly improve the performance of scanning algorithms, which search promoter sequences for matches to predefined PWMs. These algorithms typically regard all mismatches between a promoter sequence and a given PWM's preferences as equal (c.f. ScanACE , Match™ , MAST ). More reliable predictions may be obtained if such mismatches are differentially weighed based on their expected effects on expression. Identification of genuine sites is also crucial when comparing the promoters of orthologous genes - some across-species variations may change the functionality of a motif in some of the organisms. Another intriguing application is the detection of regulatory site variations, which have the potential to reduce fitness, and cause diseases, through altering gene expression. Disease-causing binding site variations are known to occur ,, however so far no attempts have been made for their prediction on a genome wide scale. Most efforts to distinguish disease-causing variations from neutral ones have focused on coding single nucleotide polymorphisms (SNPs) –. Estimates show that the human population contains thousands of cis-regulatory variations . Such high numbers justify a dedicated effort for the development of computational means for predicting deleterious regulatory variations.
The present work lays the foundations for the development of such methods, experimented here in yeast, introducing measures for quantifying the effects of binding site variations on gene expression. We have first constructed a putative binding site motif collection using our previously introduced expression coherence (EC) score, which quantifies a motif's regulatory effect by measuring the extent to which genes that contain it display similar expression at a given biological condition –. We next exploit this quantitative measures of a motif's regulatory effect, in order to systematically compare the expression patterns of genes containing binding sites differing by a single nucleotide position.
We accumulate statistics for many substitutions across multiple putative binding sites, and observe that not all nucleotide substitutions are similar in severity: We found that substitutions of the type A->N, and substitutions of the type N->A (where N is any nucleotide but A) tend to be “benign”, i.e. they relatively rarely change the expression patterns of the regulated genes. On the other hand, substitutions of the type G->N, and N->G are more likely than other substitutions to lead to binding site loss.
Predicting the outcome of a binding site substitution – the case of Ndt80
A single base mutation in the binding site of a TF can result in one of three scenarios: (i) Binding site conservation - the mutant is also recognized by the same TF and the substitution from wild-type to mutant is thus expected to have a very mild effect (Figure 1, green arrows). (ii) Binding site switching - the mutant is no longer recognized by the original TF, but is recognized by an alternative TF (Figure 1, blue arrows). (iii) Binding site loss: the mutant binding site is no longer recognized by any TF (Figure 1, red arrows). The primary goal of this work was to computationally distinguish these three scenarios.
Left panel: points represent promoter elements, discs represent TF recognition ranges. Points included within a disc represent promoter elements that are bound by the corresponding TF. Arrows illustrate the result of single nucleotide substitutions within a promoter element. Three scenarios are illustrated: binding site loss (red arrows), reduced affinity to the same TF (green arrows), or binding site switching – creation of a binding site with as higher affinity to a different TF (blue arrows). Right panel: Our motif landscape analysis tool  is used to detect these three scenarios. This display captures the effects of motif single nucleotide substitutions on the expression profiles of the downstream genes. The analyzed motif is the yeast Ndt80 sporulation factor (consensus marked in red). The dendrogram on the left part of the display shows the similarity in mean expression profiles between gene sets bearing variations of the motif in their promoters. The right side of the display shows the similarity within sets of genes that contain the same motif variation in their promoters, as measured by the EC score. Gene set sizes appear in parentheses, and p-values corresponding to the EC scores follow. The middle section displays the sequence of the motif variation examined in the corresponding row (with a ‘-’ indicating same nucleotide as the wild type motif). A substitution that is in the recognition range of the same TF is expected to maintain a high EC score and a similar expression profile (green arrow). A substitution that causes binding site loss is expected to be recognized by both loss of coherence and a change in the mean expression profile (red arrow). A substitution that creates a motif that is in the recognition range of a different TF is expected to maintain high expression coherence, while altering the mean expression profile (blue arrow).
As a first step towards establishing a general scheme for the assessment of the effect of single-base substitutions on the binding sites of transcription factors, we examined computationally the effects of such substitutions on the consensus site of the yeast sporulation factor Ndt80, the primary transcriptional activator of middle sporulation genes. Using our motif landscape analysis tool  we analyzed the effects of all single-base substitutions on Ndt80 binding (Figure 1, right panel). For each ‘mutant’ motif, this tool answers two questions: can it potentially constitute a binding site for a TF? and more specifically, is it likely to bind the same TF as the ‘wild-type’ motif? To answer the first question, the tool employs the previously described Expression Coherence (EC) score –, which assesses the effect of a promoter sequence motif on the corresponding genes' expression profiles. The EC score measures the extent to which a set of genes (in this case the set is defined by a common sequence motif in the genes' promoters) displays similar expression profiles at a given biological condition. The statistical significance (p-value) of an EC score is the estimated probability of obtaining the observed or higher EC score by chance and is dependent on the size of the set of genes considered . The answer to the second question is obtained by computing the Pearson correlation distance between the mean expression profile, under a relevant condition, of the set of genes whose promoters contain the ‘wild-type’ motif and that of the set of genes whose promoters contain the ‘mutant’ motif.
Using the S. cerevisiae sporulation expression data , our landscape analysis predicted that two out of the three possible substitutions in the second position will have only a minor effect on expression whereas an A->G substitution at the same position will have a harsher effect (see Figure 1 legend for details). When averaging over all possible single nucleotide substitutions (Figure 2), the second position seems to be the most tolerant towards substitutions (mean expression distance, i.e. 1-Pearson correlation coefficient, is 0.0358), and the seventh position – the most sensitive (mean expression distance 0.7715). One possible reason for such a marked difference between the tolerance of different positions within the same motif to substitutions may be that the binding transcription factor forms different contacts with the DNA at each of the positions. Particularly, we may expect the positions that form tight contact to be less permissive to substitutions. Indeed, our results are in good agreement with the structural data of Ndt80 bound to its DNA target : the second ‘permissive’ motif position is the only position which does not form a direct contact with the protein. But do these differences affect TF function? Reassuringly, these results are also supported by published in vivo reporter expression experiments and in vitro binding assays of Ndt80 mutants . This experiment represents the ‘wet’ analog to our computational experiment – each of the nucleotide positions in the Ndt80 consensus site was replaced with all possible three alternatives. These results too showed that the second position is most permissive to substitutions, and that, as predicted by us, G is the only nucleotide that when placed at this position weakens binding affinity and reduces expression level of the reporter gene . This implies that the computational measures used here can complement and predict the outcome of ‘wet’ mutation experiments.
The averaged tolerance to substitution for each nucleotide position within the Ndt80 motif was defined as the averaged correlation coefficient between the mean expression profile of the genes that have a perfect match to the consensus motif and the mean expression profile of the genes that have each of the three possible substitutions relative to the consensus in that position. The second motif position appears the most tolerant to substitutions. This observation is supported by the recently published structural data of Ndt80 bound to DNA . The second motif position does not form a contact with the protein.
The use of Ndt80 as a test case also provided us with the opportunity to examine whether we can computationally distinguish between binding site switching and binding site loss. Ndt80 recognizes variations of a site termed middle sporulation element (MSE), whose consensus sequence is GNCRCAAW. Interestingly, variations of the MSE are also recognized by Sum1, a transcriptional repressor of middle sporulation genes during mitosis and early sporulation. Through a combination of in vivo reporter expression assays and in vitro binding assays of Ndt80 and Sum1 mutants, Pierce et al. defined the specific binding preferences of these two TFs . They found that while positions 3–5 of the MSE are important for binding of both Ndt80 and Sum1, there is a difference in binding preferences at positions 6–7. For these positions, Ndt80 requires strictly an A, whereas Sum1 binds equally to an A and to a T. Indeed, our landscape analysis (Figure 1, right panel) shows that mutating position 6 from A to T results in a change in expression profile, yet coherence remains significant (p-value 0.0083). This may be explained by the binding site switching from Ndt80 to Sum1. Transitions of the same position into C or G result in binding site loss (p-values of the EC score of the substituted motifs are 0.4 and 0.3, respectively). The same applies for position 7, in which transition from A to T maintains a relatively significant EC score (p-value 0.019), yet the expression profile is changed relative to the genes containing the consensus motif. On the other hand, substitutions at this position to both C and G lead to complete loss of coherence (EC p-values are 0.4 for both variants). This position also scored as the most sensitive to mutations – any change will abolish the Ndt80 site, either by switching or complete loss.
Compiling a comprehensive transcription regulatory motifs collection in yeast
Encouraged by our ability to predict the effects of binding site substitutions within a single motif, we attempted to generalize these predictions in order to define universal properties of substitutions that alter gene expression. Towards this end we compiled a dataset of motifs that are likely to participate in the regulation of gene expression. This study was conducted in the S. cerevisiae genome, for which vast TFBS knowledge is available. However, in order to both broaden this knowledge and form a quantifiable connection between binding site sequence and the expression profiles of the regulated genes, we compiled a new comprehensive motif dataset. This dataset is unbiased by prior knowledge and is based on the premise that any nucleotide sequence that resides in the promoter of a gene may contribute to the regulation of the gene's expression. A further advantage of our dataset is that it is not limited to TF binding sites – motifs found by our methodology are relevant to transcription, but not all are necessarily TF binding sites. Some, for example, may be involved in DNA bending.
We constructed our motif dataset by integrating whole genome promoter sequences of S. cerevisiae with expression patterns of the corresponding genes in 40 natural and perturbed biological conditions including cell cycle, sporulation and various stress responses. Each biological condition was represented by a time series of microarrays (see methods). To obtain the most comprehensive dataset, we systematically scanned all k-mers (k ranges from 7 to 11) that appear in S. cerevisiae promoters. For each k-mer and each of the 40 biological conditions, we computed the EC score of the set of genes that contain it in their promoters. A p-value was assigned to each EC score and a false discovery rate (FDR)  of 0.1 was applied to correct for multiple hypotheses (see methods). The EC score was used not only to assess the biological significance of the scanned k-mers, but also to assign them with likely regulatory functions, in the form of the set of biological conditions in which they operate, and the regulatory effects they exert in each condition (e.g. increased expression following stress, or peak in expression level at a particular cell cycle stage).
A total of 8,610 sequence motifs appeared significant in at least one of the examined biological conditions. These comprise the ‘core’ of our dataset (hereafter referred to as the ‘core dataset’). This dataset represents potential cis-regulatory elements, whereas the rest of the scanned k-mers represent a control set of presumably non-functional elements. A list of our core motif sequences, along with their EC scores and p-values in the biological condition in which each motif obtained the most significant score is provided in the supporting information (supporting Table S1).
Validation of method used to construct motif dataset
We performed several analyses to validate the ability of our method to identify biologically significant motifs (see supporting Text S1 for complete details). First, we compared the core dataset to the well accepted reference collection of yeast TFBS published by Harbison et al.  (supporting Text S1 and Figure S1). Briefly, the Harbison set was obtained by experimentally determining the genomic occupancy of DNA-binding transcriptional regulators under rich medium as well as other growth conditions. Using motif-discovery algorithms the information from genome-wide location data was then combined with phylogenetically conserved sequences and prior knowledge to derive for each regulator its probable specificities . Each motif in the Harbison set is represented by a positional weight matrix (PWM), which specifies for each position in the regulator binding site and each of the four possible nucleotides, the likelihood of observing the specific nucleotide at that particular position. Our dataset covers 99 out of the 102 PWMs published by Harbison et al. We also found a tendency for genes, which contain the same motif from our core dataset in their promoters, to be associated with similar functions (supporting Text S1).
We next used our core dataset to investigate characteristics that may be of relevance to motifs' biological function. For this purpose we compiled a control set of 190,211 low scoring k-mers, that were insignificant in all 40 examined biological conditions, and in addition scored especially low (p-value > 0.8, gene set size > 8) in at least one of these conditions. We considered various features that may be important for the function of a regulatory motif and for each such feature, defined a quantitative measure, and tested whether it can significantly differentiate between our highly scoring motifs and the control set.
Compared to the control set our significant motifs were found to have high GC content (relative to the yeast AT rich genomic background (supporting Figure S2), to have high entropy (supporting Figure S3), to appear in higher copy numbers (supporting Figure S4) and to display a preference to distinct positions relative to the transcriptional start site (TSS) in different promoters (positional bias) (supporting Figure S5). Additionally, our motifs were found to be evolutionarily conserved in the promoters of four closely related Saccharomyces species (Figure 3 and supporting Figure S6). Reassuringly, some of these properties are known to characterize functional binding sites (positional bias ,, multiplicity of sites ,, evolutionary conservation ,).
A. Evolutionary conservation in four Saccharomyces species  was calculated for the highly scoring S. cerevisiae cell cycle k-mers (lengths 7–11; shown in red) and compared with the conservation of two sets of motifs defined by yeast phylogenetic footprinting: Cliften et al.  (green) and Kellis et al.  (blue). A set of the randomized k-mers was used as a control (to preserve the same GC content) and is shown in magenta. For each putative motif, evolutionary conservation was calculated by finding the percentage of fully conserved (in all aligned species) positions in each motif instance, and averaging over all motif instances. The background promoter conservation was calculated in a similar manner by counting the number of fully conserved positions in each promoter and averaging over all promoters. The highly scoring k-mers are conserved comparably to the set of motifs published by Kellis et al.  and appear to be more conserved than the set published by Cliften et al. . The randomized k-mers show an evolutionary conservation that is similar to that of the background promoters (∼36%). B. Evolutionary conservation rate in four Saccharomyces species  was calculated for the motifs of the core dataset (blue) and compared with the evolutionary conservation rate of a control set of randomized k-mers (to preserve GC content), shown in red. For each putative motif, evolutionary conservation rate was calculated as the percentage of motif instances that are highly conserved (i.e. at least 90% of the motif positions were identical across all four species). The evolutionary conservation rates of the core dataset motifs tend to be higher than those of the control set (Wilcoxon-Cox ranksum test; p<10−300 ).
Creation of a high-confidence subset of the core motif dataset
The analysis of evolutionary conservation revealed, that while the core dataset is significantly more conserved than a randomized motif set, there is a substantial number of motifs in the core dataset that are not significantly conserved, as manifested by an overlap in the two distributions of conservation rates (Figure 3). This implies that the core dataset likely contains many false positives. Therefore, in order to obtain a distilled signal in the analyses that follow we applied a conservation-based filter to the core dataset. Using the 95th percentile of the conservation rate (see methods) of a control motif set as a threshold, we filtered out those core dataset motifs that had a conservation rate below this threshold. The new dataset, referred to as the filtered core dataset, constitutes 1,036 motifs (see supporting Table S1 for the identity of the motifs that were included in this set).
Exploiting our dataset to predict the outcome of a binding site substitution
We next exploited the filtered core dataset in order to study the functional outcomes of binding site variations. For each motif in this dataset we exhaustively enumerated all possible single-base substitutions and examined their effect on expression patterns, in view of the three previously described scenarios (Figure 1, right panel). The process of assessment of the effect of a substitution is best described in terms of a decision tree. Figure 4 summarizes the distribution of substitutions along the leaves of this decision tree. The first decision addresses the possibility of binding site loss. If the substitution results in a k-mer sequence that is outside of the filtered core dataset we consider the substitution to result in a binding site loss, since the genes that contain that version of the motif are not significantly coherent, whereas the genes that contain the original motif from the filtered core are coherent. Next, we attempt to discover clear cases of binding site switches. These are defined as cases where the original motif and the substituted sequence are both members of the filtered core dataset, but the sets of biological conditions in which they are inferred to exert their effect are non-overlapping. Finally, substitutions that survive the two filters can constitute either a conservation of the binding site (i.e. benign mutations) or a binding site switch, depending on their effect on the expression profile in the biological conditions in which both the motif and its substituted variant are coherent. Interestingly, examination of the distribution of correlation coefficients between the mean expression profiles of the motif and its substituted variant for those substitutions that fell into the last category revealed that these correlation coefficients tend to be high and statistically significant (Figure 5). Thus, it seems that cases similar to the one observed for Ndt80 and SUM1, in which a substitution results in a switch to a binding site that is active in the same biological condition as the original binding site, are quite rare. Table 1 describes the few cases found to constitute such a switch. Consequently, we define the substitutions that fall into the last category as benign substitutions that will have very little effect on expression. Overall from the decision tree it is apparent that the majority (∼97.5%) of the single nucleotide substitutions result in a loss of a functional binding site. It should be emphasized, though, that the our criteria for inclusion in the high confidence core dataset were very strict (both in terms of expression coherence and evolutionary conservation), and that more loose criteria could have resulted in a lower proportion of binding site loss events.
All possible single-nucleotide substitutions in the filtered motif dataset were considered. In order to obtain a non-redundant set of substitutions, if both ‘wild-type’ motif and its substituted variant were members of the filtered motif dataset then the reverse substitution was not examined. In total 28,937 substitutions were examined. Cases where the substituted variant was not a member of the filtered motif dataset were considered as binding site losses. Of the remaining 702 substitutions, 118 constitute clear cases of binding site switches, as the ‘wild-type’ and substituted variant do not share biological conditions in which both of them are presumed to be active based on their EC scores. For the remaining 584 substitutions the effect of the substitution (conservation of the binding site or binding site switch) can only be determined by the similarity in mean expression profiles, as in these cases both ‘wild-type’ and substituted variant are coherent in a shared condition. Substitution types that are over-/under-abundant in the categories of “binding site loss” or “binding site retention or binding site switch” are denoted, with upward- and downward-pointing arrows indicating over- and under-representation, respectively.
Pearson correlation coefficients (A) and corresponding p-values (B) were calculated for the mean expression profiles observed in shared conditions of pairs of motifs from the filtered core dataset that differ by a single nucleotide and share at least one condition where they both display significant expression coherence. (C) p-values for substitutions from C to G and from G to C. (D) p-values for substitutions from A to T and from T to A. Substitutions between C and G tend to produce correlations between mean expression profiles that are less significant than other substitution types. For the purpose of plotting the p-value histograms very small p-values were conservatively set to 1e-06.
Deducing general properties of expression-altering substitutions
Using the classification of substitutions obtained for the filtered core dataset we next attempted to generalize these predictions in order to define properties of substitutions that alter gene expression. Our goal was to define substitution types that are more radical than others (in analogy to amino acid substitutions where there are conservative changes that maintain the chemical properties of the residue versus radical changes that result in a residue with different characteristics). For this purpose we used chi-square tests to compare the distribution of the different substitution types among the cases of binding site loss with that found for cases with benign effects on expression (the last category in the decision tree which corresponds to binding site conservation or switch). The results are summarized in Tables 2–4. We found that substitutions from A to T (or from T to A) are the most underrepresented among the cases of binding site loss, implying that such substitutions tend to be benign (Table 2). On the other hand, substitutions from G to T (or from T to G) seem to be very radical as they are the most overrepresented among cases of binding site loss (Table 2). In general it seems that substitutions that involve a G (either as the source nucleotide or as a target nucleotide, i.e. N->G, or G->N, where N is any nucleotide, but G) tend to lead to a binding site loss, whereas substitutions that involve an A (as a source or as a target) have a tendency to be benign (see Tables 3 and 4 for source and target statistics, respectively). Also, the identity of the source nucleotide has less of an impact on the outcome than the identity of the target nucleotide, as attested by the higher chi-square scores in Table 4 compared to Table 3. Finally, by taking into account the chi-square deviation observed for each of the twelve possible substitution types, as well as the information whether it is found more or less than expected among the cases of binding site loss, we can rank the substitution types from most benign to most severe (Table 2). These statistics also allow us to rank in terms of severity the three possible substitutions from every source nucleotide. For instance, in a position containing a C as the source, the most severe substitution would be to a G, followed by T, and then by A.
We further examined the cases where two motifs that differ by one nucleotide are coherent in a shared condition. In such cases the genes that contain one version of a motif and the genes that contain an alternative version of the same motif may display a similar, or dissimilar expression pattern (in the same condition where they both show high coherence). We thus examined the corresponding expression profiles in such conditions and asked if they tend to be similar or not for the different substitution types. To explore this possibility we examined separately the distributions of correlation coefficients and corresponding p-values for the different substitution types (supporting Figure S7). Since we cannot distinguish which motif corresponds to the ‘wild-type’ and which corresponds to a ‘mutant’ in this case the distributions for complementary substitution types were pooled together. Visual examination of these distributions revealed that the distribution of p-values for substitutions between C and G tends to higher (i.e. less significant) values relative to the corresponding distributions for substitutions among other pairs of nucleotides (median p-value for C⇔G substitutions is 1.08e-04, whereas the highest median for the other pairs of nucleotides is 6.60e-05). In other words, substitutions between G and C tend to generate more cases of dissimilar expression patterns compared to other substitutions. Using a rigorous comparison between the distributions corresponding to different pairs of nucleotides we found that no two distributions differ significantly from each other when correcting for multiple hypotheses (supporting Tables S2, S3, and S4). Nonetheless, the comparisons between the distribution of p-values corresponding to C⇔G substitutions to the other distributions yield much lower p-values than comparisons among the distributions of other pairs of nucleotides (p-values range from 0.0336 to 0.1606 for comparisons involving the C⇔G substitutions, whereas for other comparisons the lowest p-value is 0.5382). This may indicate that C⇔G substitutions have a greater tendency than other substitutions to weaken the affinity of the regulatory protein to the binding site.
We constructed an unbiased dataset of motifs relevant to transcription in the yeast genome by quantifying the effect of promoter sequence elements on the expression profiles of the corresponding genes. We validated the biological significance of our putative motifs by multiple analyses including coverage of known TF binding sites, evolutionary conservation and additional features, which are known to characterize functional binding sites. The quantitative link we formed between motif sequence and function allowed us to compare the effects on gene expression of binding sites differing by a single nucleotide position. Such comparisons were then used to infer what would be the severity of substituting one binding site into the other. We applied our tools to the yeast genome and were able to produce reliable predictions about the outcome of single nucleotide substitutions in a single binding site, of the transcription factor Ndt80, that has been extensively characterized experimentally. Applying the same rationale to a high-confidence subset of our motifs, defined by its evolutionary conservation, we were able to assess the effects of single-base substitutions on motifs from this subset and examine the prevalence of binding site losses, binding site switches and binding site retention among the substitution outcomes. We found that the overwhelming majority of single nucleotide substitutions result in binding site loss. However, the flip side of the coin is that many sequences that do not participate in transcription regulation are only a single nucleotide substitution away from becoming a functional regulatory site. The de novo formation of such sites might have a detrimental effect, and may explain the fact that motifs that are assumed to be non-functional differ in their positional preferences from our core dataset of motifs (see supporting Text S1 and Figure S5). It would be interesting to examine whether non-functional motifs that differ by only a single nucleotide from functional motifs are specifically avoided at promoter positions that are relevant for transcription regulation.
Differential effects of substitution types on binding sites
By accumulating statistics for many substitutions across the motifs in our filtered motif dataset we observed that not all nucleotide substitutions are similar in severity: In the S. cerevisiae genome substitutions involving a G have a harsher effect on average than those involving an A. This observation may be perhaps explained by the fact that although both G and A participate in specific protein-DNA recognition through hydrogen bonds between the side chains of nucleotides and amino acids, the amino acids that preferentially bind G (Lysine, Arginine, Serine and Histidine) are much more prevalent in DNA-protein contacts than those that preferentially recognize A (Asparagine and Glutamine) . Also, the observation that substitutions between A and T are under-abundant in cases of binding site loss may be explained by the fact that both these nucleotides participate in ring-stacking interactions with proline and phenylalanine in protein-DNA complexes . It would be interesting to check whether the rules we have found apply to additional genomes.
An intriguing follow-up on this study would be to test additional features that may affect the sensitivity of a binding site position to substitutions, such as its evolutionary conservation and its proximity to the protein in the DNA-protein complex. Many such features may be ultimately integrated in order to form a prioritization scheme that would allow the ranking of existing genome variations by their disease-causing potential.
The approach presented here demonstrates for the first time how a huge amount of data, in this case the promoter sequences of all yeast genes as well as expression data for all genes across multiple conditions, can be harnessed and utilized for taking the first step towards assessing the effects of nucleotide substitutions on regulatory binding sites. A conceptual analogue of this endeavor for assessing the effects of amino acid substitutions on protein function could amount to mutating many proteins, say enzymes, in many different ways, and for each mutation measuring the reduction, or change, in biochemical activity and specificity. Since data for such an effort is not even close to becoming available, the methodology presented here utilizes in a unique way data that is available for its domain. While the main advantage of our methodology is the huge sample size, the disadvantage is that we are unable to control for other differences between promoters of analyzed genes (i.e. differences that are outside of the substituted position). The fact that we obtain statistically significant differences between the effects of different types of substitutions on expression likely indicates that, despite uncontrolled sources of variation, we extracted genuine signals.
An additional application of the present approach may be in algorithms that assign PWMs to promoters (e.g. PRIMA ) as it should provide means to differentially weigh mismatches between the PWM preferences and the promoter sequence, based on expected effect on expression. Particularly, at least in the S. cerevisiae genome, if the mismatch between the PWM and the sequence examined involves a G, the sequence is less likely to be a functional binding site than if the mismatch involves an A.
Promoter sequences for 5,651 S. cerevisiae genes were taken from the Saccharomyces Genome Database (SGD) . Whole-genome mRNA expression data of 40 time series experiments in S. cerevisiae, were downloaded from ExpressDB . These time series represent a wide range of natural (e.g. cell cycle) and perturbed conditions. This set of conditions was utilized by us before  and a complete list of conditions is available at http://longitude.weizmann.ac.il/TFLocation/conditions_explist.html.
Yeast promoters were systematically scanned for all occurrences of every possible k-mer (k varies from 7–11), resulting in an index file listing for each k-mer the set of genes that contain it in their promoters, along with the positions and orientations (strand) of each occurrence. Bidirectional promoters were taken twice in different orientations and associated with the corresponding genes. Following the k-mer indexing step, EC scores (and corresponding p-values) in various experimental conditions were calculated for the sets of genes containing each of the k-mers in their promoters. The correction for multiple hypotheses was performed separately for each condition using a false discovery rate (FDR ) of 0.1 (allowing 10% false positives). In addition to the EC scores and corresponding p-values, each k-mer was characterized by the expression profile it dictates; this was defined, at each time point as the average expression level of all genes assigned to the k-mer. Such averaged profiles were defined for each k-mer in each of the 40 time series experiments, resulting in 40 vectors per motif.
A fundamental assumption made by our method was that a regulatory protein recognizes and binds double stranded DNA, and would therefore bind a motif instance equally whether it appears on the forward strand or the reverse strand of the promoter. Thus, in generating our motif dataset we considered a specific k-mer and its reverse complement as a single motif. As a consequence, pairs of genes with divergent promoters always ended up together in the sets of genes used to calculate the EC score of a motif. To address the question of what impact the above assumption had on the resulting dataset of motifs with statistically significant EC scores (the ‘double-stranded dataset’), we reapplied our method to the promoters of the S. cerevisiae this time counting forward instances and reverse instances of the same k-mer separately. We refer to the dataset of motifs with statistically significant EC scores generated in this way as the ‘single-stranded dataset’. Supporting Table S5 gives a detailed comparison of the double-stranded and single-stranded datasets. While the two datasets are of similar size, the overlap between them is quite low: 4728/8610 motifs are unique to the double-stranded dataset (both the forward and reverse instance of the motif is absent from the single-stranded dataset) and 3767/8280 motifs are completely unique to the single-stranded dataset. This indicates that the answer to the question of whether TF binding sites are directional is not a straight-forward one. The high fraction of motifs unique to the double-stranded dataset implies that in many cases both forward and reverse instances of a motif generate the same expression pattern, and may not be detectable using the single stranded methodology because of lack of statistical power due to splitting of the regulated genes into two gene sets. On the other hand, the high fraction of motifs unique to the single-stranded dataset, as well as the high number of cases where only one direction of a double-stranded motif is included in the single-stranded dataset implies that in many cases the directionality of the motif is important to the recognition by the regulatory protein. For these motifs consideration of their reverse complement in the calculation of EC scores in the double-stranded methodology adds noise that in many cases cannot be overcome by the signal. Thus, the most comprehensive approach in the future would probably be to consider the union of the results obtained using both the double-stranded and the single-stranded approaches. For simplicity, we chose to limit the current study to those motifs generated by the double-stranded methodology. Future studies may consider also those motifs generated using the single-stranded methodology.
Our method for compiling our dataset of potential regulatory motif is based on the detection of motifs whose presence in the promoters of a group of genes is associated with a similar expression pattern for the genes in question. A potential concern could be that paralogs resulting from very recent duplication events, and that have therefore not diverged sufficiently both in their promoters and expression patterns, would lead to false positives in our motif dataset. To address this concern we examined, using the data of Kafri et al. , the relationship between time of duplication (as assessed by Ks, the rate of synonymous substitutions within the coding sequence) and the overlap in known motif content of pairs of paralogs (supporting Figure S8). We found that time of duplication is not a good predictor for the tendency of paralogs to share regulatory motifs. Therefore, it seems unlikely that the similarity in promoter sequences of paralogous genes would drive false discovery of potential regulatory motifs.
The Expression Coherence (EC) score
The threshold D is determined based on the distribution of pairwise distances between expression profiles of all genes in the genome (or more precisely of all genes for which expression level was monitored). The original definition of the EC score  used the 5th percentile as the cutoff for defining “close” expression profiles (D). This definition may create a bias towards TFs that exert a very tight regulation and miss regulatory motifs that correspond to factors exerting a more lose regulation. We therefore tested a range of EC definitions, with cutoffs corresponding to the 5th, 10th, 20th, 30th, 40th and 50th percentiles of the pair-wise distance distribution. For each definition of EC cutoff we assigned a significance p-value separately. P-values were calculated by random sampling. For each of the 40 expression time series and for each gene set size (varying from 3–50 genes), we selected 100,000 random gene sets and computed an EC score for each such set at each cutoff definition. We define the p-value of a given EC score as the fraction of random sets (of the same size and at the same condition) that scored similarly or higher (note that this sets a lower bound of 10−5 on the significance that can be assigned to a given EC score). Because we assume that for a given EC score, the probability to get the same score for random sets of genes drops with the set size, gene sets larger than 50 were assigned an upper bound approximated p-value, using the randomly sampled sets of size 50. See supporting Figure S9 for the distribution of set sizes used for the different k-mers.
Promoter data for four closely related Saccharomyces species S. cerevisiae, S. mikatae, S. kudriazevii and S. bayanus were taken from Cliften et al. . Reference lists of motifs that were defined solely based on phylogenetic footprinting were taken from both Cliften et al.  and Kellis et al. . The motif conservation calculation was adapted from Xie et al. . Motif conservation was defined as the fraction of motif positions that are identical across all 4 species. We defined the motif conservation rate separately for each motif as the ratio of conserved motif instances to total occurrences of the motif in the genome. We regarded a motif instance as conserved if it displayed at least 90% conservation. Note that since the promoter alignments do not cover whole promoters for all genes the conservation rate doesn't factor in all occurrences of the motif in the S. cerevisiae genome, and in particular some of the motifs did not appear in any of the alignments and their conservation rate is thus undetermined. The distribution of conservation rates obtained for our core dataset of motifs was compared to a control distribution, which was obtained by calculating the conservation rate for randomized versions of the motifs (in order to preserve GC content). We took the 95th percentile of the control set distribution as the cutoff defining high conservation. Supporting Protocol S1 displays the results obtained with different cutoffs for the definition of high conservation. It can be seen that using different cutoffs the general trends observed in Table 2 are preserved, albeit less strictly in the more permissive cutoffs.
Re-discovery of the Harbison motif set using our scoring method
(0.07 MB DOC)
Distributions of GC content for high scoring k-mers and for the Harbison motifs
(0.09 MB DOC)
Distributions of entropy values and number of different nucleotides within the k-mer for high scoring k-mers versus low scoring k-mers
(0.09 MB DOC)
Distributions of mean and maximum number of occurrences per promoter for high scoring k-mers versus low scoring k-mers
(0.07 MB DOC)
Positional bias of high scoring k-mers.
(0.15 MB DOC)
Plot of normalized EC scores versus evolutionary conservation for the highly scoring S. cerevisiae cell cycle k-mers.
(0.09 MB DOC)
Distribution of expression similarities for the different types of single nucleotide substitutions
(0.04 MB DOC)
Comparison of the age of duplication of pairs of paralogs (approximated by Ks) and their tendency to share known regulatory motifs in their promoters
(0.12 MB PDF)
Distribution of the set sizes of genes examined in constructing the core motif dataset that is relevant for the cell cycle
(0.03 MB DOC)
Significantly scoring k-mers (our core set motifs). This table lists our core motif sequences, along with their EC scores and p-values in the biological condition in which each motif obtained the most significant score. For motifs that matched at least one of Harbison's PWMs with a match score higher than 99, the highest scoring match is also listed.
(1.41 MB XLS)
Redundancy and uniqueness in the core motif dataset
(0.05 MB DOC)
Coverage of the Harbison motif set by our core dataset
(0.04 MB DOC)
comparison, among the different substitution types, of the distributions of p-values (corresponding to correlation coefficients) of mean expression profiles (in shared conditions) of motifs differing by a single nucleotide substitution
(0.01 MB XLS)
Comparison of the significant motif datasets obtained using the double-stranded and single-stranded methodologies
(0.04 MB XLS)
Validation of the method of construction of the motif dataset and the comparison of this dataset to published datasets.
(0.14 MB DOC)
We thank all members of the Pilpel lab for their input and specifically Shai Kaplan and Shai Shen-Orr who improved script performance and adapted them to large scale analyses and Reut Shalgi who contributed scripts for FC calculation.
Conceived and designed the experiments: ML YP. Performed the experiments: ML OMM. Analyzed the data: ML OMM YP. Wrote the paper: ML OMM YP.
- 1. Stormo GD (2000) DNA binding sites: representation and discovery. Bioinformatics 16: 16–23.GD Stormo2000DNA binding sites: representation and discovery.Bioinformatics161623
- 2. Doniger SW, Fay JC (2007) Frequent Gain and Loss of Functional Transcription Factor Binding Sites. PLoS Comput Biol 3: e99.SW DonigerJC Fay2007Frequent Gain and Loss of Functional Transcription Factor Binding Sites.PLoS Comput Biol3e99
- 3. Tanay A, Gat-Viks I, Shamir R (2004) A global view of the selection forces in the evolution of yeast cis-regulation. Genome Res 14: 829–834.A. TanayI. Gat-ViksR. Shamir2004A global view of the selection forces in the evolution of yeast cis-regulation.Genome Res14829834
- 4. Roth FP, Hughes JD, Estep PW, Church GM (1998) Finding DNA regulatory motifs within unaligned noncoding sequences clustered by whole-genome mRNA quantitation. Nat Biotechnol 16: 939–945.FP RothJD HughesPW EstepGM Church1998Finding DNA regulatory motifs within unaligned noncoding sequences clustered by whole-genome mRNA quantitation.Nat Biotechnol16939945
- 5. Kel AE, Gossling E, Reuter I, Cheremushkin E, Kel-Margoulis OV, et al. (2003) MATCH: A tool for searching transcription factor binding sites in DNA sequences. Nucleic Acids Res 31: 3576–3579.AE KelE. GosslingI. ReuterE. CheremushkinOV Kel-Margoulis2003MATCH: A tool for searching transcription factor binding sites in DNA sequences.Nucleic Acids Res3135763579
- 6. Bailey TL, Gribskov M (1998) Combining evidence using p-values: application to sequence homology searches. Bioinformatics 14: 48–54.TL BaileyM. Gribskov1998Combining evidence using p-values: application to sequence homology searches.Bioinformatics144854
- 7. Prokunina L, Castillejo-Lopez C, Oberg F, Gunnarsson I, Berg L, et al. (2002) A regulatory polymorphism in PDCD1 is associated with susceptibility to systemic lupus erythematosus in humans. Nat Genet 32: 666–669.L. ProkuninaC. Castillejo-LopezF. ObergI. GunnarssonL. Berg2002A regulatory polymorphism in PDCD1 is associated with susceptibility to systemic lupus erythematosus in humans.Nat Genet32666669
- 8. Zwarts KY, Clee SM, Zwinderman AH, Engert JC, Singaraja R, et al. (2002) ABCA1 regulatory variants influence coronary artery disease independent of effects on plasma lipid levels. Clin Genet 61: 115–125.KY ZwartsSM CleeAH ZwindermanJC EngertR. Singaraja2002ABCA1 regulatory variants influence coronary artery disease independent of effects on plasma lipid levels.Clin Genet61115125
- 9. Ng PC, Henikoff S (2001) Predicting deleterious amino acid substitutions. Genome Res 11: 863–874.PC NgS. Henikoff2001Predicting deleterious amino acid substitutions.Genome Res11863874
- 10. Ng PC, Henikoff S (2002) Accounting for human polymorphisms predicted to affect protein function. Genome Res 12: 436–446.PC NgS. Henikoff2002Accounting for human polymorphisms predicted to affect protein function.Genome Res12436446
- 11. Ng PC, Henikoff S (2003) SIFT: predicting amino acid changes that affect protein function. Nucleic Acids Res 31: 3812–3814.PC NgS. Henikoff2003SIFT: predicting amino acid changes that affect protein function.Nucleic Acids Res3138123814
- 12. Sunyaev S, Ramensky V, Bork P (2000) Towards a structural basis of human non-synonymous single nucleotide polymorphisms. Trends Genet 16: 198–200.S. SunyaevV. RamenskyP. Bork2000Towards a structural basis of human non-synonymous single nucleotide polymorphisms.Trends Genet16198200
- 13. Sunyaev S, Ramensky V, Koch I, Lathe W 3rd, Kondrashov AS, et al. (2001) Prediction of deleterious human alleles. Hum Mol Genet 10: 591–597.S. SunyaevV. RamenskyI. KochW. Lathe 3rdAS Kondrashov2001Prediction of deleterious human alleles.Hum Mol Genet10591597
- 14. Vitkup D, Sander C, Church GM (2003) The amino-acid mutational spectrum of human genetic disease. Genome Biol 4: R72.D. VitkupC. SanderGM Church2003The amino-acid mutational spectrum of human genetic disease.Genome Biol4R72
- 15. Wang Z, Moult J (2001) SNPs, protein structure, and disease. Hum Mutat 17: 263–270.Z. WangJ. Moult2001SNPs, protein structure, and disease.Hum Mutat17263270
- 16. Rockman MV, Wray GA (2002) Abundant raw material for cis-regulatory evolution in humans. Mol Biol Evol 19: 1991–2004.MV RockmanGA Wray2002Abundant raw material for cis-regulatory evolution in humans.Mol Biol Evol1919912004
- 17. Lapidot M, Pilpel Y (2003) Comprehensive quantitative analyses of the effects of promoter sequence elements on mRNA transcription. Nucleic Acids Res 31: 3824–3828.M. LapidotY. Pilpel2003Comprehensive quantitative analyses of the effects of promoter sequence elements on mRNA transcription.Nucleic Acids Res3138243828
- 18. Pilpel Y, Sudarsanam P, Church GM (2001) Identifying regulatory networks by combinatorial analysis of promoter elements. Nat Genet 29: 153–159.Y. PilpelP. SudarsanamGM Church2001Identifying regulatory networks by combinatorial analysis of promoter elements.Nat Genet29153159
- 19. Sudarsanam P, Pilpel Y, Church GM (2002) Genome-wide Co-occurrence of Promoter Elements Reveals a cis-Regulatory Cassette of rRNA Transcription Motifs in Saccharomyces cerevisiae. Genome Res 12: 1723–1731.P. SudarsanamY. PilpelGM Church2002Genome-wide Co-occurrence of Promoter Elements Reveals a cis-Regulatory Cassette of rRNA Transcription Motifs in Saccharomyces cerevisiae.Genome Res1217231731
- 20. Chu S, DeRisi J, Eisen M, Mulholland J, Botstein D, et al. (1998) The transcriptional program of sporulation in budding yeast. Science 282: 699–705.S. ChuJ. DeRisiM. EisenJ. MulhollandD. Botstein1998The transcriptional program of sporulation in budding yeast.Science282699705
- 21. Lamoureux JS, Stuart D, Tsang R, Wu C, Glover JN (2002) Structure of the sporulation-specific transcription factor Ndt80 bound to DNA. Embo J 21: 5721–5732.JS LamoureuxD. StuartR. TsangC. WuJN Glover2002Structure of the sporulation-specific transcription factor Ndt80 bound to DNA.Embo J2157215732
- 22. Pierce M, Benjamin KR, Montano SP, Georgiadis MM, Winter E, et al. (2003) Sum1 and Ndt80 proteins compete for binding to middle sporulation element sequences that control meiotic gene expression. Mol Cell Biol 23: 4814–4825.M. PierceKR BenjaminSP MontanoMM GeorgiadisE. Winter2003Sum1 and Ndt80 proteins compete for binding to middle sporulation element sequences that control meiotic gene expression.Mol Cell Biol2348144825
- 23. Benjamini Y, Hochberg Y (1995) Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J Roy Stat Soc 57: 289–300.Y. BenjaminiY. Hochberg1995Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing.J Roy Stat Soc57289300
- 24. Harbison CT, Gordon DB, Lee TI, Rinaldi NJ, Macisaac KD, et al. (2004) Transcriptional regulatory code of a eukaryotic genome. Nature 431: 99–104.CT HarbisonDB GordonTI LeeNJ RinaldiKD Macisaac2004Transcriptional regulatory code of a eukaryotic genome.Nature43199104
- 25. Hughes JD, Estep PW, Tavazoie S, Church GM (2000) Computational identification of cis-regulatory elements associated with groups of functionally related genes in Saccharomyces cerevisiae. J Mol Biol 296: 1205–1214.JD HughesPW EstepS. TavazoieGM Church2000Computational identification of cis-regulatory elements associated with groups of functionally related genes in Saccharomyces cerevisiae.J Mol Biol29612051214
- 26. Cunningham TS, Cooper TG (1993) The Saccharomyces cerevisiae DAL80 repressor protein binds to multiple copies of GATAA-containing sequences (URSGATA). J Bacteriol 175: 5851–5861.TS CunninghamTG Cooper1993The Saccharomyces cerevisiae DAL80 repressor protein binds to multiple copies of GATAA-containing sequences (URSGATA).J Bacteriol17558515861
- 27. Cliften P, Sudarsanam P, Desikan A, Fulton L, Fulton B, et al. (2003) Finding functional features in Saccharomyces genomes by phylogenetic footprinting. Science 301: 71–76.P. CliftenP. SudarsanamA. DesikanL. FultonB. Fulton2003Finding functional features in Saccharomyces genomes by phylogenetic footprinting.Science3017176
- 28. Kellis M, Patterson N, Endrizzi M, Birren B, Lander ES (2003) Sequencing and comparison of yeast species to identify genes and regulatory elements. Nature 423: 241–254.M. KellisN. PattersonM. EndrizziB. BirrenES Lander2003Sequencing and comparison of yeast species to identify genes and regulatory elements.Nature423241254
- 29. Luscombe NM, Laskowski RA, Thornton JM (2001) Amino acid-base interactions: a three-dimensional analysis of protein-DNA interactions at an atomic level. Nucleic Acids Res 29: 2860–2874.NM LuscombeRA LaskowskiJM Thornton2001Amino acid-base interactions: a three-dimensional analysis of protein-DNA interactions at an atomic level.Nucleic Acids Res2928602874
- 30. Elkon R, Linhart C, Sharan R, Shamir R, Shiloh Y (2003) Genome-wide in silico identification of transcriptional regulators controlling the cell cycle in human cells. Genome Res 13: 773–780.R. ElkonC. LinhartR. SharanR. ShamirY. Shiloh2003Genome-wide in silico identification of transcriptional regulators controlling the cell cycle in human cells.Genome Res13773780
- 31. Balakrishnan R, Christie KR, Costanzo MC, Dolinski K, Dwight SS, et al. R. BalakrishnanKR ChristieMC CostanzoK. DolinskiSS Dwight“Saccharomyces Genome Database” ftp://ftp.yeastgenome.org/yeast/. “Saccharomyces Genome Database” ftp://ftp.yeastgenome.org/yeast/.
- 32. Aach J, Rindone W, Church GM (2000) Systematic management and analysis of yeast gene expression data. Genome Res 10: 431–445.J. AachW. RindoneGM Church2000Systematic management and analysis of yeast gene expression data.Genome Res10431445
- 33. Garten Y, Kaplan S, Pilpel Y (2005) Extraction of transcription regulatory signals from genome-wide DNA-protein interaction data. Nucleic Acids Res 33: 605–615.Y. GartenS. KaplanY. Pilpel2005Extraction of transcription regulatory signals from genome-wide DNA-protein interaction data.Nucleic Acids Res33605615
- 34. Kafri R, Bar-Even A, Pilpel Y (2005) Transcription control reprogramming in genetic backup circuits. Nat Genet 37: 295–299.R. KafriA. Bar-EvenY. Pilpel2005Transcription control reprogramming in genetic backup circuits.Nat Genet37295299
- 35. Xie X, Lu J, Kulbokas EJ, Golub TR, Mootha V, et al. (2005) Systematic discovery of regulatory motifs in human promoters and 3′ UTRs by comparison of several mammals. Nature 434: 338–345.X. XieJ. LuEJ KulbokasTR GolubV. Mootha2005Systematic discovery of regulatory motifs in human promoters and 3′ UTRs by comparison of several mammals.Nature434338345