5 Feb 2009: Doniger SW, Fay JC (2009) Correction: Frequent Gain and Loss of Functional Transcription Factor Binding Sites. PLOS Computational Biology 5(2): 10.1371/annotation/363b6074-caec-4238-b88f-acbf45de498f. https://doi.org/10.1371/annotation/363b6074-caec-4238-b88f-acbf45de498f View correction
Cis-regulatory sequences are not always conserved across species. Divergence within cis-regulatory sequences may result from the evolution of species-specific patterns of gene expression or the flexible nature of the cis-regulatory code. The identification of functional divergence in cis-regulatory sequences is therefore important for both understanding the role of gene regulation in evolution and annotating regulatory elements. We have developed an evolutionary model to detect the loss of constraint on individual transcription factor binding sites (TFBSs). We find that a significant fraction of functionally constrained binding sites have been lost in a lineage-specific manner among three closely related yeast species. Binding site loss has previously been explained by turnover, where the concurrent gain and loss of a binding site maintains gene regulation. We estimate that nearly half of all loss events cannot be explained by binding site turnover. Recreating the mutations that led to binding site loss confirms that these sequence changes affect gene expression in some cases. We also estimate that there is a high rate of binding site gain, as more than half of experimentally identified S. cerevisiae binding sites are not conserved across species. The frequent gain and loss of TFBSs implies that cis-regulatory sequences are labile and, in the absence of turnover, may contribute to species-specific patterns of gene expression.
Research in the field of molecular evolution is focused on understanding the genetic basis of functional differences between species. Protein coding sequences have traditionally been the focus of these studies, as the genetic code enables a detailed study of the strength of selection acting on amino acid sequences. However, from the earliest cross-species sequence comparisons, it was clear that protein sequences among closely related species are too similar to explain the observed phenotypic diversity. This led to the hypothesis that the evolution of gene regulation has played a key role in generating diversity between species. The availability of numerous complete genome sequences has made it possible to begin testing this hypothesis. In this work, the authors use an evolutionary model to identify functional divergence within transcription factor binding sites, the core functional elements involved in gene regulation. Applying this model to the baker's yeast, Saccharomyces cerevisiae, and its three closest relatives, the authors find that a substantial fraction of the ancestral binding sites have been lost in a species-specific manner. In some cases the loss of the binding site creates gene expression differences that may be indicative of species-specific changes in gene regulation. This work provides a useful computational framework that will allow further study of the conservation of cis-regulatory sequences and their role in molecular evolution.
Citation: Doniger SW, Fay JC (2007) Frequent Gain and Loss of Functional Transcription Factor Binding Sites. PLoS Comput Biol 3(5): e99. https://doi.org/10.1371/journal.pcbi.0030099
Editor: Mathieu Blanchette, McGill University, Canada
Received: August 2, 2006; Accepted: April 19, 2007; Published: May 25, 2007
Copyright: © 2007 Doniger and Fay. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors received no specific funding for this study.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: PWM, position weight matrix; TFBS, transcription factor binding site
Changes in gene regulation have been found in a wide range of species and can have a meaningful impact on cell and organismal phenotypes [1,2]. A significant fraction of regulatory variation can be attributed to changes in cis-regulatory sequences [3–7]. Changes in cis-regulatory sequences have been tracked to transcription factor binding sites (TFBSs), insertion of transposable elements, and variation in tandem repeats, e.g., [8–12]. Although changes in trans-acting factors are also important, e.g., [13–15], the molecular basis of changes in gene regulation will often require a dissection of cis-regulatory sequence evolution.
A major challenge in studying the evolution of cis-regulatory sequences is translating divergence in cis-regulatory sequences to divergence in regulatory function. Although conservation of sequence is a strong indicator of conservation of function, cis-regulatory sequences that have maintained their regulatory function can diverge to the extent that they are unalignable [16–19]. On a finer scale, experimentally identified TFBSs are not always conserved across species [20–22], even in cases when expression is known to be conserved . The complex relationship between divergence in sequence and divergence in function  implies that the evolution of cis-regulatory sequences cannot be understood without investigating the evolution of individual TFBSs.
The turnover of TFBSs provides a simple explanation for divergence in cis-regulatory sequences without a change in regulatory function. Under the binding site turnover model, the chance gain of a new binding site creates redundancy and can lead to loss of either the new or original site [21,23,25]. Evolutionary models suggest that many novel binding sites can be created by a stochastic mutational process and can potentially lead to the loss of existing sites [22,26–29].
Empirical evidence suggests that binding site turnover may be common. For example, the change in the position and orientation of binding sites within the even-skipped (eve) stripe 2 enhancer produces no change in embryonic patterns of expression between species, but chimeric enhancers composed from different species result in mis-regulation . Furthermore, many experimentally identified binding sites have credible counterparts at close but not orthologous positions in other species [20–22]. Thus, the gain and loss of TFBSs is directly relevant to understanding conservation and divergence in cis-regulatory sequences in relation to their function.
Models of TFBSs must account for sequence variations that have no affect on function or fitness [30,31]. Sequence variability within binding sites can arise as a consequence of a lack of specificity at certain positions or as a consequence of multiple sequences having the same binding energy. The specificity or binding probability of transcription factors for different DNA sequences has been modeled using both statistical mechanics  and information theory . However, the relationship between binding probability and function or fitness is often not known. The simplest assumption is that both function and fitness are linearly related to the probability of being bound, which is approximately a step function of binding energy [30,33,34].
The distinction between sequences that can function as a binding site and sequences that cannot is critical to identifying the gain, loss, or turnover of TFBSs. The use of a cutoff, even one based on binding probability, is problematic when trying to classify sequences close to the cutoff . One solution is to compare the likelihood of evolution under a model of neutral evolution to a model of a conserved binding site. Given a collection of known binding sites, the position-specific equilibrium base frequencies can be used to measure the strength of selection  and calculate the likelihood of evolution under a binding site model [28,37]. By combining models of neutral evolution with those for conserved binding sites, the frequency of conserved binding sites relative to those that have been gained or lost can be estimated .
Because the gain or loss of binding sites in nonfunctional sequences is common [22,26–29], it is difficult to identify which gain or loss events are functional and affect fitness without additional data. One approach is to examine the gain and loss of experimentally identified binding sites. A previous study in Drosophila melanogaster found that 5% of Zeste binding sites, identified by chromatin immunoprecipitation, have been lost or gained across Drosophila species, based on deviations from a conserved binding site model . However, nonfunctional sequences may often be bound without affecting gene expression , and changes in gene expression may not always affect fitness [40,41].
A phylogenetic approach provides a means of identifying loss of functional binding sites based on significant conservation in some species but loss of constraint in others. This approach was used to identify cis-regulatory sequences around single-minded 2 (SIM2) that were conserved in some but not all mammalian species . Here, we have used a phylogenetic approach to examine the frequency at which functional TFBSs have been lost across the genomes of four Saccharomyces species. These species are sufficiently different that even the three closest species provide enough signal to identify individual binding sites by sequence conservation alone . Using a probabilistic model of TFBS evolution  for 91 different transcription factors , we found a substantial fraction of binding sites are not conserved between species, and that these sequence changes, at least in some cases, affect gene expression.
A Model to Identify Semiconserved Transcription Factor Binding Sites
To identify semiconserved TFBSs, we used a probabilistic model of sequences evolving under a neutral and conserved binding site model. We define semiconserved sites as those that have been constrained along some lineages and unconstrained along others (Figure 1). Within this framework, semiconserved sites can be identified by their patterns of substitution rather than by their similarity to a binding site or a position weight matrix (PWM) representation of binding sites . Additionally, semiconserved sites can be distinguished from conserved sites and neutrally evolving sequences by comparing the likelihood of a neutral model, a conserved binding site model, and a semiconserved model.
Three different evolutionary models are considered in this study: a neutral model of evolution, which assumes no functional constraint (A), a conserved TFBS model, which uses site-specific substitution matrices representing the varying constraints on each nucleotide position of a binding site (B), and a semiconserved model, which combines the neutral and TFBS models to identify sequences showing loss of constraint, indicated by the asterisk, (C). We also considered the case of loss in combination with gain, i.e., turnover (D), where the loss of an ancestral binding site (black oval) is accompanied by the gain of a compensatory binding site (red oval).
The likelihood of a set of aligned sequences under a neutral model or a conserved binding site model is a function of the substitution rate under each model. Under a binding site model, the substitution rate depends on position-specific functional constraints imposed by the sequence specificity of a transcription factor. At equilibrium, the expected frequency of a nucleotide base is a function of the strength of selection on the base relative to the other bases . Thus, the equilibrium frequency of bases from a collection of binding sites can be used to estimate the intensity of selection and the expected rate of substitution at each position . To compare the likelihood of evolution under a neutral and conserved binding site model, we used synonymous sites to estimate the neutral substitution rate and PWMs to estimate the equilibrium base frequencies within binding sites and derive position-specific substitution rates (see Methods).
The likelihood under a semiconserved model depends on which lineages have evolved under a neutral model and which have evolved under a binding site model. The semiconserved model can, in theory, detect both the loss and gain of binding sites. However, constraint on only a single lineage is typically indistinguishable from neutral evolution. Thus, we limited our analysis to loss of constraint on a single lineage and we did not consider loss events on the outgroup lineage. Since the lineage and time at which loss of constraint occurred is unknown, we calculated the likelihood under the semiconserved model by integrating over a large number of loss events evenly distributed over all lineages excluding the outgroup lineage, an approximation of the method used by Mustonen and Lassig .
The Frequency of Semiconserved Binding Sites in Four Saccharomyces Genomes
To estimate the frequency of semiconserved relative to conserved binding sites, we used 91 TFBS models  and 1.7 megabases of noncoding sequences from 3,761 multiple sequence alignments of S. cerevisiae, S. paradoxus, S. mikatae, and S. bayanus . Rather than test every position in the genome alignments, we calculated the likelihood under each model for the 2,000 positions with the highest-scoring sequence match to each binding site model in any two of the four species (see Methods).
We used expectation maximization to obtain an overall estimate of the frequency of sites evolving under each model. We found that 55% of the sites are best explained by the conserved binding site model, 31% are best explained by the semiconserved model, and 14% by the neutral model. The frequency of neutral sites is arbitrary since we did not test all positions within the alignments. Of the non-neutral sites, one-third are better explained by a model that allows for loss of constraint along one lineage. However, this estimate includes many sites that are reasonably explained by all three models. Sequences that don't provide a close fit to the conserved or semiconserved model may be evolving under a similar, yet unknown, model and may be incorrectly annotated as a semiconserved binding site.
Figure 2A shows the posterior probabilities for 2,000 putative Rox1 sites present in the yeast genome alignments. Because the posterior probabilities sum to one, sites with a high likelihood under the semiconserved model but not the neutral or conserved model are shown in the bottom left corner, and sites with a high likelihood under the conserved model but not the neutral of the semiconserved model are shown in the upper left corner. The distribution of probabilities suggests that quite a few sites are equally well explained by each model.
(A) The distribution of posterior probabilities for 2,000 putative Rox1 binding sites present in yeast intergenic sequences.
(B) The distribution of 2,000 Rox1 sites simulated under a neutral model (red) or a conserved binding site model (blue) as shown.
(C) The distribution of 2,000 Rox1 sites simulated under a semiconserved model, where loss of constraint occurred at a random location on the phylogenetic tree, excluding the outgroup.
The Log2 posterior probability of the neutral model is plotted on the x-axis, the posterior probability of the conserved model is plotted on the y-axis. Since the three probabilities sum to one, p(semiconserved | data) = 1 − x − y. Conserved and semiconserved sites were classified by three cutoffs (lines), defined in the text, and determined by the simulations. Sites passing cutoff one and two are annotated as conserved. Sites passing cutoff one and three are annotated as semiconserved. The three sites tested experimentally are shown in pink.
To estimate our confidence in identifying individual sites that have evolved under a conserved or semiconserved model, and to eliminate sequences that may be evolving under a similar model, we generated null distributions for each model using computer simulations. Figure 2B shows the posterior probabilities for 2,000 sites simulated under a neutral model and 2,000 sites simulated under a model of a conserved Rox1 binding site. Three cutoffs were used to generate the high-confidence set of conserved and semiconserved sites (Figure 2B). The first cutoff delineates sites with a low probability under the neutral model (p(neutral) < 0.005). The second and third cutoffs delineate sites with a high probability under the conserved model and the semiconserved model, respectively. The second cutoff is set such that fewer than 1% of neutral sites show a higher likelihood under the conserved model. The third cutoff is set such that fewer than 1% of conserved sites show a higher likelihood under the semiconserved model.
Out of 2,000 putative Rox1 sites, 292 were inconsistent with a neutral model (cutoff 1, Figure 2A). Of these 292 sites, 242 sites were defined as conserved (cutoff 2) and 11 as semiconserved (cutoff 3). Out of 2,000 neutral simulations, two were defined as conserved and three were defined as semiconserved based on our cutoffs. Out of 2,000 conserved binding site simulations, 1% passed the semiconserved cutoff, suggesting that 292*1% ≈ 3 of the semiconserved sites are false positives. This data translates into a false discovery rate of 2/242 (1%) for conserved sites and 6/11 (54%) for semiconserved sites. The false discovery rates indicate that our cutoffs do not exactly produce a high-confidence set of semiconserved sites. However, simulations of semiconserved sites show the power to detect semiconserved Rox1 sites is only 16.4%, and increasing the stringency would reduce the power further (Figure 2C).
Using 91 TFBS models [44,48,49], we estimated the fraction of semiconserved sites for each. In total, we found 19,264 sites showed evidence of non-neutral evolution (p < 0.005 under the neutral model). Of these non-neutral sites, we classified 15,399 as conserved (p > 0.99 for the conserved model), and 982 as semiconserved model (p > 0.99 for the semiconserved model) (Table 1). In total, of the significantly conserved or semiconserved binding sites, 6.0% have been lost in a lineage specific manner. Semiconserved binding sites were identified for 85 out of 91 binding site models, and more than five loss events were found for 60 of the 91 models.
Number of Conserved and Semiconserved Binding Sites
To estimate the rate of false positive classification of conserved and semiconserved sites, we simulated 2,000 neutral and 2,000 conserved binding sites for each model. Classifying these simulated sequences, we found 224 neutral sequences passed our cutoffs for a conserved site and 242 neutral sites passed our semiconserved cutoffs. Thus, the rate of falsely classified conserved sites is just over 1% (224/15,399). By definition, 1% of the simulated conserved sites passed the semiconserved cutoff. Thus, the overall false discovery rate for semiconserved sites is 44% (19,264 * 0.01 + 224)/982.
Characterization of Semiconserved Sites
The classification of sequences into conserved and semiconserved sites supposes that all sequences bound by the same protein evolve under the same functional constraints. However, for any given transcription factor, there may be certain sites in the genome that are selected for high binding energy and other sites that are selected for lower binding energy [33,35,50]. Selection for low-energy sites may produce the appearance of semiconserved sites if analyzed using a model based on high-energy sites.
To investigate whether semiconserved sites may be low-energy binding sites, we examined the binding energies of conserved and semiconserved sites. We used the likelihood ratio score of a sequence under a binding site model compared with a model of background sequences as a proxy for binding energy . The distribution of scores shows that semiconserved binding sites tend to have higher binding energy than the completely conserved sites on the lineages in which they have been conserved. In the lineage showing loss of constraint, the binding energies are much closer to background sequences (Figure 3). Additionally, the substitution rate within semiconserved sites is indistinguishable from that of conserved sites, excluding those lineages showing loss of constraint (Table 2). These comparisons suggest that semiconserved sites cannot be explained by a class of low-energy sites.
We use the log-odds score of a sequence given a PWM relative to the genome-wide nucleotide frequencies as a proxy for binding energy. The semiconserved category (black bars) only includes sites from species where functional constraint has been maintained. The loss category (diagonally striped bars) shows sites from species where functional constraint has been lost. The neutral category (grey) shows sites generated by neutral simulations.
Evolution of Semiconserved Sites
Two models can explain the lineage-specific loss of TFBSs. First, some species may experience new environments where certain regulatory elements are not needed, or are selected against, resulting in a change in gene regulation. Second, the gain of one or more redundant binding sites within a promoter enables the loss of a previously constrained site (Figure 1D). Under the second model, the turnover of function from one binding site to another conserves the regulatory control but enables divergence within regulatory sequences.
The binding site turnover model predicts that binding site loss will be accompanied by the gain of a site elsewhere in the promoter. We tested this prediction by looking for the presence of a species-specific binding site for the same transcription factor in the promoter showing loss of constraint. We defined species-specific binding sites as a sequence that matches a PWM in one species, but whose orthologous sequences do not match the same weight matrix. To define a match to a PWM, we used a log-odds score cutoff from the tenth percentile score of conserved binding sites for each binding site model. Using this cutoff, 57% (513/894) of the species-specific loss events can be explained by turnover (Table 1). In comparison, species-specific sites are present within 50% of promoters with conserved sites and 47% of promoters with semiconserved sites, excluding lineages with loss. Using a more stringent cutoff score derived from information theory , 38% of the loss events can be explained by turnover.
Binding site turnover is not due to any one lineage or binding site model. The rate of turnover is similar across lineages, with 50% of sites showing turnover in S. cerevisiae, 55% in S. paradoxus, and 60% in S. mikatae. Although the rate of turnover varies across binding site models, most of this variation can be explained by the information content of the models and the size of the promoter sequences within which semiconserved sequences lie, consistent with previous work .
Natural selection may also result in lineage-specific loss of TFBSs. If the fitness effects of binding sites differ between species, bind sites may be lost without consequence or they may be selected against. However, it is also possible that semiconserved sites arise from compensatory changes that are more complicated than those described by a simple binding site turnover model. For example, binding site turnover may also occur between sites bound by different but functionally related transcription factors. Distinguishing between these two possibilities is not easy.
If some but not all species have undergone a substantial shift in selective pressures, binding site loss may show high rates on specific lineages. In contrast, if binding site loss is the result of turnover, loss should be a simple function of sequence divergence. The number of loss events on each lineage is heterogeneous (Table 1). Scaled by the synonymous substitution rate along each lineage, S. mikatae shows the greatest amount of loss, 66% of the loss events but only 40% of the total evolutionary distance, and S. paradoxus shows the least, 3% of the loss events but 16% of the evolutionary distance. However, simulations of semiconserved sites with loss events evenly distributed over the tree shows that the power of detecting binding site loss is the lowest on the shortest lineages, since these lineages have the fewest informative substitutions. One way to control for the confounding effects of power is to identify binding sites that show lineage-specific rates of loss that differ from the average lineage-specific rate across all binding site models.
Using the average rates of lineage-specific loss across all binding sites as a control (Table 1), we tested 29 binding site models with at least ten loss events for a heterogeneous distribution of binding site loss across lineages. We found significant heterogeneity in the loss of both Spt23 and Rlr1 binding sites (X2, 3 d.f., p = 3 × 10−7 for Spt23 and p = 4 × 10−11 for Rlr1). Spt23p stimulates Ty1 transposition and is a suppressor of Ty1-induced promoter mutations . For Spt23 sites, the largest amount of loss was found on the lineage leading to S. paradoxus (14 loss events observed, 3.5 expected). Rlr1 is involved in transcription associated hyper-recombination between direct repeats . For Rlr1, the largest amount of loss was found on the lineage leading to the ancestor of S. cerevisiae and S. paradoxus (38 loss events observed, 14.6 expected). The lineage-specific rate of loss of Spt23 and Rlr1 sites suggests that the loss of these sites may not have been a stochastic process.
Substitutions Resulting in Binding Site Loss Cause Changes in Gene Expression
In the absence of binding site turnover, the semiconserved model predicts that the substitutions resulting in binding site loss should cause changes in gene expression. To experimentally determine whether semiconserved sites are functional and whether substitutions predicted to cause binding site loss are functional, we recreated the loss of three Rox1, two Ndt80, and six Msn2/4 semiconserved binding sites. These semiconserved sites were picked from 11, 14, and 27 semiconserved binding sites predicted using the Rox1, Ndt80, and Msn2/4 binding sites models, respectively.
For each semiconserved site, we used a beta-galactosidase reporter construct to compare the expression of the wild-type S. cerevisiae promoter with a mutated S. cerevisiae promoter containing the same substitutions predicted to cause change of function (Figure 4). Expression was measured in two strains of S. cerevisiae, one with and one without the transcription factor predicted to bind the site of interest.
The sequence logo representing the PWM and the alignment of each semiconserved binding site are shown for Rox1 (A), Ndt80 (B), and Msn2/4 (C). The binding site in S. cerevisiae is outlined in grey. The sequence changes shown in red were made in the S. cerevisiae promoter to test the predictions of the semiconserved binding site model.
Mutations in five of the 11 semiconserved binding sites affected levels of gene expression (Table 3). If these changes in expression are caused by the transcription factor predicted to bind the site, they should be absent in strains lacking the transcription factor. Using transcription factor deletion strains, we found that in only three of the five cases were these effects dependent on the presence of the transcription factor predicted to bind the site. Out of three semiconserved Rox1 binding sites, the site in the SUT1 promoter showed a Rox1-dependent effect on gene expression. The three substitutions resulted in a 1.6-fold increase in gene expression, consistent with Rox1 being a transcriptional repressor in the presence of oxygen .
Substitutions Leading to Binding Site Loss Affect Gene Expression
Both of the semiconserved Ndt80 binding sites produced a significant effect on gene expression (Table 3). However, only in the HST4 promoter is the effect dependent on Ndt80. The two substitutions in the HST4 promoter led to a 1.7-fold decrease in gene expression during sporulation, consistent with Ndt80′s role as activating the middle sporulation genes . In the NAM8 promoter, a single substitution caused a 3-fold increase in expression during vegetative growth, independent of Ndt80.
Out of the six semiconserved Msn2/4 binding sites, the substitutions affected expression in two cases. Yet, of the two functional sites, only the one in the MDH1 promoter affected expression in an Msn2–Msn4 double mutant (Table 3). Interestingly, this effect was only present during nitrogen starvation and not during heat shock.
Limited Conservation of Experimentally Identified Transcription Factor Binding Sites
At equilibrium, the rate of binding site gain should be comparable to that of binding site loss. We previously showed that two Ndt80 binding sites, which show no conservation in other species, affected gene expression in S. cerevisiae . Although the gain of a binding site that affects gene expression levels may be inconsequential to fitness, and thus susceptible to loss, the frequency at which functional binding sites are gained is relevant to understanding the evolution of gene regulation.
To estimate the rate of binding site gain across multiple transcription factors, we obtained a list of documented binding sites from the Yeastract database . Because this database does not contain exact coordinates for each binding site, but rather transcription factor–promoter pairings, we limited our analysis to the 654 binding sites for 61 transcription factors where there was only a single high-scoring sequence match to the PWM in the promoter of interest. For each binding site, we tested its conservation across the four Saccharomyces species. We found that 303 (46.3%) of the Yeastract sites fit the conserved model, and seven (1.1%) fit the semiconserved model. Thus, a substantial fraction of experimentally identified binding sites appear to be species-specific or only weakly conserved across species, implying that binding site gain may be common.
Transcriptional regulatory sequences are expected to play an important role in molecular evolution. However, distinguishing functional from nonfunctional divergence within regulatory sequences continues to be a challenge. In this work, we have used a phylogenetic model to identify loss of constraint on individual TFBSs. Applying this model to four closely related Saccharomyces species, we found a substantial number of binding sites that show lineage-specific loss. In three out of 11 semiconserved sites tested, substitutions predicted to result in binding site loss affected gene expression levels in S. cerevisiae. Although a number of improvements can be made to models of TFBS evolution, there is considerable evidence for a continuous fine-scale rewiring of the transcriptional regulatory network at the level of individual promoters.
The Rate of Binding Site Gain and Loss
The frequency of experimentally identified binding sites that are not conserved across species suggests a high rate of binding site gain. We found that more than half of the binding sites extracted from the Yeastract database  are not conserved. This is consistent with studies in other organisms. Between 30% and 50% of experimentally identified binding sites lie outside of conserved blocks in Drosophila , 40% of human and mouse TFBSs are species-specific , 5% of Zeste binding sites are not conserved among closely related Drosophila species , and 5% of CRP binding sites show presence and absence at orthologous positions in two bacterial genomes . However, the biological relevance of these unconserved sites is not always known. Sites that are bound and affect gene expression may in some cases be lost without any fitness or downstream phenotypic consequences, except for a change in gene expression. In comparison, a binding site that has been conserved in some species but lost in others suggests that the site is relevant to fitness, at least in those species in which it was conserved.
The frequency of binding site loss may be quite high, but is difficult to estimate. Using expectation maximization, we estimated that one-third of all non-neutral sites are no longer constrained on some lineages. However, this estimate does not account for sequences that may have evolved under functional constraints other than the binding site model being tested. Using a number of statistical cutoffs to eliminate ambiguous sites, we found that 6% of the high-confidence binding sites fit the semiconserved model. This is similar to other estimates of the frequency of functional binding sites that are not entirely conserved across species [35,38]. Although some of these sites may be false positives, the true number of semiconserved sites could be higher, given that we estimated our power to detect semiconserved sites to be low, less than 20% for most models.
The Effect of Binding Site Loss on Gene Expression
In the absence of binding site turnover, binding site loss results in species-specific changes in gene regulation. This model predicts that changes in gene expression should result from either making substitutions that result in loss in the species with a conserved site, or from making substitutions that recreate the binding site in the species showing loss. We tested the former of these two predictions using 11 different predictions of binding site loss. In three cases, we found that the substitutions predicted to result in loss of function altered the expression of the downstream gene. Although suggestive, these experiments do not address whether the substitutions that occurred on the lineage showing loss resulted in a species-specific change in gene regulation.
The eight of 11 semiconserved sites that showed no affect on gene expression are difficult to interpret. One explanation is that the semiconserved sites only affect gene expression under specific environmental conditions. Although possible, the gene expression assays were carried out under conditions where the semiconserved sites were likely to function. Another explanation is that our assays were not sensitive enough to detect small changes in gene expression. Finally, the predictions rest on the false positive rate of the model as well as on its assumptions. While it is difficult to distinguish between these possibilities, several pieces of evidence suggest that the assumptions of the model may not always be correct.
Our predictions of binding site loss rest on a number of assumptions. The main assumptions are that the alignments are correct, the binding site models are correct, and that sequences that appear to be semiconserved binding sites are not functionally constrained for some other reason. We discuss each of these assumptions separately.
The incorrect alignment of one of the four species could make some conserved sites appear as though they were semiconserved. While incorrect alignments may occur, there are a number of reasons to believe that their impact in this dataset is negligible. Simulation studies show that the Saccharomyces species fall within the range where alignment algorithms perform well . Additionally, realigning the ClustalW aligned sequences with Mlagan  leads to only 2% of the semiconserved sites being reannotated as conserved binding sites. Finally, we used local realignments surrounding the binding sites to eliminate mis-inference of loss caused by small insertion or deletion events (see Methods). It is also possible that turnover could be the result of misalignment. However, 54% of the turnover events occur in opposite orientation, making it unlikely to be the result of alignment error. Based on these data, we believe that the effects of alignment error in our analysis are likely to be small.
Position weight matrices.
The identification of binding site loss assumes that the binding site model is correct. Inaccuracies in the degeneracy of a binding site, or in the width of the binding site, will affect our results. One particular concern is that an overly specific binding site model will overestimate the rate of loss. PWMs are typically estimated from a subset of the true binding sites, and as a result of this sampling, a position might be defined as 90% A, when in actuality, A is only slightly favored over a T. As a result, an A to T substitution may result in a false prediction of binding site loss.
Three observations suggest that semiconserved sites cannot be completely explained by inaccuracies in the binding site model (see Protocol S1 for the methods). First, the distribution of lineage-specific substitutions that result in loss are evenly distributed across the nondegenerate positions within binding sites. Second, PWMs rebuilt to include nucleotide counts of both the conserved and semiconserved data still annotate half of the semiconserved sites as semiconserved, suggesting that these loss events cannot be explained by errors in the binding site model. Third, we repeated our analysis using a second set of binding site models  and estimated that 7.9% of the binding sites have been lost in a lineage-specific manner. These analyses further suggest that the exact PWMs used could be an important source of both false positives and false negatives, but that slight errors in the binding site models are unlikely to explain all of the loss events we have observed.
A third assumption is that the sequence conservation observed in a TFBS is the result of the constraints required to maintain the binding site rather than some other functional constraint. For example, conserved binding sites may appear to be semiconserved under similar binding site models. The observation that predictions of conserved binding sites often overlap  suggests that sequences may often be conserved for reasons other than the model used to identify them. In two of the eleven sites examined experimentally, we found changes in gene expression independent of the transcription factor predicted to bind them. This suggests that these noncoding sequences are functional cis-regulatory sequences, but are not bound by Ndt80 or Msn2/4. Overlapping predictions are unlikely to explain all of the semiconserved sites, as 75% of the semiconserved binding sites do not overlap any other known binding site model. Yet, we cannot rule out that other functional noncoding sequences, regulatory or otherwise, could be the basis of the functional constraint.
The Molecular Evolution of cis-Regulatory Sequences
Although functional divergence in cis-regulatory sequences may be common, in relatively few cases have the nucleotide substitutions been identified . TFBSs provide a useful starting point to dissecting sequence divergence that underlies regulatory divergence. The semiconserved model we have used in this analysis provides an efficient way to identify loss of constraint on a putative binding site sequence. Although several good candidate loss events were identified, there is a considerable false positive and false negative rate associated with the approach. Additional comparative information should help eliminate false positives, and methods that account for uncertainty in the binding site model should improve our ability to reliably detect functional divergence in cis-regulatory sequences.
Materials and Methods
To distinguish neutral sequences from conserved and semiconserved binding sites, we used a model for the evolution of neutral sequence and functional TFBSs [35,37], calculated the likelihood of the data under three different evolutionary models, and used computer simulations to generate our statistical confidence in each model.
For each model, we assume that nucleotide sequences are evolving under a discrete-state, continuous-time Markov process, positions within an alignment evolve independently of one another, and the substitution rate is a product of the population size, N, mutation rate, μ, fixation probability, f, and time, t, measured in generations. We also assume that the mutational process is the same under each model and is governed by five parameters : four parameters for the equilibrium nucleotide frequencies (πa, πc, πg, πt) and one parameter for the rate of transitions relative to transversions (κ).
The probability of fixation is different between the models. Under the neutral model, the probability of fixation is the same for all mutations. Under the binding site model, the relative probability of fixation between any two bases is: where s is the selective advantage of base y relative to base x . The strength of selection can be estimated from the equilibrium base frequencies [36,62]. Given a collection of sites evolving under the same model, at equilibrium, the flux from base x to base y is equal to the flux from base y to x: where πx is the equilibrium frequency of base x, μ is the mutation rate, and f is the fixation probability. Using the approximation of Equation 1, which assumes Ns > 1, and Equation 2, the equilibrium base frequencies are a simple function of the relative strength of selection and mutation:
Substituting Equation 3 into Equation 1, the probability of fixation is: In the binding site model, the fixation probability is position-specific and derived from PWMs, as described below. Assuming the effective population size is constant, no estimate of N is needed since it is the same across all positions and all types of nucleotide changes.
Calculating the likelihood.
We calculated the likelihood of the data under the neutral and conserved binding site model using transition probabilities derived from the expected rate of substitution under each model and using the pruning algorithm to integrate over all possible ancestral states . To estimate the expected rate of substitution, we estimated κ from substitutions in synonymous sites in coding sequences (κ = 4), the π parameters from the genome-wide nucleotide frequencies (A = 0.3, G = 0.2, C = 0.2, T = 0.3) for the neutral model and from PWMs for each TFBS model. We estimated the mutation rate and time, together, for each branch of the phylogeny from synonymous sites using PAML . Given these branch-specific substitution rates, we calculated the transition probability under each model by exponentiating the rate matrix, P = eQ, where Q is a matrix of substitution rates of the form 2Nμπft.
Here, a represents the nucleotide in the ancestral sequence A. TAX is the branch length from the ancestor to species X. QiaX is the substitution rate from base a to base X in position i. Q can be either the neutral model of evolution (in which case it is position-independent), or the binding site model. υa is the frequency of base a in ancestral sequence. For neutral sequence, this is the genome average frequency, πa. For the binding site model, this is the frequency of a in position i of the PWM. Equation 5 can be expanded to multiple sequences by recursively calculating the left and right branches of each node in the phylogenetic tree starting at the root .
To calculate the likelihood under the semiconserved model, we integrated over many loss events evenly distributed across the entire tree, excluding the outgroup. By re-rooting the tree at the time-point, t, where constraint was lost, we split the tree into two subtrees, with one subtree containing all sequences preceding t, and the other subtree with all sequences following t. The likelihood of the left and right subtrees was then calculated under the binding site model and the neutral model using the pruning algorithm and Equation 5. Thus, the likelihood under the semiconserved model is: where D is the total evolutionary distance, S is the aligned binding site, Tt is the portion of the tree evolving under the binding site specific model of evolution, T − Tt is the neutrally evolving portion of the tree. Because very recent loss events are indistinguishable from the conserved binding site model, we do not test for loss events occurring within 0.1 substitutions per site of the extant species. We used the maximum-likelihood estimate of the location of the loss event to determine on which branch the loss of constraint occurred. Pseudocode can be found in Protocol S1.
Maximum-likelihood estimate of the frequency of semiconservation.
To estimate the fraction of sites that are evolving under a semiconserved model of evolution, we used a maximum-likelihood approach. Using expectation maximization, we maximized the likelihood equation: p (conserved | sitei) and p(neutral | sitei) were calculated using the pruning algorithm and Equation 5. p(semiconserved | sitei) was calculated using Equation 6. p(conserved), p(semiconserved), and p(neutral) are the free parameters that were maximized.
Statistical cutoffs to distinguish between the models.
To distinguish between the three models, we compared the posterior probability of each model. While the maximum-likelihood estimates suggested that the probabilities of the three models are unequal, we used flat priors for simplicity. The choice of priors did change the overall annotations slightly, but the general conclusions are unchanged.
Computer simulations of neutral and conserved sequences were used to set statistical cutoffs for distinguishing each model and to estimate the power of detecting binding site loss. For each simulation, we evolved a sequence from the root of the tree to each node/tip using the transition probabilities specific to each model. For both simulations, we generated sequence at the root from the nucleotide frequencies defined by the PWM.
We used 10,000 neutral simulations to generate the neutral cutoff (#1 in Figure 2B), such that less than 0.5% of sites show a lower posteriori probability under the neutral model. The same data were used to generate the conserved cutoff (#2 in Figure 2B), such that less than 1% of neutral sites show a higher posteriori probability under the conserved model. We used 5,000 conserved binding site simulations for each transcription factor to generate the semiconserved cutoff (#3 in Figure 2B), such that less than 1% of sites show a lower probability under the conserved model.
To control the false discovery rate and computational time, we tested only the 2,000 highest-scoring binding sites for each transcription factor. To identify these sites, we ranked each putative binding site by the sum of the two highest-scoring sequences from the four species examined by their log-odds score, see below. The choice of 2,000 sites is arbitrary, but as most transcription factors are expected to regulate fewer than a few hundred genes, this should not exclude any functional binding sites from our analysis.
Applying the model to the Saccharomyces genomes.
Alignments. ClustalW intergenic sequence alignments of S. cerevisiae, S. paradoxus, S. mikatae, and S. bayanus  were filtered to remove any alignments containing greater than 50% insertions or deletions in any one sequence or those containing greater than 20% missing data (N and . characters). After applying these filters, global alignments of 3,761 intergenic sequences from four species were used in all subsequent analysis. 1,539 coding sequence alignments were used to estimate the synonymous and nonsynonymous substitution rates . To account for insertion or deletion events within aligned binding sites, we generated local realignments by using the highest-scoring binding site in each species from the binding site and ±5 bp of it, excluding gaps.
TFBS models. We used the TFBS models defined by Harbison et al. , with the addition of a model for Ndt80  and CSRE , as these well-studied motifs were not included. We filtered the dataset to remove dubious or redundant motifs, and used 91 out of 104 reported binding site models (see Table S1).
Defining TFBS turnover. We define binding site turnover as the presence of a species-specific binding site in the promoter of the species showing loss. To identify species-specific binding sites, we used the log-likelihood ratio score of the sequence given a PWM: where πib is the frequency of base b at position i of the binding site as defined by the PWM, and ρb is the genomic frequency of base b, and W is the width of the binding site. To determine the cutoff score for a sequence match to the PWM, we used the distribution of scores in sites identified as significantly conserved. For each transcription factor, we enumerated the scores from all four species for each conserved binding site and used the tenth percentile of these scores to define a match to the PWM. To estimate the expected number of turnover events, we calculated the percentage of promoters containing a species-specific binding site for each transcription factor. We also used the default cutoff score of the Patser program  for comparison.
Beta-galactosidase activity driven by both a wild-type and mutant promoter sequence was measured to determine the effect of the binding-site loss on gene expression. For each putative loss event, the entire S. cerevisiae intergenic sequence was cloned by PCR with gap-repair or restriction digests into the YEp357r yeast–bacteria shuttle vector . Mutations were made in the binding site to mimic the substitutions that occurred between species using stitching-PCR and were confirmed by sequencing. The constructs were transformed into the S. cerevisiae strain BY4743 or the appropriate homozygous deletion strain, obtained from the yeast deletion collection, for the transcription factor of interest . The msn2Δmsn4Δ double-deletion strain was generated from a cross between the two single-deletion strains and confirmed by PCR.
To measure gene expression driven by either the S. cerevisiae binding site or the mutated binding site, yeast cultures were grown overnight in complete minimal medium minus uracil and diluted to a starting OD600 of 0.05. Each construct was measured in selective media during mid-log phase growth. The Ndt80 binding sites were also measured after 10 h in 1% potassium acetate. The Msn2/4 binding sites were also measured following a heat shock of 1 h at 37 °C, or 8 h in media with no nitrogen source.
The 11 sites tested were selected before the final statistical tests were applied. As a consequence, two of the 6 Msn2/4 binding sites, in YAL008W and GSP2, had a posteriori probability under the neutral model of 0.005 < p < 0.01.
We downloaded the set of documented S. cerevisiae binding sites from the Yeastract database . Because only transcription factor promoter pairings are reported (e.g., transcription factor X regulates gene Y), we limited the analysis to the 654 promoters with only a single high-quality match (greater than the 25th percentile of the log-odds scores of the conserved binding sites) to the transcription factor's binding site.
Protocol S1. Additional Methods and Pseudocode
(49 KB DOC)
Table S1. Summary Table of the Results for Each of the 91 PWMs Examined
(1.3 MB XLS)
Table S2. TFBS Annotations in General Feature Format
(1.3 MB XLS)
We would like to thank A. Moses for making the source code for the MONKEY algorithm available, the Fay lab members and S. Eddy for helpful discussions about the implementation and interpretation of this work, and J. Dover and M. Johnston for providing the yeast deletion strains. SWD is supported by US National Science Foundation graduate fellowship DGE-0202737.
SWD and JCF conceived and designed the experiments. SWD performed the experiments, analyzed the data, and wrote the paper.
- 1. Wray GA, Hahn MW, Abouheif E, Balhoff JP, Pizer M, et al. (2003) The evolution of transcriptional regulation in eukaryotes. Mol Biol Evol 20: 1377–1419.
- 2. Whitehead A, Crawford DL (2006) Variation within and among species in gene expression: Raw material for evolution. Mol Ecol 15: 1197–1211.
- 3. Maroni G, Laurie-Ahlberg CC (1983) Genetic control of Adh expression in Drosophila melanogaster. Genetics 105: 921–933.
- 4. Schadt EE, Monks SA, Drake TA, Lusis AJ, Che N, et al. (2003) Genetics of gene expression surveyed in maize, mouse, and man. Nature 422: 297–302.
- 5. Brem RB, Yvert G, Clinton R, Kruglyak L (2002) Genetic dissection of transcriptional regulation in budding yeast. Science 296: 752–755.
- 6. Cheung VG, Spielman RS, Ewens KG, Weber TM, Morley M, et al. (2005) Mapping determinants of human gene expression by regional and genome-wide association. Nature 437: 1365–1369.
- 7. Wittkopp PJ, Haerum BK, Clark AG (2004) Evolutionary changes in cis and trans gene regulation. Nature 430: 85–88.
- 8. Segal JA, Schulte PM, Powers DA, Crawford DL (1996) Descriptive and functional characterization of variation in the Fundulus heteroclitus Ldh-B proximal promoter. J Exp Zool 275: 355–364.
- 9. Rockman MV, Wray GA (2002) Abundant raw material for cis-regulatory evolution in humans. Mol Biol Evol 19: 1991–2004.
- 10. Gompel N, Prud'homme B, Wittkopp PJ, Kassner VA, Carroll SB (2005) Chance caught on the wing: cis-Regulatory evolution and the origin of pigment patterns in Drosophila. Nature 433: 481–487.
- 11. Lerman DN, Michalak P, Helin AB, Bettencourt BR, Feder ME (2003) Modification of heat-shock gene expression in Drosophila melanogaster populations via transposable elements. Mol Biol Evol 20: 135–144.
- 12. Zimprich A, Kraus J, Woltje M, Mayer P, Rauch E, et al. (2000) An allelic variation in the human prodynorphin gene promoter alters stimulus-induced expression. J Neurochem 74: 472–477.
- 13. Hsia CC, McGinnis W (2003) Evolution of transcription factor function. Curr Opin Genet Dev 13: 199–206.
- 14. Gasch AP, Moses AM, Chiang DY, Fraser HB, Berardini M, et al. (2004) Conservation and evolution of cis-regulatory systems in ascomycete fungi. PLoS Biol 2: e398..
- 15. Yvert G, Brem RB, Whittle J, Akey JM, Foss E, et al. (2003) Trans-acting regulatory variation in Saccharomyces cerevisiae and the role of transcription factors. Nat Genet 35: 57–64.
- 16. Mitsialis SA, Kafatos FC (1985) Regulatory elements controlling chorion gene expression are conserved between flies and moths. Nature 317: 453–456.
- 17. Tautz D (2000) Evolution of transcriptional regulation. Curr Opin Genet Dev 10: 575–579.
- 18. McGregor AP, Shaw PJ, Dover GA (2001) Sequence and expression of the hunchback gene in Lucilia sericata: A comparison with other Dipterans. Dev Genes Evol 211: 315–318.
- 19. Wratten NS, McGregor AP, Shaw PJ, Dover GA (2006) Evolutionary and functional analysis of the tailless enhancer in Musca domestica and Drosophila melanogaster. Evol Dev 8: 6–15.
- 20. Emberly E, Rajewsky N, Siggia ED (2003) Conservation of regulatory elements between two species of Drosophila. BMC Bioinformatics 4: 57.
- 21. Dermitzakis ET, Clark AG (2002) Evolution of transcription factor binding sites in mammalian gene regulatory regions: Conservation and turnover. Mol Biol Evol 19: 1114–1121.
- 22. Dermitzakis ET, Bergman CM, Clark AG (2003) Tracing the evolutionary history of Drosophila regulatory regions with models that identify transcription factor binding sites. Mol Biol Evol 20: 703–714.
- 23. Ludwig MZ, Bergman C, Patel NH, Kreitman M (2000) Evidence for stabilizing selection in a eukaryotic enhancer element. Nature 403: 564–567.
- 24. Ruvinsky I, Ruvkun G (2003) Functional tests of enhancer conservation between distantly related species. Development 130: 5133–5142.
- 25. Dover G (2000) How genomic and developmental dynamics affect evolutionary processes. Bioessays 22: 1153–1159.
- 26. Stone JR, Wray GA (2001) Rapid evolution of cis-regulatory sequences via local point mutations. Mol Biol Evol 18: 1764–1770.
- 27. MacArthur S, Brookfield JF (2004) Expected rates and modes of evolution of enhancer sequences. Mol Biol Evol 21: 1064–1073.
- 28. Berg J, Willmann S, Lassig M (2004) Adaptive evolution of transcription factor binding sites. BMC Evol Biol 4: 42.
- 29. Sinha S, Siggia ED (2005) Sequence turnover and tandem repeats in cis-regulatory modules in Drosophila. Mol Biol Evol 22: 874–885.
- 30. Berg OG, von Hippel PH (1987) Selection of DNA binding sites by regulatory proteins. Statistical–mechanical theory and application to operators and promoters. J Mol Biol 193: 723–750.
- 31. Fields DS, He Y, Al-Uzri AY, Stormo GD (1997) Quantitative specificity of the Mnt repressor. J Mol Biol 271: 178–194.
- 32. Schneider TD, Stormo GD, Gold L, Ehrenfeucht A (1986) Information content of binding sites on nucleotide sequences. J Mol Biol 188: 415–431.
- 33. Gerland U, Hwa T (2002) On the selection and evolution of regulatory DNA motifs. J Mol Evol 55: 386–400.
- 34. Sengupta AM, Djordjevic M, Shraiman BI (2002) Specificity and robustness in transcription control networks. Proc Natl Acad Sci U S A 99: 2072–2077.
- 35. Mustonen V, Lassig M (2005) Evolutionary population genetics of promoters: Predicting binding sites and functional phylogenies. Proc Natl Acad Sci U S A 102: 15936–15941.
- 36. Bulmer M (1991) The selection–mutation–drift theory of synonymous codon usage. Genetics 129: 897–907.
- 37. Moses AM, Chiang DY, Pollard DA, Iyer VN, Eisen MB (2004) MONKEY: Identifying conserved transcription-factor binding sites in multiple alignments using a binding site-specific evolutionary model. Genome Biol 5: R98.
- 38. Moses AM, Pollard DA, Nix DA, Iyer VN, Li XY, et al. (2006) Large-scale turnover of functional transcription factor binding sites in Drosophila. PLoS Comput Biol 2.
- 39. Biggin MD, McGinnis W (1997) Regulation of segmentation and segmental identity by Drosophila homeoproteins: The role of DNA binding in functional activity and specificity. Development 124: 4425–4433.
- 40. Khaitovich P, Hellmann I, Enard W, Nowick K, Leinweber M, et al. (2005) Parallel patterns of evolution in the genomes and transcriptomes of humans and chimpanzees. Science 309: 1850–1854.
- 41. Giaever G, Chu AM, Ni L, Connelly C, Riles L, et al. (2002) Functional profiling of the Saccharomyces cerevisiae genome. Nature 418: 387–391.
- 42. Frazer KA, Tao H, Osoegawa K, de Jong PJ, Chen X, et al. (2004) Noncoding sequences conserved in a limited number of mammals in the SIM2 interval are frequently functional. Genome Res 14: 367–372.
- 43. Doniger SW, Huh J, Fay JC (2005) Identification of functional transcription factor binding sites using closely related Saccharomyces species. Genome Res 15: 701–709.
- 44. Harbison CT, Gordon DB, Lee TI, Rinaldi NJ, Macisaac KD, et al. (2004) Transcriptional regulatory code of a eukaryotic genome. Nature 431: 99–104.
- 45. Hertz GZ, Stormo GD (1999) Identifying DNA and protein patterns with statistically significant alignments of multiple sequences. Bioinformatics 15: 563–577.
- 46. Moses AM, Chiang DY, Kellis M, Lander ES, Eisen MB (2003) Position specific variation in the rate of evolution in transcription factor binding sites. BMC Evol Biol 3: 19.
- 47. Kellis M, Patterson N, Endrizzi M, Birren B, Lander ES (2003) Sequencing and comparison of yeast species to identify genes and regulatory elements. Nature 423: 241–254.
- 48. Pierce M, Benjamin KR, Montano SP, Georgiadis MM, Winter E, et al. (2003) Sum1 and Ndt80 proteins compete for binding to middle sporulation element sequences that control meiotic gene expression. Mol Cell Biol 23: 4814–4825.
- 49. Roth S, Kumme J, Schuller HJ (2004) Transcriptional activators Cat8 and Sip4 discriminate between sequence variants of the carbon source-responsive promoter element in the yeast Saccharomyces cerevisiae. Curr Genet 45: 121–128.
- 50. Tanay A (2006) Extensive low-affinity transcriptional interactions in the yeast genome. Genome Res 16: 962–972.
- 51. Zhang S, Burkett TJ, Yamashita I, Garfinkel DJ (1997) Genetic redundancy between SPT23 and MGA2: Regulators of Ty-induced mutations and Ty1 transcription in Saccharomyces cerevisiae. Mol Cell Biol 17: 4718–4729.
- 52. Piruat JI, Aguilera A (1998) A novel yeast gene, THO2, is involved in RNA pol II transcription and provides new evidence for transcriptional elongation-associated recombination. EMBO J 17: 4859–4872.
- 53. Deckert J, Torres AM, Hwang SM, Kastaniotis AJ, Zitomer RS (1998) The anatomy of a hypoxic operator in Saccharomyces cerevisiae. Genetics 150: 1429–1441.
- 54. Chu S, DeRisi J, Eisen M, Mulholland J, Botstein D, et al. (1998) The transcriptional program of sporulation in budding yeast. Science 282: 699–705.
- 55. Teixeira MC, Monteiro P, Jain P, Tenreiro S, Fernandes AR, et al. (2006) The YEASTRACT database: A tool for the analysis of transcription regulatory associations in Saccharomyces cerevisiae. Nucleic Acids Res 34: D446–D451.
- 56. Pollard DA, Bergman CM, Stoye J, Celniker SE, Eisen MB (2004) Benchmarking tools for the alignment of functional noncoding DNA. BMC Bioinformatics 5: 6.
- 57. Brudno M, Do CB, Cooper GM, Kim MF, Davydov E, et al. (2003) LAGAN and Multi-LAGAN: Efficient tools for large-scale multiple alignment of genomic DNA. Genome Res 13: 721–731.
- 58. MacIsaac KD, Wang T, Gordon DB, Gifford DK, Stormo GD, et al. (2006) An improved map of conserved regulatory sites for Saccharomyces cerevisiae. BMC Bioinformatics 7: 113.
- 59. Wray GA (2007) The evolutionary significance of cis-regulatory mutations. Nat Rev Genet 8: 206–216.
- 60. Hasegawa M, Kishino H, Yano T (1985) Dating of the human–ape splitting by a molecular clock of mitochondrial DNA. J Mol Evol 22: 160–174.
- 61. Kimura M (1962) On the probability of fixation of mutant genes in a population. Genetics 47: 713–719.
- 62. Halpern AL, Bruno WJ (1998) Evolutionary distances for protein-coding sequences: Modeling site-specific residue frequencies. Mol Biol Evol 15: 910–917.
- 63. Felsenstein J (1981) Evolutionary trees from DNA sequences: A maximum-likelihood approach. J Mol Evol 17: 368–376.
- 64. Yang Z (1997) PAML: A program package for phylogenetic analysis by maximum likelihood. Comput Appl Biosci 13: 555–556.
- 65. Myers AM, Tzagoloff A, Kinney DM, Lusty CJ (1986) Yeast shuttle and integrative vectors with multiple cloning sites suitable for construction of lacZ fusions. Gene 45: 299–310.