While genome-wide gene expression data are generated at an increasing rate, the repertoire of approaches for pattern discovery in these data is still limited. Identifying subtle patterns of interest in large amounts of data (tens of thousands of profiles) associated with a certain level of noise remains a challenge. A microarray time series was recently generated to study the transcriptional program of the mouse segmentation clock, a biological oscillator associated with the periodic formation of the segments of the body axis. A method related to Fourier analysis, the Lomb-Scargle periodogram, was used to detect periodic profiles in the dataset, leading to the identification of a novel set of cyclic genes associated with the segmentation clock. Here, we applied to the same microarray time series dataset four distinct mathematical methods to identify significant patterns in gene expression profiles. These methods are called: Phase consistency, Address reduction, Cyclohedron test and Stable persistence, and are based on different conceptual frameworks that are either hypothesis- or data-driven. Some of the methods, unlike Fourier transforms, are not dependent on the assumption of periodicity of the pattern of interest. Remarkably, these methods identified blindly the expression profiles of known cyclic genes as the most significant patterns in the dataset. Many candidate genes predicted by more than one approach appeared to be true positive cyclic genes and will be of particular interest for future research. In addition, these methods predicted novel candidate cyclic genes that were consistent with previous biological knowledge and experimental validation in mouse embryos. Our results demonstrate the utility of these novel pattern detection strategies, notably for detection of periodic profiles, and suggest that combining several distinct mathematical approaches to analyze microarray datasets is a valuable strategy for identifying genes that exhibit novel, interesting transcriptional patterns.
Citation: Dequéant M-L, Ahnert S, Edelsbrunner H, Fink TMA, Glynn EF, Hattem G, et al. (2008) Comparison of Pattern Detection Methods in Microarray Time Series of the Segmentation Clock. PLoS ONE 3(8): e2856. https://doi.org/10.1371/journal.pone.0002856
Editor: Raya Khanin, University of Glasgow, United Kingdom
Received: December 19, 2007; Accepted: April 26, 2008; Published: August 6, 2008
Copyright: © 2008 Dequéant et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was partially supported by DARPA grant HR 0011-05-1-0057. HE and YM mathematical work was supported by DARPA grant HR0011-05-1-0007. AS research was supported by a Lucent Technologies Bell Labs Graduate Research. Fellowship; AK and MR research was supported by NIH grant GM U54 GM74942; and SA research was supported by Association pour la Recherche sur le Cancer (ARC), France. OP, AM, MLD, EG and GH research was supported by the Stowers Institute for Medical Research. OP is a Howard Hughes Medical Institute Investigator.
Competing interests: Thomas M.A. Fink and Sebastian Ahnert have filed U.S. patent 20070086635, Method of identifying pattern in a series of data.
The dynamics of gene expression in a biological system exposed to varying experimental conditions, such as dose response to a drug or a time course, can be analyzed now at the whole genome level by generating series of microarrays or using massively parallel sequencing technologies. Each gene in the genome becomes associated with a set of expression values, called gene expression profile. The main challenge for the biologist is to identify, among the tens of thousands of gene expression profiles, trends or patterns revealing biological properties of the system that may lead to the formation of novel hypotheses. Some such patterns are easy to detect, e.g., when a gene is silent under most conditions but is actively transcribed under a subset of conditions. However, other patterns may be subtle and of unknown shape, as well as relatively noisy, so there is a continuous need for better methods of pattern detection in gene expression data.
Microarray time series have been extensively generated to study periodic biological processes, such as the cell cycle , circadian regulation , , the life cycle of malaria parasite in human blood  and vertebrae segmentation . In most of these cases, the periodic behavior observed at the macroscopic scale is associated with periodic changes in the level of multiple mRNAs. Several approaches have been used to identify genes whose periodic expression underlies the cellular- or tissue-level periodic behavior of the system. A common feature of these approaches is their strict assumptions about the shape of periodic profiles. For example, popular Fourier-based methods detect periodicity by decomposing gene expression profiles into a series of sine curves. However, these methods are less sensitive to many types of periodic profiles that are poorly approximated by sine curves (because of the noise in the experimental measurements or because periodic profiles might have a different shape, such as asymmetric profiles with short peak and long trough), introducing biases to the results. Moreover, little attention has been given to the possible presence of aperiodic, yet non-random, patterns of gene expression in the transcription program of periodic biological processes.
The segmentation of the vertebrate axis into periodic structures, such as vertebrae, occurs during embryogenesis when the vertebral precursors, the somites, are formed rhythmically from the presomitic mesoderm (PSM). This process is associated with a molecular oscillator, the segmentation clock, which drives periodic gene expression in the PSM with a period corresponding to that of somite formation , . During one somite formation (one clock cycle), cyclic genes, such as Lunatic fringe (Lfng), are expressed as a wave initiated in the posterior PSM that progressively migrates along the PSM and narrows as it moves anteriorly –. A microarray time series of PSM samples encompassing one period of the segmentation clock has been generated in the mouse and analyzed using the Lomb-Scargle (L) periodogram, a method related to Fourier analysis in that it attempts to fit the observed data to a sine curve ,  (Microarray data are available at ArrayExpress at www.ebi.ec.uk/arrayexpress/ under accession number E-TABM-163). This analysis identified a large number of novel cyclic genes that fall into two biologically coherent clusters oscillating in opposite phase, one of which is associated with the Wnt and the other with the Notch and FGF signaling pathways.
This paper is the result of a collaborative effort which occurred in the context of the Defense Advanced Research Projects Agency (DARPA) FUNBIO program that brought together mathematicians, physicists and biologists to evaluate novel mathematical approaches for biological data analysis. In this paper, we applied four different mathematical approaches to the same mouse segmentation dataset and compared the results to the original study. The four methods are: Phase consistency (P), Address reduction (A), Cyclohedron test (C), and Stable persistence (S). These methods can be divided into two groups. In the first group, the P and S methods  are hypothesis-driven and search for periodic profiles but in a very different way compared to the L method. The P method optimizes the ratio of the total variation to the sum of the piecewise variations, with the pieces set by the behavior of the known cyclic gene Lfng, and the S method is based on a numerical assessment that is provably stable (see Materials and Methods - “Pattern Detection Methods”). In the second group, the A ,  and C ,  methods are data-driven and attempt to identify significant patterns without assuming the periodic nature of the patterns of interest. Both methods associate significance inversely with the likelihood of certain groups of patterns but differ from each other in how they partition the set of all possible patterns into groups.
All methods identified previously known cyclic genes among their top ranked candidates and each method identified a number of novel candidate cyclic genes of the Wnt pathway. We show that one such gene, coding for the Wnt-target and Wnt-modulator cysteine rich protein 61 (Cyr61) identified by three of the methods, represents a novel bona fide cyclic gene of the mouse segmentation clock.
Results and Discussion
In this study, we used a microarray dataset generated in earlier work  to identify cyclic genes associated with the mouse segmentation clock. A microarray time series was generated by collecting the PSM tissue from 17 embryos (17 time points) along the clock cycle and analyzed using L analysis  that focuses on the genes whose expression patterns display the best fit to a sine curve . This led to identification of 27 strongly periodic probe sets (corresponding to 25 genes), including seven cyclic genes whose cyclic expression pattern had been discovered earlier by in situ hybridization –, – and 20 more probe sets that subsequently were experimentally validated by in situ hybridization after L analysis  (Supplementary Information, Table S1).
In this study, we used the four methods (P, A, C and S) to rank the 7,549 probe sets of the same dataset in order of the significance of their expression profile (as defined by each method (see Materials and Methods - “Pattern Detection Methods”). We selected the top 300 ranked probe sets from each list (Supplementary Information, Tables S2, S3, S4, S5 and S6). First, we compared the rank of the seven known cyclic genes that were independently identified from non-microarray experimental methods. The L, P, A and S methods each identified at least five out of the seven benchmark genes in the top ranked 100 probe sets; whereas, C identified three of the seven known genes (Figure 1A). To measure the performance to a higher resolution, we repeated this analysis using a larger collection of 27 probe sets experimentally validated . As indicated in Figure 1B, method S performs best by identifying 90% of the benchmark probesets, followed by methods A and P (approximately 75% and 63%, respectively) and C (approximately 37%). Among the top 10 probe sets of each list, the methods perform similarly by ranking among them from four to five benchmark probesets. Thus, all methods, whether or not designed to detect specifically periodic patterns, identified cyclic genes from among their top ranked candidates. This suggests that periodic patterns of gene expression are predominant among all non-random patterns in this dataset, which is consistent with the experimental design of the time series generation. Indeed, due to technical issues, the right PSM samples of the time series were dissected from mouse embryos belonging to five consecutive somite cycles, and they were ordered based on their phase of Lfng expression pattern (revealed by in situ hybridization on the left PSM of each dissected mouse embryo) to reconstitute a unique oscillation cycle . One of the consequences of this strategy is that the collapsed dataset generated by this procedure preserves periodic patterns associated with the segmentation clock, while it may affect most other patterns (such as a linear increase with developmental time).
(A) Benchmark genes are composed of cyclic genes identified independently from the Lomb-Scargle (L) analysis (seven probe sets). (B) Benchmark genes also include cyclic genes identified by the L analysis and experimentally validated (27 probe sets). L, Lomb-Scargle analysis; P, Phase consistency; A, Address reduction; C, Cyclohedron test; S, Stable persistence.
We next compared the intersection of the top 300 ranked probe sets from the four methods and method L. This is represented in Figure 2A as a five-set Venn diagram in which each color corresponds to a different method and in Figure 2B as a Haase diagram in the form of the lattice of the subsets of a five-element set. The total number of distinct probe sets in all of the five sets (the union) is 884; the total number in each of the five sets (the intersection) is 21. The overlap contains eight true positive cyclic genes (Supplementary Information, Table S7). Many candidate genes were identified by only one, two, three or four methods. The L, P and C methods identified larger numbers of unique genes (104, 160 and 154, respectively) compared to method A (67) and method S (47) (Figure 2). Although it is not possible to know whether all the uniquely predicted genes are associated with the segmentation clock, many of them are biologically plausible since they are associated with the Wnt pathway.
(A) Venn diagram. (B) Haase diagram shows the pairwise intersection of two lists, the triple intersection of three lists, and so on. The total number of distinct probe sets in all of the five top 300 lists (the union) is 884; the total number in each of the five sets (the intersection) is 21. L, Lomb-Scargle analysis; P, Phase consistency; A, Address reduction; C, Cyclohedron test; S, Stable persistence.
We then studied the possible biological links of the top 300 genes predicted by each method to the segmentation clock process. Most of the validated cyclic genes (22 probesets or 20 genes) identified in the top 38 probesets list of the original L analysis are associated with the Notch-, FGF- and Wnt-signaling pathways and organized in two clusters . In the first cluster, almost one half of the genes are associated with the Notch- and FGF-signaling pathways. The second cluster shows an even more striking biological coherence with more than 90% of the genes linked to Wnt signaling. To test the biological relevance of the predictions of each method, we investigated their ability to identify novel cyclic candidates associated with Wnt signaling. We first independently clustered the top 300 gene expression profiles identified by the P, A, C, S and L methods (Figure 3; Supplementary Information, Table S8, S9, S10, S11 and S12 and Materials and Methods). While the L and S methods identified periodic patterns oscillating in different phases, the P, A and C methods also identified a larger variety of patterns (illustrated by higher numbers of clusters). Dimensionality analysis, inferred from principal component analysis (Materials and Methods; Figure S1) of the corresponding top 300 probeset lists, is in agreement with these observations. The highest numbers of degrees of freedom (between four and six) found for C and A stem from the uninformed priors used in these methods, allowing for discovery of unrestricted profile shapes. In contrast, the other methods are characterized by smaller numbers of degrees of freedom: L had only two significant degrees of freedom, corresponding to sine and cosine of the main harmonic oscillation; S had two strong sin-cos components, plus two additional, presumably related to shape parameters; and finally, P showed three degrees of freedom (corresponding to the difference between phases 1 and 3, the difference between phases 2 and 3, and the variation within phase 3).
K-means clustering was applied as described in the Materials and Methods section. The “Notch” and “Wnt” clusters contain validated cyclic genes regulated by the Notch and Wnt pathways, respectively. Blue, decrease in gene expression; yellow, increase in gene expression. Wnt clusters are boxed in red.
In each of the five analyses, we identified a cluster of periodic profiles containing the known cyclic genes Axin2, dickkopf homolog 1 (Dkk1), myelocytomatosis oncogene (c-Myc) and dapper homolog (Dact1) of the Wnt pathway (Figure 3 [red boxes]; Figure 4; Table 1). Given the very tight biological coherence of the Wnt cluster identified by the L method and according to the principle of “guilt by association,” it is likely that other gene members of the cluster also belong to the Wnt pathway. We find that the S method identifies the eight known members of the Wnt cluster previously identified by the L method and validated as described , while the P and A methods identify six out of eight, and the C method identifies five out of eight of the known Wnt cyclic genes. We further analyzed the novel candidate cyclic genes contained in each of the Wnt clusters through a literature search to investigate their potential link to Wnt signaling (Table 1). The PubMed database was searched for each of the 142 genes in the Wnt clusters to identify articles indicating a link between these genes and the Wnt pathway. The results indicated some articles containing the two search terms: the “gene name” and “Wnt.” Manual curation of these results was necessary to verify the biological connection between each gene and the Wnt pathway. The search of the PubMed database was automated using the MedlineR library  for the R statistical language. The number of matches for each pair of search terms was returned, as well as a link to the abstracts for each match. Thirteen genes were identified as novel Wnt cyclic gene candidates (Table 1).
Blue, decrease in gene expression; yellow, increase in gene expression.
This allowed us to identify six novel candidate genes in the L-Wnt cluster showing a link to the Wnt pathway. These include the genes Cyr61 , homeo box B1 (Hoxb1) , rhodopsin (Rho) , SPEN homolog, transcriptional regulator (Drosophila), (Spen)  and fibroblast growth factor 9 (Fgf9)  which were all previously identified as Wnt targets. Interestingly, the P method performs similarly to the L method by predicting six new candidates (although only two are common with those predicted by L), while A, S and C methods predict two, two and three additional members, respectively. Most of the Wnt cyclic gene candidates predicted by the L method are also predicted by at least one of the other methods. In contrast, the P and C methods identify the largest numbers of putative Wnt pathway candidates that are not predicted by any other method.
One of the candidates, Cyr61 (Figure 5A–E), a well known Wnt target  which codes for a modulator of the Wnt-signaling pathway  that had not been identified in the original analysis , was identified by three of the methods. We experimentally investigated the expression pattern of this gene by in situ hybridization in the PSM of mouse embryos (Figure 5B–E) and indeed, observed a dynamic pattern of expression in the posterior PSM that was reminiscent of the typical expression of a cyclic gene; hence, validating it as a novel cyclic gene and extending the list of known cyclic genes associated with the Wnt pathway. More generally, the other Wnt cyclic gene candidates identified by the different methods are attractive, potential new cyclic genes involved in the mouse segmentation clock and would deserve to be further experimentally validated. Interestingly, the gastrulation brain homeobox 2 (Gbx2) gene predicted by method C and which is a target of Wnt signaling, was reported to be expressed in the PSM , .
(A) Gene expression profiles (in log2 ratio of Cyr61) represented by two probe sets and the benchmark Wnt-cyclic gene Axin2. (B–E) Experimental validation by in situ hybridization. (B, C) Lateral views of the tails of 9.0 dpc mouse embryos hybridized with the Cyr61 probe. (D, E) are schematic representations of (B) and (C), respectively, and illustrate the dynamic expression of the gene in the presomitic mesoderm. Arrows in all four panels indicate the posterior boundary of the last formed somite (SI).
An interesting feature common to the A, C and S methods is that they work on the ranked data as opposed to the raw amplitudes of the signal. In other words, the signal intensities that describe over time the expression of a gene are sorted by magnitude, and each signal intensity is then replaced by the integer rank within this sorted order. Thus, each gene expression profile is represented by a permutation that is invariant over the transformations of monotonically increasing functions (such as log or taking the square) and is much more mathematically tractable. These methods offer a particular advantage for the analysis of this segmentation clock time series in which only the ordering of the time points could be estimated, but not the exact time interval in between. These methods, based on the rank permutation, do not require such precise timing information. These methods perform similarly to the L and P methods, which use the raw signal intensities. This suggests that moving to ranked data despite losing some information (like fold change), might be advantageous in certain cases, especially when these methods are not based on a priori biological knowledge, making them promising exploratory tools to discover novel, interesting transcriptional patterns in large-scale expression analysis.
Materials and Methods
Description of the starting microarray dataset
Microarray data, available at ArrayExpress at www.ebi.ec.uk/arrayexpress/ under accession number E-TABM-163, were normalized as described  and filtered based on detection call (by removing the probe sets called “absent” throughout the experiment), signal intensity (by removing genes with low-maximum expression level <50) and amplitude (by eliminating peak-to-trough variation <1.65). After these filters, the dataset consisted of 7,549 probe sets.
Pattern Detection Methods
Here we describe the four methods used in the analysis of the mouse segmentation clock: Phase consistency (P), Address reduction (A), Cyclohedron test (C) and Stable persistence (S). For further details, we refer the reader to papers describing each individual method. A description of the Lomb-Scargle method (L), previously used to study the mouse segmentation clock in  can be found in . In contrast to experiments exhibiting two or more periods, which are well suited to Fourier analysis and related methods (see, e.g.,), the mouse embryo data in this paper represents only a single period. The analysis of this system is therefore particularly challenging and requires novel approaches.
The methods A, C and S begin by converting the raw data into rank order, which we explain here. Each gene is characterized by its expression profile, which is a function f whose values are given at N = 17 distinct time points. In the raw data, these values fi, for 1≤i≤N, are real numbers quantifying the amount of expression as measured by the microarray. We sort the values and replace each fi by its rank within this sorted order. For example, the values (0.41, 0.63, 0.11, 0.23, 0.59) would be replaced by (3, 5, 1, 2, 4). The function f is thus replaced by a permutation which we denote π(f) and the ith element of π is πi. Ramifications of this step are provided in the Discussion.
All four methods associate with each gene expression profile a number μ(f). This number is used to rank the probe sets in order of significance (as defined by each method).
Phase consistency (P).
This method is unique in that it looks directly at the raw data (f rather than π(f)) and uses information that is specific to the mouse embryo experiment. Specifically, it was observed that the expression of the gene Lfng suggests a decomposition into three phases comprising the first four, the next five and the last eight measurements in each time series. To make the phase lengths more equal in size, we further divided the last phase into two subphases, each comprising four measurements. Measurements were assigned to the respective subphases according to their projection onto the main principal component of the data in the eight-dimensional space. The periodicity of a function f is assessed by comparing the overall standard deviation with the sum of the normalized standard deviations of the four phases.
Mathematical description— First we normalize the function values to zero average and unit variance: xi = (fi−avg)/var1/2, where and . By construction, the standard deviation of the normalized values is . The estimated population standard deviations of the four phases are denoted by σi. The measure used by P is thenOrdering by decreasing μP prioritizes profiles which exhibit a high global variation and low local variation.
Address reduction (A).
This method is based on the idea of algorithmic information content, also known as Kolmogorov complexity. In its original form, the Kolmogorov complexity is the length, in bits, of the shortest description of a data string given some universal computer. Address reduction bounds the Kolmogorov complexity of a gene expression profile and uses this to determine how much a curve can be compressed, measured in bits. This method works with the ranked data π(f), and the bound is calculated by dividing the address of the rank permutation into two parts: a coarse address (a block) and a fine address (the permutation within the block).
Mathematical description—We first partition the space of permutations into blocks using some blocking function γA that maps each permutation to a real number; permutations with the same number are in the same block. Second, we base the measure of an expression profile f on the size of the block that contains it, and the total number of possible blocks. Then the number of bits μA(f) that f can be compressed iswhere is the set of permutations mapping to the same block as π(f) and Im(γA), the image of γA, is the set of possible values that the blocking function can take on. The vertical bars denote the number of elements in the set shown between them. Subtracting the logarithm of the image size allows comparison between different blocking functions and curves with different numbers of data points, which we do not consider here. In the application to the mouse embryo data, we use what is sometimes called the bounded variation, , where πi is the rank of fi in the sorted order (see Figure 6 left for an example). Other blocking functions can be used: see Figure 1 right and , as well as the discussions of the methods C and S. Further details about address reduction can be found in , .
The tree representations of the block structures for the blocking functions γΔ1 (left) and γ+− (right) (γ+− is the number of permutations with a given sequence of rises and falls ). Locating a given curve using the two-part address is equivalent to starting at the centre of the tree (A) and finding a particular exit at the edge (e.g., B). Address reduction μA gives the reduction in information, measured in bits, to get from A to some B, compared to the information needed to locate B explicitly. In the case above, the endpoint B, being in a block of four, could correspond to the permutation (4, 5, 3, 2, 1) (this and three other permutations have γΔ1 = 5). To find it, someone starting at A would require log2 8+log2 4 = 5 bits of information (8 paths to choose from, then 4 paths to choose from), which is μA = 1.91 bits less than that required to transmit (4, 5, 3, 2, 1) explicitly, namely, log2 5!.
Cyclohedron test (C).
This method is a non-parametric test that determines the significance of each expression profile based on its topography. In addition, p-values are computed for groups of highest ranked genes. Similar to A, the score in C is derived from the ranked data π(f). It involves a partition of the set of patterns, and ascribes higher biological significance to patterns in small blocks of the partition. However, the details of C and A are quite different.
Mathematical description—This method is a non-parametric test that is based on the significance of a topographical map constructed from a permutation. The topographical map is obtained by encircling the vertices of a cycle in decreasing order of their corresponding raw data vector coordinates. Denoting the first circle by the set σ1, the second by σ2, and so on, the circles are constructed according to the following provision: in order to encircle the vertex δi, if it is adjacent to some vertex j which has already been encircled by some σk, then σi must contain the σk circle. Figure 7 depicts the beginning of the creation of such a topographical map.
Displayed at the top are the formations of the first two circles σi, and at the bottom are the third and fourth, for an example with N = 11.
The score μC(f) assigned to the raw data vector f is the number of permutations that have the same topographical map as the permutation π(f); this score is called the permutation count. Data vectors with small permutation counts are deemed significant, because it is unlikely that a random permutation will have a topographical map shared by few permutations. A full description of the cyclohedron test, including a method for computing p-values, appears in . Connections to algebraic combinatorics are discussed in .
Stable persistence (S).
In contrast to A and C, this method assesses the biological significance of an expression pattern directly from the corresponding permutation π(f), without calculating block sizes of the implied partition. The main focus is to use a measure that is stable under small perturbations of the gene expression profile.
Mathematical description—Each expression pattern corresponds to one period of somitogenesis. We represent this period by a circle and denote time points where expression levels were measured by xi, 1≤i≤N. Since these times are unknown, we choose the N points xi at regular intervals during the period, that is, , and define g(xi) = (πi−1)/(N−1), where πi is the rank of fi in the sorted ordering, as before. Values of g(x) at other points of the circle are obtained by linear interpolation. Notice that the normalization constant 1/(N−1) guarantees that 0≤g(x)≤1.
Given a threshold t, the sublevel set g−1[0, t] consists of all points x of the circle with g(x)≤t. In other words, it contains all the time intervals during which the (modified) expression level is below t. As we increase the threshold from 0 to 1, the sublevel set grows until it eventually covers the entire circle. A birth event corresponds to t passing the function value of a minimum, at which time a new interval is added to the sublevel set. A death event corresponds to t passing the value of a maximum, at which time the sublevel set merges two intervals into one or, at the last and global maximum, it closes up to form the complete circle. Using this process we form a canonical pairing in which each minimum is matched with the maximum that merges its interval with another interval started by an earlier minimum; see  and Figure 8.
After matching the global minimum with the global maximum we exhausted all minima and maxima and completed the construction of the canonical pairing. The persistence of a min-max pair (xi, xj) is the difference between the function values pers(i, j) = g(xj)−g(xi), which is necessarily positive. Pairs with small persistence correspond to small local variations of the expression profile, while pairs with large persistence correspond to significant oscillations. We note that the sum of persistences is equal to half the bounded variation used in A, except that there the domain is taken as the interval rather than the circle. For each non-negative integer p, we define the order-p measure as the sum of the p-th powers of the persistences over all min-max pairs. (Incidentally, the blocking functions γA and γC are related to the order-1 measure.) As proved in , this measure is stable for p≥2 and unstable for p equal to 0 or 1. Method S uses the order-2 measure, since two is the smallest integer power that implies stability. Thus,Further details about stable persistence can be found in , .
The 300 top ranked expression profiles of each method were clustered using K-means based on the Pearson correlation distance in MultiExperiment Viewer (MEV) software. The optimal number of clusters was determined using the Figure of Merit (FOM) function  in the MEV package that provides a measure of the fit of the expression patterns for the clusters produced by K-means.
Effective dimensionality, or number of degrees of freedom of the five “top 300” datasets (Figure S1) can be inferred from Principal Component Analysis (see e.g., ). The transcription profiles have been normalized to zero average and unit variance. Then, principal components have been computed for each of the sets of 300 points (top 300 from each method). Intrinsic dimensions in each set were considered significant until differences in log residual variance drop and converge towards the common noise level.
The candidate cyclic gene Cyr61 was experimentally validated by whole mount in situ hybridization that was performed as described  on 9.0 dpc mouse embryos using expressed sequence tag (ESTs) from Image clone 5716887 as a probe for Cyr61.
The NCBI EntrezGene (http://www.ncbi.nlm.nih.gov/sites/entrez/query.fcgidbgene) accession numbers for the genes discussed in this paper are Axin2 (12006), c-Myc (17869), Cyr61 (16007), Dact1 (59036), Dkk1 (13380), Fgf9 (14180), Gbx2 (14472), Hoxb1 (15407), Lfng (16848), Rho (212541) and Spen (56381).
The authors thank Z. Otwinowski for helpful discussions, J. Chatfield for editorial assistance and S. Esteban for artwork.
Performed the experiments: MLD. Analyzed the data: MLD. Wrote the paper: MLD HE TMAF GH AK AM MR OP. Prepared the microarray data: MD. Conceived, designed and implemented the algorithm of the Address reduction method: SA TMAF. Conceived and designed the algorithm of the Stable persistence method: HE YM. Implemented the algorithm of the Lomb Scargle method: EFG. Implemented the automated PubMed Search: GH. Conceived, designed and implemented the algorithm of the Phase consistency method: AK MR. Conceived, designed and implemented the algorithm of the Cyclohedron test method: JM AS. Conceived and designed the algorithm of the Cyclohedron test method: LP BS.
- 1. Spellman PT, Sherlock G, Zhang MQ, Iyer VR, Anders K, et al. (1998) Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. Mol Biol Cell 9: 3273–3297.PT SpellmanG. SherlockMQ ZhangVR IyerK. Anders1998Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization.Mol Biol Cell932733297
- 2. McDonald MJ, Rosbash M (2001) Microarray analysis and organization of circadian gene expression in Drosophila. Cell 107: 567–578.MJ McDonaldM. Rosbash2001Microarray analysis and organization of circadian gene expression in Drosophila.Cell107567578
- 3. Claridge-Chang A, Wijnen H, Naef F, Boothroyd C, Rajewsky N, et al. (2001) Circadian regulation of gene expression systems in the Drosophila head. Neuron 32: 657–671.A. Claridge-ChangH. WijnenF. NaefC. BoothroydN. Rajewsky2001Circadian regulation of gene expression systems in the Drosophila head.Neuron32657671
- 4. Bozdech Z, Llinas M, Pulliam BL, Wong ED, Zhu J, et al. (2003) The Transcriptome of the Intraerythrocytic Developmental Cycle of Plasmodium falciparum. PLoS Biol 1: E5.Z. BozdechM. LlinasBL PulliamED WongJ. Zhu2003The Transcriptome of the Intraerythrocytic Developmental Cycle of Plasmodium falciparum.PLoS Biol1E5
- 5. Dequeant ML, Glynn E, Gaudenz K, Wahl M, Chen J, et al. (2006) A complex oscillating network of signaling genes underlies the mouse segmentation clock. Science 314: 1595–1598.ML DequeantE. GlynnK. GaudenzM. WahlJ. Chen2006A complex oscillating network of signaling genes underlies the mouse segmentation clock.Science31415951598
- 6. Palmeirim I, Henrique D, Ish-Horowicz D, Pourquié O (1997) Avian hairy gene expression identifies a molecular clock linked to vertebrate segmentation and somitogenesis. Cell 91: 639–648.I. PalmeirimD. HenriqueD. Ish-HorowiczO. Pourquié1997Avian hairy gene expression identifies a molecular clock linked to vertebrate segmentation and somitogenesis.Cell91639648
- 7. Dequeant ML, Pourquie O (2008) Segmental patterning of the vertebrate embryonic axis. Nat Rev Genet 9: 370–382.ML DequeantO. Pourquie2008Segmental patterning of the vertebrate embryonic axis.Nat Rev Genet9370382
- 8. McGrew MJ, Dale JK, Fraboulet S, Pourquie O (1998) The lunatic fringe gene is a target of the molecular clock linked to somite segmentation in avian embryos. Curr Biol 8: 979–982.MJ McGrewJK DaleS. FrabouletO. Pourquie1998The lunatic fringe gene is a target of the molecular clock linked to somite segmentation in avian embryos.Curr Biol8979982
- 9. Aulehla A, Johnson RL (1999) Dynamic expression of lunatic fringe suggests a link between notch signaling and an autonomous cellular oscillator driving somite segmentation. Dev Biol 207: 49–61.A. AulehlaRL Johnson1999Dynamic expression of lunatic fringe suggests a link between notch signaling and an autonomous cellular oscillator driving somite segmentation.Dev Biol2074961
- 10. Forsberg H, Crozet F, Brown NA (1998) Waves of mouse Lunatic fringe expression, in four-hour cycles at two-hour intervals, precede somite boundary formation. Curr Biol 8: 1027–1030.H. ForsbergF. CrozetNA Brown1998Waves of mouse Lunatic fringe expression, in four-hour cycles at two-hour intervals, precede somite boundary formation.Curr Biol810271030
- 11. Glynn EF, Chen J, Mushegian AR (2006) Detecting periodic patterns in unevenly spaced gene expression time series using Lomb-Scargle periodograms. Bioinformatics 22: 310–316.EF GlynnJ. ChenAR Mushegian2006Detecting periodic patterns in unevenly spaced gene expression time series using Lomb-Scargle periodograms.Bioinformatics22310316
- 12. Edelsbrunner H, Letscher D, Zomorodian A (2002) Topological persistence and simplification. Discrete Comput Geom 28: 511–533.H. EdelsbrunnerD. LetscherA. Zomorodian2002Topological persistence and simplification.Discrete Comput Geom28511533
- 13. Ahnert SE, Fink TMA (2006) New distance measure for microarray data series based on unbiased pattern detection. Bioinformatics 1–4.SE AhnertTMA Fink2006New distance measure for microarray data series based on unbiased pattern detection.Bioinformatics14
- 14. Fink TM, Brown FCS, Willbrand K (2007) 1-D random landscapes and non-random data series. Europhysics Letters (EPL) 79: 38006.TM FinkFCS BrownK. Willbrand20071-D random landscapes and non-random data series.Europhysics Letters (EPL)7938006
- 15. Morton J, Pachter L, Shiu A, Sturmfels B (2007) The cyclohedron test for finding periodic genes in time course expression studies. Stat Appl Genet Mol Biol 6: Article 21.J. MortonL. PachterA. ShiuB. Sturmfels2007The cyclohedron test for finding periodic genes in time course expression studies.Stat Appl Genet Mol Biol6Article 21
- 16. Morton J, Pachter L, Shiu A, Sturmfels B, Wienand O (2006) Geometry of rank tests. J. MortonL. PachterA. ShiuB. SturmfelsO. Wienand2006Geometry of rank tests.Proceedings of the conference Probabilistic Graphical Models (PGM 3), Prague, Czech Republic, September 2006, available from ArXiv:math.ST/0605173. Proceedings of the conference Probabilistic Graphical Models (PGM 3), Prague, Czech Republic, September 2006, available from ArXiv:math.ST/0605173.
- 17. Aulehla A, Wehrle C, Brand-Saberi B, Kemler R, Gossler A, et al. (2003) Wnt3a plays a major role in the segmentation clock controlling somitogenesis. Dev Cell 4: 395–406.A. AulehlaC. WehrleB. Brand-SaberiR. KemlerA. Gossler2003Wnt3a plays a major role in the segmentation clock controlling somitogenesis.Dev Cell4395406
- 18. Suriben R, Fisher DA, Cheyette BN (2006) Dact1 presomitic mesoderm expression oscillates in phase with Axin2 in the somitogenesis clock of mice. Dev Dyn 235: 3177–3183.R. SuribenDA FisherBN Cheyette2006Dact1 presomitic mesoderm expression oscillates in phase with Axin2 in the somitogenesis clock of mice.Dev Dyn23531773183
- 19. Jouve C, Palmeirim I, Henrique D, Beckers J, Gossler A, et al. (2000) Notch signalling is required for cyclic expression of the hairy-like gene HES1 in the presomitic mesoderm. Development 127: 1421–1429.C. JouveI. PalmeirimD. HenriqueJ. BeckersA. Gossler2000Notch signalling is required for cyclic expression of the hairy-like gene HES1 in the presomitic mesoderm.Development12714211429
- 20. Ishikawa A, Kitajima S, Takahashi Y, Kokubo H, Kanno J, et al. (2004) Mouse Nkd1, a Wnt antagonist, exhibits oscillatory gene expression in the PSM under the control of Notch signaling. Mech Dev 121: 1443–1453.A. IshikawaS. KitajimaY. TakahashiH. KokuboJ. Kanno2004Mouse Nkd1, a Wnt antagonist, exhibits oscillatory gene expression in the PSM under the control of Notch signaling.Mech Dev12114431453
- 21. Leimeister C, Dale K, Fischer A, Klamt B, Hrabe de Angelis M, et al. (2000) Oscillating expression of c-hey2 in the presomitic mesoderm suggests that the segmentation clock may use combinatorial signaling through multiple interacting bHLH factors. Dev Biol 227: 91–103.C. LeimeisterK. DaleA. FischerB. KlamtM. Hrabe de Angelis2000Oscillating expression of c-hey2 in the presomitic mesoderm suggests that the segmentation clock may use combinatorial signaling through multiple interacting bHLH factors.Dev Biol22791103
- 22. Dunwoodie SL, Clements M, Sparrow DB, Sa X, Conlon RA, et al. (2002) Axial skeletal defects caused by mutation in the spondylocostal dysplasia/pudgy gene Dll3 are associated with disruption of the segmentation clock within the presomitic mesoderm. Development 129: 1795–1806.SL DunwoodieM. ClementsDB SparrowX. SaRA Conlon2002Axial skeletal defects caused by mutation in the spondylocostal dysplasia/pudgy gene Dll3 are associated with disruption of the segmentation clock within the presomitic mesoderm.Development12917951806
- 23. Lin SM, McConnell P, Johnson KF, Shoemaker J (2004) MedlineR: an open source library in R for Medline literature data mining. Bioinformatics 20: 3659–3661.SM LinP. McConnellKF JohnsonJ. Shoemaker2004MedlineR: an open source library in R for Medline literature data mining.Bioinformatics2036593661
- 24. Latinkic BV, Mercurio S, Bennett B, Hirst EM, Xu Q, et al. (2003) Xenopus Cyr61 regulates gastrulation movements and modulates Wnt signalling. Development 130: 2429–2441.BV LatinkicS. MercurioB. BennettEM HirstQ. Xu2003Xenopus Cyr61 regulates gastrulation movements and modulates Wnt signalling.Development13024292441
- 25. Lickert H, Cox B, Wehrle C, Taketo MM, Kemler R, et al. (2005) Dissecting Wnt/beta-catenin signaling during gastrulation using RNA interference in mouse embryos. Development 132: 2599–2609.H. LickertB. CoxC. WehrleMM TaketoR. Kemler2005Dissecting Wnt/beta-catenin signaling during gastrulation using RNA interference in mouse embryos.Development13225992609
- 26. Malliri A, Collard JG (2003) Role of Rho-family proteins in cell adhesion and cancer. Curr Opin Cell Biol 15: 583–589.A. MalliriJG Collard2003Role of Rho-family proteins in cell adhesion and cancer.Curr Opin Cell Biol15583589
- 27. Feng Y, Bommer GT, Zhai Y, Akyol A, Hinoi T, et al. (2007) Drosophila split ends homologue SHARP functions as a positive regulator of Wnt/beta-catenin/T-cell factor signaling in neoplastic transformation. Cancer Res 67: 482–491.Y. FengGT BommerY. ZhaiA. AkyolT. Hinoi2007Drosophila split ends homologue SHARP functions as a positive regulator of Wnt/beta-catenin/T-cell factor signaling in neoplastic transformation.Cancer Res67482491
- 28. Schwartz DR, Wu R, Kardia SL, Levin AM, Huang CC, et al. (2003) Novel candidate targets of beta-catenin/T-cell factor signaling identified by gene expression profiling of ovarian endometrioid adenocarcinomas. Cancer Res 63: 2913–2922.DR SchwartzR. WuSL KardiaAM LevinCC Huang2003Novel candidate targets of beta-catenin/T-cell factor signaling identified by gene expression profiling of ovarian endometrioid adenocarcinomas.Cancer Res6329132922
- 29. Si W, Kang Q, Luu HH, Park JK, Luo Q, et al. (2006) CCN1/Cyr61 is regulated by the canonical Wnt signal and plays an important role in Wnt3A-induced osteoblast differentiation of mesenchymal stem cells. Mol Cell Biol 26: 2955–2964.W. SiQ. KangHH LuuJK ParkQ. Luo2006CCN1/Cyr61 is regulated by the canonical Wnt signal and plays an important role in Wnt3A-induced osteoblast differentiation of mesenchymal stem cells.Mol Cell Biol2629552964
- 30. Kudlicki A, Rowicka M, Otwinowski Z (2007) SCEPTRANS: an online tool for analyzing periodic transcription in yeast. Bioinformatics 23: 1559–1561.A. KudlickiM. RowickaZ. Otwinowski2007SCEPTRANS: an online tool for analyzing periodic transcription in yeast.Bioinformatics2315591561
- 31. Ahnert SE, Willbrand K, Brown FC, Fink TM (2006) Unbiased pattern detection in microarray data series. Bioinformatics 22: 1471–1476.SE AhnertK. WillbrandFC BrownTM Fink2006Unbiased pattern detection in microarray data series.Bioinformatics2214711476
- 32. Cohen-Steiner D, Edelsbrunner H, Harer J, Mileyko Y (2007) Lipschitz functions have Lp-stable persistence, manuscript, Department of Computer Science, Duke University, Durham, North Carolina. D. Cohen-SteinerH. EdelsbrunnerJ. HarerY. Mileyko2007Lipschitz functions have Lp-stable persistence, manuscript, Department of Computer Science, Duke University, Durham, North Carolina
- 33. Yeung KY, Haynor DR, Ruzzo WL (2001) Validating clustering for gene expression data. Bioinformatics 17: 309–318.KY YeungDR HaynorWL Ruzzo2001Validating clustering for gene expression data.Bioinformatics17309318
- 34. Clewley RH, Guckenheimer JM, Valero-Cuevas FJ (2008) Estimating effective degrees of freedom in motor systems. IEEE Trans Biomed Eng 55: 430–442.RH ClewleyJM GuckenheimerFJ Valero-Cuevas2008Estimating effective degrees of freedom in motor systems.IEEE Trans Biomed Eng55430442
- 35. Henrique D, Adam J, Myat A, Chitnis A, Lewis J, et al. (1995) Expression of a Delta homologue in prospective neurons in the chick. Nature 375: 787–790.D. HenriqueJ. AdamA. MyatA. ChitnisJ. Lewis1995Expression of a Delta homologue in prospective neurons in the chick.Nature375787790