Advances in “omics” technologies have revolutionized the collection of biological data. A matching revolution in our understanding of biological systems, however, will only be realized when similar advances are made in informatic analysis of the resulting “big data.” Here, we compare the capabilities of three conventional and novel statistical approaches to summarize and decipher the tomato metabolome.
Principal component analysis (PCA), batch learning self-organizing maps (BL-SOM) and weighted gene co-expression network analysis (WGCNA) were applied to a multivariate NMR dataset collected from developmentally staged tomato fruits belonging to several genotypes. While PCA and BL-SOM are appropriate and commonly used methods, WGCNA holds several advantages in the analysis of highly multivariate, complex data.
PCA separated the two major genetic backgrounds (AC and NC), but provided little further information. Both BL-SOM and WGCNA clustered metabolites by expression, but WGCNA additionally defined “modules” of co-expressed metabolites explicitly and provided additional network statistics that described the systems properties of the tomato metabolic network. Our first application of WGCNA to tomato metabolomics data identified three major modules of metabolites that were associated with ripening-related traits and genetic background.
Citation: DiLeo MV, Strahan GD, den Bakker M, Hoekenga OA (2011) Weighted Correlation Network Analysis (WGCNA) Applied to the Tomato Fruit Metabolome. PLoS ONE6(10): e26683. https://doi.org/10.1371/journal.pone.0026683
Editor: Peter Csermely, Semmelweis University, Hungary
Received: July 19, 2011; Accepted: October 2, 2011; Published: October 21, 2011
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding: This work was supported by the Agricultural Research Service of the US Department of Agriculture. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The technologies common to systems biology approaches – transcriptomics, proteomics, ionomics and metabolomics (the “-omics”) – are now capable of generating data orders of magnitude more efficiently than was previously possible. This increasingly economical flood of data is placing very significant limitations on the ability of scientists to store, process and analyze it , . While many field are grappling with the contemporary challenge of “big data”, it is proving particularly demanding for many biologists, who historically have often been able to rely on relatively simple statistical and computational methods. Although such well-known methods (e.g. ANOVA) are powerful when investigating small numbers of variables, most are extremely susceptible to the multiple testing problem in large systems biology datasets, often forcing the user to invoke biology-independent filters (such as minimum expression fold change thresholds) in order to produce manageable numbers of interesting candidates and to limit Type I and Type II errors . Thus, new approaches are needed that are, ideally, both efficient in extracting meaningful associations from these highly multivariate datasets and are easily and intuitively understood by the end user.
Network analyses have been proposed as a solution to systems biology studies, particularly those involving transcriptomic datasets, as this approach both models the interactions of real biological networks and is intuitively understood by users , , . The reconstruction of biological networks allows processes to be examined from a truly systems-scale perspective and provides unique insight into the structure and behavior of the molecular interactions that underlie important phenomena such as development and nutrient deficiency stress , . Furthermore, the clustering of co-expressed molecules into "modules" mirrors regulatory associations found in biological systems and provides information on unknown nodes through "guilt by association" with well-characterized ones. Such analyses can be focused on identifying properties associated with key molecules or can be applied in a non-targeted manner, where the networks themselves are the primary focus of interest. The latter approach often leads to the interrogation of molecules that display certain network properties or associations with external traits . Although numerous improved methods have been proposed to model and describe these networks, it is not difficult to find studies that continue to rely on more traditional, and less effective, approaches to analyze such highly complex datasets.
Weighted gene correlation network analysis (WGCNA) is one new approach to network modeling that relies on easily understood statistical methods and improves on simple correlation networks . WGCNA has been implemented in R, a free and open source statistical programming language that is widely used, maintained and improved by an active community . WGCNA was developed to more efficiently analyze microarray datasets by quantifying not only the correlations between individual pairs of genes, but also the extent to which these genes share the same neighbors. The resulting topological overlap matrix is then converted to a dissimilarity measure and submitted to hierarchical clustering. This process creates a dendrogram that clusters similarly expressed genes into discrete branches, with the most highly connected nodal points or "hubs" located at the branch tips. WGCNA, as implemented in R, then provides various methods through which individual branches can be clustered in separate "modules" . By allowing additional genetic, phenotypic, developmental and behavioral traits to be associated with tens of modules or nodal points, instead of thousands of individual variables (i.e. gene probes), WGCNA not only alleviates the multiple testing problem, but also provides a direct route through which the effects of experimental treatments can be detected in modeled networks. While WGCNA was developed to analyze transcriptomic profiling experiments, we assert that this method is equally powerful and illustrative to analyze metabolomic fingerprinting experiments.
Metabolomic technologies, which have historically lagged behind transcriptomics and proteomics, are proving increasingly useful in systems biology . As a major component of economically important phenotypes such as quality and composition, the metabolome holds concrete relevance to the biology of organisms. Furthermore, as metabolites occupy a generally downstream location relative to the transcriptome and proteome, their presence is both likely to integrate the full sum of changes that occur in upstream regulatory steps and may additionally provide causal anchors to model directional biological networks , , . Metabolomics additionally incurs relatively low per analysis costs relative to common transcriptomic and proteomic approaches . Moreover, metabolomics can be taken advantage of to provide a high-throughput platform for phenotyping, which has become an increasingly unavoidable bottleneck in systems biology as upstream genomic, transcriptomic and proteomic technologies improve . Although identification of detected metabolites is not trivial, a given molecular species, once elucidated, can be expected to have similar phenomenology in different organisms, which greatly assists the annotation of modules.
Metabolomic approaches are particularly valuable in plant biology, where more than 200,000 secondary metabolites have been identified so far . This chemical diversity exists both within and among different chemical classes. For example, flavonoids currently contain more than 7,000 known members. This includes 232 different glycosides of a single flavonol, quercetin, one of the most common flavonoids in tomato fruit , , . The chemical diversity found within tomato fruits in particular has been relatively well characterized and shown to play critical roles in physiology, development and ecology , , , , , , . The tomato fruit metabolome varies not only with genetic background and due to the impact different alleles of key regulatory genes, but also by specific tissue type within the fruit. Furthermore, major metabolomic reorganizations are known to occur during the transition from green mature, through red ripe to overripe tomato fruit. The accumulation and dissolution of major primary and secondary metabolites has been well characterized, with dramatic changes in pigmentation, flavor, scent and nutritional quality due to variation in many compounds , , , , , , , .
Following initial pulses of cell division and expansion, a developing tomato fruit reaches the mature, green stage, at which point it becomes competent to undergo ripening. Initiation of tomato fruit ripening is climacteric, requiring a burst of respiration that is triggered by the phytohormone ethylene . Tomato ripening is additionally regulated by a light-dependent pathway, which appears most critical for pigment accumulation (e.g. carotenoids and flavonoids) , . Onset of ripening is additionally coordinated through transcription factors produced by genes such as LeMADS-RIN, which potentiates ethylene dependent fruit ripening. If LeMADS-RIN function is impaired, fruit development essentially arrests at the mature green stage , . A spontaneous mutant form of LeMADS-RIN exists that exhibits a dose-dependent phenotype . In the heterozygous state, this natural rin mutation inhibits ripening only partially, producing a fruit with an extended shelf life. Such Rin/rin genotypes have been used extensively in commercial fresh market tomatoes for decades .
Here, we apply non-targeted NMR profiling and WGCNA to explore the impact of the rin mutation on the tomato fruit metabolome, using the spontaneous mutation in two genetic backgrounds together with wild type tomatoes and a transgenic line expressing LeMADS-RIN in an antisense orientation. We additionally compare the relative ability of two currently popular statistical approaches to metabolomics data (PCA and BL-SOM) to analyze, visualize and interpret our results. To our knowledge, this is the first time WGCNA has been applied to a metabolomics dataset.
Non-targeted NMR Provides a High-throughput View of the Tomato Fruit Metabolome
For this proof of concept study, we chose a small number of closely related tomato varieties that exhibited significant phenotypic variation to demonstrate the utility of WGCNA to explain metabolomic data. As mentioned above, a hypomorphic allele of LeMADS-RIN is in widespread use by tomato breeders to prolong shelf life . This usage implies acceptance by producers, consumers and other stakeholders of the rin effect on tomato fruit composition . The rin mutation has been introgressed into heirloom varieties (Ailsa Craig ), modern breeding lines (NC1rinEC) and commercialized varieties (Mountain Crest ). A phenocopy of the rin mutant was created to verify identification of the LeMADS-RIN gene as responsible for the rin mutation . Thus, using six tomato accessions, we could examine the effect of a single gene mutation with strong phenotypic effect in two genetic backgrounds representing different levels of genetic improvement (heirloom versus modern cultivars; Table 1). To further simplify our analyses, we used methanolic extracts from whole, mature fruit grown in a greenhouse to represent a tomato fruit metabolome relevant to human consumption.
The NMR dataset was constructed by individually measuring the spectra of methanolic extracts from each of 60 fruits (ten separate fruits per genotype), thereby providing information on the intrinsic biological variation within the samples. Compound identification utilized 1D and 2D spectroscopic techniques to establish through-bond connectivities, and the concentrations of each compound was determined by manual profiling against the spectra of more than 150 standard compounds. This produced a list of 46 metabolites that accounted for most of the NMR intensities, although a significant number of important resonances remain unidentified and could not be profiled. As expected, the use of water-methanol extracts resulted in appreciable concentrations of sugars and acids, which are important biomarkers for flavor, nutrition and food quality. Their inclusion, however, may have also limited the dynamic range of the NMR spectra and obscured other signals . WGCNA is especially adept at combining multiple disparate datasets. In this proof-of-concept study, however, we chose to focus on the metabolite concentrations determined by the profiled NMR analyses, which produces annotated PCA, BL-SOM and WGCNA plots that are extremely information-rich, and provide a better understanding of what might be expected from an analysis with a greater number of variables.
Principal component analysis clusters tomato fruit by genetic background and phenotype, but does not provide fine-scale information about the metabolome
Principal components analysis (PCA) is a technique whereby the behavior of hundreds or thousands of variables are summarized by a small number of orthogonal "principal components," which are linear combinations of the original variables. The first principal component describes the dimension that displays the greatest variation in the dataset; the second principal component describes the dimension that displays the second greatest variation, etc. The first two or three principal components usually describe the majority of the variation seen in the entire dataset. PCA allows the user to view the relative similarity of different individuals along principal components while associating each principal component with a set of original variables. PCA reveals the relative similarity among samples in an unbiased fashion. Although this is an extremely useful tool for the initial exploration of multidimensional data, it is not particularly effective at clustering or classifying data , . While PCA score and loading plots often do indicate which features dominate differences among sample types, there is no further explanation. PCA does not inform the user of the larger reasons that underlie differences between sample types, nor does it provide a route to investigate specific differences in more detail.
PCA of non-targeted NMR profiles grouped the six genotypes into two primary clusters with clear separation by genetic background (Figure 1). Principal component 1 explained 25.2 % of the variation in the data and roughly separated genotypes based on ripening phenotype and Rin allele status. This component was associated positively with formate, threonine, glutamate, phenylalanine, leucine, GABA, τ-methylhistidine, tyrosine and NADP (loading values >0.20) and negatively with malic acid (loading value <− 0.10). While principal component 1 separated the three varieties in the AC background by apparent degree of ripeness, an explanation for the relative positions of the three NC varieties was not as apparent. Principal component 2 was positively associated with this difference between AC and NC backgrounds and explained 15.7 % of the variation in the data. This component was associated positively with indole-3-acetic acid, malic acid, an incompletely identified sterol, chlorogenic acid, citrate, and coumaric acid (loading values >0.20) and negatively with aspartate, indole, glucose and cytidine (loading values <−0.20).
Six tomato genotypes from two genetic backgrounds were analyzed by PCA using 46 NMR-profiled metabolites. Within each background (AC, an heirloom variety; NC, modern production varieties), variation existed at the Rin locus such that one fully ripening type (red squares), one partially ripening type (orange diamonds), and one non-ripening type (yellow circles) existed. Ten individual fruits were profiled per genotype.
Batch learning self-organizing map (BL-SOM) clusters metabolites by expression pattern but does not illustrate relationships among genotypes
BL-SOM clusters metabolites in a two-dimensional matrix according to relative similarities in expression patterns and has been used extensively in plant metabolomic studies , , , . Metabolites with similar expression patterns are located in adjacent cells in the matrix and metabolites with nearly identical expression patterns share the same cell. This method makes comparisons between any two samples easy to visualize. One can also easily compare one sample versus the mean population values. BL-SOM was used to analyze our tomato data set . Based on the relationships detected and the rules of the program, lysine was placed adjacent to phenylalanine, while fructose and glucose were collocated, as were aspartate and glutamate (Figure 2A, Figure S1). A heat map was generated to describe the metabolome of a wild type AC fruit relative to the mean values for the complete data set; thirteen clustered metabolites were more abundant in AC than the population mean, while fifteen were less abundant (Figure 2B). A relative comparison was made between one of the AC and NC samples; nine clustered metabolites were more abundant in AC sample #2 than NC sample #5, while five were less abundant (Figure 2C). However, there is no direct way to compare genotypes represented by multiple replicate samples, or to make higher order comparisons. Together, PCA and BL-SOM indicate which metabolites share similar expression patterns and which vary the most among genotypes, but provide limited insight to understand higher order relationships within a complex data set.
Six tomato genotypes from two genetic backgrounds were analyzed by BL-SOM using 46 NMR-profiled metabolites. Metabolites were clustered by expression patterns among six genotypes, with highly similar metabolites appearing in the same cells and similar metabolites appearing in adjacent cells. A. BL-SOM Lattice. Numbers indicate how many metabolites are contained within each cell. Metabolites that were clustered in the “blue” module of WGCNA are labeled to facilitate comparison. A complete representation of metabolite locations within the BL-SOM analysis is presented as Figure S1. B. Comparison of AC sample #1 with population mean values. The metabolome of a single wild type AC fruit was compared with the population mean values using BL-SOM. Red highlighting indicates cells where one or more metabolites are more abundant in AC than the population (red: greater than one standard deviation above the mean; pink: less than one standard deviation above the mean). Blue highlighting indicates where one or more metabolites were less abundant in AC than the population (blue: more than one standard deviation less than the population mean; turquoise: less than one standard deviation less than the population mean). The four cells without highlighting were not different in the comparison. C. Comparison of AC sample #2 with NC sample #5. The metabolomes of two single fruit were compared with each other. Nine cells contained metabolites more abundant in AC than NC; five cells contained metabolites less abundant in AC than NC.
Weighted correlation network analysis clusters metabolites by expression pattern, identifies highly-connected “hubs” and associates specific modules with genetic and phenotypic traits
WGCNA is a correlation-based method that describes and visualizes networks of data points, whether they are gene expression estimates, metabolite concentrations or other phenotypic data . The actual connectivity of features (topology) of the network is indicated by their position in a dendrogram or other network diagram. Features are clustered into co-expressed "modules" so that one can easily appreciate the complete dataset. Module assignment in WGCNA is a flexible process that permits the user to influence the minimum number of features contained in each module, and therefore the total number of modules identified. Each module is obtained through semi-automated pruning of the dendrogram and is notated by a unique color. Summarizing a network with a limited number of modules can reduce the complexity of a dataset from hundreds or thousands of metabolites or genes to a far smaller number of modules, which can be analyzed with greater statistical power using univariate or multivariate statistics. This overall approach permits broad-scale statistical analysis of feature clusters while retaining the fine-scale relationships for further analyses. This powerful feature of WGCNA allows the user to explore sample-dependent differences at multiple scales, possibly offering explanations for any observed differences.
Network statistics based on WGCNA
WGCNA supports the assembly of both signed and unsigned networks. Here, we constructed unsigned networks using the 46 metabolite data set, which co-localize both positively and negatively correlated metabolites into three modules (Figure 3). The WGCNA package additionally provides easy quantification of several network statistics, or indices , . In a weighted correlation network, connectivity equals the sum of connection strengths between a node and all of its neighbors, which has been associated with essentiality in protein and metabolic networks , . Additionally, highly connected hubs may play a disproportionate role either in influencing the expression patterns of other nodes in the network, or alternatively may act as "sentries," communicating changes that occur elsewhere in the network. Scaled connectivity indicates the connectivity of a given node relative to the most connected node within the same module. The maximum adjacency ratio is related to connectivity; low values indicate nodes with many, weak connections to their neighbors, while high values indicate nodes with few, strong connections to their neighbors. In some situations, the maximum adjacency ratio may be more effective than connectivity to identify important hub features . The clustering coefficient indicates the local density of a network, or the extent to which a node's neighbors are all strongly connected to each other. Other statistics are used to describe modules instead of individual nodes. Network density describes how tightly co-expressed a set of nodes within a module are, while centralization and heterogeneity describe the extent to which nodes within a given module differ in connectivity. Network heterogeneity describes the variation in connectivity within a module while centralization describes the extent to which a network contains many nodes that connect to a central hub node, but do not connect to their neighbors .
Six tomato genotypes from two genetic backgrounds were analyzed by WGCNA using 46 NMR-profiled metabolites. Metabolites were clustered by expression patterns as represented by the dendrogram and correlation heat map. Clusters of like-regulated metabolites are referred to as modules by color (red, blue, turquoise). Metabolites that could not be assigned to a module are labeled gray. In the heat map, intensity of red coloring indicates strength of correlation between pairs of metabolites on a linear scale.
Module analysis based on WGCNA
Module and metabolite-specific network statistics were calculated for this network (Tables 2 and 3). The turquoise and blue modules were the largest modules, containing 13 and 12 compounds respectively, while the red module contained 6 (Figure 3, Table 2). Fifteen metabolites were not assigned to any module, and were labeled with the color gray. All three modules are similar in centralization, while the red module is denser and less heterogeneous than the blue and turquoise modules; these features can easily be observed when the network is displayed using Cytoscape (Figure 4) . Aspartate has the highest connectivity in the dataset (1.66) and, logically, the highest scaled connectivity within its module (1.00; Table 3). It surpasses all other metabolites in its number of connections, many of which are strong and link shared neighbors. Sterol, which has a single, very weak connection, has the lowest connectivity among the three modules (0.45). Fructose has the highest maximum adjacency ratio among all metabolites (0.26), which is reflected in its single, yet extremely strong connection to glucose. This connection is consistent with the precursor/product roles of glucose and fructose in glycolysis and gluconeogenesis . Similar precursor/product or product/co-factor relationships were recognized by the WGCNA between isoleucine and threonine, leucine and GABA, and alanine and AMP, as evidenced by their high connectivity within the network (Figure 4) . Formate has one of the lowest maximum adjacency ratios in the dataset (0.08) and has many weak connections. The lowest maximum adjacency ratio within the turquoise, blue, and red modules (0.05) belongs to tyrosine, which has a single, very weak connection. NADP+ has the highest clustering coefficient (0.11) due to the dense connections among all of its neighbors. Glucose has the lowest clustering coefficient within the three modules (0.05), which is reflected in its connection to two completely unconnected nodes.
22 of 46 NMR-profiled metabolites were clustered into three modules (red, blue, turquoise); remaining metabolites were not assigned to any module (color coded as gray). Connection strength is represented by edge width (edges <0.10 omitted). The topological overlap measure from the WGCNA was displayed using Cytoscape to illustrate the network assembled from the 22 metabolites.
One of the most common challenges in systems biology experiments is that of multiple testing. It is extremely common to have very few observations on hundreds to tens of thousands of different entities (e.g. metabolites, genes). WGCNA addresses this issue by allowing the user to investigate associations among specific network nodes or clusters with other factors, such as genetic background or the impact of a mutation. For example, instead of searching for correlations between a given factor or trait (e.g. ripeness) and thousands of genes in a dataset, attention could be focused only on the most highly-connected “hub” genes that might be expected to play the most influential regulatory roles. Alternatively, external traits can be compared to the typical expression pattern (an “eigengene”, or analogously an “eigenmetabolite”) of putatively co-regulated modules instead of to every constituent molecule individually. In our analysis, the turquoise module is positively associated with wild-type fruit ripening (and the presence of functional Rin alleles) (Figure 5). The blue module shares this pattern and is additionally positively associated with the difference in genetic background (AC versus NC), possibly indicating which metabolites prevented principal component 1 of the PCA from completely predicting ripeness. By estimating a set of eigenmetabolites, WGCNA allows the user to apply commonly used and well-understood statistical approaches such as ANOVA to investigate specific hypothesis within the data, by limiting the number of necessary comparisons that are required to query the entire data set.
ANOVA was used to compare the typical expression patterns (eigenmetabolites) of each module. Significant differences in eigenmetabolites among genotypes within for each module are indicated by letters (at Bonferonni-adjusted threshold of 0.0167). Metabolites in the blue module were more highly expressed in the NC than the AC background. Metabolites in both the blue and turquoise modules were more highly expressed in fully-ripe relative to partially-ripe and unripe fruit. Interestingly, the metabolites in the red module were high in both NC and NC rin, but not in the NC F1 hybrid.
A new emphasis on the thoughtful use and adoption of statistical analyses is required in order for the biological sciences to keep pace with the increasing dominance of complex and highly multivariate systems biology data. Here, we compare the relative utility of two common and one novel statistical approach to investigate a non-targeted metabolomic profiling dataset. While our present data set contains only six related varieties and 46 compounds, we assert that this is an adequate test case to evaluate different statistical methods and draw attention to the need for more descriptive and powerful statistics in the analysis of metabolomics data. PCA revealed relative variation among the six genotypes but was only able to separate genotypes based on the major sources of variation. While the differences between the AC and NC genetic backgrounds were identified and visualized, the potentially more interesting differences associated with Rin allele state and ripening phenotype were not. For example, while PCA demonstrated that AC tg rin is intermediate between AC and AC rin, as would be expect by the gross phenotype, PCA did not allow us to ask if there are fine scale differences in phenotypes caused by two expression states for Rin as a required factor for ripening. Additionally, while NC and NC rin are the parents of NC F1, which has an intermediate ripening phenotype to its parents, PCA did not assign these three varieties as we would have predicted. PCA placed NC rin as intermediate between NC and NC F1, where NC rin was nearly contained within NC, in spite of the fact that NC was fully ripe, NC rin was unripe, and their hybrid was intermediate. This is a fundamental limitation of PCA that extends even to the major sources of variation. The few metabolites that explain most of the variation among genotypes are often obvious, e.g. with loading values well above +0.1 or below −0.1, but the identification of other, potentially significant differences are difficult as there is little further discrimination among features. Additional variables are presumed to be unimportant because they explain little of the total variation, but this cannot be confirmed empirically if such secondary candidates cannot be identified. Similarly, as PCA plots are dominated by the influence of those metabolites that best describe the overall variation, adding additional layers of information may not enrich the analysis.
BL-SOM rapidly allows the user to visualize relationships between metabolites in a test population, using a lattice to organize the results . This method organizes like regulated metabolites into cells of the lattice, where heat maps can then be generated to illustrate differences between single samples and the population mean or any two samples (Figure 2). BL-SOM does not offer much flexibility for analysis, nor does it facilitate making every pair-wise comparison between samples and sample types within a complex dataset.
WGCNA differs fundamentally from the methods mentioned previously by defining a network that continuously links all variables and then clusters the most highly co-expressed variables in flexibly defined modules. Explicitly defining all of the relationships between metabolites at multiple scales facilitates additional comparisons in a way that the lattice display of BL-SOM does not. WGCNA can be used to create both signed networks, which separate positively and negatively correlated nodes into separate modules and also unsigned networks, which assess correlations by their absolute values. We chose to use unsigned networks in this study, which is consistent with the coordinated changes in the tomato metabolome that occur during ripening , . Grouping features into modules has several advantages. First, condensing a very large network into a small number of modules or, alternately, hub nodes, allows external traits to be compared to a limited number of variables, providing a solution to the multiple testing problem. This is also consistent with the biology of ripening, where many structural genes are regulated by small number of key regulators such as Rin . Second, module construction provides a means by which the roles of unidentified or poorly characterized molecules can be inferred from their better-annotated neighbors. The identification of co-regulated modules helps to annotate the results from systems biology scale experiments, adding valuable biological information. Third, since the influence of minor variables is not masked by the most dramatic differences in terms of absolute scale, as occurs in PCA, WGCNA allows the combining of disparate datasets. Preliminary analysis of other metabolomics data collected from these tomato fruits using liquid chromatography/mass spectrometry suggests that WGCNA can combine thousands of compounds that vary over many logs of abundance in a highly meaningful way, including the clustering of precursor and product ions of provisionally identified compounds (DiLeo, Strahan and Hoekenga, unpublished observations). This provides further evidence that WGCNA is an appropriate method for metabolomic fingerprinting and profiling data beyond the analysis of microarray and physiological trait data for which it was created. Finally, WGCNA allows the topology and dynamics of the molecular network itself to be studied, providing a truly systems perspective. The corresponding molecular networks of various biological entities can be compared at multiple scales, assessing both the presence of major, high-level reorganization and fine-scale differences. While BL-SOM also groups metabolites into co-expressed clusters, this method does not define the relative similarity among metabolites, making the assignment of metabolites to different modules difficult. Also, unlike WGCNA, BL-SOM does not allow the user to compare relative differences among different classes of samples, nor does it provide network statistics. In addition to the statistics described here, WGCNA can also be used to analyze causality in a network, using genetic markers or other data , , .
While it is not novel to propose a method of generating molecular co-expression networks, few approaches provide such a complete network investigation toolkit as WGCNA, particularly in the straightforward generation of network statistics, the flexible yet objective delineation of modules and the ability to compare the typical expression values of a small number of modules or hub molecules to external traits. While the implementation of WGCNA in R is not as straightforward as a standalone program such as SimpleSOM or many software packages that provide for PCA and ANOVA, we believe that the extent to which WGCNA gives insight into and control of data gives it a critical advantage over relying on more common but less powerful methods. While future methods will certainly eclipse WGCNA's effective balance of analytical power and ease of use, it is unlikely that biology will soon return to a state where groundbreaking work can be done with minimal statistical analysis. WGCNA, when incorporated into a thoughtful data analysis plan, can provide not only a rich and multi-perspective view of systems biology data, but also an easy introduction to the R statistical environment, and therefore facilitate data analyses where the investigator has greater flexibility and control over the process of analysis.
It increasingly appears that much of the low-hanging fruit in crop genetics (e.g. non-lethal single genes of major effect) have already been picked . With the advent of affordable, high-throughput systems biology technologies, new statistical approaches are required to fully interrogate the resulting mountains of data. Here, we demonstrate how WGCNA, a powerful and user-friendly approach, can be used to more fully analyze a non-targeted metabolomic profiling dataset than would be possible with more common statistical methods such as PCA and BL-SOM. Specifically, we show how WGCNA can recognize and model systems-level differences in biological networks even where poorly defined phenotypes preclude the use of simple, deductive experimentation. We suggest that this approachable network analysis tool would be extremely useful to biologists who are hoping to condense meaning from large, multidimensional and incompletely annotated datasets.
Materials and Methods
Plant material and processing
Tomato varieties were selected from two genetic backgrounds: heirloom Ailsa Craig (AC) and modern accessions from the Mountain Horticultural Crops Research and Extension Center of North Carolina State University (NC; Table I). Plants were grown in a greenhouse during the first quarter of 2008 under standard horticultural practices in Ithaca NY. Three AC genotypes with different combinations of Rin alleles were included in this study: homozygous wild-type Rin/Rin (AC wt), homozygous rin/rin mutant (AC rin) and transgenic that was homozygous for an antisense LeMADS-RIN full-length cDNA construct (AC tg rin) . Three NC genotypes with different combinations of Rin alleles were included in this study: homozygous wild-type Rin/Rin NC84173 (NC), homozygous rin/rin mutant NC1rinEC (NC rin) and the heterozygous Rin/rin Mountain Crest (NC F1), which is a commercialized hybrid of NC84173 and NC1rinEC grown in the Mid Atlantic region of the US as a fresh market tomato . Plants were hand pollinated in the greenhouse so that staged fruit could be harvested. Fruit were harvested 15 days past breaker stage except for some AC tg rin fruit, which were harvested 7 days past breaker due to difficulties assessing progress through ripening. Wild-type fruit (AC wt and NC wt) and the commercial hybrid (NC F1) were bright red at harvest. AC rin fruit were usually green and occasionally yellow. While the AC tg rin exhibited full suppression of LeMADS-RIN in the initial description (2002), we observed far less complete gene silencing in the 2008 greenhouse . For this study, AC tg rin fruit were generally yellow-orange and occasionally green. NC rin fruit were usually yellow, which is consistent with the selection of NC rin to have enhanced light dependent ripening responses . Ten fruit from 4–6 plants per genotype were collected according to a standard methodology . Briefly, approximately 10 g segments of whole fruit were flash frozen in N2 (l), ground to a fine powder with an Ika Mill, and extracted 3:1 (v/w) in a methanol: formic acid solution (99.875∶0.125 % v/v). These ten fruit per genotype were handled as separate biological replicates and measured individually by NMR.
Non-targeted NMR metabolic profiling
Methanolic extracts were concentrated using a SpeedVac, then reconstituted to near- natural concentrations by the addition of 500 µL of 400 mM sodium phosphate buffer with a pD value of 6.59, and containing 5 mM TSP for referencing and 2 mM sodium azide to inhibit bacterial growth. Each sample was then centrifuged for five minutes to remove water-insoluble extracts and transferred to a standard 5 mm NMR tube and analyzed using a Varian INOVA 11.7 T (Tesla) NMR MHz, equipped with an inverse-detect probe with Z-PFG. Proton spectra were acquired at 400 MHz and 20 C, using a 1D-NOESY pulse sequence with a 100 ms mixing time and presaturation of the solvent signal during the relaxation times. Standard 90° flip angle pulses were used with a relaxation delay of 5 s, and 256 fid transients with 64K data points were acquired. Proton spectra were apodized with a 0.25 Hz exponential line broadening and zero-filled once.
Selected samples of different tomato genotypes were analyzed in greater depth to assign metabolite compounds. These experiments included 1D-13C and 135° DEPT, and gradient versions of 2D homonuclear and heteronuclear experiments. The 13C and DEPT experiments, at 100 MHz, were acquired with 25 k or 30 k Hz sweep-widths. The 13C spectra were averaged over 10,000 transients, used a relaxation delay of 2 s and a standard 45° flip angle. The DEPT spectra used standard 90° and 135° flip angles, 10,000 transients and a relaxation delay of 1 s. These spectra were processed with a 2.5–5 Hz exponential line-broadening and zero-filled once.
The 2D-NMR studies included gradient enhanced versions of COSY (Correlation Spectroscopy), HSQC (Heteronuclear Single Quantum Correlation) or HMQC (Heteronuclear Multiple Quantum Correlation), HMBC (Heteronuclear Multiple Bond Correlation) (16 Hz coupling) and TOCSY (Total Correlation Spectroscopy). The proton homonuclear COSY and TOCSY (80 ms mixing time) 2D experiments were recorded with spectral widths of 6 k or 8 k Hz in both dimensions, using 4096 points in the directly-detected dimension, and 512 increments in the second dimension; 16 transients per fid were collected with a 2 s delay between scans. The 1H-13C heteronuclear experiments, HSQC (non-edited), HMQC and HMBC (8 Hz and 16 Hz coupling), were recorded using 4096 data points and spectral widths of 6 k or 8 k Hz in the proton dimension (directly-detected). For the carbon (indirectly-detected) dimension, 120–512 increments were acquired with a spectral width of 25 k or 30 k Hz, a 1–2 s delay between scans, and 64–256 transients per fid. The F1 dimension of all heteronuclear spectra were forward linear predicted up to 2 times the number of data points, using the half data set as the basis. Spectra were apodized with a sine or sine-squared function and a shift of 0° or 70°. Assignments were performed using Sparky to analyze through-bond connectivities, and resonance values were compared to those in the literature when available , , , , . This raw data was both analyzed directly as a fingerprint (450 features) and manually profiled, revealing 45 metabolites.
Chenomx software (Alberta, CA) was used for baseline correction, spectral binning, and chemical compound profiling of the 1D 1H NMR spectra of individual tomato fruits. Raw spectra were initially binned in equally spaced 0.02 ppm increments between 10 ppm and 0.5 ppm, excluding the water peak region between 4.5 and 5 ppm. This enabled the rapid assessment of the overall data quality using PCA. An in-depth analysis of the metabolite concentrations in each fruit was performed using the Chenomx software to manually fit the individual spectra to the Chenomx profile database of compounds, which was augmented by the profiles of ∼20 other standard compounds. The profiles of these standard samples were based on 1D-1H spectra acquired at ∼1 mM concentration and used the same buffer as the tomato samples.
Most statistical analyses were performed in R (version 2.10.1) . NMR profile data were analyzed by principal component analysis (PCA), batch learning self-organizing maps (BL-SOM) and weighted correlations network analysis (WGCNA). Data were autoscaled prior to statistical analyses in order to reduce the dominance of dynamic, high-concentration metabolites. PCA was performed with R package pcaMethods with SVD , ANOVA was performed with R package stats and BL-SOM was performed with Simple BL-SOM . Unsigned, weighted correlation networks were produced with R package WGCNA with the default power of six , .
Annotation of metabolites associated with each cell in BL-SOM. Six tomato genotypes from two genetic backgrounds were analyzed by BL-SOM using 46 NMR-profiled metabolites. Metabolites were clustered by expression patterns among six genotypes, with highly similar metabolites appearing in the same cells and similar metabolites appearing in adjacent cells. This figure indicates the identity of metabolites contained within each cell of the BL-SOM output (Figure 2). Metabolites are highlighted according to WGCNA module assignment to enhance comparison between analysis methods (Figure 3).
We thank Dr. James Giovannoni, Dr. Julia Vrebalov, Dr. Nigel Gapper and Dr. Stuart Krasnoff for helpful discussions and donations of research materials. We thank Victoria Hodgkinson, Aisha Abdul-Wakeel and Yiyi Chu for their expert technical assistance, as well as the greenhouse staff of the Boyce Thompson Institute for Plant Research.
The U.S. Department of Agriculture (USDA) prohibits discrimination in all its programs and activities on the basis of race, color, national origin, age, disability, and where applicable, sex, marital status, familial status, parental status, religion, sexual orientation, genetic information, political beliefs, reprisal, or because all or part of an individual's income is derived from any public assistance program. (Not all prohibited bases apply to all programs.) Persons with disabilities who require alternative means for communication of program information (Braille, large print, audiotape, etc.) should contact USDA's TARGET Center at (202) 720-2600 (voice and TDD). To file a complaint of discrimination, write to USDA, Director, Office of Civil Rights, 1400 Independence Avenue, S.W., Washington, D.C. 20250-9410, or call (800) 795-3272 (voice) or (202) 720-6382 (TDD). USDA is an equal opportunity provider and employer.
Conceived and designed the experiments: OAH MVD GDS. Performed the experiments: MVD MdB GDS. Analyzed the data: MVD GDS OAH. Contributed reagents/materials/analysis tools: OAH MdB. Wrote the paper: OAH MVD GDS.
- 1. Bader DA (2004) Computational Biology and High-Performance Computing. Communications of the ACM 47: 34–41.DA Bader2004Computational Biology and High-Performance Computing.Communications of the ACM473441
- 2. Maltsev N (2006) Computing and the "Age of Biology". CTWatch Quarterly 2: N. Maltsev2006Computing and the "Age of Biology".CTWatch Quarterly2
- 3. Barenco M, Brewer D, Papouli E, Tomescu D, Callard R, et al. (2009) Dissection of a complex transcriptional response using genome-wide transcriptional modelling. Molecular Systems Biology 5: 327.M. BarencoD. BrewerE. PapouliD. TomescuR. Callard2009Dissection of a complex transcriptional response using genome-wide transcriptional modelling.Molecular Systems Biology5327
- 4. Aoki K, Ogata Y, Shibata D (2007) Approaches for extracting practical information from gene co-expression networks in plant biology. Plant & Cell Physiology 48: 381–390.K. AokiY. OgataD. Shibata2007Approaches for extracting practical information from gene co-expression networks in plant biology.Plant & Cell Physiology48381390
- 5. Horvath S, Dong J (2008) Geometric Interpretation of Gene Coexpression Network Analysis. PLoS Computational Biology 4: e1000117.S. HorvathJ. Dong2008Geometric Interpretation of Gene Coexpression Network Analysis.PLoS Computational Biology4e1000117
- 6. Langfelder P, Horvath S (2008) WGCNA: an R package for weighted correlation network analysis. BMC Bioinformatics 9: 559.P. LangfelderS. Horvath2008WGCNA: an R package for weighted correlation network analysis.BMC Bioinformatics9559
- 7. Hirai MY, Yano M, Goodenowe DB, Kanaya S, Kimura T, et al. (2004) Integration of transcriptomics and metabolomics for understanding of global responses to nutritional stresses in Arabidopsis thaliana. Proceedings of the National Academy of Sciences (USA) 101: 10205–10210.MY HiraiM. YanoDB GoodenoweS. KanayaT. Kimura2004Integration of transcriptomics and metabolomics for understanding of global responses to nutritional stresses in Arabidopsis thaliana.Proceedings of the National Academy of Sciences (USA)1011020510210
- 8. Fait A, Hanhineva K, Beleggia R, Dai N, Rogachev I, et al. (2008) Reconfiguration of the achene and receptacle metabolic networks during strawberry fruit development. Plant Physiology 148: 730–750.A. FaitK. HanhinevaR. BeleggiaN. DaiI. Rogachev2008Reconfiguration of the achene and receptacle metabolic networks during strawberry fruit development.Plant Physiology148730750
- 9. Zhang B, Horvath S (2005) A general framework for weighted gene co-expression network analysis. Statistical Applications in Genetics and Molecular Biology 4: B. ZhangS. Horvath2005A general framework for weighted gene co-expression network analysis.Statistical Applications in Genetics and Molecular Biology4
- 10. R Development Core Team (2010) R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. 11: R Development Core Team2010R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing.11Accessed from http://www.r-project.org/verified 10/5/. Accessed from http://www.r-project.org/verified 10/5/.
- 11. Dettmer K, Aronov PA, Hammock BD (2007) Mass spectrometry-based metabolomics. Mass Spectrometry Reviews 26: 51–78.K. DettmerPA AronovBD Hammock2007Mass spectrometry-based metabolomics.Mass Spectrometry Reviews265178
- 12. Bino RJ, Hall RD, Fiehn O, Kopka J, Saito K, et al. (2004) Potential of metabolomics as a functional genomics tool. Trends in Plant Science 9: 418–425.RJ BinoRD HallO. FiehnJ. KopkaK. Saito2004Potential of metabolomics as a functional genomics tool.Trends in Plant Science9418425
- 13. Carrari F, Fernie AR (2006) Metabolic regulation underlying tomato fruit development. Journal of Experimental Botany 57: 1883–1897.F. CarrariAR Fernie2006Metabolic regulation underlying tomato fruit development.Journal of Experimental Botany5718831897
- 14. Dunn WB (2008) Current trends and future requirements for the mass spectrometric investigation of microbial, mammalian and plant metabolomes. Physical Biology. 011001 p.WB Dunn2008Current trends and future requirements for the mass spectrometric investigation of microbial, mammalian and plant metabolomes.Physical Biology011001
- 15. Champy MF, Selloum M, Piard L, Zeitler V, Caradec C, et al. (2004) Mouse functional genomics requires standardization of mouse handling and housing conditions. Mammalian Genome 15: 768–783.MF ChampyM. SelloumL. PiardV. ZeitlerC. Caradec2004Mouse functional genomics requires standardization of mouse handling and housing conditions.Mammalian Genome15768783
- 16. Fiehn O (2002) Metabolomics – the link between genotypes and phenotypes. Plant Molecular Biology 48: 155–171.O. Fiehn2002Metabolomics – the link between genotypes and phenotypes.Plant Molecular Biology48155171
- 17. Harborne JB, Baxter H (1999) The Handbook of Natural Flavonoids. volume 2. Chichester: Wiley. 879 p.JB HarborneH. Baxter1999The Handbook of Natural Flavonoidsvolume 2ChichesterWiley879
- 18. Andersen ØM, Markham KR, editors. (2006) Flavonoids: Chemistry, Biochemistry and Applications. Boca Raton, , FL: CRC Press.. ØM AndersenKR Markham2006Flavonoids: Chemistry, Biochemistry and Applications.Boca Raton, , FLCRC Press.1237 P
- 19. USDA-ARS (2007) Database for the Flavonoid Content of selected foods, release 2.1: USDA-ARS2007Database for the Flavonoid Content of selected foods, release2.1
- 20. Giovannoni JJ (2004) Genetic Regulation of Fruit Development and Ripening. Plant Cell 16: S170–180.JJ Giovannoni2004Genetic Regulation of Fruit Development and Ripening.Plant Cell16S170180
- 21. Goff SA, Klee HJ (2006) Plant Volatile Compounds: Sensory Cues for Health and Nutritional Value? Science 311: 815–819.SA GoffHJ Klee2006Plant Volatile Compounds: Sensory Cues for Health and Nutritional Value?Science311815819
- 22. Moco S, Capanoglu E, Tikunov Y, Bino RJ, Boyacioglu D, et al. (2007) Tissue specialization at the metabolite level is perceived during the development of tomato fruit. Journal of Experimental Botany 58: 4131–4146.S. MocoE. CapanogluY. TikunovRJ BinoD. Boyacioglu2007Tissue specialization at the metabolite level is perceived during the development of tomato fruit.Journal of Experimental Botany5841314146
- 23. Bertin N, Causse M, Brunel B, Tricon D, Genard M (2009) Identification of growth processes involved in QTLs for tomato fruit size and composition. Journal of Experimental Botany 60: 237–248.N. BertinM. CausseB. BrunelD. TriconM. Genard2009Identification of growth processes involved in QTLs for tomato fruit size and composition.Journal of Experimental Botany60237248
- 24. Mathieu S, Cin VD, Fei Z, Li H, Bliss P, et al. (2009) Flavour compounds in tomato fruits: identification of loci and potential pathways affecting volatile composition. Journal of Experimental Botany 60: 325–337.S. MathieuVD CinZ. FeiH. LiP. Bliss2009Flavour compounds in tomato fruits: identification of loci and potential pathways affecting volatile composition.Journal of Experimental Botany60325337
- 25. Slimestad R, Verheul M (2009) Review of flavonoids and other phenolics from fruits of different tomato Lycopersicon esculentum Mill. cultivars. Journal of the Science of Food and Agriculture 89: 1255–1270.R. SlimestadM. Verheul2009Review of flavonoids and other phenolics from fruits of different tomato Lycopersicon esculentum Mill. cultivars.Journal of the Science of Food and Agriculture8912551270
- 26. Davies JN, Kempton RJ (1975) Changes in the individual sugars of tomato fruit during ripening. Journal of the Science of Food and Agriculture 26: 1103–1110.JN DaviesRJ Kempton1975Changes in the individual sugars of tomato fruit during ripening.Journal of the Science of Food and Agriculture2611031110
- 27. Roessner-Tunali U, Hegemann B, Lytovchenko A, Carrari F, Bruedigam C, et al. (2003) Metabolic Profiling of Transgenic Tomato Plants Overexpressing Hexokinase Reveals That the Influence of Hexose Phosphorylation Diminishes during Fruit Development. Plant Physiology 133: 84–99.U. Roessner-TunaliB. HegemannA. LytovchenkoF. CarrariC. Bruedigam2003Metabolic Profiling of Transgenic Tomato Plants Overexpressing Hexokinase Reveals That the Influence of Hexose Phosphorylation Diminishes during Fruit Development.Plant Physiology1338499
- 28. Alba R, Payton P, Fei Z, McQuinn R, Debbie P, et al. (2005) Transcriptome and Selected Metabolite Analyses Reveal Multiple Points of Ethylene Control during Tomato Fruit Development. Plant Cell 17: 2954–2965.R. AlbaP. PaytonZ. FeiR. McQuinnP. Debbie2005Transcriptome and Selected Metabolite Analyses Reveal Multiple Points of Ethylene Control during Tomato Fruit Development.Plant Cell1729542965
- 29. Carrari F, Baxter C, Usadel B, Urbanczyk-Wochniak E, Zanor M-I, et al. (2006) Integrated Analysis of Metabolite and Transcript Levels Reveals the Metabolic Shifts That Underlie Tomato Fruit Development and Highlight Regulatory Aspects of Metabolic Network Behavior. Plant Physiology 142: 1380–1396.F. CarrariC. BaxterB. UsadelE. Urbanczyk-WochniakM-I Zanor2006Integrated Analysis of Metabolite and Transcript Levels Reveals the Metabolic Shifts That Underlie Tomato Fruit Development and Highlight Regulatory Aspects of Metabolic Network Behavior.Plant Physiology14213801396
- 30. Mounet F, Moing A, Garcia V, Petit J, Maucourt M, et al. (2009) Gene and Metabolite Regulatory Network Analysis of Early Developing Fruit Tissues Highlights New Candidate Genes for the Control of Tomato Fruit Composition and Development. Plant Physiology 149: 1505–1528.F. MounetA. MoingV. GarciaJ. PetitM. Maucourt2009Gene and Metabolite Regulatory Network Analysis of Early Developing Fruit Tissues Highlights New Candidate Genes for the Control of Tomato Fruit Composition and Development.Plant Physiology14915051528
- 31. Adams-Phillips L, Barry C, Giovannoni J (2004) Signal transduction systems regulating fruit ripening. Trends in Plant Science 9: 331–338.L. Adams-PhillipsC. BarryJ. Giovannoni2004Signal transduction systems regulating fruit ripening.Trends in Plant Science9331338
- 32. Lincoln JE, Fischer RL (1988) Regulation of Gene Expression by Ethylene in Wild-Type and rin Tomato (Lycopersicon esculentum) Fruit. Plant Physiology 88: 370–374.JE LincolnRL Fischer1988Regulation of Gene Expression by Ethylene in Wild-Type and rin Tomato (Lycopersicon esculentum) Fruit.Plant Physiology88370374
- 33. Vrebalov J, Ruezinsky D, Padmanabhan V, White R, Medrano D, et al. (2002) A MADS-Box Gene Necessary for Fruit Ripening at the Tomato Ripening-Inhibitor (Rin) Locus. Science 296: 343–346.J. VrebalovD. RuezinskyV. PadmanabhanR. WhiteD. Medrano2002A MADS-Box Gene Necessary for Fruit Ripening at the Tomato Ripening-Inhibitor (Rin) Locus.Science296343346
- 34. Bai Y, Lindhout P (2007) Domestication and Breeding of Tomatoes: What have We Gained and What Can We Gain in the Future? Annals of Botany 100: 1085–1094.Y. BaiP. Lindhout2007Domestication and Breeding of Tomatoes: What have We Gained and What Can We Gain in the Future?Annals of Botany10010851094
- 35. Hoekenga OA (2008) Using metabolomics to estimate unintended effects in transgenic crop plants: problems, promises, and opportunities. Journal of Biomolecular Technology 19: 159–166.OA Hoekenga2008Using metabolomics to estimate unintended effects in transgenic crop plants: problems, promises, and opportunities.Journal of Biomolecular Technology19159166
- 36. Gardner R (2006) Mountain Crest hybrid tomato and its parent, NC 1rinEC. HortScience 41: 261–262.R. Gardner2006Mountain Crest hybrid tomato and its parent, NC 1rinEC.HortScience41261262
- 37. Schripsema J (2010) Application of NMR in plant metabolomics: techniques, problems and prospects. Phytochemical Analysis 21: 14–21.J. Schripsema2010Application of NMR in plant metabolomics: techniques, problems and prospects.Phytochemical Analysis211421
- 38. Ringner M (2008) What is principal component analysis? Nature Biotechnology 26: 303–304.M. Ringner2008What is principal component analysis?Nature Biotechnology26303304
- 39. Jolliffe I (2004) Principal Component Analysis. New York: Springer-Verlag. 487 p.I. Jolliffe2004Principal Component Analysis.New YorkSpringer-Verlag487
- 40. Hirai MY, Klein M, Fujikawa Y, Yano M, Goodenowe DB, et al. (2005) Elucidation of gene-to-gene and metabolite-to-gene networks in arabidopsis by integration of metabolomics and transcriptomics. Journal of Biological Chemistry 280: 25590–25595.MY HiraiM. KleinY. FujikawaM. YanoDB Goodenowe2005Elucidation of gene-to-gene and metabolite-to-gene networks in arabidopsis by integration of metabolomics and transcriptomics.Journal of Biological Chemistry2802559025595
- 41. Kim JK, Bamba T, Harada K, Fukusaki E, Kobayashi A (2007) Time-course metabolic profiling in Arabidopsis thaliana cell cultures after salt stress treatment. Journal of Experimental Botany 58: 415–424.JK KimT. BambaK. HaradaE. FukusakiA. Kobayashi2007Time-course metabolic profiling in Arabidopsis thaliana cell cultures after salt stress treatment.Journal of Experimental Botany58415424
- 42. Sawada Y, Akiyama K, Sakata A, Kuwahara A, Otsuki H, et al. (2009) Widely targeted metabolomics based on large-scale MS/MS data for elucidating metabolite accumulation patterns in plants. Plant & Cell Physiology 50: 37–47.Y. SawadaK. AkiyamaA. SakataA. KuwaharaH. Otsuki2009Widely targeted metabolomics based on large-scale MS/MS data for elucidating metabolite accumulation patterns in plants.Plant & Cell Physiology503747
- 43. Akiyama K, Chikayama E, Yuasa H, Shimada Y, Tohge T, et al. (2008) PRIMe: a Web site that assembles tools for metabolomics and transcriptomics. In Silico Biology 8: 339–345.K. AkiyamaE. ChikayamaH. YuasaY. ShimadaT. Tohge2008PRIMe: a Web site that assembles tools for metabolomics and transcriptomics.In Silico Biology8339345
- 44. Dong J, Horvath S (2007) Understanding network concepts in modules. BMC Systems Biology 1: 24.J. DongS. Horvath2007Understanding network concepts in modules.BMC Systems Biology124
- 45. Jeong H, Mason SP, Barabasi AL, Oltvai ZN (2001) Lethality and centrality in protein networks. Nature 411: 41–42.H. JeongSP MasonAL BarabasiZN Oltvai2001Lethality and centrality in protein networks.Nature4114142
- 46. Samal A, Singh S, Giri V, Krishna S, Raghuram N, et al. (2006) Low degree metabolites explain essential reactions and enhance modularity in biological networks. BMC Bioinformatics 7: 118.A. SamalS. SinghV. GiriS. KrishnaN. Raghuram2006Low degree metabolites explain essential reactions and enhance modularity in biological networks.BMC Bioinformatics7118
- 47. Kohl M, Wiese S, Warscheid B (2011) Cytoscape: software for visualization and analysis of biological networks. Methods in Molecular Biology 696: 291–303.M. KohlS. WieseB. Warscheid2011Cytoscape: software for visualization and analysis of biological networks.Methods in Molecular Biology696291303
- 48. Zhang P, Dreher K, Karthikeyan A, Chi A, Pujar A, et al. (2010) Creation of a genome-wide metabolic pathway database for Populus trichocarpa using a new approach for reconstruction and curation of metabolic pathways for plants. Plant Physiology 153: 1479–1491.P. ZhangK. DreherA. KarthikeyanA. ChiA. Pujar2010Creation of a genome-wide metabolic pathway database for Populus trichocarpa using a new approach for reconstruction and curation of metabolic pathways for plants.Plant Physiology15314791491
- 49. Aten J, Fuller T, Lusis A, Horvath S (2008) Using genetic markers to orient the edges in quantitative trait networks: The NEO software. BMC Systems Biology 2: 34.J. AtenT. FullerA. LusisS. Horvath2008Using genetic markers to orient the edges in quantitative trait networks: The NEO software.BMC Systems Biology234
- 50. Doebley JF, Gaut BS, Smith BD (2006) The molecular genetics of crop domestication. Cell 127: 1309–1321.JF DoebleyBS GautBD Smith2006The molecular genetics of crop domestication.Cell12713091321
- 51. De Vos RCH, Moco S, Lommen A, Keurentjes JJB, Bino RJ, et al. (2007) Untargeted large-scale plant metabolomics using liquid chromatography coupled to mass spectrometry. Nature Protocols 2: 778–791.RCH De VosS. MocoA. LommenJJB KeurentjesRJ Bino2007Untargeted large-scale plant metabolomics using liquid chromatography coupled to mass spectrometry.Nature Protocols2778791
- 52. Goddard T, Kneller D (2008) SPARKY 3. Computer program. San Francisco: University of California. 11: T. GoddardD. Kneller2008SPARKY 3. Computer program. San Francisco: University of California.11Accessed from http://www.cgl.ucsf.edu/home/sparky/ verified 10/5/. Accessed from http://www.cgl.ucsf.edu/home/sparky/ verified 10/5/.
- 53. Le Gall G, Colquhoun I, Davis A, Collins G, Verhoeyen M (2003) Metabolite profiling of tomato (Lycopersicon esculentum) using 1H NMR spectroscopy as a tool to detect potential unintended effects following a genetic modification. Journal of Agricultural and Food Chemistry 51: 2447–2456.G. Le GallI. ColquhounA. DavisG. CollinsM. Verhoeyen2003Metabolite profiling of tomato (Lycopersicon esculentum) using 1H NMR spectroscopy as a tool to detect potential unintended effects following a genetic modification.Journal of Agricultural and Food Chemistry5124472456
- 54. Sobolev AP, Segre AL, Lamanna R (2003) Proton high-field NMR study of tomato juice. Magnetic Resonance in Chemistry 41: 237–245.AP SobolevAL SegreR. Lamanna2003Proton high-field NMR study of tomato juice.Magnetic Resonance in Chemistry41237245
- 55. Tiziani S, Schwartz SJ, Vodovotz Y (2006) Profiling of carotenoids in tomato juice by one- and two-dimensional NMR. Journal of Agricultural and Food Chemistry 54: 6094–6100.S. TizianiSJ SchwartzY. Vodovotz2006Profiling of carotenoids in tomato juice by one- and two-dimensional NMR.Journal of Agricultural and Food Chemistry5460946100
- 56. Neelam A, Cassol T, Mehta RA, Abdul-Baki AA, Sobolev AP, et al. (2008) A field-grown transgenic tomato line expressing higher levels of polyamines reveals legume cover crop mulch-specific perturbations in fruit phenotype at the levels of metabolite profiles, gene expression, and agronomic characteristics. Journal of Experimental Botany 59: 2337–2346.A. NeelamT. CassolRA MehtaAA Abdul-BakiAP Sobolev2008A field-grown transgenic tomato line expressing higher levels of polyamines reveals legume cover crop mulch-specific perturbations in fruit phenotype at the levels of metabolite profiles, gene expression, and agronomic characteristics.Journal of Experimental Botany5923372346