The acquisition and analysis of datasets including multi-level omics and physiology from non-model species, sampled from field populations, is a formidable challenge, which so far has prevented the application of systems biology approaches. If successful, these could contribute enormously to improving our understanding of how populations of living organisms adapt to environmental stressors relating to, for example, pollution and climate. Here we describe the first application of a network inference approach integrating transcriptional, metabolic and phenotypic information representative of wild populations of the European flounder fish, sampled at seven estuarine locations in northern Europe with different degrees and profiles of chemical contaminants. We identified network modules, whose activity was predictive of environmental exposure and represented a link between molecular and morphometric indices. These sub-networks represented both known and candidate novel adverse outcome pathways representative of several aspects of human liver pathophysiology such as liver hyperplasia, fibrosis, and hepatocellular carcinoma. At the molecular level these pathways were linked to TNF alpha, TGF beta, PDGF, AGT and VEGF signalling. More generally, this pioneering study has important implications as it can be applied to model molecular mechanisms of compensatory adaptation to a wide range of scenarios in wild populations.
Understanding how living organisms adapt to changes in their natural habitats is of paramount importance particularly in respect to environmental stressors, such as pollution or climate. Computational models integrating the multi-level molecular responses with organism physiology are likely to be indispensable tools to address this challenge. However, because of the difficulties in acquiring and integrating data from non-model species and because of the intrinsic complexity of field studies, such an approach has not yet been attempted. Here we describe the first example of a global network reconstruction linking transcriptional and metabolic responses to physiology in the flatfish, European flounder, a species currently used to monitor coastal waters around Northern Europe. The model we developed has revealed a remarkable similarity between network modules predictive of chemical exposure in the environment and pathways involved in relevant aspects of human pathophysiology. Generally, the approach we have pioneered has important implications as it can be applied to model molecular mechanisms of compensatory adaptation to a wide range of scenarios in wild populations.
Citation: Williams TD, Turan N, Diab AM, Wu H, Mackenzie C, Bartie KL, et al. (2011) Towards a System Level Understanding of Non-Model Organisms Sampled from the Environment: A Network Biology Approach. PLoS Comput Biol 7(8): e1002126. https://doi.org/10.1371/journal.pcbi.1002126
Editor: Christian von Mering, University of Zurich and Swiss Institute of Bioinformatics, Switzerland
Received: January 7, 2011; Accepted: May 26, 2011; Published: August 25, 2011
Copyright: © 2011 Williams et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by UK NERC Post-genomic and Proteomic programme grant NE/C507661/1, UK BBSRC and EU GENIPOL programme grant EKV-2001-0057, Birmingham functional genomics facilities by BBSRC grant 6/JIF 13209 and bioinformatics by MRC infrastructure grant G.4500017. Flounder collection and chemical analysis was supported by the Department for Environment, Food and Rural Affairs (Defra) Clean Safe Seas Environmental Monitoring Programme (CSEMP) (http://www.bodc.ac.uk/projects/uk/merman/project_overview/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Modelling the responses and compensatory adaptations of living organisms to a changing environment is extremely important both in terms of scientific understanding and for its potential impact on global health. Although computational modelling of ecological systems has been utilised in ecotoxicology, the application of systems biology approaches to non-model organisms in general presents formidable difficulties, partly due to limited sequence information for environmentally relevant sentinel species. Moreover, the number of samples and the depth of information available are often limited and there may be a lack of truly relevant physiological endpoints. Thus, omics have proven effective in finding responses of aquatic organisms to model toxicants in laboratory-based experiments  but the environment poses a greater challenge as anthropogenic contaminants are present as complex mixtures and responses will additionally be dependent upon natural life history traits and other environmental factors.
Relatively few omics studies have focussed upon the ecotoxicology of environmentally sampled fish –. Although we have previously shown ,  that expression of stress response genes could be used to distinguish fish from environmental sampling sites with different underlying contaminant burdens, this gave little insight to the health outcomes of these molecular differences. In this context, identifying molecular mechanisms of compensatory and toxic responses from observational data (reverse engineering), an approach that has been so successful in clinical studies and in laboratory model organisms, is highly challenging in field studies. We addressed this challenge by developing a novel network inference strategy based on the integration of multi-level measurements of populations of fish exposed to a diverse spectrum of environmental pollutants. This provides a useful model for a network biology approach generally applicable to non-model species and represents a breakthrough in the way we study the mechanisms whereby organisms respond to chemical exposure in the environment. We directed our efforts towards modelling molecular networks representative of populations of the flatfish European flounder (Platichthys flesus) sampled from marine environments of North Western Europe, including locations significantly impacted by anthropogenic chemical contaminants.
The study integrated measurements representing a broad spectrum of samples characterized using transcriptomics, metabolomics, conventional biomarkers and analysis of chemicals in sediments from the sampling sites. Previous studies have shown both anthropogenic contamination and higher prevalence of pre-neoplastic and neoplastic lesions in flounder from the Elbe estuary  and from the Mersey and Tyne , together with elevated levels of hepatic DNA adducts at these sites . Data integration was achieved by implementing a systems biology framework for network reconstruction, starting from cross-species mapping of sequence information to the integration of multi-level datasets within a framework for network inference  and culminating in the identification of network modules predictive of physiological responses to chemical exposure, valuable for marine monitoring .
The networks we identified demonstrate a remarkable parallel between human liver carcinogenesis and environmental effects on fish liver as well as revealing potentially novel adaptation mechanisms. The broader application of network biology approaches to other non-model species sampled from the environment is therefore likely to profoundly change our understanding of how living systems are likely to adapt to complex environments.
The molecular state of flounder liver reflects chemical exposure
An important assumption in many eco-toxicology studies is that the molecular states of organisms reflect their biological responses to complex chemical mixtures present within that environment. Indirect evidence suggests that this hypothesis may be correct. For example, consistent with previous studies , we have identified genes and metabolites that were differentially expressed between environmental sites (the results obtained are shown in detail in Table 1 and Text S1, Tables S1 and S2). Many of these were either known to be associated with stress responses or were previously shown to respond to anthropogenic chemical contaminants in fish. Although these results were encouraging they did not provide a direct link between molecular status and response to specific chemicals. Since sediment chemistry data was available, we assessed whether chemical contaminant profiles could be inferred from gene expression data and whether these would at least partially match the known sediment composition. Our analysis was performed by linking genes differentially expressed between each sampling site and the reference site, with chemical-gene relationships within the Comparative Toxicology Database (CTD) . The Alde estuary was chosen as the reference site due to its low concentrations of major anthropogenic chemical contaminants (Table 1), both in sediment and in flounder livers. These significant associations may be regarded as predictive of the most important classes of chemicals exerting their biological effects upon flounder gene expression amongst the highly complex chemical mixtures within the sediments at these sites. Results were consistent with the initial hypothesis, as where contaminants were highlighted both by chemistry and CTD analysis; sediment concentrations all exceeded the lower OSPAR ecotoxicological assessment criteria, except for PAHs at the Morecambe site. At Brunsbuttel, elevated chromium and polychlorinated biphenyls (PCBs); at Cuxhaven, chromium, nickel, lead, zinc, polycyclic aromatic hydrocarbons (PAHs) and PCBs; at Helgoland nickel, zinc, manganese and PCBs, at Mersey PCBs; at Morecambe Bay arsenic, nickel and PAHs; and at Tyne arsenic and PCBs were all predicted by the CTD analyses and confirmed by chemistry data (Table 2 and Table S3). PAHs were predicted at Morecambe and Cuxhaven, with the AhR-inducer beta-naphthoflavone predicted at Brunsbuttel, Helgoland and Tyne, consistent with our finding of CYP1A transcriptional induction at all sites in comparison with the Alde. Additionally, Ingenuity Pathway Analysis (IPA) of all genes identified as significantly differentially expressed between sites showed significant associations with a number of toxicologically important processes and outcomes (Table 3).
Molecular networks linked to fish morphometric indices represent the interface between metabolic and transcriptional networks
As there were clear relationships between geographical location, chemical exposure and molecular profiles of flounder livers, we proceeded to reconstruct a network model representing the relationships between transcriptomic and metabolomic data, morphological measurements, protein biomarkers and microsatellite markers (Figure 1). This network was constructed from all data, not limited to molecules that differed between sites.
A schematic representation of the analysis workflow and the network inference methodology.
Inspection of the resulting network (Figure 2) showed that transcriptional and metabolic networks separated into two different areas of the network layout. Interestingly, modules whose hubs were fish morphometric measurements occurred exactly at the interface between these two areas and these modules contained metabolite (46%) and transcript (50%) measurements as well as fish morphometric measurements (4%).
Modules (consisting of transcripts, metabolite bins and morphological measurements) are numbered; sizes are proportional to the number of nodes within each module. Red colouring is proportional to the percentage of each module that consisted of metabolite bins. Modules whose seeds were transcripts are shown as circles; metabolites as triangles; morphological measurements as squares. Annotation terms significantly enriched (FDR<0.05 by DAVID) in areas of the network are shown (* = not statistically significant).
Different areas of the inferred network (Figure 2) were characterised with different functional profiles. The modules close to the interface with metabolism (A) showed enrichment (FDR<0.05) for the annotation terms mitochondrion (GO:0005739), oxidoreductase activity (GO:0016491), endoplasmic reticulum (GO:0005783), protein folding (GO:0006457) and antioxidant activity (GO:0016209), and the two KEGG pathways hsa03050:proteasome and hsa00480:glutathione metabolism. The second sub-network (B) was enriched for immune response (GO:0006955) and response to stress (GO:0006950). The third sub-network (C) was enriched for proteolysis (GO:0006508) and digestion (GO:0007586).
Identification of sub-networks predictive of geographical location and histopathological features
Each individual network module was tested for its ability to predict geographic sampling sites (Figure 3), the presence of parasites (Figure 4A) and the presence of any of the liver histo-pathological abnormalities shown in Table 1H (Figure S2). Modules that were predictive of environmental sampling site were concentrated in two sub-networks. The larger (Figure 3, area A) was centred on the interface between metabolic and transcriptional networks and consequently included 14 modules consisting of morphometric indices as well as metabolites and transcripts (1% morphometric indices, 36% metabolite bins, 63% transcripts).
Modules in red predict membership of at least one environmental sampling site by GALGO with a sensitivity and specificity of >70%. The number of sites that each module could predict is illustrated by shading. Modules are split into a major group (A) and a minor group (B).
A: Modules coloured red predict parasite infections using GALGO with a sensitivity and specificity of >70%. Clustering of profiles is shown. B: Modules coloured red significantly overlap (Fisher's Exact Test FDR<0.05) with transcripts significantly altering (ANOVA FDR<0.05, 2-fold change at each timepoint) in response to laboratory treatments of flounders with lindane over a 16-day time course.
Modules that were predictive of parasitic copepod infection by Acanthochondria sp. and Lepeophtheirus sp. were similarly distributed in the network, but with additional modules localized in the sub-network B that were enriched in annotation to the immune response. Modules that were predictive of infection by Anisakid nematodes (Figure 4A) displayed a different profile, being more concentrated within group B. Hierarchical clustering of the profile of modules that were predictive of parasite infections showed that responses to copepod infections by Lepeophtheirus and Acanthochondria clustered together and were distinguished from responses to infection by the Anisakid nematodes.
Laboratory exposures to individual chemicals mimic complex mixture responses in the environment
We have previously shown that there is a strong link between laboratory exposure to individual chemicals and flounder hepatic gene expression . It was therefore reasonable to hypothesize that genes differentially expressed in laboratory exposures may map onto modules predictive of sampling location. Fisher's Exact Test was therefore used to identify modules where genes differentially regulated as a result of single chemical laboratory exposures were over-represented (these were determined by ANOVA FDR<0.05 over 16 day time-courses post-intraperitoneal injection). Responses to lindane are shown as an example in Figure 4B. This highlighted the temporal change in responses to toxicants, with the majority of overlapping modules occurring in both sub-networks A and B at early timepoints, followed by a shift towards sub-networks B and C at later timepoints. We have previously shown  that this temporal change is associated with an early induction of transcripts for chaperones, phase I and II metabolic enzymes, oxidative stress and protein synthesis that diminishes by the later timepoints and is replaced by induction of protein degradation, immune-function and inflammation-related transcripts.
The results for all treatments are illustrated graphically in Figure S2 E to L. All treatments showed overlap with modules in group A, at the metabolite/transcript interface, and this was clearest for cadmium, that only affected this area, apart from one module in group C. All other treatments showed overlap between responsive genes and group B modules to varying extents and all except estradiol and cadmium overlapped with at least two modules within group C. These results are supported by our previous study  in which we found that employing transcripts altered during laboratory exposures to a range of individual toxicants improved predictivity of environmental sampling sites.
Environmental exposure to polluted sites recapitulates human liver pathophysiology
Having defined network modules predictive of geographical location, Ingenuity Pathway Analysis was used to elucidate the detailed structure of molecular pathways and their potential association with specific signatures of liver pathology. We performed these analyses under the hypothesis that the underlying response to chemical exposure would be consistent with what is known of human liver molecular pathophysiology. It was therefore expected that significant associations between the modules defined by our analysis and networks stored in the Ingenuity database would be informative of the underlying molecular mechanisms. We indeed observed a remarkable overlap between modules predictive of geographical location and modules containing genes whose transcriptional profile has been previously associated with liver fibrosis, cirrhosis and hepatocellular carcinoma in mammals.
Modules whose component genes related to hepatotoxicity are shown in Figure 5. The major group of site-predictive modules shows significant overlap with modules relating to liver cholestasis and hepatocellular carcinoma, whereas the secondary group overlaps with liver fibrosis. The annotation gained from Ingenuity, with key regulators inferred from networks based on interaction information, was combined and clustered in the TMEV software package using 5 different algorithms. These show (Table 4) that genes and metabolites a) involved in bile acid synthesis, transport and amino acid metabolism b) predictive of parasite infection c) linked to hepatocellular carcinoma, reproductive disorders and liver cirrhosis d) responding to oxidative stressors tert-butylhydroperoxide (tBHP) and cadmium, the hormone estradiol and rodent peroxisome proliferator perfluoro-octanoic acid (PFOA) are closely linked to differences between environmental sites. Additional relationships with inflammation, immune response, energy, fatty acids and nucleic acid metabolism, response to other toxicants and regulation by insulin, huntingtin, MYC and hepatocyte nuclear factor HNF4A were also highlighted. Functional analysis of the modules that were both site-predictive and associated with hepatocellular carcinoma showed significant overlap with mitochondrion, proteasome, tricarboxylic acid cycle, melanosome, protein dimerization activity, membrane-enclosed lumen, glutathione metabolism, coenzyme binding, microsome, translation, protein transport and carbohydrate catabolism (enrichment score >2, FDR<0.05).
Modules predictive of sampling site are shown in red. Those associated with hepatocellular carcinoma are indicated by a solid line, those associated with liver cholestasis and liver fibrosis are indicated by dashed lines. Annotation terms were derived from Ingenuity.
Knowledge-based analysis of predictive modules reveals potentially novel response pathways
The models we have developed are a high level representation of the molecular network's underlying response to environmental exposure. In order to generate specific hypotheses on the molecular pathways modulated during compensatory adaptation and toxicity further in-depth analyses of the specific interactions between genes and metabolites were performed. In this context, we combined the genes and metabolites represented in each group of predictive modules (Groups A and B in Figure 3) and input these to IPA software. The most statistically significant networks derived from each group are shown in Figure 6 and Figure S3, coloured by expression represented as a ratio between a highly polluted site and the reference site (Brunsbuttel versus Alde). The component genes and metabolites were clustered and the resulting expression profiles are shown in Figure S1. The Ingenuity networks are further described in Text S1 and are discussed below.
A– Most significant Ingenuity network derived from the union of modules that were highly predictive of sampling sites (5 or more), shown as major area A in Figure 3. B- Ingenuity network derived from the module that was predictive of sampling sites (3), shown as minor area B in Figure 3. Ingenuity networks are coloured by mean gene expression in Brunsbuttel fish versus Alde fish with red for induction more than 2-fold, dark green for repression more than 2-fold, pink or light green for changes less than 2-fold. Uncoloured nodes were predicted by Ingenuity.
This is the first network level analysis of an environmental study integrating multilevel omic datasets. We discovered that the overall molecular state of the flounder liver (transcriptomics and metabolomics) is representative of the chemical contaminant burden of the sediments. Network reconstruction showed that the interface between transcriptional and metabolic network domains is linked to fish morphometric indices and is predictive of environmental exposure. In-depth analyses of predictive networks have identified putative novel pathways representative of responses to exposure. This approach provides a framework both for prediction of chemical pollutants in complex mixtures and for prediction of the health outcomes for exposed animals.
The molecular state of flounder liver samples reflects chemical exposure
The chemical exposures predicted from CTD interactions were partly confirmed by chemical data (Table 2) despite the complexity of the environment, potentially including mixture effects, bioaccumulation and non-chemical stressors. Additional stressors were indicated that had not been chemically measured. Taking the Brunsbuttel site as an example, ethinyl-estradiol was a predicted contaminant and serum VTG protein, a canonical marker of endocrine disruption, was induced relative to the Alde (Table 1). Perfluorooctane sulfonic acid  and other persistent organic pollutants including PCBs, dieldrin and endosulfan  have been detected at elevated concentrations in the Elbe estuary and floodplain, and were all identified by our approach. Additional chemicals highlighted included systhane and vinclozolin fungicides, the halogenated aromatic hydrocarbon pesticide lindane, chlorine and tetradecanoylphorboyl acetate (TPA). It is uncertain whether these compounds are in fact present at this site as, for example, the presence of TPA appears unlikely. However TPA is a well-known tumour promoter , so detection of its associated gene expression changes might be viewed as a biomarker of effect, not necessarily of a specific exposure. At a number of sites flavonoids and flavonols, such as epicatechin gallate, were predicted, potentially indicating plant-derived exposures not of anthropogenic origin. At Morecambe Bay and the Tyne the prediction of paraquat perhaps reflected an oxidative stress response rather than the presence of this particular compound.
These results support the use of a knowledge-based approach to infer chemical exposure profiles from molecular responses and validate the underlying assumptions in the study. Predictions from interrogation of the CTD database (Table 2; Table S3) differed between sites suggesting that the approach can be sufficiently sensitive to specific differences in the exposure profiles. However, we do not propose that these associations necessarily indicate the presence of each specific contaminant at each site, for example ‘tobacco smoke pollution’ in the Mersey, we instead hypothesise that these represent the effects of related stressors, for example, AhR inducers at the Mersey site.
Interpretation of the molecular interaction network
The development of a modular network, representing the integration between molecular and physiological readouts, provided us with an interpretive framework to analyse the complex molecular signatures linked to exposure. One of the most interesting findings is that the modules that predict environmental exposure with greatest accuracy represent the interface between metabolite and transcriptional networks and link to higher level indicators of fish health, such as condition factor and hepatosomatic index (Figure 2).
Consistent with this observation, network modules at the interface between metabolite and transcriptional networks were also differentially regulated in response to single chemical laboratory exposures. It should be borne in mind that the environmentally sampled fish have been chronically exposed to pollutants, and that chronic exposure can result in different responses than acute exposure , . In addition bioavailability, mixture effects, metabolism and bioaccumulation affect compound-specific responses within the livers of these fish. This is illustrated by the modules containing genes that responded to 16-day treatments of flounder with individual toxicants (Figure 4 B, Figure S2). While all toxicants induced changes in the metabolic-interface genes, they also affected the secondary area of the network that related more to acute stress and immune response (Figure 2, area B), in contrast to the differences between environmental sites, where only one module (40) in this area was affected.
The characterisation of transcripts and metabolites that differed between sites was undertaken to provide insights into the molecular mechanisms that they describe, and to inform on the potential health outcomes for the fish. Canonical pathways that contributed to these differences included those relevant to metabolism of toxicants; AhR signalling, metabolism of xenobiotics by cytochromes P450, the NRF2-mediated oxidative stress response, glutathione metabolism and bile acid bioysnthesis (Table 3). Together these describe phase I and II metabolism of xenobiotics, such as aromatic hydrocarbons, and their excretion via the bile. Additional endobiotic metabolic pathways were affected. Changes in glycolysis, pyruvate metabolism, the citric acid cycle and oxidative phosphorylation implied disturbances to the energy pathways of the liver that could reflect the energetic requirements of xenobiotic metabolism and lead to further metabolic disruption. Changes in amino acid synthesis and proteasomal protein degradation also indicated reorganisation of metabolism.
This change in metabolic state and gene expression could be viewed as a successful compensatory response to toxicants and thus of little concern for the health of individual fish and these fish populations. Further examination of the annotation of transcripts and metabolites differing between sites implied that this hypothesis was false. As illustrated in Figure 5, and shown in Tables 3 and 4, there is a remarkable overlap between site-predictive modules and modules associated with hepatocellular carcinoma (HCC). Additionally, liver cholestasis -annotated modules overlapped with HCC and site predictive modules and this area of the network was highly associated with bile acid biosynthesis. Apart from this metabolic interface group only one other module (module 40) was predictive of site. This was also associated with hepatocellular carcinoma, and additionally with liver fibrosis, indicative of chronic liver damage, and occurred in an area of the network associated with inflammation. Therefore flounders inhabiting differentially contaminated sites show transcript and metabolite changes that have been associated with liver carcinogenesis in mammals. A question remains as to whether this simply represents the detection of HCC in the liver samples, as histopathology data were unavailable for the fish sampled off Germany. By comparison with studies of tumours from the closely related flatfish dab (Limanda limanda) this does not appear to be the case. In dab tumours the metabolites choline, phospocholine and glycine were reduced in concentration and lactate increased, an indication of the switch to anaerobic metabolism in the bulk tumours . In, for example, the Brunsbuttel samples compared with non-tumour bearing Alde fish, choline, phosphocholine and glycine increased, and lactate decreased. Additionally, transcripts for ribosomal proteins showed co-ordinated induction in bulk tumours from dab, indicative of proliferation , but no such induction was apparent from the present samples. The changes in gene expression and metabolites detected in this study do not recapitulate those found in bulk tumours, and may be viewed as indicating either an earlier stage of tumourigenesis or a permissive micro-environment in which hyperplastic tissue may form and lead to tumour formation.
Network analysis reveals potentially novel response pathways
Ingenuity networks, based on mammalian interaction data, permitted more detailed biological characterisation of the site-associated modules. Complete pathways were not recapitulated by these analyses, as only a minority of the transcripts and metabolites from flounder liver were examined. Nevertheless, the analyses highlighted important processes and inferred key regulators. Here the most significant network derived from site-predictive modules is discussed in detail and additional networks are discussed in terms of their key inferred regulators.
The most striking finding from the Ingenuity analyses was the co-ordinated repression of proteasomal subunit genes at the Brunsbuttel site (Figure 6A; Figure S3A1). This was not so marked at other sites (Figure S1), indeed at Morecambe Bay these genes were induced in comparison with the Alde fish. Proteasome maturation protein (POMP) has been found to be a critical regulator of proteasomal activity  and has been shown to be repressed by the halogenated aromatic hydrocarbon 2,3,7,8-tetrachlorodibenzodioxin (TCDD) in an AhR-independent manner . Although TCDD concentration was not measured, the mean expression of proteasomal genes was inversely correlated (r = −0.79) with fish liver PCB concentrations but did not correlate well with sediment PAH or PCB concentrations. Tyne fish, for example, displayed relatively high proteasomal gene expression and had low liver PCB but high PAH concentrations (Table 1, Figure S1). Therefore the repression of proteasomal genes may represent a halogenated aromatic hydrocarbon-related response (Figure 7). In trout Oncorhynchus mykiss, a proteasome inhibitor reduced PAH-dependent CYP1A induction , in contrast to mammalian studies . This difference may contribute to the lower inducibility of CYP1A in flounder in comparison with many mammals. Ingenuity analysis also predicted an interaction between the proteasome and NF kappa B, a key regulator of mammalian hepatocarcinogensis . The proteasome represses NK kappa B activation, and potentially disruption of proteasomal activity could have extensive additional effects on intracellular protein levels due to its role in the degradation of numerous proteins. We found no significant changes in NF kappa B gene expression between sites, and the consequences of putative activation at the Brunsbuttel site, and repression at the Morecambe site, due to changes in the proteasome, are difficult to predict, as in the early stages of carcinogenesis NF kappa B can have a protective effect, whereas in later stages it can promote tumourigenesis .
Relationship between the AhR pathway and proteasome, generated within Ingenuity, coloured deep red or green for changes exceeding 2-fold up and down respectively between Brunsbuttel and Alde fish, and light red and green for those less than 2-fold.
From the Ingenuity networks a number of key regulatory molecules were inferred. These included insulin (Figure 6B, Figure S3A2, S3A4, S3B1), estrone, luteinizing hormone (LH) and follicle stimulating hormone (FSH) (Figure S3A3 and S3A6), platelet derived growth factor beta (PDGFBB) (Figure 6B, Figure S3A2, S3B1), transforming growth factor beta (TGF-beta) (Figure S3A8), vascular endothelial growth factor (VEGF) (Figure 6B, Figure S3A7, S3B1), tumour necrosis factor (TNF) (Figure S3A5), and angiotensinogen (Figure 6B, Figure S3B1).
Insulin, in fish as in mammals, is a key hormonal regulator of energy, glucose and lipid metabolism, all pathways that were identified as affected by sampling site. By the Ingenuity networks it was linked to protein kinases, metabolites (including glucose and lactate) and the glucose transporter SLC2A4. The most obvious explanation for changes in insulin and related parameters would be differences in diet between fish from different sites. Amino-acid levels are more important regulators of insulin in carnivorous fish such as the flounder than sugars . Dietary parameters would be expected to be highly variable depending upon recent feeding history of the fish, which was unknown for these individuals. However, insulin can also be modulated by exposure to toxicants including organophosphates  that was suggested to lead to an increase in lipogenesis, in agreement with our observations of phospholipidosis in fish from polluted sites (Table 1). Mild estrogenic endocrine disruption was suggested by VTG induction in Brunsbuttel fish, and networks shown in Figures S3A6 and S3A3 inferred that estrogen receptor alpha (ESR1), FSH and LH target genes were modulators of the different responses between sampling sites. ESR1 and HNF alpha were linked in Figure S3A6 and both are involved in hepatic cholestasis, indeed EE2-induced hepatotoxicity has been linked to alterations in bile acid biosynthesis in mice .
PDGFBB is the dimeric form of platelet derived growth factor beta (PDGF-B). Notably, PDGF-B over-expressing mice spontaneously developed liver fibrosis , and PDGF-BB was inferred as part of the network deriving from the liver fibrosis-annotated module 40 in our analysis. Additionally PDGF-B over-expressing mice developed hepatocellular carcinoma in response to phenobarbital and diethylnitrosamine treatment and induced TGF-beta and VEGF expression. TGF-beta was inferred to be an important regulator in site-specific responses (Figure S3A8) and is a well-known mediator of cancer initiation, progression and metastasis, via interaction with the inflammatory response . Furthermore, the pro-inflammatory cytokine TNF-alpha, an initiating signal for the innate immune response in fish as well as mammals , was also identified by Ingenuity analysis (Figure S3A5). Release of TNF alpha from Kupffer cells leads to hepatocyte cell death, regeneration and fibrosis that can lead to hepatocellular carcinoma . VEGF, best known as a stimulator of angiogenesis, was also highlighted in both the fibrosis-related and carcinoma-related sections of the network, and was linked with cell cycle, oncogenes and tumour suppressor genes (CDKN1A, TP53, MYC). Angiogenesis is a key requirement for the transition from fibrosis to hepatocellular carcinoma .
Angiotensinogen (AGT) is the precursor of angiotensin and was found to be repressed at all sites in comparison to the Alde reference site (Table S1). Angiotensin is a signal for vasoconstriction in mammals and in fish its expression is related to osmoregulation  with repression in liver in response to higher salinity. As the sampling sites differed in salinity, alteration of AGT transcription was not a surprising finding. As shown in Figure 6B, AGT was a member of the fibrosis-related module 40 and was predicted to form part of a complex network with VEGF, PDGF and intracellular kinases. Angiotensin has indeed been linked to stimulation of inflammatory liver fibrosis , via fibroblast proliferation and production of inflammatory cytokines and growth factors, including TGF-beta. Inhibition of the angiotensin system by antagonism of its receptor  or inhibition of angiotensin-converting enzyme  has been shown to reduce hepatic fibrosis.
VEGF, TGF beta, TNF alpha, PDGF and AGT are all intimately related to the progression of fibrosis to cirrhosis and hepatocellular carcinoma in mammals. These molecules were all highlighted as important regulators of the differences between molecular profiles of flounder livers from different sampling sites using an unbiased approach combining network inference and predictive algorithms.
A combination of omics, multiple biomarkers and bioinformatics were used to identify and characterise hepatic molecular changes between fish sampled from several environmental sites. Based on these data, parasite infection, fish morphology and genetics do contribute to the differences between sites, but do not explain the majority of changes seen. For example, within-site tests showed that morphometric parameters and parasite infections could be significantly associated only with a small proportion (<3%) of the gene expression differences between sites (Table S1, Table S4). Taken as a whole with our previous studies , , we find that anthropogenic chemical contamination of the marine environment is a major factor in explaining the molecular differences between fish sampled from these sites.
The different methodologies employed displayed different strengths and weaknesses. Histopathology was a good guide to broad levels of pollution effect, but provided little information upon the nature of the contaminant profile. Protein biomarkers and enzyme activities were useful for categorising sites by major classes of toxicant, but gave little information on the potential health outcomes. 1H NMR metabolomics showed low technical variability, and metabolite profiles alone were more predictive of sampling site than gene expression profiles alone, however the annotation of metabolites is not yet well advanced, limiting the functional information currently available. Transcriptomics exhibited higher variability than metabolomics, but was more informative due to better annotation. Overall the methodologies were highly complementary, allowing analyses that would be impossible if one were limited to a single technique.
The gene expression signatures associated with fish from each sampling site were used to predict the presence of chemical contaminants using the CTD gene expression-chemical interaction database. Mixture effects, other environmental influences and the similarity of certain stressors, such as the metals, might be expected to confound this approach. Additionally the incomplete nature of the flounder microarray and the CTD database and the limited numbers of samples for certain sites, which is a common issue in field studies, reduce the potential of this analysis. Therefore we did not expect to predict all environmental contaminants by this method. While this approach was useful with the current dataset, it may be expected to improve in future as both the CTD database and transcriptomic data become more comprehensive.
Data integration and network analyses were essential; both to predicting health outcomes and to identifying and examining affected biological pathways. They allowed visualisation of the highly complex dataset and facilitated comparison of the effects of different stimuli upon the model system. Modules associated with specific parameters could then be examined in detail, utilising interaction databases (Ingenuity) for further characterisation. Detailed examination of these networks illustrated the changes detected by broader classification of modules by annotation terms. In addition to potential interactions with diet and salinity, the majority of networks contained key regulators of inflammation, hepatic fibrosis and hepatocellular carcinoma. Therefore we propose that network biology approaches can lead to the identification of health impacts of environmental pollutants upon non-model organisms.
The molecular differences between reference and contaminated sampling sites were associated with carcinogenesis, and this outcome is supported by previous histopathology , . Flatfish hepatic histopathology has long been associated with chemical contamination  and our results demonstrate the linkages between toxicants and histopathology via alterations in molecular signalling pathways and metabolism.
The sampling sites employed in this study were: In UK waters; on the Irish Sea, the Mersey estuary, at Eastham Sands, Liverpool (lat 53°19N, long 2°55W) and Morecambe Bay (lat 54°10N, long 2°58W); on the North Sea, the Alde estuary, Suffolk (lat 52°95N, long 01°33E) and the Tyne estuary at Howdon, Tyne and Wear (lat 54°57N, long 1°38W): In North Sea waters off Schleswig-Holstein, Germany; the Elbe estuary at Cuxhaven (lat 53°53N, long 08°15–19E) and Brunsbuttel (lat53°52N, long 09°09–10E) and off Helgoland (lat 54°06N, long07°15–08°00E). Adult European flounders (Platichthys flesus) were caught during statutory monitoring programs carried out by the Centre for Environment, Fisheries and Aquaculture Science (Cefas) at UK sites in April 2006 and by AWI Bremerhaven at FRG sites in October 2004 and April 2005. Fish were caught using beam trawls and held in tanks of flowing sea water onboard ship and were dissected either onboard ship or on return to shore. Livers were immediately removed and 100 mg samples for microarrays and metabolomics and 200 mg samples for biomarker assays were flash frozen in liquid nitrogen, with liver slices taken for histopathology. Blood was extracted and stored at 4°C overnight before plasma preparation for vitellogenin (VTG) analysis. Fin clips (1 cm2) were preserved in 70% ethanol at 4°C for genotyping. After sexing, livers from males that were 12 to 34 cm long were used for further analyses, this sample set included n = 20 for Alde, n = 16 for Tyne, n = 22 for Mersey, n = 23 for Morecambe Bay, n = 22 for Helgoland, n = 24 for Cuxhaven and n = 48 for Brunsbuttel. Fish lengths and weight, condition factor (K; body wt/length3×100), liver weight and hepatosomatic index (HSI; liver wt/body wt×100) were determined for all samples, gonad weight and gonadosomatic index (GSI; gonad wt/body wt×100) for FRG fish only.
Chemical determinations were carried out on sediment samples and independent sets of flounder liver samples from the same samplings by Cefas and Deutsches Ozeanographiches Datenzentrum, Germany and submitted to the International Council for the Exploration of the Sea (ICES), Copenhagen, Denmark as part of the national marine monitoring programmes. UK data was analysed from that collected as part of the Clean Safe Seas Environmental Monitoring Programme (CSEMP) and archived in the UK's Marine Environment Monitoring and Assessment National database (MERMAN). For sediment; metal concentrations (Al, As, Cd, Cr, Cu, Fe, Hg, Li, Mn, Ni, Pb and Zn); polycyclic aromatic hydrocarbons (PAHs) (anthracene, benzo[a]anthracene, benzo[a]pyrene, benzo[ghi]perylene, chrysene/triphenylene, fluoroanthrene, indo[123-c]pyrene, naphthalene, phenanthrene and pyrene); total organic carbon and polychlorinated biphenyls (PCBs) (congeners CB28, 52, 101, 118, 138, 153 and 180) were determined and the sum of PAHs and the sum of ICES 7 priority PCBs calculated for all sites. For flounder livers; metals (As, Cd, Cr, Cu, Fe, Hg, Ni, Pb, Se and Zn) and PAHs (acenaphthylene, acenaphthene, benzo[a]anthracene, C1-, C2- and C3- naphthalene, C1-phenanthrene/anthracene, chrysene, fluoroanthrene, fluorene, naphthalene, phenanthrene and sum of PAHs) were determined for Alde, Tyne and Mersey fish, with partial metal concentration data for Morecambe Bay, Helgoland, Cuxhaven and Brunsbuttel samples. Polychlorinated biphenyls (PCBs) (congeners CB28, 52,101, 118, 138, 153, 180 and sum of ICES 7 PCBs) were determined for liver samples from all sites. Data are available from the Merman database (http://www.bodc.ac.uk/projects/uk/merman/).
UK flounders were examined for external lesions, liver gross appearance and parasite infection. Liver pathology was assessed according to the criteria of Feist et al. . Sections of liver tissue were removed, placed into individual histological cassettes, transferred to 10% neutral buffered formalin and processed for histopathology as described previously . The presence of toxicopathic lesions, foci of cellular alteration, benign neoplasia, malignant neoplasia and non-specific inflammatory lesions was determined.
Plasma vitellogenin (VTG) concentrations (mg/ml) were determined by the method described by Kirby et al . Hepatic metallothionein (MT) concentration (µg per mg) and glutathione reductase (GR) (nmol/mg), glutathione-S-transferase (GST) (µmol/mg) and ethoxyresorufin-o-deethylase (EROD) (pmol/mg) activities were determined by the methods of George and Young . These assays were carried out for all except Cuxhaven and Helgoland fish.
Flounder fin-clip samples (n = 50) from all sites were surveyed for six neutral microsatellite markers (all polymorphic) and 13 detoxification gene-associated size variants within introns of flounder cytochrome P450 1A (CYP1A) , GST-A  and peroxisome proliferator activated receptors (PPAR) alpha, beta and gamma . Following targeted PCR spanning each polymorphic site; DNA fragments were detected and sized by fluorescent capillary electrophoresis (Beckman CEQ8800 sequencer). Chromatogram files were individually inspected, and alleles were identified/scored manually. Four standard flounder DNA samples were analysed in each genotyping run (96 sample plate) to maintain scoring consistency. Standard genetic analyses for both single and multi-locus conformance to Hardy-Weinberg expectations within samples and examination of potential allelic differentiation among sites were undertaken using GENEPOP . PHYLIPv3.5 software  was then employed to compute and compare four different measures of genetic distance (Nei's standard and Da distances; Cavalli-Sforza chord distance; Reynolds distance) and to construct unrooted neighbour-joined dendrograms (branch points being bootstrap-supported).
The GENIPOL flounder cDNA microarray has been described previously , . The methods and design were similar to those employed in earlier experiments, with minor modifications , . Briefly, liver tissue from individual flounders was homogenised in a methanol/water mixture  and aliquots were taken for both metabolomics and transcriptomics. Liver homogenates were used to prepare total RNA (Qiagen, Crawley, UK), reverse-transcribed to cDNA and labeled with Cy5-dCTP fluorophore (GE Healthcare, Amersham, UK). Labeled cDNAs were individually statically hybridised overnight to the microarray versus a common Cy3-labeled synthetic reference, before stringent washing and scanning (Axon 4000B; Molecular Devices, Wokingham, UK). Data were captured using Genepix software (Molecular Devices), and each slide was checked in detail, with spots showing poor morphology or arrays showing gross experimental artefacts being discarded. The data consisted of local background-subtracted median 635 nm intensities. MIAME-compliant gene expression data are available from ArrayExpress under accession E-MTAB-396. As the microarray is redundant, CAP3 clustering  had been used to identify contiguous sequences .
For metabolomics, liver homogenate aliquots were further extracted individually using methanol/chloroform/water (2∶2∶1.8 final volumes) , . One-dimensional 1H NMR spectroscopy was performed upon the hydrophilic fraction as previously described . Briefly, NMR spectra were measured at 500.11 MHz using an Avance DRX-500 spectrometer and cryogenic probe (Bruker, Coventry, UK), with 200 transients collected into 32k data points. NMR data sets were zero-filled to 64k points, exponential line-broadenings of 0.5 Hz were applied before Fourier transformation, and spectra were phase and baseline corrected, then calibrated (TMSP, 0.0 ppm) using TopSpin software (version 1.3; Bruker). The subsequent processing and statistical analyses of the NMR data have been described in detail in a previous study . Briefly, taurocholic acid, an abundant bile acid with highly variable concentration in the liver extracts was subtracted from each spectrum using Chenomx NMR metabolomics software (version 4.6; Chenomx, Edmonton, Canada). Next, residual water was removed, each spectrum was segmented into 0.005 ppm bins, and the total area of each binned spectrum was normalized to unity so as to facilitate comparison between the samples. Subsequently to statistical analyses, significantly changing metabolite ‘bins’ were identified as particular metabolites by comparison with spectral libraries of reference compounds and were annotated with PubChem CID accessions (NCBI).
Microarray data were filtered to remove spots where 20% or more of the data were undetectable over all samples and background-subtracted intensity values of 0 or below were set to 0.5. Data were log2 transformed, quantile normalised and de-noised by a) removing data where SD/mean was more than 0.9 and b) removing data where maximum–minimum was less than 1.5. Missing data were estimated using MetaGeneAlyse probabilistic principal components analysis (PCA) algorithm . Array slide batch effects were resolved using an empirical Bayes correction . A representative clone with greatest average expression across all samples was chosen for each contiguous sequence cluster where the Pearson correlation score was greater than 0.6 to other members of the cluster. Where the correlation failed to pass this cut-off, data were discarded. The noise level for each metabolomics NMR spectrum was estimated by dividing the spectrum into 32 regions and calculating the smallest bin SD for each region and multiplying this by 3. These results were used to de-noise the data . Data from metabolomics, transcriptomics and fish measurements (K, length, weight, liver weight, HSI) were then combined where all were available. The final data set therefore consisted of n = 15 for Alde, n = 9 for Tyne, n = 9 for Mersey, n = 13 for Morecambe Bay, n = 21 for Helgoland, n = 23 for Cuxhaven and n = 36 for Brunsbuttel. An additional dataset was generated for the omics samples that also possessed genetic data.
Normalised combined microarray and metabolomic data were input to Genespring GX 7.3.1 (Agilent Technologies, Santa Clara, CA, USA). Statistically significantly changing genes were found by 1-way ANOVA with a multiple testing correction  for a false discovery rate (FDR)<0.05, and with Welch T-tests employing the same FDR. Fold change cutoffs of 1.5-fold were additionally applied. A classification algorithm was used to compare previous data  with the current data; this employed the Support Vector Machines algorithm within Genespring with the Kernel Function Polynomial Dot Product (Order 3), a Diagonal Scaling Factor of 0, for all genes passing QC cut-offs in both experiments. Gene ontology (GO) analyses were carried out within Blast2GO ,  employing the GOSSIP package . As flounder is a non-model species, genes were annotated with gene symbols of their putative human orthologs, found by employing a Conditional Stepped Reciprocal Best Hit approach between flounder and zebrafish (Danio rerio) and human transcriptome databases, similar to Herbert et al. , with additional manual curation.
Chemical-gene expression interactions were downloaded from the Comparative Toxicology Database (CTD) , for all annotated genes. These represent a database of the previous literature on chemical-gene expression interactions. The chemical-gene pairs from this list were segregated into inducers and repressors, duplicates were removed, and the two lists uploaded into TMEV , thereby annotating each gene with its ‘chemical inducers’ and ‘chemical repressors’. Lists of genes (ANOVA, FDR<0.05, fold change versus Alde>1.5; illustrated in Table S1) were interrogated for enrichment of chemical associations using EASE (Expression Analysis Systematic Explorer) within TMEV, and FDR calculated. Where associations were found between an inducing chemical and induced genes and also between the same chemical acting as a repressor and repressed genes, FDRs were multiplied to produce a final FDR value. Lists of genes and metabolites were additionally interrogated by Ingenuity Pathway Analysis (Ingenuity IPA 8.5; Ingenuity Systems, Redwood City, CA, USA), employing Human Gene Organisation (HUGO) gene identifiers and PubChem CID compound identifiers, with statistical tests using Benjamini and Hochberg multiple testing corrections.
The overall approach taken for network construction and analysis is shown in Figure 1. It is conceptually sub-divided into: 1) Selection of network hubs: 2) Construction of a fully connected network: 3) Identification of network modules representing the neighbourhood of the hubs: 4) Assembly of the final modules and graphical representation: 5) In-depth analysis of gene interactions using Ingenuity Pathway Analysis (IPA) software.
The network was constructed from all measured variables, including transcript, metabolite, morphometric, protein biomarker and genetic data. Within the network each individual variable is described as a node. We selected 99 ‘hub’ nodes representing transcripts with known toxicological and regulatory relevance in order to identify the molecular network representing the interactions between these hubs and all the other nodes in the multi-level dataset. In addition, morphometric indices and metabolite peaks were also included in the list of hubs to represent the complexity of the metabolic networks, which, we reasoned are likely to closely influence liver physiology. The network inference methodology ARACNE  was used to create the network. Statistically significant interactions were selected on the basis of mutual information between the nodes at cut-off of P<1e-6. We defined 99 modules derived from each selected hub and its neighbourhood. Many nodes were present in multiple modules. The overlap index was calculated between each pair of modules by dividing the number of overlapping nodes by the total number of nodes in the smaller module. The final network was then constructed as the union of all network modules and visualized using a force driven layout available in the software application Cytoscape . In the final network, the edge distances between the modules are relative to the overlap index and the node sizes are relative to the size of the module. We also compared this strategy to develop mutual information-based modules from hub variables with a more complex method , shown in Text S1, and discovered that they both gave similar results.
Subsequently the multivariate selection algorithm GALGO  was applied to each module to determine its predictivity for parameters including fish sampling site, parasite infection, and the presence or absence of liver pathologies. The cut-off employed for identification of predictive modules was >70% specificity and >70% sensitivity. Genes were annotated with HUGO identifiers for their putative human orthologs. DAVID v 2008 and v6.7 ,  was used to classify module genes and groups of modules inferred from the topology of the module graph, by their shared Gene Ontology (GO) and other annotation terms. Flounder laboratory treatment data was employed to relate gene expression changes seen in the environmental samples to those elicited by model toxicant treatments. These treatments consisted of a single intraperitoneal injection with cadmium chloride (Cd, 50 µg/kg), 3-methylcholanthrene (3-MC, 25 mg/kg), aroclor 1254 (50 mg/kg), tert-butyl-hydroperoxide (tBHP, 5 mg/kg), lindane (25 mg/kg), perfluoro-octanoic acid (PFOA, 100 mg/kg), estradiol (l0 mg/kg) and furunculosis vaccine (killed Aeromonas salmonicia, Aquavac Furovac 5; 1 ml/kg) with gene expression monitored over a 16-day timecourse versus appropriate controls. Full details are shown in Williams et al. , Williams et al.  and Diab et al. , with data available from ArrayExpress under accessions E-MAXD-32 and E-MAXD-38. Overlap between module genes and genes differentially expressed by toxicant treatments over the 16 day timecourse, ANOVA, FDR<0.05 was determined by Fisher's Exact Test with a cut-off of P<0.01. Modules and groups of modules were interrogated by Ingenuity Pathway Analysis. Key regulatory molecules were inferred from networks generated within Ingenuity, that also output functional enrichment within the lists of nodes (P<0.05). Modules were annotated with associated diseases, functions, canonical pathways, toxicity and hepatotoxicity terms within Ingenuity and with inferred key regulators, as well as with environmental and parasitological predictivity and overlap with laboratory treatment data to produce a binary matrix. This was clustered within TMEV  using hierarchical clustering, SOTA self organising tree, K-means, QT and SOM self organising map algorithms. Grouped modules that were predictive of sampling site were subjected to Ingenuity analyses and were overlaid with Brunsbuttel expression data relative to Alde, the reference site. These genes and metabolites were subjected to K-means clustering within TMEV and the clusters functionally annotated using DAVID.
Expression of site-predictive genes and metabolites. Expression profiles of the site-predictive genes and metabolites shown in Figure 6, separated by K-means clustering and functionally annotated within DAVID.
Modules overlapping with histopathology and chemical treatments. A to D – modules coloured red predict parasite infections and presence of histopathological liver abnormalities using GALGO with a sensitivity and specificity of >70%. E to L - modules coloured red significantly overlap (Fisher's Exact Test FDR<0.05) with transcripts significantly altering (ANOVA FDR<0.05) in response to laboratory exposures of flounders to individual stimuli over 16-day time courses.
Networks derived from modules that were predictive of sampling sites. A1 to A8 – Ingenuity networks derived from the union of modules that were highly predictive of sampling sites (5 or more), shown as major area A in Figure 3. B1 Ingenuity network derived from the module that was predictive of sampling sites (3), shown as minor area B in Figure 3. Ingenuity networks are coloured by mean gene expression in Brunsbuttel fish versus Alde fish with red for induction more than 2-fold, dark green for repression more than 2-fold, pink or light green for changes less than 2-fold. Uncoloured nodes were predicted by Ingenuity.
Gene expression and metabolic changes. Identifiable transcripts and metabolites that were significantly different between sampling sites (ANOVA FDR<0.05). Best viewed in MS-Excel.
Correlations of omic data with other variables. Correlations between gene and metabolite expression and chemistry data; comparisons of gene and metabolite expression with presence or absence of liver pathologies; comparisons of gene and metabolite expression with metallothionein quartile. Best viewed in MS-Excel.
Gene-chemical interactions associated with sampling sites. Best viewed in MS-Excel.
Omic data altered with Lepeophtheirus infection. Genes and metabolites altered with Lepeophtheirus infection in Morecambe Bay fish (T-test FDR<0.05). Best viewed in MS-Excel.
We thank S. Jondhale and A. Jones for assistance with transcriptomics, J. Byrne for metabolite identification and K. Dempsey (GCAL), V. Sabine (Stirling), K. Broeg, A. Koehler and colleagues (AWI, Bremerhaven) for provision of flounder samples.
Conceived and designed the experiments: MJL SGG MRV KJC FF. Performed the experiments: TDW AMD HW CM BPL GDS IK. Analyzed the data: TDW NT KLB OH JKA JBT JMH. Wrote the paper: TDW FF.
- 1. Van Aggelen G, Ankley GT, Baldwin WS, Bearden DW, Benson WH, et al. (2010) Integrating omic technologies into aquatic ecological risk assessment and environmental monitoring: hurdles, achievements, and future outlook. Environ Health Perspect 118: 1–5.G. Van AggelenGT AnkleyWS BaldwinDW BeardenWH Benson2010Integrating omic technologies into aquatic ecological risk assessment and environmental monitoring: hurdles, achievements, and future outlook.Environ Health Perspect11815
- 2. Roling JA, Bain LJ, Gardea-Torresdey J, Key PB, Baldwin WS (2007) Using mummichog (Fundulus heteroclitus) arrays to monitor the effectiveness of remediation at a superfund site in Charleston, South Carolina, U.S.A. Environ Toxicol Chem 26: 1205–1213.JA RolingLJ BainJ. Gardea-TorresdeyPB KeyWS Baldwin2007Using mummichog (Fundulus heteroclitus) arrays to monitor the effectiveness of remediation at a superfund site in Charleston, South Carolina, U.S.A.Environ Toxicol Chem2612051213
- 3. Baker ME, Ruggeri B, Sprague LJ, Eckhardt-Ludka C, Lapira J, et al. (2009) Analysis of endocrine disruption in Southern California coastal fish using an aquatic multispecies microarray. Environ Health Perspect 117: 223–230.ME BakerB. RuggeriLJ SpragueC. Eckhardt-LudkaJ. Lapira2009Analysis of endocrine disruption in Southern California coastal fish using an aquatic multispecies microarray.Environ Health Perspect117223230
- 4. Moran PW, Aluru N, Black RW, Vijayan MM (2007) Tissue contaminants and associated transcriptional response in trout liver from high elevation lakes of Washington. Environ Sci Technol 41: 6591–6597.PW MoranN. AluruRW BlackMM Vijayan2007Tissue contaminants and associated transcriptional response in trout liver from high elevation lakes of Washington.Environ Sci Technol4165916597
- 5. Fisher MA, Oleksiak MF (2007) Convergence and divergence in gene expression among natural populations exposed to pollution. BMC Genomics 8: 108.MA FisherMF Oleksiak2007Convergence and divergence in gene expression among natural populations exposed to pollution.BMC Genomics8108
- 6. Larsen PF, Nielsen EE, Williams TD, Hemmer-Hansen J, Chipman JK, et al. (2007) Adaptive differences in gene expression in European flounder (Platichthys flesus). Mol Ecol 16: 4674–4683.PF LarsenEE NielsenTD WilliamsJ. Hemmer-HansenJK Chipman2007Adaptive differences in gene expression in European flounder (Platichthys flesus).Mol Ecol1646744683
- 7. Larsen PF, Nielsen EE, Williams TD, Loeschcke V (2008) Intraspecific variation in expression of candidate genes for osmoregulation, heme biosynthesis and stress resistance suggests local adaptation in European flounder (Platichthys flesus). Heredity 101: 247–259.PF LarsenEE NielsenTD WilliamsV. Loeschcke2008Intraspecific variation in expression of candidate genes for osmoregulation, heme biosynthesis and stress resistance suggests local adaptation in European flounder (Platichthys flesus).Heredity101247259
- 8. Williams TD, Diab A, Ortega F, Sabine VS, Godfrey RE, et al. (2008) Transcriptomic responses of European flounder (Platichthys flesus) to model toxicants. Aquat Toxicol 90: 83–91.TD WilliamsA. DiabF. OrtegaVS SabineRE Godfrey2008Transcriptomic responses of European flounder (Platichthys flesus) to model toxicants.Aquat Toxicol908391
- 9. Falciani F, Diab AM, Sabine V, Williams TD, Ortega F, et al. (2008) Hepatic transcriptomic profiles of European flounder (Platichthys flesus) from field sites and computational approaches to predict site from stress gene responses following exposure to model toxicants. Aquat Toxicol 90: 92–101.F. FalcianiAM DiabV. SabineTD WilliamsF. Ortega2008Hepatic transcriptomic profiles of European flounder (Platichthys flesus) from field sites and computational approaches to predict site from stress gene responses following exposure to model toxicants.Aquat Toxicol9092101
- 10. Koehler A (2004) The gender-specific risk to liver toxicity and cancer of flounder (Platichthys flesus (L.)) at the German Wadden Sea coast. Aquat Toxicol 70: 257–276.A. Koehler2004The gender-specific risk to liver toxicity and cancer of flounder (Platichthys flesus (L.)) at the German Wadden Sea coast.Aquat Toxicol70257276
- 11. Stentiford GD, Longshaw M, Lyons BP, Jones G, Green M, et al. (2003) Histopathological biomarkers in estuarine fish species for the assessment of biological effects of contaminants. Mar Environ Res 55: 137–159.GD StentifordM. LongshawBP LyonsG. JonesM. Green2003Histopathological biomarkers in estuarine fish species for the assessment of biological effects of contaminants.Mar Environ Res55137159
- 12. Lyons BP, Stentiford GD, Green M, Bignell J, Bateman K, et al. (2004) DNA adduct analysis and histopathological biomarkers in European flounder (Platichthys flesus) sampled from UK estuaries. Mutat Res 552: 177–186.BP LyonsGD StentifordM. GreenJ. BignellK. Bateman2004DNA adduct analysis and histopathological biomarkers in European flounder (Platichthys flesus) sampled from UK estuaries.Mutat Res552177186
- 13. Basso K, Margolin AA, Stolovitzky G, Klein U, Dalla-Favera R, et al. (2005) Reverse engineering of regulatory networks in human B cells. Nat Genet 37: 382–390.K. BassoAA MargolinG. StolovitzkyU. KleinR. Dalla-Favera2005Reverse engineering of regulatory networks in human B cells.Nat Genet37382390
- 14. Lyons BP, Thain JE, Stentiford GD, Hylland K, Davies IM, et al. (2010) Using biological effects tools to define Good Environmental Status under the European Union Marine Strategy Framework Directive. Mar Pollut Bull 60: 1647–1651.BP LyonsJE ThainGD StentifordK. HyllandIM Davies2010Using biological effects tools to define Good Environmental Status under the European Union Marine Strategy Framework Directive.Mar Pollut Bull6016471651
- 15. Davis AP, Murphy CG, Saraceni-Richards CA, Rosenstein MC, Wiegers TC, et al. (2009) Comparative Toxicogenomics Database: a knowledgebase and discovery tool for chemical-gene-disease networks. Nucleic Acids Res 37: D786–792.AP DavisCG MurphyCA Saraceni-RichardsMC RosensteinTC Wiegers2009Comparative Toxicogenomics Database: a knowledgebase and discovery tool for chemical-gene-disease networks.Nucleic Acids Res37D786792
- 16. Pistocchi A, Loos R (2009) A map of European emissions and concentrations of PFOS and PFOA. Environ Sci Technol 43: 9237–9244.A. PistocchiR. Loos2009A map of European emissions and concentrations of PFOS and PFOA.Environ Sci Technol4392379244
- 17. Kiersch K, Jandl G, Meissner R, Leinweber P (2010) Small scale variability of chlorinated POPs in the river Elbe floodplain soils (Germany). Chemosphere 79: 745–753.K. KierschG. JandlR. MeissnerP. Leinweber2010Small scale variability of chlorinated POPs in the river Elbe floodplain soils (Germany).Chemosphere79745753
- 18. Blumberg PM (1988) Protein kinase C as the receptor for the phorbol ester tumor promoters: sixth Rhoads memorial award lecture. Cancer Res 48: 1–8.PM Blumberg1988Protein kinase C as the receptor for the phorbol ester tumor promoters: sixth Rhoads memorial award lecture.Cancer Res4818
- 19. Hook SE, Lampi MA, Febbo EJ, Ward JA, Parkerton TF (2010) Temporal patterns in the transcriptomic response of rainbow trout, Oncorhynchus mykiss, to crude oil. Aquat Toxicol 99: 320–329.SE HookMA LampiEJ FebboJA WardTF Parkerton2010Temporal patterns in the transcriptomic response of rainbow trout, Oncorhynchus mykiss, to crude oil.Aquat Toxicol99320329
- 20. Leaver MJ, Diab A, Boukouvala E, Williams TD, Chipman JK, et al. (2010) Hepatic gene expression in flounder chronically exposed to multiply polluted estuarine sediment: Absence of classical exposure ‘biomarker’ signals and induction of inflammatory, innate immune and apoptotic pathways. Aquat Toxicol 96: 234–245.MJ LeaverA. DiabE. BoukouvalaTD WilliamsJK Chipman2010Hepatic gene expression in flounder chronically exposed to multiply polluted estuarine sediment: Absence of classical exposure ‘biomarker’ signals and induction of inflammatory, innate immune and apoptotic pathways.Aquat Toxicol96234245
- 21. Southam AD, Easton JM, Stentiford GD, Ludwig C, Arvanitis TN, et al. (2008) Metabolic changes in flatfish hepatic tumours revealed by NMR-based metabolomics and metabolic correlation networks. J Proteome Res 7: 5277–5285.AD SouthamJM EastonGD StentifordC. LudwigTN Arvanitis2008Metabolic changes in flatfish hepatic tumours revealed by NMR-based metabolomics and metabolic correlation networks.J Proteome Res752775285
- 22. Small HJ, Williams TD, Sturve J, Chipman JK, Southam AD, et al. (2010) Gene expression analyses of hepatocellular adenoma and hepatocellular carcinoma from the marine flatfish Limanda limanda. Dis Aquat Organ 88: 127–141.HJ SmallTD WilliamsJ. SturveJK ChipmanAD Southam2010Gene expression analyses of hepatocellular adenoma and hepatocellular carcinoma from the marine flatfish Limanda limanda.Dis Aquat Organ88127141
- 23. Fricke B, Heink S, Steffen J, Kloetzel PM, Kruger E (2007) The proteasome maturation protein POMP facilitates major steps of 20S proteasome formation at the endoplasmic reticulum. EMBO Rep 8: 1170–1175.B. FrickeS. HeinkJ. SteffenPM KloetzelE. Kruger2007The proteasome maturation protein POMP facilitates major steps of 20S proteasome formation at the endoplasmic reticulum.EMBO Rep811701175
- 24. Tijet N, Boutros PC, Moffat ID, Okey AB, Tuomisto J, et al. (2006) Aryl hydrocarbon receptor regulates distinct dioxin-dependent and dioxin-independent gene batteries. Mol Pharmacol 69: 140–153.N. TijetPC BoutrosID MoffatAB OkeyJ. Tuomisto2006Aryl hydrocarbon receptor regulates distinct dioxin-dependent and dioxin-independent gene batteries.Mol Pharmacol69140153
- 25. Wiseman SB, Vijayan MM (2007) Aryl hydrocarbon receptor signaling in rainbow trout hepatocytes: role of hsp90 and the proteasome. Comp Biochem Physiol C Toxicol Pharmacol 146: 484–491.SB WisemanMM Vijayan2007Aryl hydrocarbon receptor signaling in rainbow trout hepatocytes: role of hsp90 and the proteasome.Comp Biochem Physiol C Toxicol Pharmacol146484491
- 26. Santiago-Josefat B, Pozo-Guisado E, Mulero-Navarro S, Fernandez-Salguero PM (2001) Proteasome inhibition induces nuclear translocation and transcriptional activation of the dioxin receptor in mouse embryo primary fibroblasts in the absence of xenobiotics. Mol Cell Biol 21: 1700–1709.B. Santiago-JosefatE. Pozo-GuisadoS. Mulero-NavarroPM Fernandez-Salguero2001Proteasome inhibition induces nuclear translocation and transcriptional activation of the dioxin receptor in mouse embryo primary fibroblasts in the absence of xenobiotics.Mol Cell Biol2117001709
- 27. Sun B, Karin M (2008) NF-kappaB signaling, liver disease and hepatoprotective agents. Oncogene 27: 6228–6244.B. SunM. Karin2008NF-kappaB signaling, liver disease and hepatoprotective agents.Oncogene2762286244
- 28. Andoh T (2007) Amino acids are more important insulinotropins than glucose in a teleost fish, barfin flounder (Verasper moseri). Gen Comp Endocrinol 151: 308–317.T. Andoh2007Amino acids are more important insulinotropins than glucose in a teleost fish, barfin flounder (Verasper moseri).Gen Comp Endocrinol151308317
- 29. Thangavel P, Sumathiral K, Karthikeyan S, Ramaswamy M (2005) Endocrine response of the freshwater teleost, Sarotherodon mossambicus (Peters) to dimecron exposure. Chemosphere 61: 1083–1092.P. ThangavelK. SumathiralS. KarthikeyanM. Ramaswamy2005Endocrine response of the freshwater teleost, Sarotherodon mossambicus (Peters) to dimecron exposure.Chemosphere6110831092
- 30. Yamamoto Y, Moore R, Hess HA, Guo GL, Gonzalez FJ, et al. (2006) Estrogen receptor alpha mediates 17alpha-ethynylestradiol causing hepatotoxicity. J Biol Chem 281: 16625–16631.Y. YamamotoR. MooreHA HessGL GuoFJ Gonzalez2006Estrogen receptor alpha mediates 17alpha-ethynylestradiol causing hepatotoxicity.J Biol Chem2811662516631
- 31. Maass T, Thieringer FR, Mann A, Longerich T, Schirmacher P, et al. (2010) Liver specific overexpression of platelet-derived growth factor-B accelerates liver cancer development in chemically induced liver carcinogenesis. Int J Cancer 128: 1259–1268.T. MaassFR ThieringerA. MannT. LongerichP. Schirmacher2010Liver specific overexpression of platelet-derived growth factor-B accelerates liver cancer development in chemically induced liver carcinogenesis.Int J Cancer12812591268
- 32. Bierie B, Moses HL (2010) Transforming growth factor beta (TGF-beta) and inflammation in cancer. Cytokine Growth Factor Rev 21: 49–59.B. BierieHL Moses2010Transforming growth factor beta (TGF-beta) and inflammation in cancer.Cytokine Growth Factor Rev214959
- 33. Yazawa R, Hirono I, Ohira T, Aoki T (2005) Functional analysis of tumor necrosis factor gene promoter from Japanese flounder, Paralichthys olivaceus, using fish cell lines. Dev Comp Immunol 29: 73–81.R. YazawaI. HironoT. OhiraT. Aoki2005Functional analysis of tumor necrosis factor gene promoter from Japanese flounder, Paralichthys olivaceus, using fish cell lines.Dev Comp Immunol297381
- 34. Farazi PA, DePinho RA (2006) Hepatocellular carcinoma pathogenesis: from genes to environment. Nat Rev Cancer 6: 674–687.PA FaraziRA DePinho2006Hepatocellular carcinoma pathogenesis: from genes to environment.Nat Rev Cancer6674687
- 35. Fernandez M, Semela D, Bruix J, Colle I, Pinzani M, et al. (2009) Angiogenesis in liver disease. J Hepatol 50: 604–620.M. FernandezD. SemelaJ. BruixI. ColleM. Pinzani2009Angiogenesis in liver disease.J Hepatol50604620
- 36. Warner FJ, Lubel JS, McCaughan GW, Angus PW (2007) Liver fibrosis: a balance of ACEs? Clin Sci (Lond) 113: 109–118.FJ WarnerJS LubelGW McCaughanPW Angus2007Liver fibrosis: a balance of ACEs?Clin Sci (Lond)113109118
- 37. Yoshiji H, Kuriyama S, Yoshii J, Ikenaka Y, Noguchi R, et al. (2001) Angiotensin-II type 1 receptor interaction is a major regulator for liver fibrosis development in rats. Hepatology 34: 745–750.H. YoshijiS. KuriyamaJ. YoshiiY. IkenakaR. Noguchi2001Angiotensin-II type 1 receptor interaction is a major regulator for liver fibrosis development in rats.Hepatology34745750
- 38. Jonsson JR, Clouston AD, Ando Y, Kelemen LI, Horn MJ, et al. (2001) Angiotensin-converting enzyme inhibition attenuates the progression of rat hepatic fibrosis. Gastroenterology 121: 148–155.JR JonssonAD CloustonY. AndoLI KelemenMJ Horn2001Angiotensin-converting enzyme inhibition attenuates the progression of rat hepatic fibrosis.Gastroenterology121148155
- 39. Stentiford G, Bignell JP, Lyons BP, Feist SW (2009) Site-specific disease profiles in fish and their use in environmental monitoring. Marine Ecology Progress Series 381: 1–5.G. StentifordJP BignellBP LyonsSW Feist2009Site-specific disease profiles in fish and their use in environmental monitoring.Marine Ecology Progress Series38115
- 40. Feist SW, Lang T, Stentiford GD, Kohler A (2004) Biological effects of contaminants: use of liver pathology of the European flatfish dab (Limanda limanda L.) and flounder (Platichthys flesus L.) for monitoring. ICES Techniques in Marine Environmental Sciences 38: 42.SW FeistT. LangGD StentifordA. Kohler2004Biological effects of contaminants: use of liver pathology of the European flatfish dab (Limanda limanda L.) and flounder (Platichthys flesus L.) for monitoring.ICES Techniques in Marine Environmental Sciences3842
- 41. Kirby MF, Allen YT, Dyer RA, Feist SW, Katsiadaki I, et al. (2004) Surveys of plasma vitellogenin and intersex in male flounder (Platichthys flesus) as measures of endocrine disruption by estrogenic contamination in United Kingdom estuaries: temporal trends, 1996 to 2001. Environ Toxicol Chem 23: 748–758.MF KirbyYT AllenRA DyerSW FeistI. Katsiadaki2004Surveys of plasma vitellogenin and intersex in male flounder (Platichthys flesus) as measures of endocrine disruption by estrogenic contamination in United Kingdom estuaries: temporal trends, 1996 to 2001.Environ Toxicol Chem23748758
- 42. George SG, Young P (1986) The time course of effects of cadmium and 3-methylcholanthrene on activities of enzymes of xenobiotic metabolism and metallothionein levels in the plaice, Pleuronectes platessa. Comp Biochem Physiol C 83: 37–44.SG GeorgeP. Young1986The time course of effects of cadmium and 3-methylcholanthrene on activities of enzymes of xenobiotic metabolism and metallothionein levels in the plaice, Pleuronectes platessa.Comp Biochem Physiol C833744
- 43. Williams TD, Lee JS, Sheader DL, Chipman JK (2000) The cytochrome P450 1A gene (CYP1A) from European flounder (Platichthys flesus), analysis of regulatory regions and development of a dual luciferase reporter gene system. Mar Environ Res 50: 1–6.TD WilliamsJS LeeDL SheaderJK Chipman2000The cytochrome P450 1A gene (CYP1A) from European flounder (Platichthys flesus), analysis of regulatory regions and development of a dual luciferase reporter gene system.Mar Environ Res5016
- 44. Leaver MJ, Wright J, George SG (1997) Structure and expression of a cluster of glutathione S-transferase genes from a marine fish, the plaice (Pleuronectes platessa). Biochemical Journal 321: 405–412.MJ LeaverJ. WrightSG George1997Structure and expression of a cluster of glutathione S-transferase genes from a marine fish, the plaice (Pleuronectes platessa).Biochemical Journal321405412
- 45. Leaver MJ, Boukouvala E, Antonopoulou E, Diez A, Favre-Krey L, et al. (2005) Three peroxisome proliferator-activated receptor isotypes from each of two species of marine fish. Endocrinology 146: 3150–3162.MJ LeaverE. BoukouvalaE. AntonopoulouA. DiezL. Favre-Krey2005Three peroxisome proliferator-activated receptor isotypes from each of two species of marine fish.Endocrinology14631503162
- 46. Raymond M, Rousset F (1995) GENEPOP(V. 1.2): A population genetics software for exact tests and ecumenicism. J Hered 86: 248–249.M. RaymondF. Rousset1995GENEPOP(V. 1.2): A population genetics software for exact tests and ecumenicism.J Hered86248249
- 47. Felsenstein J (1989) PHYLIP - Phylogeny Inference Package (Version 3.2). Cladistics 5: 164–166.J. Felsenstein1989PHYLIP - Phylogeny Inference Package (Version 3.2).Cladistics5164166
- 48. Williams TD, Diab AM, George SG, Godfrey RE, Sabine V, et al. (2006) Development of the GENIPOL European flounder (Platichthys flesus) microarray and determination of temporal transcriptional responses to cadmium at low dose. Environ Sci Technol 40: 6479–6488.TD WilliamsAM DiabSG GeorgeRE GodfreyV. Sabine2006Development of the GENIPOL European flounder (Platichthys flesus) microarray and determination of temporal transcriptional responses to cadmium at low dose.Environ Sci Technol4064796488
- 49. Diab AM, Williams TD, Sabine VS, Chipman JK, George SG (2008) The GENIPOL European flounder Platichthys flesus L. toxicogenomics microarray: application for investigation of the response to furunculosis vaccination. J Fish Biol 72: 2154–2169.AM DiabTD WilliamsVS SabineJK ChipmanSG George2008The GENIPOL European flounder Platichthys flesus L. toxicogenomics microarray: application for investigation of the response to furunculosis vaccination.J Fish Biol7221542169
- 50. Wu H, Southam AD, Hines A, Viant MR (2008) High-throughput tissue extraction protocol for NMR- and MS-based metabolomics. Anal Biochem 372: 204–212.H. WuAD SouthamA. HinesMR Viant2008High-throughput tissue extraction protocol for NMR- and MS-based metabolomics.Anal Biochem372204212
- 51. Huang X, Madan A (1999) CAP3: A DNA sequence assembly program. Genome Res 9: 868–877.X. HuangA. Madan1999CAP3: A DNA sequence assembly program.Genome Res9868877
- 52. Bligh EG, Dyer WJ (1959) A rapid method of total lipid extraction and purification. Can J Biochem Physiol 37: 911–917.EG BlighWJ Dyer1959A rapid method of total lipid extraction and purification.Can J Biochem Physiol37911917
- 53. Katsiadaki I, Williams TD, Ball JS, Bean TP, Sanders MB, et al. (2010) Hepatic transcriptomic and metabolomic responses in the Stickleback (Gasterosteus aculeatus) exposed to ethinyl-estradiol. Aquat Toxicol 97: 174–187.I. KatsiadakiTD WilliamsJS BallTP BeanMB Sanders2010Hepatic transcriptomic and metabolomic responses in the Stickleback (Gasterosteus aculeatus) exposed to ethinyl-estradiol.Aquat Toxicol97174187
- 54. Daub CO, Kloska S, Selbig J (2003) MetaGeneAlyse: analysis of integrated transcriptional and metabolite data. Bioinformatics 19: 2332–2333.CO DaubS. KloskaJ. Selbig2003MetaGeneAlyse: analysis of integrated transcriptional and metabolite data.Bioinformatics1923322333
- 55. Johnson WE, Li C, Rabinovic A (2007) Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics 8: 118–127.WE JohnsonC. LiA. Rabinovic2007Adjusting batch effects in microarray expression data using empirical Bayes methods.Biostatistics8118127
- 56. Golotvin S, Williams A (2000) Improved baseline recognition and modeling of FT NMR spectra. J Magn Reson 146: 122–125.S. GolotvinA. Williams2000Improved baseline recognition and modeling of FT NMR spectra.J Magn Reson146122125
- 57. Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: A practical and powerful approach to multiple testing. J R Statist Soc B 57: 289–300.Y. BenjaminiY. Hochberg1995Controlling the false discovery rate: A practical and powerful approach to multiple testing.J R Statist Soc B57289300
- 58. Conesa A, Gotz S, Garcia-Gomez JM, Terol J, Talon M, et al. (2005) Blast2GO: a universal tool for annotation, visualization and analysis in functional genomics research. Bioinformatics 21: 3674–3676.A. ConesaS. GotzJM Garcia-GomezJ. TerolM. Talon2005Blast2GO: a universal tool for annotation, visualization and analysis in functional genomics research.Bioinformatics2136743676
- 59. Gotz S, Garcia-Gomez JM, Terol J, Williams TD, Nagaraj SH, et al. (2008) High-throughput functional annotation and data mining with the Blast2GO suite. Nucleic Acids Res 36: 3420–3435.S. GotzJM Garcia-GomezJ. TerolTD WilliamsSH Nagaraj2008High-throughput functional annotation and data mining with the Blast2GO suite.Nucleic Acids Res3634203435
- 60. Bluthgen N, Brand K, Cajavec B, Swat M, Herzel H, et al. (2005) Biological profiling of gene groups utilizing Gene Ontology. Genome Inform 16: 106–115.N. BluthgenK. BrandB. CajavecM. SwatH. Herzel2005Biological profiling of gene groups utilizing Gene Ontology.Genome Inform16106115
- 61. Herbert JM, Buffa FM, Vorschmitt H, Egginton S, Bicknell R (2009) A new procedure for determining the genetic basis of a physiological process in a non-model species, illustrated by cold induced angiogenesis in the carp. BMC Genomics 10: 490.JM HerbertFM BuffaH. VorschmittS. EggintonR. Bicknell2009A new procedure for determining the genetic basis of a physiological process in a non-model species, illustrated by cold induced angiogenesis in the carp.BMC Genomics10490
- 62. Saeed AI, Bhagabati NK, Braisted JC, Liang W, Sharov V, et al. (2006) TM4 microarray software suite. Methods Enzymol 411: 134–193.AI SaeedNK BhagabatiJC BraistedW. LiangV. Sharov2006TM4 microarray software suite.Methods Enzymol411134193
- 63. Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, et al. (2003) Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res 13: 2498–2504.P. ShannonA. MarkielO. OzierNS BaligaJT Wang2003Cytoscape: a software environment for integrated models of biomolecular interaction networks.Genome Res1324982504
- 64. Abraham K, Sameith K, Falciani FImproving functional module detection; 2009; Ohio.110–115.K. AbrahamK. SameithF. FalcianiImproving functional module detection; 2009; Ohio.110115
- 65. Trevino V, Falciani F (2006) GALGO: an R package for multivariate variable selection using genetic algorithms. Bioinformatics 22: 1154–1156.V. TrevinoF. Falciani2006GALGO: an R package for multivariate variable selection using genetic algorithms.Bioinformatics2211541156
- 66. Dennis G Jr, Sherman BT, Hosack DA, Yang J, Gao W, et al. (2003) DAVID: Database for Annotation, Visualization, and Integrated Discovery. Genome Biol 4: P3.G. Dennis JrBT ShermanDA HosackJ. YangW. Gao2003DAVID: Database for Annotation, Visualization, and Integrated Discovery.Genome Biol4P3
- 67. Huang da W, Sherman BT, Lempicki RA (2009) Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc 4: 44–57.W. Huang daBT ShermanRA Lempicki2009Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources.Nat Protoc44457