Genome sequencing projects provide nearly complete lists of the individual components present in an organism, but reveal little about how they work together. Follow-up initiatives have deciphered thousands of dynamic and context-dependent interrelationships between gene products that need to be analyzed with novel bioinformatics approaches able to capture their complex emerging properties. Here, we present a novel framework for the alignment and comparative analysis of biological networks of arbitrary topology. Our strategy includes the prediction of likely conserved interactions, based on evolutionary distances, to counter the high number of missing interactions in the current interactome networks, and a fast assessment of the statistical significance of individual alignment solutions, which vastly increases its performance with respect to existing tools. Finally, we illustrate the biological significance of the results through the identification of novel complex components and potential cases of cross-talk between pathways and alternative signaling routes.
Citation: Pache RA, Aloy P (2012) A Novel Framework for the Comparative Analysis of Biological Networks. PLoS ONE7(2): e31220. https://doi.org/10.1371/journal.pone.0031220
Editor: Philip M. Kim, University of Toronto, Canada
Received: November 14, 2011; Accepted: January 4, 2012; Published: February 21, 2012
Copyright: © 2012 Pache, Aloy. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was partially supported by the Spanish Ministerio de Ciencia e Innovación (PSE-010000-2009-1; BIO2010-22073) and the European Commission under FP7 Grant Agreement 223101 (AntiPathoGN). RAP is a recipient of the Spanish FPU fellowship. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Genome sequencing projects provide nearly complete lists of the genes and gene products present in an organism, including human , . However, biological systems are often complex, and knowledge of the individual components reveals little about how they work together to create a living entity. Follow-up initiatives to the sequencing projects have thus focused on deciphering the thousands of interrelationships between proteins and have already delivered the first drafts of whole species interactomes (e.g. –). Moreover, large efforts are now being put into identifying the changes that biological networks undergo in response to different stimuli , . To understand and interpret this deluge of data we need novel bioinformatics approaches able to tackle interactome networks as a whole and to capture their complex dynamics and emerging properties. Based on the success of sequence alignment methods and comparative genomics, we expect that the global comparison of interactomes from different species will vastly increase our understanding of cellular events, evolution and adaptation to changing environmental conditions, as well as shed light on the evolutionary mechanisms that lead to species diversity , .
In the last years, several global and local pathway alignment algorithms have been developed to extract the most out of interactome networks (e.g. –). However, existing strategies suffer from important limitations: For instance, the inability to properly handle the large fraction of false negatives (i.e. not reported interactions) present in the current versions of interactome networks , and the lack of support for intra-species comparison, hamper the detection of alternative routes and prevent the identification of backup circuits and cross-talk between pathways of the same species. In addition, most tools are tailored towards detecting classical linear pathways or well-connected permanent complexes, which we know are an exception, and are much less effective at aligning dynamic networks of arbitrary topology. Moreover, many current methods are based on empirical scoring schemes and not backed-up by probabilistic models, being thus unable to provide a clear assessment of the statistical significance of alignment solutions . Overall, these obstacles, together with difficult front-end implementations, have prevented the general applicability of network alignment methods.
Here, we describe a novel pairwise network alignment algorithm that addresses all those limitations, featuring fast global and local alignment of networks of arbitrary topology, both between different species and within the same organism. In addition, we benchmark its performance in several alignment tasks (i.e. interactome to interactome, complex to interactome and pathway to interactome) and illustrate the biological significance of the results through the identification of novel complex components and potential cases of cross-talk between pathways and alternative signaling routes.
Results and Discussion
Network alignment strategy
Given two input networks and a set of homology relationships between the proteins in those networks, the aim is to identify conserved subnetworks, considering both the presence of false positive and false negative interactions, as well as accounting for small amounts of network rewiring during evolution. To solve this problem, we developed a novel method (NetAligner) that allows fast and accurate alignment of protein interaction networks based on the following six steps: (i) construction of an initial alignment graph, (ii) identification of alignment seeds, (iii) extension of the alignment graph, (iv) definition of the alignment solutions, (v) scoring of the alignment solutions and (vi) assessment of their statistical significance (Fig. 1).
1) Pairs of orthologous proteins between the two input networks are identified, with the possibility to include or exclude distant homologs. Each vertex in the network represents a pair of orthologs. Vertex probabilities are indicated by different shades of blue, ranging from 0 (white) to 1 (blue). 2.) The initial alignment graph is constructed by drawing edges between vertices that are involved in a conserved interaction (green). Likely conserved interactions for all pairs of orthologs with an interaction in at least one of the input networks can also be considered (yellow). Edges with a low probability are filtered out based on the given edge probability threshold. 3.) To identify alignment solution seeds, we search for connected components in the initial alignment graph (red ellipses). 4.) The alignment graph is then extended by connecting vertices of different seeds through gap or mismatch edges (dashed lines) if the given orthologs are connected by indirect interactions in one or both input networks, respectively. Again, the edge probability threshold is used to filter out false positives. 5.) Lastly, we search for connected components in the extended alignment graph, which represent the final alignment solutions (red ellipses), and determine their statistical significance (see Materials and Methods). These and all subsequent network representations were created with Cytoscape .
We start by constructing an initial alignment graph, consisting of pairs of orthologous proteins from the two input networks placed as vertices and conserved interactions as edges between vertices (i.e. overlaying the two networks). Orthology information can either come from public databases, such as Ensembl , or computed ad hoc from reciprocal BLAST  searches for those pairs of species for which homology data is not readily available. Each alignment graph vertex is assigned a probabilistic measure of protein similarity (see Materials and Methods), and there is a vertex probability threshold to filter out distant homology relationships, which also helps in reducing the number of false positive interactions originating from false protein matchings. The algorithm then connects those vertices that represent pairs of orthologues with conserved interactions. In the case of intra-species network alignment, the matching of proteins between the two input networks is instead based on a list of paralogous proteins (or pairs of identical proteins if desired by the user).
A key issue in network biology is the large number of interactions that have not yet been detected , and that represent a clear limitation when comparing two interactomes. Sharan et al.  tackled this issue by introducing a parameter to estimate the fraction of missing interactions. Though, since it is a global parameter, it cannot consider differences in the evolutionary pressures acting upon distinct proteins. This is crucial, however, as interactions impose certain constraints on sequence divergence and evolution , , which may result in co-adaptation at the residue level, either directly through correlated mutations in the interaction interface  or indirectly via allosteric effects , . In NetAligner, we profit from the observation that interacting proteins evolve at rates significantly closer than expected by chance  (even within the same functional module ) to predict the probabilities for likely conserved interactions based on the difference of the evolutionary distances (or divergence in case of intra-species network alignment) between the protein pairs involved in the interactions (see Materials and Methods). NetAligner is hence the first network alignment algorithm that directly addresses the issue of false negatives in current interactomes by specifically predicting likely conserved interactions. For all conserved or likely conserved interactions, we then compute the probabilities of the corresponding edges in the alignment graph, respecting both interaction conservation probabilities and interaction reliabilities (see Materials and Methods), and offer the possibility to set an edge probability threshold to filter out false positive interactions by removing those edges from the alignment graph that consist of mainly unreliable interactions (e.g. those supported by only one publication).
After constructing the initial alignment graph, we identify core conserved subnetworks, which serve as alignment seeds, by searching for connected components in the graph using depth first search (DFS). In contrast to many existing tools , , , we consider all pairs of orthologous proteins simultaneously during alignment seed identification, meaning that instead of constructing one seed for each possible combination of interacting pairs of orthologues, we include all of them into the same seed (as long as they are connected through conserved or likely conserved interactions). This circumvents the combinatorial explosion linked to the construction of alignments with different sets of orthologues, reducing algorithm complexity, and allows the accurate modeling of evolutionary duplication events leading to one-to-many and many-to-many orthology relationships , .
To identify conserved subnetworks despite slight connectivity changes, we extend the initial alignment graph through edges allowing for gaps and mismatches, where pairs of orthologous proteins in different seeds are connected through an indirect interaction in one or both of the input networks, respectively. Note that we search for gaps/mismatches only between, but not within alignment seeds, since this would in most cases yield too many potentially false positive hits, because alignment seeds represent connected components of (likely) conserved interactions, and many pairs of seed nodes could thus be bridged by indirect interactions. Unlike existing tools for network alignment , , we tolerate gaps and mismatches of any length, although, due to the small-world structure of most interactomes , we recommend to restrict the maximum gap length to three edges to avoid connecting unrelated proteins. To decide on the inclusion of gaps and mismatches, we search for the shortest weighted paths in the input networks that connect pairs of homologous proteins in different seeds through a modified version of Dijkstra's algorithm , which considers only paths up to a user-defined length. Gap and mismatch edges are penalized automatically , with their probabilities being computed as the joint probability of the individual interactions (see Materials and Methods), and edges with probabilities below the user-defined threshold are filtered out.
We then identify the final alignment solutions by searching for connected components in the extended alignment graph, again using DFS. This, together with our strategy for finding alignment seeds, ensures that the alignment solutions are maximal (i.e. no pair of orthologous proteins is common to any two alignment solutions). Since complexes or pathways that share components are thus automatically part of the same alignment solution, we circumvent the problem of having to merge overlapping solutions in a postprocessing step that many existing tools have to execute , , .
To assess the quality of an alignment solution represented by the graph , following the approach by Kelley et al. , we devised the following overall scoring function to combine the individual vertex and edge probabilities into a single score for each alignment solution:with and denoting the sets of vertices and edges of , respectively, and the vertex to edge score balance, which allows the user to control the impact of vertex scores and edge scores on the final score. Those scores are calculated in the same way to make them directly comparable:with and being the probabilities of the vertex and of the edge between and , respectively (see Materials and Methods). Treating the underlying probabilities in the same way when calculating the vertex and edge scores (i.e. by taking the logarithm) ensures that the weight α directly determines the vertex to edge score balance in the final scoring function. Taking the logarithm does not affect the relative ranking of alignment solutions, because all alignment solution scores are calculated in this manner. Adding one to the probabilities only ensures that the scores are positive and that alignment solutions can be ranked by decreasing score, but does not affect the alignment results.
To test the statistical significance of alignment solutions, we implemented a fast Monte-Carlo permutation test that preserves network topologies (see Materials and Methods) and thus allows to discriminate significant solutions from simply high-scoring ones (which also ensures that large alignment solutions are not automatically significant). Alignment solutions with insignificant p-values can also represent cases with many potential false positive interactions. This is because those alignment solutions would receive low scores and thus more likely get insignificant p-values in the Monte-Carlo permutation test. In contrast to many existing network alignment strategies , , our significance test does not involve rewiring of the input networks and performing additional alignments, since this would require a considerable amount of computational resources. Instead, we chose the much faster and thus more practical option of building random backgrounds of alignment solution scores separately for each alignment solution based on random sampling of the input data. The NetAligner program package and the associated web-tool can be downloaded and accessed from http://sbnb.irbbarcelona.org/resources.
Interactome to interactome alignment
Because of the ever increasing number of comprehensive interactomes available for species from all kingdoms of life, we anticipate that one of the applications where NetAligner will have an immediate impact is precisely in the direct comparison of whole-interactome networks to unveil conserved subnetworks. This feature is particularly useful in those cases where little is known for either of the species considered, which precludes the use of annotation strategies relying on pre-existing information. In addition, recent efforts to chart the rewiring of biological networks in response to certain stimuli also make interactome to interactome alignment strategies paramount to readily identify the differential dynamic links between conserved biological modules .
To assess the performance of our alignment method in the identification of functional modules spanning out from the direct comparison of two interactome networks, and compare it to the current standards in the field, we created a benchmark set consisting of 71 non-redundant conserved human/yeast complex pairs, with a number of protein components ranging from 2 to 18 (Tables S1 and S2). We restricted our benchmark set to human and yeast due to a lack of reliable datasets of protein complexes in other model organisms for which interaction data is available. We evaluated algorithm performance in terms of precision and recall on several levels of detail, using a cross-evaluation procedure to avoid parameter overfitting (see Materials and Methods and Fig. S1A). Using default parameters (Table S3), we found that NetAligner is, on average, able to automatically rediscover 44% of the known complexes common to human and yeast (i.e. recall). In addition, only about 15% of the significantly conserved subnetworks identified between these two species correspond to known complexes (i.e. precision), the rest representing potentially novel functional modules. If we evaluate the results in terms of the proteins belonging to complexes and thus the quality of the alignment solutions found, the precision is 19% while the recall of known protein components is 35% (Fig. 2A). Figures for the individual runs can be found in the Table S2. These results significantly outperform by more than tenfold the current standard in the field  both in precision and recall, with p-values ranging from to , while requiring only a fraction of the runtime (on average: NetworkBLAST 1,633 s, NetAligner 54 s). Here, predicting likely conserved interactions did not increase alignment performance, instead leading to the identification of larger conserved subnetworks, consisting of several interconnected functional modules. In fact, the performance increase compared to NetworkBLAST is due to NetAligner being better at handling binary and sparsely-connected complexes, while NetworkBLAST is limited to the identification of conserved multi-protein complexes that are well-connected. It is also worth stressing that, although some predicted relationships that are considered mispredictions in our benchmark are likely to be false positives, others might represent novel complex components or connect different complexes into higher order functional assemblies with biological relevance, such as the 26S proteasome  (Fig. S2). Indeed, the moderate levels of precision achieved when comparing whole interactomes are in contrast to those attained when either multi-protein complexes or pathways are known for one of the species and can thus be used as queries (Fig. 2B and C). This suggests that, since the algorithm is performing at a very high level for known complexes/pathways, it is likely that many of the significant hits identified in the whole-interactome comparison, and that we considered as false positives, do in fact correspond to functional modules not yet described. It is worth noting, however, that the identification of conserved pathways through interactome to interactome alignment is not yet possible given the current interaction data, since the strict parameters required when aligning thousands of interactions (to avoid finding only very large conserved subnetworks) cannot account for the lack of coverage of biological pathways in current interactomes.
Performance of NetAligner (blue) measured in A) interactome to interactome, B) complex to interactome and C) pathway to interactome alignment benchmarks in comparison to the current standard in the field (NetworkBLAST  and IsoRank ; grey). Precision and recall are shown on the complex/pathway and protein level, separately for each species pair (e.g. H/Y for human vs. yeast), using default parameters (see Materials and Methods). We calculated the statistical significance of the performance differences using a two-sided Fisher's exact test (with a standard p-value threshold of 0.05) and marked all significant values with an asterisk.
An illustrative example of the biological relevance of this application comes from the alignment of the yeast vs. human interactomes, where we identified de novo the COP9 signalosome (CSN) (alignment solution p-value), a multifunctional protein complex known to be conserved throughout eukaryotes and critical for organism development . The CSN participates in ubiquitin-dependent proteolysis , and its components are homologous to the proteins of the lid subcomplex of the 19S regulatory particle of the proteasome. The conserved interactions identified in the alignment support the hypothesis that the CSN might be able to act as a substitute for the lid subcomplex of the proteasome , providing a mechanistic rationale for why one complex might be able to replace another, which cannot be gained from comparing homologous proteins individually or using other alignment strategies (Fig. 3A). In fact, NetworkBLAST was not able to identify the match between the yeast 19/22S regulator and the human CSN complex, correctly aligning only one protein (RPN5 (yeast) to CSN4 (human)). On the other hand, the (mismatch) connection between the pairs of homologous proteins RPN11/CSN5 and CDC28/CDK2, revealed by NetAligner, suggests a functional role of the CSN complex in cell-cycle control through interaction with cyclins and cyclin-dependent kinases (Fig. 3A). Indeed, the CSN has been found to be important for cell-cycle entry and progression by promoting the degradation of CDN1B (cyclin-dependent kinase inhibitor p27), which results in the activation of the cyclin-dependent kinase CDK2 . This link to cell proliferation, identified by NetAligner, might help explaining why overexpression of CSN components can lead to oncogenesis in human , . Overall, NetAligner facilitates the identification of conserved protein modules in different species from interactome data only. While conserved interactions highlight similarities in complex topology between two species, the identification of non-identical yet similar network regions through gaps and mismatches in the alignment permits to uncover functional connections affected by minor network rewiring during evolution.
A) Interactome to interactome alignment: alignment of the yeast to the human interactome indicates that the COP9 signalosome (CSN) might be able to substitute the lid subcomplex of the proteasome and suggests a functional role of the CSN in cell-cycle control through interaction with cyclins and cyclin-dependent kinases. B) Complex to interactome alignment: alignment of the human DNA polymerase α - primase complex to the yeast interactome reveals a similar topology of the complex in the two organisms and hints towards a potential cross-talk between the DNA polymerases α and δ in yeast. C) Pathway to interactome alignment: alignment of the fly PI3K-AKT-IKK signalling pathway to the human interactome predicts an IKKB homo- to IKKA/IKKB heteromultimer evolution and uncovers different interaction patterns of IKK with the three AKT isoforms in human, indicating different roles in cellular signalling events. See main text for details. Vertices represent pairs of orthologous proteins. Edges denote either conserved interactions (green), interactions in the query (blue) or target species (yellow) that are likely conserved, gaps in the query (magenta) or target network (orange), or mismatches (dark red). The similarity of aligned proteins on the sequence level is represented by the respective vertex probability, ranging from 0 (dissimilar; white) to 1 (highly similar; blue). Phosphorylations (P) are shown as red spheres.
Complex to interactome alignment
When protein complexes are well characterized for a given species, we can use them as query to identify their counterparts in other organisms. To benchmark the performance of NetAligner in this alignment task, we again used the set of 71 non-redundant conserved human/yeast complex pairs, aligning each human complex to the yeast interactome and vice versa (see Materials and Methods). We determined the complex- and protein-level performance as in the interactome to interactome alignment benchmark, again using cross-evaluation to avoid parameter overfitting (see Materials and Methods and Fig. S1B). Using the respective default parameters (Table S3), we found that NetAligner could correctly identify as the top-ranked significant solution 55% of the query complexes with a precision of 81%, on average. These figures decrease to 45% and 54%, respectively, when assessing the quality of the alignment solutions found, using the number of correctly identified protein complex components as a measure of performance (Fig. 2B). In this case, our methodology also significantly outperforms the current standard in the field, IsoRank  for this particular task, doubling both precision and recall, with p-values ranging from to , with one insignificant increase of recall from 20.3% to 37.5% for the yeast vs. human comparison (p-value = 0.05). Here, the large increase in performance comes from NetAligner being able to address the incompleteness of current interactomes through the prediction of likely conserved interactions beyond what is possible with gaps and mismatches alone. Indeed, NetAligner was only able to outperform IsoRank once we activated the option to predict likely conserved interactions, underlining the importance of this novel functionality. We would like to highlight that NetAligner only produces 0.71 significant solutions per complex on average, meaning that its statistical assessment of the results is indeed very good at avoiding the identification of partial complexes.
An example of the biological applicability of complex to interactome alignment is the DNA polymerase α – primase machinery, which we retrieved when aligning the set of human complexes to the yeast interactome (alignment solution p-value = ). This complex is highly conserved and the only eukaryotic DNA polymerase that can initiate DNA synthesis de novo . The alignment solution between the human and yeast complexes, not detected by IsoRank (i.e. IsoRank correctly matched only one protein, DPOLA (human) to DPOA (yeast)), shows many conserved interactions between their components, suggesting a similar topology in the two species (Fig. 3B). In addition, NetAligner predicted the interaction between the two primase subunits PRI1 and PRI2 in yeast, as well as the self-interaction of DPOA2, to be likely conserved in human, proposing new interactions to be tested experimentally. The inclusion of the yeast DNA polymerase δ and ζ subunits DPOD and DPOZ in the alignment suggests that, if needed, they might be able to substitute for the DNA polymerase α subunit DPOA, or a potential cross-talk between the different DNA polymerases in yeast (Fig. 3B). Indeed, Pavlov et al.  reported evidence that errors made by DNA polymerase α during lagging strand replication are corrected by DNA polymerase δ. Thus, NetAligner is both able to identify conserved complex topologies, as well as suggest likely conserved interactions and cross-talk events between similar protein complexes.
Pathway to interactome alignment
A similar procedure can be applied to identify biological pathways of arbitrary topology and complexity in whole species interactomes, and to assess pathway conservation across different organisms or to identify alternative pathways and backup circuits within a given species. To assess alignment performance in this task, we compiled a benchmark set of 19 human/fly, 32 human/yeast and 13 fly/yeast non-redundant conserved pathway pairs (see Materials and Methods and Table S4), since these are the three model organisms with the best coverage of their interactomes and annotation of biological pathways. We aligned each pathway of a given species to the interactomes of the other two organisms and considered only the highest-ranked significant alignment solution for each query pathway, evaluating algorithm performance on the pathway-, protein- and interaction level and using cross-evaluation to avoid overfitting (see Materials and Methods and Fig. S1C). Using the given default parameters (Table S3), NetAligner correctly identified a significant solution for 55% of the query pathways with a precision of 80%, obtaining very similar results as for the complex to interactome alignment task, despite the much higher variation in the topologies of pathways. These figures decrease to 38% and 60%, respectively, when assessing the quality of the alignments, using the number of correctly identified protein components as a measure of performance (Fig. 2C and Fig. S3). Again, our methodology significantly outperforms the current standard in the field , with two notable but insignificant increases of recall for the yeast/fly and yeast/human pairs, while requiring only a fraction of the runtime (on average: IsoRank 46 s, NetAligner 5 s). Like in complex to interactome alignment, predicting likely conserved interactions turned out to be crucial in outperforming IsoRank, again highlighting the importance of this novel approach at addressing the large number of missing interactions in current interactome networks. NetAligner always finds less than a handful of significant alignment solutions per query pathway (in most cases only one), showing a good discretization of the complex interaction space into functional subnetworks.
A clarifying example of the potential of this functionality is the identification and alignment of fly pathways within the human interactome, where we recovered 13 out of the 19 conserved human pathways (68%) without any manual intervention. One of these was the PI3K-AKT-IKK signalling pathway (alignment solution p-value = ), which is an important positive regulator of the transcription factor NF-κB, resulting in the transcription of anti-apoptotic genes . In this three-step signalling cascade, phosphatidylinositol-3 kinase (PI3K) phosphorylates protein kinase B (AKT), which then activates I-κB kinase (IKK), followed by phosphorylation and degradation of the NF-κB inhibitor I-κB. While in fly there exists only one AKT (AKT1) and one IKK isoform (IKKB), the human genome encodes three closely related isoforms AKT1-3 , as well as two highly similar isoforms IKKA and IKKB . While NetAligner was able to automatically recover ten out of the sixteen known protein components of this pathway in human, IsoRank correctly matched only two proteins (AKT1 (fly) to AKT3 (human) and O18683 (fly) to P55G (human)). In addition to highlighting parts of the pathway that are identical in the two species (Fig. 3C), NetAligner also predicts that the interaction between human IKKA and IKKB is likely conserved in fly, suggesting an IKKB homo- to IKKA/IKKB heteromultimer evolution somewhere on the lineage from fly to human. In contrast, both the missing interaction between human IKKB and AKT2, as well as the indirect interactions between IKK and AKT3 (represented as gaps in the alignment) found by NetAligner, propose different roles for the three AKT isoforms in cell signalling (Fig. 3C). Indeed, the three corresponding genes were found to exhibit different expression profiles  and AKT2 amplification is by far the most frequent aberration of AKT genes in human cancer . These findings illustrate the ability of NetAligner not only to uncover conserved pathway regions but, perhaps more importantly, its capacity to generate hypotheses for investigating differences in pathway topology and alternative signalling routes.
We have presented a novel network alignment algorithm that addresses the limitations of existing tools, with an emphasis on being widely applicable by featuring fast alignment of small query pathways or complexes to species interactomes and of whole interactome networks. NetAligner is able to perform both inter- and intra-species alignment of networks of arbitrary topology and to accurately model evolutionary duplication events by supporting one-to-many and many-to-many homology relationships. This in turn allows the identification of conserved cellular pathways and protein complexes between species as well as alternative signaling routes to a given pathway in the same organism. In addition to addressing the issue of false positives through interaction reliabilities, this is the first network alignment algorithm to offer the prediction, based on evolutionary distances, of likely conserved interactions to counter the high amount of missing interactions in current interactomes, which markedly improved the performance of our program in complex/pathway to interactome alignment. This, together with its fast assessment of the statistical significance of alignment solutions and a user-friendly front-end, makes it attractive for large-scale network comparisons. In addition, since there does not yet exist an established benchmark set for network alignment strategies, we would like to encourage the network biology community to consider our benchmark suite for future performance evaluations.
Similar to comparative genomics, which resulted in a deeper understanding of genome function, organisation and evolution, we expect comparative interactomics to vastly increase our knowledge of cellular events, their evolution and adaptation to changing environmental conditions or induced stimuli. With the ever increasing number of interactome networks, accurate network alignment methods will be paramount to identify common modules and varying regulatory elements, draw evolutionary trees based on complete cellular processes and study how certain metabolic or signalling pathways have emerged.
Materials and Methods
Datasets of protein sequences
We collected protein sequences for human (H. sapiens), fly (D. melanogaster) and yeast (S. cerevisiae) from UniProt release 15.0  by merging the set of sequences stored in Swiss-Prot (including splice variants) and TrEMBL with experimental evidence on protein or transcript level. After clustering by 100% sequence identity, we ended up with non-redundant sets of 75,981 human, 23,296 fly and 6,121 yeast protein sequences.
Lists of orthologous proteins
We determined lists of orthologous proteins for all three species combinations by performing a reciprocal BLASTP  search, requiring an E-value and considering only hits in the top10 of the BLASTP output to remove spurious hits. This resulted in non-redundant sets of 91,112 human/fly, 19,558 human/yeast and 12,778 fly/yeast orthologs.
Computation of vertex probabilities
We computed the probability of each alignment graph vertex as the posterior probability of the two proteins and being homologous given their BLASTP E-value . This calculation is based on the likelihood ratio of observing the respective E-value under a homology model and a null model (see Fig. S4). The null model consists of all pairs of proteins between the two species, while the homology model consists only of the subset of homologous pairs. We calculated the posterior probability using Bayes' theorem:with the prior probability set to:such that the pair of homologous proteins with the highest likelihood ratio is assigned a vertex probability of 1 (default parameter). We binned raw E-values based on their order of magnitude and smoothed the likelihood ratios using monotone regression (pool adjacent violators algorithm (PAVA) ).
Construction of whole organism interactomes
We built whole organism interactome networks for human, fly and yeast from the interaction databases IntAct , MINT  and HPRD (for human) . We assigned a reliability to each interaction based on the number of publications supporting it . This resulted in non-redundant interactomes consisting of 53,290 interactions in human, 19,260 in fly and 60,721 in yeast.
Estimation of evolutionary distances
We estimated evolutionary distances (or divergence in case of intra-species network alignment) between homologous proteins as the number of amino acid substitutions per site , calculated from the fraction of identical residues using the general equation derived by Grishin  that accounts for substitution rate variations both between different types of amino acids and between different sites:
We solved this equation numerically by iteration, using , which allows for the substitution rate to vary only among sites, as the starting point, until the difference between subsequent estimates of was smaller than (default parameter).
Calculation of interaction conservation probabilities
Given two species interactomes, for each pair of homologs that interact in at least one of the interactomes, we calculated the probability of the respective interaction being conserved as the posterior probability of interaction conservation given the difference between the evolutionary distances of and , and and . This calculation is based on the likelihood ratio of observing the respective under a conservation model (all pairs of homologs with a conserved interaction) and a null model ( random pairs of homologs; see Fig. S5). We calculated the posterior probability using Bayes' theorem:with the prior probability set to:such that the pair of homologous proteins with the highest likelihood ratio is assigned an interaction conservation probability of 0.9 (default parameter). Likelihood ratios were smoothed using monotone regression (PAVA ).
Computation of edge probabilities
We computed the probability of an edge between the vertices and of a given alignment solution depending on the respective edge type:with and being edges in the query and target network, respectively, and and direct interactions. denotes the event that the given direct interaction between and or between and is conserved according to the difference of the evolutionary distances , while and refer to the shortest weighted path between and , and between and , respectively. Assuming mutual independence of all terms (based on the general notion that individual interaction conservation probabilities and interaction reliabilities do not depend on each other):(i)with and as interaction reliabilities, and calculated as defined above;(ii)with and denoting interaction reliabilities.
Calculation of the statistical significance of alignment solutions
We calculate p-values for all alignment solutions based on random backgrounds of 10,000 scores each (default parameter), which we generate independently for each alignment solution by randomly sampling vertex probabilities and interaction conservation probabilities of the given species, as well as interaction reliabilities of the given input networks (Monte-Carlo permutation test). Our sampling procedure and calculation of random scores respect edge types and preserve alignment solution topologies. To assess the significance of the conservation of interactions rather than the conservation of proteins , we do not randomize homology relationships.
Non-redundant benchmark sets of complexes and pathways
We constructed a non-redundant benchmark set of conserved human/yeast complex pairs by collecting all manually-curated yeast complexes from MPACT  and all human complexes from CORUM  whose components are fully present in the interactomes. Since some complexes are known to share components, to avoid artificially inflating alignment performance, we then clustered those complexes based on the overlap of their components with the distance between two complexes and defined as:and a distance threshold of 0.5. Similar to , we determined the list of conserved complexes by requiring at least 2 and 25% of the components of the given human complex to have at least one ortholog in the respective yeast complex and vice versa. We determined cluster-pair representatives by minimising the number of unmatched components and maximising the number of matched components in case of ties. This resulted in 71 conserved human/yeast complex pairs, consisting of 64 non-redundant human and 52 non-redundant yeast complexes (Table S1). We limited our complexes benchmark set to human and yeast, because there do not yet exist any curated databases of protein complexes for other species.
We analogously constructed a non-redundant benchmark set of conserved pathways between human, fly and yeast based on all KEGG  pathways for which at least two thirds of the proteins are present in the interactomes (only six human and fly pathways are completely present), transforming protein-protein (PPrel) and enzyme-enzyme (ECrel) relationships into binary interactions. We clustered those pathways based on the overlap of their interactions as defined above for complexes. We determined conserved pathways between two species based on pathway names, which is a controlled vocabulary in KEGG. This resulted in non-redundant sets of 19 human/fly, 32 human/yeast and 13 fly/yeast conserved pathway pairs (Table S4). We restricted our pathways benchmark set to human, fly and yeast, since those three organisms have the best interactome coverage and annotation of biological pathways.
Benchmark evaluation and determination of default parameters
We performed complex, pathway and interactome to interactome alignment benchmarks using the non-redundant benchmark sets described above and considering only significant alignment solutions (standard p-value threshold of 0.05). For the interactome to interactome alignment benchmark, we determined the best matching benchmark complex for each significant alignment by minimizing the total number of unmatched proteins. Using a similar evaluation criterion as in , an alignment solution was deemed to ‘cover’ a given target complex if at least 2 and at least 50% of the target complex components were aligned. We then calculated the number of true positives (TP) as the number of distinct complexes covered; the number of false positives (FP) as the number of alignment solutions that do not cover any complex; and the number of false negatives (FN) as the number of complexes that are not covered. Next, we computed the complex-level performance in terms of precision, recall and F measure:To assess the protein-level performance and thus the quality of the alignment solutions found, we determined the overlap between each alignment solution and the respective complex it covers, setting TP to the total number of distinct proteins in all overlaps; FP to the total number of distinct proteins unique to alignment solutions; and FN to the total number of distinct proteins unique to covered complexes. We calibrated the NetAligner parameters based on the highest average F measure of the complex- and protein-level results separately for each species pair and, to avoid overfitting, cross-evaluated the performance using those distinct parameter sets over all species pairs, reporting average precision and recall (see Fig. S1). Please note that, although the NetAligner algorithm itself is symmetric, alignment results depend on the order of the species (e.g. human vs. yeast or yeast vs. human), since the vertex probabilities are based on proteome-wide BLAST E-values, which in turn depend on the sequence composition of the target species proteome. More importantly, in our benchmarks, alignment solutions are always evaluated using the known conserved complexes/pathways of the given target species. We therefore measured the NetAligner performance always in both alignment directions. For the complex to interactome alignment benchmark, we built a network representation of each complex, taking interactions from the respective interactome and added self-interactions with a reliability of 0 for all singletons in order to not lose any information about complex composition. Here, we evaluated only the highest ranked significant alignment solution and calculated the complex- and protein-level performance as described above. Finally, for the pathway to interactome alignment benchmark, we again considered only the highest-ranked significant alignment solution, which was deemed to cover a pathway if it contained at least 2 and at least 1/3 of the pathway proteins (to compensate for the prevalence of transient interactions, which are underrepresented in current interactome networks ). We calculated the pathway-, protein- and interaction-level performance analogously to the complex- and protein–level performance described above. In case of the interaction-level performance, we evaluated the interaction overlap between each alignment solution and the respective pathway it covers, and calibrated the NetAligner parameters based on the highest average F measure of the pathway-, protein- and interaction-level results. We again cross-evaluated the performance over all species pairs to avoid overfitting and report average precision and recall (Fig. S1). For each alignment task, we determined the set of default parameters as those leading to the highest average F measure over all evaluation levels and species pairs (Table S3). For the performance comparison, both NetworkBLAST  and IsoRank  were run with their respective default parameters, using the same datasets of interactions, lists of orthologous proteins and BLAST E-values . Since the different alignment tasks benchmarked in this work require different alignment strategies, we applied NetworkBLAST and IsoRank only to the tasks for which they have been designed for, i.e. IsoRank for complex/pathway to interactome alignment, and NetworkBLAST for the identification of conserved complexes through interactome to interactome alignment. Please, note that the default parameters implemented in these alignment algorithms are already fine tuned to achieve a maximum accuracy for whole interactome comparisons and complex/pathway to interactome alignment, respectively. In contrast, since NetAligner can be used for both global and local network alignment, we first needed to determine the default parameters for each type of alignment task as described above. Nevertheless, since we used the average F-measure over all evaluation levels and species pairs, the NetAligner default parameters are only tuned for the given alignment task rather than for a specific benchmark set. Moreover, we did not use the newer implementations of NetworkBLAST and IsoRank (i.e. NetworkBLAST-M  and IsoRankN ), since they are intended for multiple network alignments, rather than pairwise comparisons.
NetAligner cross-evaluation performance in different alignment tasks. Cross-evaluation performance of NetAligner (blue) measured in A) interactome to interactome, B) complex to interactome and C) pathway to interactome alignment benchmarks in comparison to the current standard in the field (grey). Precision and recall are shown on the complex/pathway and protein level for all three alignment tasks, and for pathway to interactome alignment also on the interaction level (see Materials and Methods). The given species pair used for parameter calibration is highlighted (e.g. H/Y for human vs. yeast). NetworkBLAST and IsoRank were run with default parameters. Error bars denote one standard error of the mean performance across all species pairs in the benchmark.
Predicting likely conserved interactions in interactome to interactome alignment recovers higher order assemblies. Alignment solution example for human to yeast interactome alignment, using the default parameters when predicting likely conserved interactions (Table S3). Here, the known interaction between PSA1 of the 20S core particle of the yeast proteasome and RPN10 of the 19S regulatory particle is predicted to be likely conserved in human between PSA1 and PSMD4, suggesting that the complete 26S proteasome is conserved in those two species. Performing interactome to interactome alignment with NetAligner, predicting likely conserved interactions, is thus able to identify conserved higher order assemblies, such as the 26S proteasome. Vertices represent pairs of orthologous proteins, while edges denote either conserved (green) or direct interactions in yeast (yellow) that are likely conserved in human. The similarity of aligned proteins on the sequence level is represented by the respective vertex probability, ranging from 0 (dissimilar; white) to 1 (highly similar; blue/yellow).
NetAligner interaction-level performance in pathway to interactome alignment using default parameters. Interaction-level performance of NetAligner (blue) measured in the pathway to interactome alignment benchmark (see Materials and Methods) in comparison to the current standard in the field, IsoRank (grey). Precision and recall are shown separately for each species pair (e.g. H/Y for human vs. yeast), using default parameters. We calculated the statistical significance of the performance differences using a two-sided Fisher's exact test (with a standard p-value threshold of 0.05) and marked all significant values with an asterisk.
Empirical distributions of BLAST E-values for estimating vertex probabilities. Empirical probability distributions of BLASTP  E-values used for the Bayesian estimation of vertex probabilities (see Materials and Methods) for all species pairs. The Null model (all pairs of proteins between the two given species) is shown in purple, while the Homology model (subset of orthologous pairs of proteins) is shown in green. The probability for the Homology model drops to zero at a BLASTP E-value of 10−10, since having an E-value below that threshold is a requirement in our definition of orthology (see Materials and Methods).
Empirical distributions of the differences of evolutionary distances for estimating interaction conservation probabilities. Empirical probability distributions of the differences of evolutionary distances used for the Bayesian estimation of interaction conservation probabilities (see Materials and Methods) for all species pairs. The Null model (106 random pairs of orthologs between the two given species) is shown in purple, while the Conservation model (all pairs of orthologs with a conserved interaction) is shown in green.
Non-redundant benchmark set of protein complexes. List of 71 matching human/yeast complex pairs, consisting of 64 non-redundant human complexes from the CORUM database (Ruepp et al., 2010) and 52 non-redundant yeast complexes from the MPACT database (Güldener et al., 2006). Complex components are given as UniProt accession codes. The individual lists of 64 and 52 non-redundant human and yeast complexes are given on the following two sheets. The induced complex networks that we constructed for the complex to interactome alignment benchmark can be found in the NetAligner program package.
Benchmark set statistics and NetAligner performance. Basic statistics on the total number of complexes and pathways present in the benchmark set, as well as the range and average number of protein components of those complexes and the range and average number of proteins and interactions in those pathways. The following sheets present the detailed statistics about the performance of NetAligner in interactome to interactome, complex to interactome and pathway to interactome alignment (using the respective default parameters), including the range and average number of proteins and interactions of benchmark complexes and pathways that were recovered. The +/− indicates standard deviations. For each alignment task, after showing the results when predicting likely conserved interactions, we also present the results without predictions.
Default parameters and expected average performance for different alignment tasks. Default parameters for interactome, complex and pathway to interactome alignment, which can be set in the given input parameter file for NetAligner. For interactome to interactome alignment, we show the default parameters both for alignments excluding (0) and including (1) the prediction of likely conserved interactions, since they lead to a similar benchmark performance and the latter allows the identification of higher order assemblies (such as the 26S proteasome; Supplementary Fig. 2), which might be desired in certain cases. Below each set of parameters, we provide the corresponding expected average performance (calculated across all species pairs used in the benchmarks) in terms of precision and recall on the complex/pathway, protein and/or interaction levels, depending on the given alignment task (see Materials and Methods).
Non-redundant pathways benchmark set. List of 19 human/fly, 32 human/yeast and 13 fly/yeast non-redundant conserved pathway pairs originating from the KEGG database (Kanehisa et al., 2000). The 32 human/yeast and 13 fly/yeast pathway pairs are given on the following two sheets. The binary interaction network representations of these pathways that we constructed for the pathway to interactome alignment benchmark can be found in the NetAligner program package.
We would like to thank Trey Ideker (UCSD), Amelie Stein, Roberto Mosca and Andreas Zanzoni (IRB Barcelona) for helpful discussions. We are also thankful to Mike Smoot (UCSD) and Maxim Kalaev (Tel Aviv University) for NetworkBLAST support.
Conceived and designed the experiments: RAP PA. Performed the experiments: RAP. Analyzed the data: RAP PA. Wrote the paper: RAP PA.
- 1. Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, et al. (2001) Initial sequencing and analysis of the human genome. Nature 409: 860–921.ES LanderLM LintonB. BirrenC. NusbaumMC Zody2001Initial sequencing and analysis of the human genome.Nature409860921
- 2. Venter JC, Adams MD, Myers EW, Li PW, Mural RJ, et al. (2001) The sequence of the human genome. Science 291: 1304–1351.JC VenterMD AdamsEW MyersPW LiRJ Mural2001The sequence of the human genome.Science29113041351
- 3. Rual J-F, Venkatesan K, Hao T, Hirozane-Kishikawa T, Dricot A, et al. (2005) Towards a proteome-scale map of the human protein-protein interaction network. Nature 437: 1173–1178.J-F RualK. VenkatesanT. HaoT. Hirozane-KishikawaA. Dricot2005Towards a proteome-scale map of the human protein-protein interaction network.Nature43711731178
- 4. Stelzl U, Worm U, Lalowski M, Haenig C, Brembeck FH, et al. (2005) A human protein-protein interaction network: a resource for annotating the proteome. Cell 122: 957–968.U. StelzlU. WormM. LalowskiC. HaenigFH Brembeck2005A human protein-protein interaction network: a resource for annotating the proteome.Cell122957968
- 5. Ewing RM, Chu P, Elisma F, Li H, Taylor P, et al. (2007) Large-scale mapping of human protein-protein interactions by mass spectrometry. Molecular Systems Biology 3: 89.RM EwingP. ChuF. ElismaH. LiP. Taylor2007Large-scale mapping of human protein-protein interactions by mass spectrometry.Molecular Systems Biology389
- 6. Bandyopadhyay S, Mehta M, Kuo D, Sung MK, Chuang R, et al. (2010) Rewiring of genetic networks in response to DNA damage. Science 330: 1385–1389.S. BandyopadhyayM. MehtaD. KuoMK SungR. Chuang2010Rewiring of genetic networks in response to DNA damage.Science33013851389
- 7. Califano A (2011) Rewiring makes the difference. Mol Syst Biol 7: 463.A. Califano2011Rewiring makes the difference.Mol Syst Biol7463
- 8. Beltrao P, Serrano L (2007) Specificity and evolvability in eukaryotic protein interaction networks. PLoS Computational Biology 3: e25.P. BeltraoL. Serrano2007Specificity and evolvability in eukaryotic protein interaction networks.PLoS Computational Biology3e25
- 9. Kiemer L, Cesareni G (2007) Comparative interactomics: comparing apples and pears? Trends Biotechnol 25: 448–454.L. KiemerG. Cesareni2007Comparative interactomics: comparing apples and pears?Trends Biotechnol25448454
- 10. Kelley BP, Sharan R, Karp RM, Sittler T, Root DE, et al. (2003) Conserved pathways within bacteria and yeast as revealed by global protein network alignment. Proc Natl Acad Sci USA 100: 11394–11399.BP KelleyR. SharanRM KarpT. SittlerDE Root2003Conserved pathways within bacteria and yeast as revealed by global protein network alignment.Proc Natl Acad Sci USA1001139411399
- 11. Sharan R, Ideker T (2006) Modeling cellular machinery through biological network comparison. Nat Biotechnol 24: 427–433.R. SharanT. Ideker2006Modeling cellular machinery through biological network comparison.Nat Biotechnol24427433
- 12. Sharan R, Suthram S, Kelley RM, Kuhn T, McCuine S, et al. (2005) Conserved patterns of protein interaction in multiple species. Proc Natl Acad Sci USA 102: 1974–1979.R. SharanS. SuthramRM KelleyT. KuhnS. McCuine2005Conserved patterns of protein interaction in multiple species.Proc Natl Acad Sci USA10219741979
- 13. Koyutürk M, Kim Y, Topkara U, Subramaniam S, Szpankowski W, et al. (2006) Pairwise alignment of protein interaction networks. J Comput Biol 13: 182–199.M. KoyutürkY. KimU. TopkaraS. SubramaniamW. Szpankowski2006Pairwise alignment of protein interaction networks.J Comput Biol13182199
- 14. Singh R, Xu J, Berger B (2008) Global alignment of multiple protein interaction networks with application to functional orthology detection. Proc Natl Acad Sci USA 105: 12763–12768.R. SinghJ. XuB. Berger2008Global alignment of multiple protein interaction networks with application to functional orthology detection.Proc Natl Acad Sci USA1051276312768
- 15. Flannick J, Novak A, Do CB, Srinivasan BS, Batzoglou S (2009) Automatic parameter learning for multiple local network alignment. J Comput Biol 16: 1001–1022.J. FlannickA. NovakCB DoBS SrinivasanS. Batzoglou2009Automatic parameter learning for multiple local network alignment.J Comput Biol1610011022
- 16. Venkatesan K, Rual J-F, Vazquez A, Stelzl U, Lemmens I, et al. (2009) An empirical framework for binary interactome mapping. Nat Methods 6: 83–90.K. VenkatesanJ-F RualA. VazquezU. StelzlI. Lemmens2009An empirical framework for binary interactome mapping.Nat Methods68390
- 17. Zhang S, Zhang X-S, Chen L (2008) Biomolecular network querying: a promising approach in systems biology. BMC systems biology 2: 5.S. ZhangX-S ZhangL. Chen2008Biomolecular network querying: a promising approach in systems biology.BMC systems biology25
- 18. Flicek P, Aken BL, Ballester B, Beal K, Bragin E, et al. (2010) Ensembl's 10th year. Nucleic Acids Research 38: D557–562.P. FlicekBL AkenB. BallesterK. BealE. Bragin2010Ensembl's 10th year.Nucleic Acids Research38D557562
- 19. Altschul SF, Madden TL, Schäffer AA, Zhang J, Zhang Z, et al. (1997) Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res 25: 3389–3402.SF AltschulTL MaddenAA SchäfferJ. ZhangZ. Zhang1997Gapped BLAST and PSI-BLAST: a new generation of protein database search programs.Nucleic Acids Res2533893402
- 20. Yu H, Braun P, Yildirim MA, Lemmens I, Venkatesan K, et al. (2008) High-quality binary protein interaction map of the yeast interactome network. Science 322: 104–110.H. YuP. BraunMA YildirimI. LemmensK. Venkatesan2008High-quality binary protein interaction map of the yeast interactome network.Science322104110
- 21. Teichmann SA (2002) The constraints protein-protein interactions place on sequence divergence. Journal of Molecular Biology 324: 399–407.SA Teichmann2002The constraints protein-protein interactions place on sequence divergence.Journal of Molecular Biology324399407
- 22. Cesareni G, Ceol A, Gavrila C, Palazzi LM, Persico M, et al. (2005) Comparative interactomics. FEBS LETTERS 579: 1828–1833.G. CesareniA. CeolC. GavrilaLM PalazziM. Persico2005Comparative interactomics.FEBS LETTERS57918281833
- 23. Pazos F, Valencia A (2002) In silico two-hybrid system for the selection of physically interacting protein pairs. Proteins 47: 219–227.F. PazosA. Valencia2002In silico two-hybrid system for the selection of physically interacting protein pairs.Proteins47219227
- 24. Juan D, Pazos F, Valencia A (2008) Co-evolution and co-adaptation in protein networks. FEBS LETTERS 582: 1225–1230.D. JuanF. PazosA. Valencia2008Co-evolution and co-adaptation in protein networks.FEBS LETTERS58212251230
- 25. Fraser HB, Hirsh AE, Steinmetz LM, Scharfe C, Feldman MW (2002) Evolutionary rate in the protein interaction network. Science 296: 750–752.HB FraserAE HirshLM SteinmetzC. ScharfeMW Feldman2002Evolutionary rate in the protein interaction network.Science296750752
- 26. Chen Y, Dokholyan NV (2006) The coordinated evolution of yeast proteins is constrained by functional modularity. Trends Genet 22: 416–419.Y. ChenNV Dokholyan2006The coordinated evolution of yeast proteins is constrained by functional modularity.Trends Genet22416419
- 27. Cootes AP, Muggleton SH, Sternberg MJE (2007) The identification of similarities between biological networks: application to the metabolome and interactome. Journal of Molecular Biology 369: 1126–1139.AP CootesSH MuggletonMJE Sternberg2007The identification of similarities between biological networks: application to the metabolome and interactome.Journal of Molecular Biology36911261139
- 28. Pache RA, Zanzoni A, Naval J, Mas JM, Aloy P (2008) Towards a molecular characterisation of pathological pathways. FEBS LETTERS 582: 1259–1265.RA PacheA. ZanzoniJ. NavalJM MasP. Aloy2008Towards a molecular characterisation of pathological pathways.FEBS LETTERS58212591265
- 29. Zhenping L, Zhang S, Wang Y, Zhang X-S, Chen L (2007) Alignment of molecular networks by integer quadratic programming. Bioinformatics 23: 1631–1639.L. ZhenpingS. ZhangY. WangX-S ZhangL. Chen2007Alignment of molecular networks by integer quadratic programming.Bioinformatics2316311639
- 30. Barabási A-L, Oltvai ZN (2004) Network biology: understanding the cell's functional organization. Nat Rev Genet 5: 101–113.A-L BarabásiZN Oltvai2004Network biology: understanding the cell's functional organization.Nat Rev Genet5101113
- 31. Dijkstra EW (1959) A note on two problems in connexion with graphs. Numerische Mathematik 1: 269–271.EW Dijkstra1959A note on two problems in connexion with graphs.Numerische Mathematik1269271
- 32. Hirsh E, Sharan R (2007) Identification of conserved protein complexes based on a model of protein network evolution. Bioinformatics 23: e170–176.E. HirshR. Sharan2007Identification of conserved protein complexes based on a model of protein network evolution.Bioinformatics23e170176
- 33. Cheng Y (2009) Toward an atomic model of the 26S proteasome. Curr Opin Struct Biol 19: 203–208.Y. Cheng2009Toward an atomic model of the 26S proteasome.Curr Opin Struct Biol19203208
- 34. Cope GA, Deshaies RJ (2003) COP9 signalosome: a multifunctional regulator of SCF and other cullin-based ubiquitin ligases. Cell 114: 663–671.GA CopeRJ Deshaies2003COP9 signalosome: a multifunctional regulator of SCF and other cullin-based ubiquitin ligases.Cell114663671
- 35. Wei N, Serino G, Deng X-W (2008) The COP9 signalosome: more than a protease. Trends Biochem Sci 33: 592–600.N. WeiG. SerinoX-W Deng2008The COP9 signalosome: more than a protease.Trends Biochem Sci33592600
- 36. Foiani M, Lucchini G, Plevani P (1997) The DNA polymerase alpha-primase complex couples DNA replication, cell-cycle progression and DNA-damage response. Trends Biochem Sci 22: 424–427.M. FoianiG. LucchiniP. Plevani1997The DNA polymerase alpha-primase complex couples DNA replication, cell-cycle progression and DNA-damage response.Trends Biochem Sci22424427
- 37. Pavlov YI, Frahm C, Nick McElhinny SA, Niimi A, Suzuki M, et al. (2006) Evidence that errors made by DNA polymerase alpha are corrected by DNA polymerase delta. Curr Biol 16: 202–207.YI PavlovC. FrahmSA Nick McElhinnyA. NiimiM. Suzuki2006Evidence that errors made by DNA polymerase alpha are corrected by DNA polymerase delta.Curr Biol16202207
- 38. Altomare DA, Testa JR (2005) Perturbations of the AKT signaling pathway in human cancer. Oncogene 24: 7455–7464.DA AltomareJR Testa2005Perturbations of the AKT signaling pathway in human cancer.Oncogene2474557464
- 39. Häcker H, Karin M (2006) Regulation and function of IKK and IKK-related kinases. Sci STKE 2006: re13.H. HäckerM. Karin2006Regulation and function of IKK and IKK-related kinases.Sci STKE2006re13
- 40. Nicholson KM, Anderson NG (2002) The protein kinase B/Akt signalling pathway in human malignancy. Cell Signal 14: 381–395.KM NicholsonNG Anderson2002The protein kinase B/Akt signalling pathway in human malignancy.Cell Signal14381395
- 41. Consortium U (2009) The Universal Protein Resource (UniProt) 2009. Nucleic Acids Res 37: D169–174.U. Consortium2009The Universal Protein Resource (UniProt) 2009.Nucleic Acids Res37D169174
- 42. Kerrien S, Alam-Faruque Y, Aranda B, Bancarz I, Bridge A, et al. (2007) IntAct–open source resource for molecular interaction data. Nucleic Acids Research 35: D561–565.S. KerrienY. Alam-FaruqueB. ArandaI. BancarzA. Bridge2007IntAct–open source resource for molecular interaction data.Nucleic Acids Research35D561565
- 43. Chatr-aryamontri A, Ceol A, Palazzi LM, Nardelli G, Schneider MV, et al. (2007) MINT: the Molecular INTeraction database. Nucleic Acids Research 35: D572–574.A. Chatr-aryamontriA. CeolLM PalazziG. NardelliMV Schneider2007MINT: the Molecular INTeraction database.Nucleic Acids Research35D572574
- 44. Keshava Prasad TS, Goel R, Kandasamy K, Keerthikumar S, Kumar S, et al. (2009) Human Protein Reference Database–2009 update. Nucleic Acids Res 37: D767–772.TS Keshava PrasadR. GoelK. KandasamyS. KeerthikumarS. Kumar2009Human Protein Reference Database–2009 update.Nucleic Acids Res37D767772
- 45. Grishin NV (1995) Estimation of the number of amino acid substitutions per site when the substitution rate varies among sites. J Mol Evol 41: 675–679.NV Grishin1995Estimation of the number of amino acid substitutions per site when the substitution rate varies among sites.J Mol Evol41675679
- 46. Güldener U, Münsterkötter M, Oesterheld M, Pagel P, Ruepp A, et al. (2006) MPact: the MIPS protein interaction resource on yeast. Nucleic Acids Res 34: D436–441.U. GüldenerM. MünsterkötterM. OesterheldP. PagelA. Ruepp2006MPact: the MIPS protein interaction resource on yeast.Nucleic Acids Res34D436441
- 47. Ruepp A, Waegele B, Lechner M, Brauner B, Dunger-Kaltenbach I, et al. (2010) CORUM: the comprehensive resource of mammalian protein complexes–2009. Nucleic Acids Res 38: D497–501.A. RueppB. WaegeleM. LechnerB. BraunerI. Dunger-Kaltenbach2010CORUM: the comprehensive resource of mammalian protein complexes–2009.Nucleic Acids Res38D497501
- 48. Kanehisa M, Goto S (2000) KEGG: kyoto encyclopedia of genes and genomes. Nucleic Acids Res 28: 27–30.M. KanehisaS. Goto2000KEGG: kyoto encyclopedia of genes and genomes.Nucleic Acids Res282730
- 49. Narayanan M, Karp RM (2007) Comparing protein interaction networks via a graph match-and-split algorithm. J Comput Biol 14: 892–907.M. NarayananRM Karp2007Comparing protein interaction networks via a graph match-and-split algorithm.J Comput Biol14892907
- 50. Pawson T, Linding R (2005) Synthetic modular systems–reverse engineering of signal transduction. FEBS LETTERS 579: 1808–1814.T. PawsonR. Linding2005Synthetic modular systems–reverse engineering of signal transduction.FEBS LETTERS57918081814
- 51. Kalaev M, Bafna V, Sharan R (2009) Fast and accurate alignment of multiple protein networks. J Comput Biol 16: 989–999.M. KalaevV. BafnaR. Sharan2009Fast and accurate alignment of multiple protein networks.J Comput Biol16989999
- 52. Liao C-S, Lu K, Baym M, Singh R, Berger B (2009) IsoRankN: spectral methods for global alignment of multiple protein networks. Bioinformatics 25: i253–i258.C-S LiaoK. LuM. BaymR. SinghB. Berger2009IsoRankN: spectral methods for global alignment of multiple protein networks.Bioinformatics25i253i258
- 53. Smoot ME, Ono K, Ruscheinski J, Wang PL, Ideker T (2011) Cytoscape 2.8: new features for data integration and network visualization. Bioinformatics 27: 431–432.ME SmootK. OnoJ. RuscheinskiPL WangT. Ideker2011Cytoscape 2.8: new features for data integration and network visualization.Bioinformatics27431432