13 Dec 2013: Wang Y, Chen S, Deng N, Wang Y (2013) Correction: Drug Repositioning by Kernel-Based Integration of Molecular Structure, Molecular Activity, and Phenotype Data. PLOS ONE 8(12): 10.1371/annotation/fe02e998-6a38-4fd7-9df6-241bc4d0f267. https://doi.org/10.1371/annotation/fe02e998-6a38-4fd7-9df6-241bc4d0f267 View correction
Computational inference of novel therapeutic values for existing drugs, i.e., drug repositioning, offers the great prospect for faster and low-risk drug development. Previous researches have indicated that chemical structures, target proteins, and side-effects could provide rich information in drug similarity assessment and further disease similarity. However, each single data source is important in its own way and data integration holds the great promise to reposition drug more accurately. Here, we propose a new method for drug repositioning, PreDR (Predict Drug Repositioning), to integrate molecular structure, molecular activity, and phenotype data. Specifically, we characterize drug by profiling in chemical structure, target protein, and side-effects space, and define a kernel function to correlate drugs with diseases. Then we train a support vector machine (SVM) to computationally predict novel drug-disease interactions. PreDR is validated on a well-established drug-disease network with 1,933 interactions among 593 drugs and 313 diseases. By cross-validation, we find that chemical structure, drug target, and side-effects information are all predictive for drug-disease relationships. More experimentally observed drug-disease interactions can be revealed by integrating these three data sources. Comparison with existing methods demonstrates that PreDR is competitive both in accuracy and coverage. Follow-up database search and pathway analysis indicate that our new predictions are worthy of further experimental validation. Particularly several novel predictions are supported by clinical trials databases and this shows the significant prospects of PreDR in future drug treatment. In conclusion, our new method, PreDR, can serve as a useful tool in drug discovery to efficiently identify novel drug-disease interactions. In addition, our heterogeneous data integration framework can be applied to other problems.
Citation: Wang Y, Chen S, Deng N, Wang Y (2013) Drug Repositioning by Kernel-Based Integration of Molecular Structure, Molecular Activity, and Phenotype Data. PLoS ONE 8(11): e78518. https://doi.org/10.1371/journal.pone.0078518
Editor: Luonan Chen, Chinese Academy of Sciences, China
Received: July 2, 2013; Accepted: September 17, 2013; Published: November 11, 2013
Copyright: © 2013 Wang et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work is supported by the National Natural Science Foundation of China (No. 11201470, No. 31270270, No. 61171007, and No. 11131009). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Drug repositioning is known as the ‘old drug, new disease’ paradigm. It aims to find new diseases to cure for existing drugs and thus offers the possibility for faster, safer, and cheaper drug development. Given the huge search space and the rapid accumulation of drug related data at molecular level, computational approaches are highly desired to narrow down the gap between medical indications and elucidation of drug effects . In addition to their low cost and time-efficiency predictions, computational methods have the advantage in understanding the mechanisms of drug actions.
Drug takes effect via its protein targets in cell to cure disease. Thus, many previous studies in computational drug repositioning focused on the drugs with known downstream target proteins in disease-specific molecular networks –. However, low-throughput data limits the applications in small scale. Recent accumulated high-throughput data for both drugs and diseases provide possibilities to uncover novel statistical associations between drugs and diseases in a large-scale manner. Many methods have been developed in this direction, including: (i) matching drug indications by their disease-specific response profiles based on the Connectivity Map (CMap) dataset  and (ii) predicting novel associations among drugs and diseases by the ‘Guilt and Association’ (GBA) approaches . Every method has its pros and cons. CMap approach relies on the dynamic gene expression datasets generated under different conditions and suffers from low precision . GBA  approach takes advantage of disease associations with the same drug, but it is only applicable in the case that some indications for the drug in question are already known and complete.
Integrative analysis is one way out . Recently, a novel integrative method was proposed for drug-disease association prediction . This method heuristically summarized multiple drug-drug and disease-disease similarity measures from various aspects and repositioning was done based on the observation that similar drugs tend to treat similar diseases. The authors reported high specificity and sensitivity (AUC = 0.9). This approach applied logistic regression to integrate multiple drug-drug and disease-disease similarity metrics to collect the evidence for a strong association. This scheme provides a machine learning framework, and there is still much room to improve both from more general data collecting and accurate predicting.
In this paper, we construct a universal Predictor for Drug Repositioning (PreDR) to dissect drug-disease associations in a large-scale manner. We notice the rapid development of high-throughput technologies and ever-increasing accumulation of genome-wide datasets. On one hand, high-quality drug-disease networks have been constructed as the gold-standard to learn. On the other hand, drug’s functional roles in cell can be depicted from different aspects. For example, drug’s chemical structure provides information by the ‘structure determines function’ paradigm. Target protein provides the direct effect at molecular level, and side effect hints the unwanted effect at phenotype level. One straightforward idea is to learn understandable rules from these existing data and to predict novel drug-disease relationships. We demonstrate that drugs with similar chemical structures, target proteins, or side-effects will indicate similar diseases. Then we integrate heterogeneous chemical structures, target proteins, and side-effects information sources. Specifically, drug and disease are characterized by their similarity-based profiles, and kernel function is then defined to correlate drug with disease. Finally the potential drug-disease interactions are inferred by a machine learning model, i.e., support vector machine (SVM), which is motivated by statistical learning theory ,  and has been proven successful on many different classification problems in bioinformatics . PreDR provides an efficient way to overcome the main difficulty that these data sources are from three different levels and are extremely heterogenous.
PreDR is validated on a well-established drug-disease network with 1,933 interactions between 593 drugs and 313 diseases. By cross-validation, we find that all chemical structures, drug targets, and side-effects are predictive in different power. Combining these heterogenous properties predicts more drug-disease associations supported by literature and disease pathway database. Moreover, some novel predictions are supported by clinical trials database.
Materials and Methods
We design a novel algorithm, named PreDR, to predict drug repositioning by associating known drugs with potential disease labels based on kernel fusion of heterogenous data sources. The schematic illustration of PreDR is shown in Figure 1A. The functional role of drug is characterized by its molecular structure, molecular activity, and phenotype data. PreDR aims to optimally integrate these three data sources and to connect drug with disease more accurately.
Subfigure A: The schematic plot for the PreDR method. Subfigure B: Collecting known interactions between drugs and diseases as gold standard positives in a bipartite graph. Subfigure C: Calculating the drug-drug and disease-disease similarity metrics. Subfigure D: Relating the similarity among drugs and similarity among diseases by kernel function, and applying SVM-based algorithm to predict unknown relationships among drugs and diseases.
We treat drug-disease interaction prediction as a binary classification problem, i.e., determining whether a give pair of drug and disease is associated or not. We introduce SVM-based algorithm to cope with this task. The algorithm works in three phases (Figure 1): (Phase I) Collecting known drug-disease interactions as gold-standard positives in a bipartite graph. (Phase II) Modeling drug-drug and disease-disease similarity metrics. Drug similarity is derived from chemical structure, target protein, and side-effects. Disease similarity is based on semantic similarity of disease phenotypes . (Phase III) Fusing the similarity among drugs and similarity among diseases by kernel methods, and applying SVM algorithm to predict the unknown relationships between drugs and diseases.
Given two drug-disease pairs, we consider to construct a kernel function which potentially correlates with their similarity. Since the kernel function represents the similarities among the training samples in some sense , we focus on the similarities among drugs and similarities among diseases. Therefore, we try to construct the similarity profile to represent drug and disease, respectively, in the following subsections.
Collecting Structure, Activity, and Phenotype Data for Drugs
Chemical structure data.
It is generally believed that drugs with similar chemical structure would carry out common therapeutic function, thus likely treat common diseases. So here, drugs are firstly represented by its chemical structure similarity profile.
PubChem database (http://pubchem.ncbi.nlm.nih.gov/) has defined 881 chemical substructures based on fingerprint search. Then a given drug can be represented by an 881 dimensional binary vector x. Each element of x is encoded as 1 or 0, which means the presence or absence of corresponding PubChem substructure. The description of these 881 chemical substructures is available at PubChem’s website. There are 107,292 associations between drugs and chemical substructures in the dataset, and each drug has 120.8 substructures on average . The similarity between two drugs d and is evaluated by the weighted cosine correlation coefficient  as follows(1)where is the weight function for the k-th substructure, and defined as(2)where is the frequency of the k-th substructure, and is the total number of substructures, is the standard derivation of , and is a parameter and set to 10 in this study. The weight function puts more emphasis on rare substructures rather than frequent ones across different drugs, because rare substructures are more informative than common ones for specific function.
Suppose that we have drugs in total, a matrix is then constructed to represent the chemical structure similarity matrix. Each row (or column) of this matrix is the chemical structure similarity profile for a single drug.
Drug-target interaction data.
Drugs sharing common targets often possess similar therapeutic function. So there are many drug-target prediction studies for drug function. In our case, drugs interacting with the same targets are assumed to treat common diseases.
In this subsection, we represent drug-drug similarity by their target protein similarity. The high-quality drug-target interactions can be manually constructed from the KEGG BRITE , BRENDA , SuperTarget , and DrugBank . In addition, the drug target interactions are well-studied for some specific protein families in previous studies , –. Here, we mainly collected drug-targets data from DrugBank , and defined drug similarity by target proteins’ sequence similarity. That is, given two drugs and , the similarity among them can be calculated as follows(3)where and are the sets of target proteins, is sequence similarity among protein and , which is calculated by a normalized version of Smith-Waterman scores , .
The matrix is then constructed to represent the compound target similarity matrix. Each row (or column) of this matrix is the target protein similarity profile for a single drug. Unlike chemical structure similarity matrix , target protein similarity matrix may not be a positive semidefinite matrix and needs the following normalization step(4)where is diagonal matrix. The k-th diagonal element of is .
Drug side-effects, or adverse drug reactions, is one of the main causes of drug development failure and drug withdrawal from the market . This high level phenotype data for drugs indicates the malfunction by off-targets. Thus side-effects data is useful to infer whether two drugs share similar target proteins . In this study, drug side-effects are utilized to drug repositioning as some previous studies did , . Similar to structure and target data, drug side-effects information is also applied to construct the drug similarity profile.
There are a total of 1,450 side-effect annotations in the SIDER database (http://sideeffects.embl.de/) for 888 approved drugs. Then each drug can be represented as an 1,450 dimensional binary vector . Each element of is encoded as 1 or 0 to indicate the presence or absence of corresponding side-effect. Drugs similarity under their side-effects metric is assessed by the weighted cosine correlation coefficient between and as follows(5)where is the weight function for the k-th side-effect(6)where is the frequency of the k-th side-effect in the data, and is the total number of side-effect, is the standard derivation of , and is a parameter (set to be 10 in this study).
The matrix then represents the drug similarity matrix by their side-effects similarity. Each row (or column) of this matrix is the side-effect similarity profile for a single drug.
Characterizing Disease Similarity by Phenotype Data
Similar to drug similarity profile, we used the disease similarity profiles to represent diseases. The disease-disease similarities were measured by their semantic similarity of disease phenotypes . Text mining techniques were utilized to classify over 5,000 human phenotypes contained in the Online Mendelian Inheritance in Man (OMIM) database . The phenotype similarity data are accessible through website at http://www.cmbi.ru.nl/MimMiner/. As a result, the similarity between two diseases and can be calculated as follows(7)where is semantic similarity of disease phenotype and , which is calculated by text mining approach in .
The matrix represents the similarities for all pairwise diseases. Each row (or column) is the phenotype similarity profile for a single disease.
With the representation of drugs and diseases by their similarity profiles, the similarity between two drug-disease pairs and can be calculated as Kronecker product kernel – as follows(8)where can be any one of , , and or their combination.
In this paper, “Chem” denotes the case when , “Inter” denotes the case when , “Side-effect” denotes the case when , and “Comb” denotes the case when , which means drug similarity supported by one or more than one metrics. Taken together, the rationale behind our kernel function construction scheme for drug-disease pairs is that two drug-disease pairs are similar only when the corresponding diseases and drugs are simultaneously similar supported by heterogeneous data sources.
SVM Prediction with the Defined Kernel Function
With the above kernel function construction scheme, the drug-disease interactions prediction task is formalized as a binary classification problem. We treat the known drug-disease pairs as the gold-standard positives and the others as the gold-standard negatives. We note that this may cause the training data imbalance problem. Because there are more negatives and only a relatively small number of positives. This situation makes the SVM ineffective in determining the class boundary . To maintain a balance, we randomly select a set of training negatives from the unlabelled data to have the same size with the training positives.
Feeding the kernel function in Equation (8) and training dataset to SVM, the classifier can be calculated by SVM algorithm.
Benchmark Datasets and Algorithm Implementation
The benchmark dataset, which is used to test the performance of PreDR as a community standard, was summarized in . It spans 1,933 associations between 593 drugs taken from DrugBank  and 313 diseases in OMIM database . The drug chemical structure representation matrix was from  (http://cbio.ensmp.fr/yyamanishi/side-effect/), which contains 888 approved drugs represented by 881 substructures derived from PubChem . Drug targets and targets sequences are from DrugBank . The Smith-Waterman scores among protein sequences were calculated by MATLAB’s Bioinformatics Toolbox. Drug side-effects are from SIDER . The disease phenotype similarity data was obtained at http://www.cmbi.ru.nl/MimMiner/.
We trained the SVM-based predictor by using . In our implementation, the penalty parameter was optimized by a grid search approach with 3-fold cross-validation, and the optimal value of is . To evaluate the performance of our methods, 10-fold cross-validation was utilized. The performance of PreDR is shown by receiver operating characteristic (ROC) curve , which shows the trade-off between the true positive (correctly predicted interactions) rate (TPR) with respect to the false positive (wrongly predicted interactions) rate (FPR). Furthermore, the evaluation criteria shown in Table S1 are also applied to assess the performance rigorously.
Chemical Structure, Drug-target Interactions, and Side-effects are all Predictive
We collect three data sources from structure, activity, and phenotype levels to characterize drugs: chemical structures, target proteins, and side-effects. First we test the fact that drugs with similar structures (target proteins or side-effects) will treat similar diseases. To show this, we correlate drug’s profile by chemical structure, target protein, side-effect similarity, and their curing disease profile. The drug similarity by disease profiling is defined as follows(9)where and are the sets of diseases associated with drug and in gold standard positives, and is the disease phenotype similarity calculated by text mining approach .
Figure 2A plots the weak correlations between drug similarity by their structures, protein targets, side-effects with drug similarity by its disease profile. It shows that drug’s disease profile similarity is more correlated with its side-effect similarity comparing with chemical structure and protein targets similarity. The Pearson’s correlation coefficients (PCCs) between drug’ disease profile similarity and the similarity from chemical structures, target proteins, and side-effects data are shown in Figure 2B. It shows that the correlation coefficients tend to be larger when two drugs are more similar. For example, the correlation coefficients are all larger than 0.2 with high confidence when drugs are similar than 0.8 for all three kind of data sources. Correlation coefficient between side-effects profile based similarity and disease profile based similarity is larger than 0.3 (Figure 2B). Taken together, chemical structure, target protein, and side-effect similarity correlate with drug’s disease profile similarity, i.e., drugs similar in either structure, target, or side-effects tend to cure similar diseases.
Subfigure A: Scatter plot relating drug structures (yellow circles), targets (blue diamonds), side-effects (red stars) similarity with disease profile similarity. It shows that drug disease profile similarity is better correlated with its side-effect similarity, that is, drugs with similar side-effects similarity tends to cure similar diseases. Subfigure B: Barplot of the PCCs between structures, targets, side-effects similarity and disease profile similarity. All the p-values are smaller than 1e-2.
In addition to global similarity by disease profile, we also correlate the similarity obtained from three kinds of data sources with the drugs’ distance in the known drug-disease interaction network. We define the distance of two drugs in the network as the length of the shortest path between them in the network. We plot the distributions of chemical structure, target protein, and side-effects similarity scores with respect to network distance in Figure S1. It shows that all three kinds of similarities are larger than 0.6 for 75% drug pairs sharing common diseases. That is, two drugs with larger similarity scores in the three data sources tend to share common diseases.
All the facts suggest predictability of different data sources for drug-disease associations. This analysis provides support for our follow-up integrative analysis.
Drug Repositioning by Single Data Source
In this subsection, we assess the effects of chemical structures, target proteins, and side-effects in drug repositioning prediction. Their performances are evaluated and visualized by ROC curves .
Firstly, we replace the drug similarity matrix in kernel function (8) (see Materials and Methods) with , , and to test the effect of chemical structure, target protein, and side-effects similarity in uncovering the experimentally observed drug-disease interactions. The ROCs for each data source are displayed in Figure 3A. It shows that all the ROC curves are beyond the diagonal (random classification) and closer to the 0–1 baseline. The corresponding evaluation criteria when the corresponding F-measure reaches its maximum are listed in Table 1. We can see that “Chem” obtains AUC 0.83 and Sn 0.83. That is, chemical structure is useful in drug-disease interaction prediction. Target proteins and side-effects play their important roles in predicting drug-disease interactions too. The Accs, Sns, Pres and F-measures are all larger than 0.8 for “Inter” and “Side-effect”, and AUCs reach 0.88. It indicates that target proteins and side-effects can address the activity and effect of drug in cell thus uncover more experimentally observed drug-disease interactions.
Subfigure A: The ROC curves for three data sources (“Chem”: chemical structure, “Inter”: target protein, “Side-effect”: side-effect based similarity and “Comb”: integration of “Chem”, “Inter”, and “Side-effect”). “Side-effect” is general more predictive for more experimentally observed drug-disease associations. Subfigure B shows the ROC curves with false positive rate (FPR) less than 0.05. “Chem” obtains the highest true positive rate (TPR) when FPR is very small.
Since we are more interested in the performance of these methods when FPR is rather small, we also draw ROC curves when FPR is less than 0.05 in Figure 3B. It shows that, “Chem” obtains the highest TPR when FPR is very small, and with the number of known interactions increasing, “Side-effect” reveals more experimentally observed drug-disease interactions. All these results suggest that, each data source will do one’s bit in prediction. Therefore, combination of these three data sources produces a much more sophisticated picture of the interactions among drugs and diseases.
Data Fusion Improves Drug Repositioning
The usefulness of each data source is validated in uncovering the experimentally observed indications for drugs. In the following, we validate the effect of combination of three data sources.
The performances of combination method: “Comb” is also evaluated and visualized by ROC curve in Figure 3 and various evaluation criteria in Table 1. Figure 3 shows that, “Comb” not only obtains the best area under ROC curve, but also achieves the highest TPR when FPR less than 0.05. This specifically demonstrates that “Comb” improves performance when predicting a small fraction of known drug-disease interactions as positives.
Table 1 shows that, “Comb” performs better than using single data source. For example, “Inter” and “Side-effect” reach the AUC 0.889 and 0.894, respectively, while “Comb” obtains an AUC 0.902. “Inter” and “Side-effect” obtain F-measures 0.811 and 0.812, respectively. “Comb” obtains a F-measure 0.822 and improves by one percent. These facts demonstrate that the significant improvement is obtained by data integration.
For drug-disease interaction prediction task, the gold standard positives are relatively not abundant. The area under precision-recall curve  (AUPR) is a more significant quality measure than the AUC, as it punishes much more the existence of false positive examples found among the best ranked prediction scores . So we use the AUPRs (Figure S2) and precision-recall curves (Figure S3) to validate our results. All results shown in Figure S2 and Figure S3 suggest that each data source is predictive and data integration brings the improvement.
Leave One Drug Out Cross-validation
Given a new drug, people are interested in which disease it will cure, i.e., whether this novel drug is related with known diseases. To this end, we test the performance of our method by doing leave one drug out cross-validation. That is, we exclude each drug and its interactions from gold standard positives (known drug-disease interaction network). This drug and its interactions are taken in turn as a test dataset to validate the model trained on the remaining drug-disease interaction network. The procedure is illustrated in Figure 4A. The AUCs for leave one drug out cross-validation are shown as barplot in Figure 4B. The results are similar to 10 fold cross-validation results. “Chem” achieves the worst AUC, “Inter” obtains a better one, and “Side-effect” performs the best. Furthermore, all three data sources have larger AUCs than 0.78. “Inter” and “Side-effect” make AUC 0.80 and 0.84, respectively. “Comb” receives an AUC 0.85. These results demonstrate the data source complementarily and utility of heterogeneous data integration.
Subfigure A: The procedure for leave one drug out cross-validation. Subfigure B: The AUCs obtained from leave one drug out cross-validation (“Chem”: chemical structure, “Inter”: target protein, “Side-effect”: side-effect, and “Comb”: integration of “Chem”, “Inter”, and “Side-effect”). It further shows that all three data sources can uncover new diseases for a novel drug, and integration works even better.
Comparing with Previous Work
We compared PreDR with previous work in  since the gold-standard positives used in our study is the same. The authors in  measured the similarity of the pertaining drug and disease only for the nearest known associated drug-disease pair. Specifically, a simple geometric mean based score is calculated to combine the drug-drug similarity with disease-disease similarity, and the maximal score with the known associated drug-disease pair is extracted as classification feature . Differently, we measured similarities among all the drugs and among all the diseases to represent drug and disease, respectively. And then we use kernel function and SVM classifier to train the model. That is, we utilize the global information extracted from drug-disease data in PreDR. To show this advantage, we illustrated one example in Figure 5A. Here the candidate association between drug and disease (shown as black dash line in Figure 5A) cannot be inferred directly by the most similar known association (shown as black solid line in Figure 5A). Because drug ‘Eletriptan’ is not very similar to drug ‘Orphenadrine’ (similarity score is 0.367). However our method can utilize the drug ‘Benztropine’ as a bridge to connect drug ‘Eletriptan’ and drug ‘Orphenadrine’. In this way we can have more confidence to associate candidate drug-disease pair. Because this prediction is achieved by the indirect drug similarity and we call it as ‘indirect drug-disease association’. Indeed, more drug-disease associations can be uncovered by PreDR (Figure 5B).
Subfigure A: An example for ‘indirect drug-disease association’. The candidate drug disease association is revealed utilizing the drug ‘Benztropine’ as a bridge to connect drug ‘Eletriptan’ and drug ‘Orphenadrine’. Subfigure B: The overlap of predictions by our method PreDR and previous method.
On cross-validation accuracy, the authors in  had obtained an AUC 0.9 in predicting drug indications. In our study, “Comb” achieves an AUC 0.91, which is nearly the same as the authors obtained in . The authors in  used more data sources to measure the drugs and diseases associations, including GO annotations for target proteins, the genetic based disease similarity from gene expression experiments and so on. Given the fact that we use less data sources, PreDR works well to achieve comparable performance. We note that these data sources can be easily integrated into PreDR. Since our aim here is to demonstrate a useful data integrative analysis framework instead of the most comprehensive and accurate predictions. We only pick one representative data source from the structure, activity, and phenotype levels. Thus we have the sufficient reason to believe that the improvement can be expected by introducing more data for each level.
In this subsection, we test whether PreDR can produce biologically useful predictions. To this end, we focus on the unknown (non-interacting) drug-disease pairs. We used kernel “Comb” on the gold standard positives and randomly selected gold standard negatives from the unlabelled pairs, and tested it on the remaining drug-disease pairs. Our expectation is that “Comb” can discover many missing associations. We drew the predicted drug-disease network in Figure 6 (only top 100 newly predicted interactions are shown for conciseness). Take drug ‘Hydroxyurea’ as an example, disease ‘Colorectal Cancer; Crc’ is revealed because that the similar drug ‘Capecitabine’ which shares the same side-effect ‘erythema’, treats disease ‘Colorectal Cancer; Crc’ (illustrated in Figure 7). The top five novel predictions are listed in Table S2. For each novel prediction, we checked the drug target proteins form DrugBank , the disease genes from OMIM , and the corresponding pathway information from KEGG BRITE . Finally, we checked whether novel predictions appear in current clinical trials database (http://clinicaltrials.gov/). Take the most confident prediction as an example, target protein ‘Endothelin-1 receptor’ (EDNRA) for ‘Bosentan’, and the disease gene ‘KCNMB1’ (Kca) for ‘Hypertension, Diastolic, Resistance To’ belong to the same pathway ‘Arachidonic Acid metabolism’ (Figure 8). Furthermore, we find that this drug-disease pair appears in current clinical trials, the ‘ClinicalTrials.gov Identifier’ is NCT00820352. That is, this novel drug-disease association may be true with high probability.
LightCoral rectangle represents drug and LightSteelBlue cycle represents disease. Pink solid line represents the known interaction and the DarkBlue dash line represents the new prediction.
Disease ‘Colorectal Cancer; Crc’ is revealed because that the similar drug ‘Capecitabine’ which shares the same side-effect ‘erythema’, treats disease ‘Colorectal Cancer; Crc’.
Drug target proteins and disease genes are highlighted by orange border.
The target of ‘Hydroxyurea’ is ‘Ribonucleoside-diphosphate reductase large subunit’ (RRM2: p53R2), the disease gene of ‘Colorectal Cancer; Crc’ is ‘TP53’ (p53). In addition EDNRA and Kca belong to the same pathway hsa04115 (shown in Figure 8). Unfortunately, we do not find the evidence of this pair in current clinical trials database. However, the lower pathway distance between disease gene and target already shows the high probability for their association.
The target of ‘Dasatinib’ is ‘Tyrosine-protein kinase ABL1’ (ABL1: BCRABL), the disease gene of ‘Leukemia, Acute Myeloid; Aml’ is ‘Mast/stem cell growth factor receptor Kit’ (KIT). In addition ABL1 and KIT belong to the same pathway hsa05200. Furthermore. this drug disease pair is found the current clinical trials database, the ‘ClinicalTrials.gov Identifier’ are NCT01392703 and NCT00850382. It means that this novel pair may interact in vivo with high probability.
The target of ‘Nabumetone’ is ‘Prostaglandin G/H synthase 2’ (PTGS2), the disease gene of ‘Sensory Ataxic Neuropathy, Dysarthria, And Ophthalmoparesis; Sando’ is ‘DNA polymerase subunit gamma-1’ (POLG). In addition ABL1 and KIT belong to a same pathway hsa01100. No evidence is found for this pair in clinical trials database.
The target of ‘Acebutolol’ is ‘Beta-1 adrenergic receptor’ (ADRB1: ADR), the disease gene of ‘Alcohol Dependence’ is ‘Gammaaminobutyric acid receptor subunit alpha-2’ (GABRA2: GABR). In addition ABL1 and KIT belong to a same pathway hsa04080 No evidence is found for this pair in current clinical trials database. The lower pathway distance between disease gene and target shows the high probability for their association.
Among our top five predictions, two of them are supported by current clinical trials. All these results suggest that, PreDR can uncover potential repositioning of drugs, and can provide candidates for further high-resolution validation.
In this paper, we propose a new computational method, PreDR, to predict drug repositioning. PreDR allows us to infer novel associations among drugs and diseases by integrating heterogeneous data sources. Our main contributions here are both in integrating the heterogeneous drug and disease similarity profiles by kernel function and construction of a predictive model.
Specifically, we characterize the drug similarity profiles form three levels. Chemical structures, target proteins, and side-effects data are collected to represent structure, activity, and phenotype for drugs. Treating the task as a binary classification problem, we train a SVM-based predictor to uncover unknown interactions between drugs and diseases. The improvement in various evaluation criteria is obtained on a well-established dataset with 1,933 interactions among 593 drugs and 313 diseases. Leave one drug out cross-validations, database search, literature survey, and functional annotation analysis reveal that PreDR provides high quality predictions. For example, among the top five novel predictions, two of them are supported by current clinical trials database. Taken together, PreDR can serve as a useful tool for drug repositioning and promote the further drug discovery.
One possible concern is that PreDR works well by those ‘trivial’ predictions. For example, those drugs sharing common target are easily to be predicted to cure the same diseases. To address this issue, we test our PreDR by filtering out the potential “trivial’ predictions. Take target protein as an example, we filter the target proteins with high sequence similarity (0.8). That is, the drugs with high sequence similarity targets (0.8) are excluded from gold standard positives. On this filtered dataset, we validate PreDR’s prediction performance. We achieve the AUC 0.754 for “Inter”, which is lower than 0.889 obtained by “Inter” on the full gold standard positive dataset, but much higher than 0.5 (random classification). This experiment suggests that PreDR can reveal ‘non-trivial’ predictions, by fully considering the global and remote similarity in kernel function.
In this article, we attempt to improve the performance by integrating target proteins information. The experimental results show that, comparing with chemical structures, the performance is indeed improved by characterizing drugs in target sequence-based similarity. In fact, there are other ways to define the drug similarity based on their targets. For example, target closeness in protein-protein interaction (PPI) network can be used . Therefore we take the targets closeness in a human PPI network derived from HPRD (Release 9) to incorporate into PreDR. Unfortunately, the prediction accuracy is worse than sequence-based similarity. This may be due to the high false positive rate and relative low precision of single PPI network. In the future, we will define the targets closeness based on an integrated human PPI networks collected from multiple curated databases, including HPRD , OPHID , and BIND  databases.
For disease, we only apply the phenotypic similarity in current study. Studies have shown that phenotypically similar diseases are often caused by functionally related genes . In addition, many large-scale studies support the idea that genes sharing similar diseases are tightly linked in the network , . Therefore, disease genes closeness in a PPI network is useful to correlate disease with candidate genes . Apart from gene closeness, genes with similar sequences may be functionally related , . It is promising to use disease gene sequence similarity and closeness in a PPI network to characterize disease. So we applied disease gene sequence similarity and closeness in a human PPI networks to measure the disease similarity, and then extend PreDR. Unfortunately, neither sequence similarity nor closeness in a human PPI networks can achieve better results than phenotype-based similarity (see Table S3). The inefficient performance may be due to the fact that the gap between phenotype (disease) and genotype (gene) is too large and the associations are not so accurate. One possible way out is to validate the disease gene based similarity by GO annotation terms, which may closely correlate with the disease similarity.
The distribution of drug similarity scores among the drugs sharing common diseases (Distance is 2 for Drug1 and Drug 2), mediate (Distance is 4 for Drug1 and Drug 2) or unrelated (Distance is 6 for Drug1 and Drug 2), respectively. Figure S1 shows that the drugs sharing common disease tend to have higher side-effect similarity comparing with the structure and target protein similarity.
The AUPRs derived from different similarity measurements (Chem: chemical structure, Inter: drug target interaction, Side-effect: side-effect based similarity and Comb: integration of Chem, Inter, and Side-effect). Figure S2 shows that all chemical structures, target proteins, and side-effects are predictive in drug repositioning prediction, and improved performance can be achieved by integration of them.
The precision-recall curves derived from different similarity measurements (chem: chemical structure, inter: drug target interaction, side-effect: side-effect based similarity, and comb: Integration of chem, inter, and side-effect). Figure S3 presents, all methods make precision higher than 0.7 when recall value is larger than 0.8, and comb achieves the highest precision with higher recall values. All these results suggest that each data source is predictive and by combination further performance improvement can be obtained.
The definitions of evaluation criteria. Table S1 lists the evaluation criteria used in this article. Here TP is the number of drug-disease pairs correctly predicted to interact, FP is the number of drug-disease pairs predicted to interact but actually not. And TN is the number of drug-disease pairs do not interact and predicted correctly, FN is the number of drug-disease pairs predicted not to interact but actually interact.
The top five drug repositioning predictions by our method. Table S2 presents the top five novel predicted drug-disease interactions.
The performance comparison of disease gene closeness in a human PPI network under different drug similarity measurements to predict drug repositioning. The best predictions obtained are highlighted in bold. Table S3 just lists the performance of disease gene closeness in PPI network due to the fact that disease gene sequence similarity performs worse than its closeness in PPI network.
The authors would like to thank the editor and reviewers for their thoughtful comments, which greatly improved the clarity of our paper.
Conceived and designed the experiments: YCW YW. Performed the experiments: YCW. Analyzed the data: YCW YW. Contributed reagents/materials/analysis tools: YCW YW SLC NYD. Wrote the paper: YCW YW. Contribution type: SLC NYD.
- 1. DiMasi JA, Hansen RW, Grabowski HG (2003) The price of innovation: new estimates of drug development costs. J Health Econ 22: 151–185.
- 2. Kinnings SL, Liu N, Buchmeier N, Tonge PJ, Xie L, et al. (2009) Drug discovery using chemical systems biology: repositioning the safe medicine Comtan to treat multi-drug and extensively drug resistant tuberculosis. PLoS Comput Biol 5: e1000423.
- 3. Li J, Zhu X, Chen JY (2009) Building disease-specific drug-protein connectivity maps from molecular interaction networks and PubMed abstracts. PLoS Comput Biol 5: e1000450.
- 4. Kotelnikova E, Yuryev A, Mazo I, Daraselia N (2010) Computational approaches for drug repositioning and combination therapy design. J Bioinform Comput Biol 8: 593–606.
- 5. Hu G, Agarwal P (2009) Human disease-drug network based on genomic expression profiles. PLoS One 4: e6536.
- 6. Chiang AP, Butte AJ (2009) Systematic evaluation of drug-disease relationships to identify leads for novel drug uses. Clin Pharmacol Ther 86: 507–510.
- 7. Wu ZK, Wang Y, Chen L (2013) Network-based drug repositioning. Mol. BioSyst 9(6): 1268–1281.
- 8. Gottlieb A, Stein GY, Ruppin E, Sharan R (2011) PREDICT: a method for inferring novel drug indications with application to personalized medicine. Mol Syst Biol 7: 496.
- 9. Vapnik V (1995) The nature of statistical learning theory. Springer, New York.
- 10. Vapnik V (1998) Statistical learning theory. Wiley.
- 11. Schölkopf B, Tsuda K, Vert JP (2004) Support vector machine applications in computational biology. MIT Press, Cambridge, MA, pp: 71–92.
- 12. van Driel MA, Bruggeman J, Vriend G, Brunner HG, Leunissen JA (2006) A text-mining analysis of the human phenome. Eur J Hum Genet 14: 535–542.
- 13. Hofmann T, Schölkopf B, Smola AJ (2008) Kernel methods in machine learning. Ann Stat 36: 1171–1220.
- 14. Pauwels E, Stoven V, Yamanishi Y (2011) Predicting drug side-effect profiles: a chemical fragmentbased approach. BMC Bioinformatics 12: 169.
- 15. Yamanishi Y, Kotera M, Kanehisa M, Goto S (2010) Drug-target interaction prediction from chemical, genomic and pharmacological data in an integrated framework. Bioinformatics 26: i246–i254.
- 16. Kanehisa M, Goto S, Hattori M, Aoki-Kinoshita KF, Itoh M, et al. (2006) From genomics to chemical genomics: new developments in kegg. Nucleic Acids Res 34: D354–D357.
- 17. Schomburg I, Chang A, Ebeling C, Gremse M, Heldt C, et al. (2004) Brenda, the enzyme database: updates and major new developments. Nucleic Acids Res 32: D431–D433.
- 18. Günther S, Kuhn M, Dunkel M, Campillos M, Senger C, et al. (2008) Supertarget and matador: resources for exploring drug–target relationships. Nucleic Acids Res 36: D919–D922.
- 19. Wishart DS, Knox C, Guo AC, Cheng D, Shrivastava S, et al. (2008) Drugbank: a knowledgebase for drugs, drug actions and drug targets. Nucleic Acids Res 36: D901–D906.
- 20. Yamanishi Y, Araki M, Gutteridge A, Honda W, Kanehisa M (2008) Prediction of drug-target interaction networks from the integration of chemical and genomic spaces. Bioinformatics 24: i232–i240.
- 21. Zhao SW, Li S (2010) Network-based relating pharmacological and genomic spaces for drug target identification. PLoS ONE 5(7): e11764.
- 22. Wang YC, Yang ZX, Wang Y, Deng NY (2010) Computationally probing drug-protein interactions via support vector machine. Lett Drug Des Discov 7: 370–378.
- 23. Wang YC, Chen SL, Deng NY, Wang Y (2013) Network predicting drug’s anatomical therapeutic chemical code. Bioinformatics 29(10): 1317–1324.
- 24. Smith TF, Waterman M (1981) Identification of common molecular subsequences. J Mol Biol 147: 195–197.
- 25. Campillos M, Kuhn M, Gavin AC, Jensen LJ, Bork P (2008) Drug target identification using side-effect similarity. Science 321: 263–266.
- 26. Yang L, Agarwal P (2011) Systematic drug repositioning based on clinical side-effects. PLoS ONE 6(12): e28025.
- 27. Duran-Frigola M, Aloy P (2012) Recycling side-effects into clinical markers for drug repositioning. Genome Med 4: 3.
- 28. Basilico J, Hofmann T (2004) A joint framework for collaborative and content filtering. 27th Annual International ACM SIGIR Conference.
- 29. Ben-Hur A, Noble WS (2005) Kernel methods for predicting protein-protein interactions. Bioin- formatics 21 Suppl 1i38–i46.
- 30. Oyama S, Manning CD (2004) Using feature conjunctions across examples for learning pairwise classifiers. In European Conference on Machine Learning 2004, pp: 322–333.
- 31. Hue M, Vert JP (2010) On learning with kernels for unordered pairs. ICML, pp: 463–470.
- 32. Wu G, Chang EY (2003) Class-boundary alignment for imbalanced dataset learning. In ICML 2003 Workshop on Learning from Imbalanced Data Sets.
- 33. Hamosh A, Scott AF, Amberger JS, Bocchini CA, McKusick VA (2002) Online Mendelian Inheritance in Man (OMIM), a knowledgebase of human genes and genetic disorders. Nucleic Acids Res 30: 52–55.
- 34. Chen B, Wild D, Guha R (2009) PubChem as a Source of Polypharmacology. (J Chem Inform Model 49(9): 2044–2055.
- 35. Kuhn M, Campillos M, Letunic I, Jensen LJ, Bork P (2010) A side effect resource to capture phenotypic effects of drugs. Mol Syst Biol 6: 343.
- 36. Chang CC, Lin CJ (2011) LIBSVM : a library for support vector machines. ACM TIST 2(27): 1–27.
- 37. Gribskov M, Robinson NL (1996) Use of receiver operating characteristic (roc) analysis to evaluate sequence matching. Comput Chem 20: 25–33.
- 38. Raghavan VV, Bollmann P, Jung GS (1989) A critical investigation of recall and precision as measures of retrieval system performance. ACM TMIS 7(3): 205–229.
- 39. Davis J, Goadrich M (2006) The relationship between Precision-Recall and ROC curves. ICML ’06 Proceedings of the 23rd international conference on Machine learning, pages 233–240. ACM.
- 40. Keshava Prasad TS, Goel R, Kandasamy K, Keerthikumar S, Kumar S, et al. (2009) Human protein reference database-2009 update. Nucleic Acids Res 37: D767–D772.
- 41. Brown KR, Jurisica I (2005) Online predicted human interaction database. Bioinformatics 21: 2076–2082.
- 42. Bader GD, Betel D, Hogue CW (2003) BIND: the biomolecular interaction network database. Nucleic Acids Res 31: 248–250.
- 43. Wu X, Jiang R, Zhang MQ, Li S (2008) Network-based global inference of human disease genes. Mol Syst Biol 4: 189.
- 44. Fraser HB, Plotkin JB (2007) Using protein complexes to predict phenotypic effects of gene mutation. Genome Biol 8: R252.
- 45. McGary KL, Lee I, Marcotte EM (2007) Broad network-based predictability of S. cerevisiae gene loss-of-function phenotypes. Genome Biol 8: R258.
- 46. Whisstock JC, Lesk AM (2003) Prediction of protein function from protein sequence and structure. Q Rev Biophys 36: 307–340.
- 47. Dobson PD, Cai YD, Stapley BJ, Doig AJ (2004) Prediction of protein function in the absence of significant sequence similarity. Curr Med Chem 11: 2135–2142.