Advertisement

  • Loading metrics

Open Access

Peer-reviewed

Research Article

Using the Semantic Web for Rapid Integration of WikiPathways with Other Biological Online Data Resources

Abstract

The diversity of online resources storing biological data in different formats provides a challenge for bioinformaticians to integrate and analyse their biological data. The semantic web provides a standard to facilitate knowledge integration using statements built as triples describing a relation between two objects. WikiPathways, an online collaborative pathway resource, is now available in the semantic web through a SPARQL endpoint at http://sparql.wikipathways.org. Having biological pathways in the semantic web allows rapid integration with data from other resources that contain information about elements present in pathways using SPARQL queries. In order to convert WikiPathways content into meaningful triples we developed two new vocabularies that capture the graphical representation and the pathway logic, respectively. Each gene, protein, and metabolite in a given pathway is defined with a standard set of identifiers to support linking to several other biological resources in the semantic web. WikiPathways triples were loaded into the Open PHACTS discovery platform and are available through its Web API (https://dev.openphacts.org/docs) to be used in various tools for drug development. We combined various semantic web resources with the newly converted WikiPathways content using a variety of SPARQL query types and third-party resources, such as the Open PHACTS API. The ability to use pathway information to form new links across diverse biological data highlights the utility of integrating WikiPathways in the semantic web.

Author Summary

WikiPathways is a crowd-sourced online platform for biological pathways. It is based on the same underlying platform as Wikipedia. Pathways are saved as graphical images embedded in a set of meta data elements (i.e. references, list of pathways elements, and context annotations). Pathways are used as proxies of biological knowledge in their role as descriptors of processes. Yet integrating these hubs of biological knowledge with other biological data resources remains challenging due to a cacophony of file formats, identifier systems, and hidden content. We show the application of the semantic web to enable a straightforward integration of heterogeneous biological data sources. We have taken high-quality pathways from a curated set from WikiPathways and converted the content into a data format native to the semantic web. Here, data is expressed as a set of statements where the statements are built upon a set of web addresses. Given the results, we successfully integrated external resources (e.g., EBI Expression Atlas) and pathway content with a single query.

Citation: Waagmeester A, Kutmon M, Riutta A, Miller R, Willighagen EL, Evelo CT, et al. (2016) Using the Semantic Web for Rapid Integration of WikiPathways with Other Biological Online Data Resources. PLoS Comput Biol 12(6): e1004989. https://doi.org/10.1371/journal.pcbi.1004989

Editor: Christos A. Ouzounis, Hellas, GREECE

Received: February 15, 2016; Accepted: May 17, 2016; Published: June 23, 2016

Copyright: © 2016 Waagmeester et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All files are available for download at http://rdf.wikipathways.org. The data are also accessible through SPARQL queries at http://sparql.wikipathways.org or through REST-calls at https://dev.openphacts.org/docs.

Funding: This work was supported by: Innovative Medicines Initiatives Joint Undertaking under grant agreement no115191 (http://www.imi.europa.eu/content/open-phacts); and NIH National Institute for General Medical Sciences (R01-GM100039) (https://www.nigms.nih.gov/Research/Pages/default.aspx). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Pathway analysis and visualisation of data on pathways provide insights into the underlying biology of effects found in genomics, proteomics, and metabolomics experiments [1–4]. WikiPathways is a pathway repository where content is provided by the community at large [5, 6]. In a given pathway, elements like genes, proteins, metabolites, and interactions are identified using common accession numbers from reference databases such as Entrez Gene [7], Ensembl [8], UniProt [9], HMDB [10], ChemSpider [11], PubChem [12] and ChEMBL [13]. Multiple databases can be referenced to annotate an element of the same semantic type, e.g. Ensembl and Entrez Gene to annotate gene information. Even single studies sometimes use different reference databases to annotate experimental findings. It is common for bioinformaticians to spend valuable time dealing with data mapping issues that impede the actual data analysis and interpretation. In WikiPathways we use the open source software framework BridgeDb [14], to help resolve different identifiers representing the same (or related) entities. Capturing a semantically correct description of biological entities and their connections across datasets is the broader challenge that we have to address. The semantic web provides an approach to define entities and their relationships. By explicitly defining these entities and relationships the semantic web can provide a network of linked data [15]. The Resource Description Framework (RDF) consists of two key components: statements and universal identifiers. Each statement is captured as a triple, consisting of a subject, a predicate, and an object. For example, the following triple defines the glucose molecule as being part of the glycolysis pathway:

The notion of a semantic web surfaces as you link across large sets of triples representing a vast number of objects and diverse types of concepts and predicates. The use of uniform identifiers, or URIs [16], provides consistency when specifying subjects and objects. identifiers.org [17], for example, provides a clearinghouse for a wide variety of URIs for biological entities in the life science domain. WikiPathways provides identifiers for all its pathways and identifiers.org provides the URI scheme to make these resolvable. Standardized URIs for predicates come from efforts such as the Simple Knowledge Organization System (SKOS) [18]. For example, our example triple above can be expressed in a more universal way as: where each element is uniquely and universally resolvable to a defined concept (glycolysis, “has member”, and glucose respectively). Of course, the more human readable information can also be explicitly added by describing the labels in RDF. But that information is also available by resolving the URIs.

  1. PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
  2. PREFIX wp: <http://identifiers.org/wikipathways/>
  3. PREFIX skos: <http://www.w3.org/2004/02/skos/core#>
  4. PREFIX chebi: <http://identifiers.org/chebi/CHEBI:>
  5. wp:WP534 skos:member chebi:4167.
  6. wp:WP534 rdfs:label “Glycolysis and Gluconeogenesis (Homo sapiens)”@en.
  7. chebi:4167 rdfs:label “Glucose”@en.

In order to contribute pathway knowledge to the semantic web, we have modeled the content of WikiPathways to form triple-based statements. The interactions and reactions curated at WikiPathways are particularly well-suited to enrich the overall connectivity of the semantic web. Pathways offer a meaningful context for relations between biological entities, such as proteins, metabolites and diseases that are otherwise defined in disparate databases. We report on the conversion process and the development of two new vocabularies essential in capturing the semantics behind pathway diagrams. Finally, we evaluate the use of the semantically linked pathway knowledge through specialized queries and third-party resources, showing how to link WikiPathways with disease annotations (from UniProt [9] and DisGeNET [19]), with gene-expression values (from Gene Express Atlas) and with bioactive chemical compounds known to affect proteins that occur in pathways (e.g. from ChEMBL).

Results and Discussion

Pathway vocabularies

There are existing standards to model various aspects of pathway knowledge, such as BioPAX [20], SBGN [21], MIM [22], SBML [23] and SBO [24]. BioPAX and SBO are in fact already available in a Semantic Web-compatible language called OWL [25]. These standards provide valuable building blocks for our “WP” vocabulary that captures the biological meaning of pathways. However, not all of the graphical annotations, spatial information and other subtleties critical for the visual representation, the intuitive understanding and the usability for data visualisation of the curated content at WikiPathways are captured by these standards. Our “GPML” vocabulary directly reflects these features defined in the XML format, GPML, or Graphical Pathway Markup Language. For example, in GPML, all genes, proteins and metabolites are types of data nodes, which are rendered as a rectangular box with properties capturing among others its position, height, width, label, and external reference. For example:

<DataNode TextLabel = “Glucose” GraphId = “dba83” Type = “Metabolite”>

 <Graphics CenterX = “279.0” CenterY = “468.0” Width = “112.0” Height = “20.0” ZOrder = “32768”>

 <Xref Database = “ChEBI” ID = “CHEBI:4167” />

</DataNode>

In the GPML vocabulary, used for semantic representation of pathway diagrams, the markup elements and values are described as classes and properties, each with their respective URIs.

<http://identifiers.org/chebi/CHEBI:4167> rdf:type gpml:DataNode.

<http://identifiers.org/chebi/CHEBI:4167> rdfs:label “Glucose”@en.

<http://identifiers.org/chebi/CHEBI:4167> gpml:graphId “dba83”.

<http://identifiers.org/chebi/CHEBI:4167> gpml:ZOrder 32768.

…

The GPML vocabulary, in its current form, is mainly instrumental in the representation of the spatial information captured at WikiPathways. However, as we will describe below it can also be used to convert pathway information from other semantic web resources into a format amenable to being rendered and curated at WikiPathways. Explicit mappings to external (graphical) ontologies are not added, however through plugins such as Pathvisio-MIM [26] mappings to graphical notations such as MIM or SBGN, are possible. In an analogous way, the WP vocabulary can be used to capture the biological relations from other pathways in such a way that they can be used in resources using this semantic layer of the WikiPathways RDF. We used this approach for example to make the relations from Reactome pathways available in the Open PHACTS discovery platform [27] starting from the converted pathways at WikiPathways.

The WP vocabulary, focusing on biological meaning, issues URIs for biological concepts and disregards layout and other rendering details. Using URIs from this vocabulary allows stating that something is a Pathway, or that a DataNode is a chemical compound or gene product. The vocabulary also captures descriptive elements, such as labels, shapes and lines that help annotate and contextualize the pathway reaction details. The RDF generated consist of terms from the vocabularies developed in this context. This is done to be able to reflect the semantics used in the WikiPathways community. However, to allow integration with external pathway resources—which is the primary objective of this project—we need to link to external ontologies. For the subset of concepts in common with prior vocabularies, such as BioPAX, we utilize the SKOS data model to express a range of similarities from skos:exactMatch to skos:closeMatch [18, 28].

Pathway conversion and queries

With these vocabularies in place, the next step is the actual conversion of GPML files into triples using the GPML vocabulary. Then rules are applied to make the biological meaning explicit using the WP vocabulary. For example a directed interaction is captured in GPML as two “DataNodes”, a line and an arrowhead. The “DataNodes” have external references as properties. Rules are then applied to state that a line is a Directed Interaction, with a source and a target. Fig 1 contains an example of such a rule based reasoning query that issues triples with URIs from the WP vocabulary.

thumbnail
Download:
Fig 1. A construct query is type of SPARQL query that enables the conversion of one graph pattern to another.

Here an interaction described by its spatial properties (GPML) is converted into a semantic representation reflecting its biological interpretation (WP). The SPARQL query is available in the supporting information section.

https://doi.org/10.1371/journal.pcbi.1004989.g001

WikiPathways pathways are regularly curated by a team of volunteers that evaluate their usability for analysis and tag the pathways as “curated”. WikiPathways contains 1000 pathways in the curated set across over a dozen species that convert to a total of 1.6 million triples. The triples are loaded in a SPARQL endpoint (http://sparql.wikipathways.org), which allows semantic querying of the data with the SPARQL query language [29]. RDF, including new and updated pathways, is generated and tested regularly and can be delivered upon request. Updates of the RDF that is available for download and in the SPARQL endpoint are triggered by crucial events, such as Reactome or Open PHACTS data releases. This prevents discrepancies in quality control or curation, due to small differences between (frequent) releases. Example SPARQL queries and their plain language translations are given in Table 1. A broad set of ∼50 queries is available on the help pages of WikiPathways [30].

thumbnail
Download:
Table 1. Example queries handled by the WikiPathways SPARQL endpoint.

https://doi.org/10.1371/journal.pcbi.1004989.t001

A federated SPARQL query [17] enables querying over multiple SPARQL endpoints. With a variety of SPARQL endpoints available with data on disease annotations (e.g. DisGeNET and UniProt), significantly expressed genes (e.g. EBI Expression Atlas) and drug-target interactions (e.g. ChEMBL), knowledge from these remote SPARQL endpoints can be integrated. Example queries are given in Table 2 and on the help pages of WikiPathways [30]

thumbnail
Download:
Table 2. Example federated queries handled by the WikiPathways SPARQL endpoint.

https://doi.org/10.1371/journal.pcbi.1004989.t002

Using linked data in common analysis platforms

Different common analysis platform allow the integration of linked data for future analysis and visualization. One nice example of such a analysis platform is R, a widely used software environment for statistical computing and graphics. R has a SPARQL library [31], which enables the import of linked data for further processing in R. This allows running common statistical tests or the creation of different visualization of linked data. We recently published an R library that interfaces R with PathVisio [32] and allows manipulation of pathways and data visualisation on pathways. Fig 2 shows up and down regulated genes in Diabetes Mellitus (efo:EFO_0000400, efo:EFO_0001359, and efo:EFO_0001360) in the pathway diagram on insulin signaling in human [30]. This pathway diagram with color-coding parts indicating up- and down regulated pathway elements, was created by integrating knowledge from two geographically dispersed and independent resources, through a single SPARQL query embedded in a R script, which is available online [33].

thumbnail
Download:
Fig 2. The colored boxes represent genes which are up (red) or down (blue) regulated in diabetes mellitus.

PIK3R2, MYO1C, PRKAA2, LIPE are down regulated in pre-diabetes. STX4A is down regulated in type 1 diabetes longstanding. PRKCQ, PTPN11, FOXO3A are down regulated in type 2 diabetes. GAB1, RHEB, MAP4K4, SNAP23 are up regulated in pre-diabetes. RHOJ, PRKCB are up regulated in type 1 diabetes recent onset. MAPK14UP, EIF4EBP1 are up regulated in type 1 diabetes clinical onset. From these 17 up or down regulated genes, 9 are being reported as being in the top 10 disease and phenotype associations for the selected gene in DisGeNET (i.e. PIK3R2, PRKAA2, LIPE, STX4A, PRKCQ, FOXO3A, MAP4K4, SNAP23, and PRKCB) (Gene-disease association data were retrieved from the DisGeNET Database, GRIB/IMIM/UPF Integrative Biomedical Informatics Group, Barcelona. (http://www.disgenet.org/). 04, 2016)

https://doi.org/10.1371/journal.pcbi.1004989.g002

Rosetta stone function

A number of resources provide content from multiple pathway databases, including Pathway Commons [34] and NCBIs BioSystems (http://ncbi.org/biosystems). While BioPAX in fact is RDF, the NCBI system is not. NCBI BioSystems uses NCBIs native identifiers: GeneId, ProteinId, CID. We thus have a resource with pathways from different origins that are already described in the same way. Since for WikiPathways content we know how the different entities in these resources map to the GPML and WP vocabularies we can now use that to produce RDF using these same ontologies for each of the other pathway resources present in NCBI BioSystems. In fact, we can do the same for Pathway Commons where this approach will lead to an improved version of RDF with explicit mappings to the WP vocabulary. We made a prototype script available on GitHub to be used for this type of conversions from BioSystems [35].

Use in discovery platforms

The semantically linked pathway data from WikiPathways RDF have also been integrated into the Open PHACTS discovery platform [27, 36]. Open PHACTS delivers and sustains an open pharmacological space using semantic web standards and technologies. The Open PHACTS platform currently provide 51 API methods of which thirteen deliver pathway information (https://dev.openphacts.org/docs). Other information collected in Open PHACTS describes other relationships like drug-target (from ChEMBL) and protein interaction (from UniProt). Having this all in one resource combined with a set of mapping tools allows fast analysis across the domains. By combining Open PHACTS API calls one can, for instance, find all protein targets for a drug and then all pathways that contain these targets.

Materials and Methods

Use of Open PHACTS RDF guidelines

In collaboration with partners in the Open PHACTS project, we proposed guidelines for presenting data as RDF [37], most of that can be considered as general guidelines to produce RDF in the biomedical domain. The guidelines consist of a prerequisite and 11 steps, covering the licensing (step 0), designing (step 1–5), implementation (steps 6–9), and presentation (steps 10–11) of the data in the semantic web. In the work presented here we follow these steps:

Licensing.

WikiPathways content is covered by the Creative Commons Attribution 3.0 Unported license (https://creativecommons.org/licenses/by/3.0/). This is stated in the VoID headers of the RDF made. These headers are automatically generated by the same script generating the WikiPathways RDF. Open PHACTS provides a template for these header files.

Implementation.

We used a Java RDF framework, Jena (http://jena.apache.org/)[38], to generate the RDF for WikiPathways. The pathway diagrams were obtained through the web services of WikiPathways, after which they were converted into RDF with the Jena RDF framework. The code of the serializer is available on GitHub (https://github.com/wikipathways/wp2lod). The vocabularies were generated with a vocabulary framework called Deri Neologism (http://neologism.deri.ie/).

Presentation.

The resulting RDF triples are available from (http://rdf.wikipathways.org) and loaded on a instance of the Virtuoso Open-Source Edition (http://virtuoso.openlinksw.com/) and available through its SPARQL endpoint at http://sparql.wikipathways.org. The triples are also loaded on the Open PHACTS discovery platform (https://dev.openphacts.org/docs/1.5) where they can be accessed through eleven API calls.

Identifier mapping

In the context of the semantic web, it is impractical to burden query writers with handling identifier mapping per resource and per query. Rather, the mapping results themselves need to become part of the semantic web. We applied two distinct approaches to addressing identifier mapping in our WikiPathways and Open PHACTS projects.

Query expansion.

The Open PHACTS framework provides query expansion functionality through its Identifier Mappings Services. When an identifier is queried the SPARQL query is enriched with all possible identifiers to retrieve an expanded set of related entities. This approach is the most efficient in terms of the number of triples, since it requires only a single identifier per relationship, eliminating redundancy. However, it also requires a hosted identifier mapping service that it called along with every query.

Unified identifiers.

In the case of WikiPathways, which does not host a mapping service, we chose a unified identifier approach, where all identifiers are mapped ahead of time to a set of common identifier systems. In this way, the database effectively contains the results of a limited number of identifier mappings in form of partially redundant triples. For example, in the WikiPathways RDF, all identifiers have been unified to Entrez Gene [7] (wp:bdbEntrezGene), Ensembl [8] (wp:bdbEnsembl), UniProt [9] (wp:bdbUniprot) for gene products and HMDB [10] (wp:bdbHmdb), and ChemSpider [11] (wp:bdbChemspider) for compounds like metabolites and drugs. The original identifier provided by the pathway curator is stored as a triple, with the predicate dc:identifier, and a URI from identifiers.org, which points to both the identifier and the resource.

Summary

We present a semantic web representation of WikiPathways together with vocabularies needed to cover the graphical pathway layout and the biological meaning and solutions to map between different identifier systems. The public availability allows rapid integration with other biological resources. The availability of two vocabularies allows to convert between different pathways resources. Different analytical tools now support the import of semantic web data, allowing integrated use of data from different resources with a single query. We demonstrate this with a federated query across multiple resources where the resulting differentially expressed genes for a disease where shown on a discovered pathway using PathVisio.

Availability

The following resources are publically available as beta releases just like WikiPathways. They are maintained as part of the open source WikiPathways project

WikiPathways on the Semantic Web

Supporting Information

S1 File. CONSTRUCT query to translate from the GPML vocabulary to the WP vocabulary.

A construct query is type of SPARQL query that enables the conversion of one graph pattern to another. Here an interaction described by its spatial properties is converted into a semantic representation reflecting its biological interpretation.

https://doi.org/10.1371/journal.pcbi.1004989.s001

(PDF)

Acknowledgments

We acknowledge the help from the teams behind UniProt, DisGeNET and EBI’s Array atlas for the help on the various SPARQL queries.

Author Contributions

Wrote the paper: AW MK CTE ARP. Designed the queries queries and use cases: AW MK AR RM ELW.

References

  1. 1. Jennen DGJ, Gaj S, Giesbertz PJ, van Delft JHM, Evelo CT, et al. (2010) Biotransformation pathway maps in wikipathways enable direct visualization of drug metabolism related expression changes. Drug Discov Today 15: 851–858. pmid:20708095
  2. 2. Khatri P, Sirota M, Butte AJ (2012) Ten years of pathway analysis: current approaches and outstanding challenges. PLoS Comput Biol 8: e1002375. pmid:22383865
  3. 3. van Iersel MP, Kelder T, Pico AR, Hanspers K, Coort S, et al. (2008) Presenting and exploring biological pathways with PathVisio. BMC Bioinformatics 9: 399. pmid:18817533
  4. 4. Kelder T, Conklin BR, Evelo CT, Pico AR (2010) Finding the right questions: exploratory pathway analysis to enhance biological discovery in large datasets. PLoS Biol 8. pmid:20824171
  5. 5. Kelder T, van Iersel MP, Hanspers K, Kutmon M, Conklin BR, et al. (2012) WikiPathways: building research communities on biological pathways. Nucleic Acids Res 40: D1301–1307. pmid:22096230
  6. 6. Kutmon M, Riutta A, Nunes N, Hanspers K, Willighagen EL, et al. (2016) WikiPathways: capturing the full diversity of pathway knowledge. Nucleic Acids Research 44: D488–D494. pmid:26481357
  7. 7. Maglott D, Ostell J, Pruitt KD, Tatusova T (2011) Entrez gene: gene-centered information at NCBI. Nucleic Acids Research 39: D52–D57. pmid:21115458
  8. 8. Yates A, Akanni W, Amode MR, Barrell D, Billis K, et al. (2016) Ensembl 2016. Nucleic Acids Research 44: D710–D716. pmid:26687719
  9. 9. The UniProt Consortium (2015) UniProt: a hub for protein information. Nucleic Acids Research 43: D204–D212. pmid:25348405
  10. 10. Wishart DS, Jewison T, Guo AC, Wilson M, Knox C, et al. (2013) HMDB 3.0—The human metabolome database in 2013. Nucleic Acids Research 41: D801–D807. pmid:23161693
  11. 11. Pence HE, Williams A (2010) ChemSpider: An online chemical information resource. J Chem Educ 87: 1123–1124.
  12. 12. Kim S, Thiessen PA, Bolton EE, Chen J, Fu G, et al. (2016) PubChem substance and compound databases. Nucleic Acids Research 44: D1202–D1213. pmid:26400175
  13. 13. Bento AP, Gaulton A, Hersey A, Bellis LJ, Chambers J, et al. (2014) The ChEMBL bioactivity database: an update. Nucleic Acids Research 42: D1083–D1090. pmid:24214965
  14. 14. van Iersel MP, Pico AR, Kelder T, Gao J, Ho I, et al. (2010) The BridgeDb framework: standardized access to gene, protein and metabolite identifier mapping services. BMC Bioinformatics 11: 5. pmid:20047655
  15. 15. Semantic web. URL http://www.w3.org/standards/semanticweb/.
    • 16. Berners-Lee T, Fielding R, Irvine U, and LM. Uniform resource identifiers (uri): Generic syntax. URL http://www.faqs.org/rfcs/rfc2396.html.
      • 17. Juty N, Le Novere N, Laibe C (2012) Identifiers.org and MIRIAM Registry: community resources to provide persistent identification. Nucleic Acids Res 40: D580–586. pmid:22140103
      • 18. Miles A, Bechhofer S. Skos simple knowledge organization system reference. URL http://www.w3.org/TR/skos-reference/.
        • 19. Piñero J, Queralt-Rosinach N, Bravo A, Deu-Pons J, Bauer-Mehren A, et al. (2015) DisGeNET: a discovery platform for the dynamical exploration of human diseases and their genes. Database 2015: bav028+. pmid:25877637
        • 20. Luciano JS (2005) Pax of mind for pathway researchers. Drug Discov Today 10: 937–942. pmid:15993813
        • 21. Le Novere N, Hucka M, Mi H, Moodie S, Schreiber F, et al. (2009) The Systems Biology Graphical Notation. Nat Biotechnol 27: 735–741. pmid:19668183
        • 22. Kohn KW, Aladjem MI, Weinstein JN, Pommier Y (2006) Molecular interaction maps of bioregulatory networks: a general rubric for systems biology. Mol Biol Cell 17: 1–13. pmid:16267266
        • 23. Finney A, Hucka M (2003) Systems biology markup language: Level 2 and beyond. Biochem Soc Trans 31: 1472–1473. pmid:14641091
        • 24. Juty N, Ali R, Glont M, Keating S, Rodriguez N, et al. (2015) BioModels: Content, Features, Functionality and Use. CPT: Pharmacometrics & Systems Pharmacology.
        • 25. OWL 2 Web Ontology Language Document Overview (Second Edition). URL http://www.w3.org/TR/owl2-overview/.
          • 26. Luna A, Sunshine ML, van Iersel MP, Aladjem MI, Kohn KW (2011) PathVisio-MIM: PathVisio plugin for creating and editing Molecular Interaction Maps (MIMs). Bioinformatics 27: 2165–2166. pmid:21636591
          • 27. Ratnam J, Zdrazil B, Digles D, Cuadrado-Rodriguez E, Neefs JM, et al. (2014) The application of the open pharmacological concepts triple store (open PHACTS) to support drug discovery research. PLoS ONE 9: e115460. pmid:25522365
          • 28. Halpin H, Hayes PJ, McCusker JP, McGuinness DL, Thompson HS (2010) When owl:sameAs Isn’t the Same: An Analysis of Identity in Linked Data. In: International Semantic Web Conference. Springer, volume 6496 of LNCS, pp. 305–320.
            • 29. Prud x2019;Hommeaux E, Seaborne A, et al. (2008) SPARQL query language for RDF. W3C recommendation 15.
              • 30. (2015). Help:WikiPathways Sparql queries. URL http://www.wikipathways.org/index.php/Help:WikiPathways_Sparql_queries.
                • 31. van Hage WR, Kauppinen T, Davis C (2015) SPARQL Package for R.
                  • 32. Bohler A, Eijssen LM, van Iersel MP, Leemans C, Willighagen EL, et al. (2015) Automatically visualise and analyse data on pathways using PathVisioRPC from any programming environment. BMC Bioinformatics 16: 267. pmid:26298294
                  • 33. Waagmeester A (2015). DifExInsullinSIgnalling.R. https://gist.github.com/andrawaag/6989c8c218862a912ef6.
                    • 34. Cerami EG, Gross BE, Demir E, Rodchenkov I, Babur O, et al. (2011) Pathway commons, a web resource for biological pathway data. Nucleic Acids Research 39: D685–D690. pmid:21071392
                    • 35. Waagmeester A (2015). BioSystems2RDF. https://github.com/andrawaag/BioSystems2RDF.
                      • 36. Williams AJ, Harland L, Groth P, Pettifer S, Chichester C, et al. (2012) Open PHACTS: semantic interoperability for drug discovery. Drug Discovery Today 17: 1188–98. pmid:22683805
                      • 37. Haupt C, Waagmeester A, Zimmermann M, Willighagen E (2013). Guidelines for exposing data as RDF in Open PHACTS. URL http://www.openphacts.org/specs/2013/WD-rdfguide-20131007/.
                        • 38. McBride B (2002) Jena: a semantic web toolkit. Internet Computing, IEEE 6: 55–59.