License: 
Creative Commons Attribution 4.0 International license (CC BY 4.0)
When quoting this document, please refer to the following
DOI: 10.4230/OASIcs.SLATE.2021.2
URN: urn:nbn:de:0030-drops-144198
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2021/14419/
Santos, André Fernandes dos ;
Leal, José Paulo
Derzis: A Path Aware Linked Data Crawler
Abstract
Consuming Semantic Web data presents several challenges, from the number of datasets it is composed of, to the (very) large size of some of those datasets and the uncertain availability of querying endpoints. According to its core principles, accessing linked data can be done simply by dereferencing the IRIs of RDF resources. This is a light alternative both for clients and servers when compared to dataset dumps or SPARQL endpoints. The linked data interface does not support complex querying, but using it recursively may suffice to gather information about RDF resources, or to extract the relevant sub-graph which can then be processed and queried using other methods. We present Derzis, an open source semantic web crawler capable of traversing the linked data cloud starting from a set of seed resources. Derzis maintains information about the paths followed while crawling, which allows to define property path-based restrictions to the crawling frontier.
BibTeX - Entry
@InProceedings{santos_et_al:OASIcs.SLATE.2021.2,
author = {Santos, Andr\'{e} Fernandes dos and Leal, Jos\'{e} Paulo},
title = {{Derzis: A Path Aware Linked Data Crawler}},
booktitle = {10th Symposium on Languages, Applications and Technologies (SLATE 2021)},
pages = {2:1--2:12},
series = {Open Access Series in Informatics (OASIcs)},
ISBN = {978-3-95977-202-0},
ISSN = {2190-6807},
year = {2021},
volume = {94},
editor = {Queir\'{o}s, Ricardo and Pinto, M\'{a}rio and Sim\~{o}es, Alberto and Portela, Filipe and Pereira, Maria Jo\~{a}o},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops.dagstuhl.de/opus/volltexte/2021/14419},
URN = {urn:nbn:de:0030-drops-144198},
doi = {10.4230/OASIcs.SLATE.2021.2},
annote = {Keywords: Semantic web, linked open data, RDF, crawler}
}
