Over the last years, Linked Data has grown continuously. Today, we count more than 10,000 datasets being available online following Linked Data standards. These standards allow data to be machine readable and inter-operable. Nevertheless, many applications, such as data integration, search, and interlinking, cannot take full advantage of Linked Data if it is of low quality. There exist a few approaches for the quality assessment of Linked Data, but their performance degrades with the increase in data size and quickly grows beyond the capabilities of a single machine. In this paper, we present DistQualityAssessment – an open source implementation of quality assessment of large RDF datasets that can scale out to a cluster of machines. This is the first distributed, in-memory approach for computing different quality metrics for large RDF datasets using Apache Spark. We also provide a quality assessment pattern that can be used to generate new scalable metrics that can be applied to big data. The work presented here is integrated with the SANSA framework and has been applied to at least three use cases beyond the SANSA community. The results show that our approach is more generic, efficient, and scalable as compared to previously proposed approaches. Resource type Software Framework Website http://sansa-stack.net/distqualityassessment/ Permanent URL https://doi.org/10.6084/m9.figshare.7930139

Sejdiu, G., Rula, A., Lehmann, J., Jabeen, H. (2019). A Scalable Framework for Quality Assessment of RDF Datasets. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp.261-276). GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND : Springer [10.1007/978-3-030-30796-7_17].

A Scalable Framework for Quality Assessment of RDF Datasets

Rula A.
Secondo
;
2019

Abstract

Over the last years, Linked Data has grown continuously. Today, we count more than 10,000 datasets being available online following Linked Data standards. These standards allow data to be machine readable and inter-operable. Nevertheless, many applications, such as data integration, search, and interlinking, cannot take full advantage of Linked Data if it is of low quality. There exist a few approaches for the quality assessment of Linked Data, but their performance degrades with the increase in data size and quickly grows beyond the capabilities of a single machine. In this paper, we present DistQualityAssessment – an open source implementation of quality assessment of large RDF datasets that can scale out to a cluster of machines. This is the first distributed, in-memory approach for computing different quality metrics for large RDF datasets using Apache Spark. We also provide a quality assessment pattern that can be used to generate new scalable metrics that can be applied to big data. The work presented here is integrated with the SANSA framework and has been applied to at least three use cases beyond the SANSA community. The results show that our approach is more generic, efficient, and scalable as compared to previously proposed approaches. Resource type Software Framework Website http://sansa-stack.net/distqualityassessment/ Permanent URL https://doi.org/10.6084/m9.figshare.7930139
paper
big data, large-scale data quality
English
18th International Semantic Web Conference, ISWC 2019
2019
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
9783030307950
2019
11779
261
276
partially_open
Sejdiu, G., Rula, A., Lehmann, J., Jabeen, H. (2019). A Scalable Framework for Quality Assessment of RDF Datasets. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp.261-276). GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND : Springer [10.1007/978-3-030-30796-7_17].
File in questo prodotto:
File Dimensione Formato  
Sejdiu-2019-ISWC-VoR.pdf

Solo gestori archivio

Descrizione: Intervento a convegno
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 1.24 MB
Formato Adobe PDF
1.24 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Sejdiu-2019-ISWC-AAM.pdf

accesso aperto

Descrizione: Intervento a convegno
Tipologia di allegato: Author’s Accepted Manuscript, AAM (Post-print)
Licenza: Altro
Dimensione 851.69 kB
Formato Adobe PDF
851.69 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/285296
Citazioni
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 7
Social impact