Using a pay-as-you-go strategy, we allow for a community of users to validate or invalidate mappings obtained by an automatic ontology matching system using consensus for each mapping. The ultimate objectives are effectiveness - improving the quality of the obtained alignment (set of mappings) measured in terms of F-measure as a function of the number of user interactions - and robustness - making the system as much as possible impervious to user validation errors. Our strategy consists of two major steps: candidate mapping selection, which ranks mappings based on their perceived quality so that users are presented first with those mappings with lowest quality, and feedback propagation, which seeks to validate or invalidate those mappings that are perceived to be similar to the mappings already presented to the users for validation. The purpose of these two strategies is twofold: achieve greater improvements earlier and minimize overall user interaction. There are three important features of our approach: the use of a dynamic ranking mechanism to adapt to the new conditions after each user interaction, the presentation of each mapping for validation more than once - revalidation - because of possible user errors, and the immediate propagation of the user input on a mapping without first achieving consensus for that mapping. We study extensively the effectiveness and robustness of our approach as several of these parameters change, namely the error and revalidation rates, as a function of the number of iterations, to provide conclusive guidelines for the design and implementation of multi-user feedback ontology matching systems.

Cruz, I., Palmonari, M., Loprete, F., Stroe, C., Taheri, A. (2016). Quality-based model for effective and robust multi-user pay-as-you-go ontology matching. SEMANTIC WEB, 7(4), 463-479 [10.3233/SW-150205].

Quality-based model for effective and robust multi-user pay-as-you-go ontology matching

PALMONARI, MATTEO LUIGI
Secondo
;
2016

Abstract

Using a pay-as-you-go strategy, we allow for a community of users to validate or invalidate mappings obtained by an automatic ontology matching system using consensus for each mapping. The ultimate objectives are effectiveness - improving the quality of the obtained alignment (set of mappings) measured in terms of F-measure as a function of the number of user interactions - and robustness - making the system as much as possible impervious to user validation errors. Our strategy consists of two major steps: candidate mapping selection, which ranks mappings based on their perceived quality so that users are presented first with those mappings with lowest quality, and feedback propagation, which seeks to validate or invalidate those mappings that are perceived to be similar to the mappings already presented to the users for validation. The purpose of these two strategies is twofold: achieve greater improvements earlier and minimize overall user interaction. There are three important features of our approach: the use of a dynamic ranking mechanism to adapt to the new conditions after each user interaction, the presentation of each mapping for validation more than once - revalidation - because of possible user errors, and the immediate propagation of the user input on a mapping without first achieving consensus for that mapping. We study extensively the effectiveness and robustness of our approach as several of these parameters change, namely the error and revalidation rates, as a function of the number of iterations, to provide conclusive guidelines for the design and implementation of multi-user feedback ontology matching systems.
Articolo in rivista - Articolo scientifico
Computer Networks and Communications; Computer Science Applications1707 Computer Vision and Pattern Recognition; Information Systems
English
2016
7
4
463
479
partially_open
Cruz, I., Palmonari, M., Loprete, F., Stroe, C., Taheri, A. (2016). Quality-based model for effective and robust multi-user pay-as-you-go ontology matching. SEMANTIC WEB, 7(4), 463-479 [10.3233/SW-150205].
File in questo prodotto:
File Dimensione Formato  
SWJ2016 - Green Open Access.pdf

Accesso Aperto

Descrizione: Post-print version for self-archiving purposes
Tipologia di allegato: Author’s Accepted Manuscript, AAM (Post-print)
Dimensione 1.21 MB
Formato Adobe PDF
1.21 MB Adobe PDF Visualizza/Apri
+J2016-swj-publisherVersion.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 507.19 kB
Formato Adobe PDF
507.19 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/136403
Citazioni
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 5
Social impact