Using our multi-user model, a community of users provides feedback in a pay-as-you-go fashion to the ontology matching process by validating the mappings found by automatic methods, with the following advantages over having a single user: the effort required from each user is reduced, user errors are corrected, and consensus is reached. We propose strategies that dynamically determine the order in which the candidate mappings are presented to the users for validation. These strategies are based on mapping quality measures that we define. Further, we use a propagation method to leverage the validation of one mapping to other mappings. We use an extension of the AgreementMaker ontology matching system and the Ontology Alignment Evaluation Initiative (OAEI) Benchmarks track to evaluate our approach. Our results show how Fmeasure and robustness vary as a function of the number of user validations. We consider different user error and revalidation rates (the latter measures the number of times that the same mapping is validated). Our results highlight complex trade-offs and point to the benefits of dynamically adjusting the revalidation rate.

Cruz, I., Loprete, F., Palmonari, M., Stroe, C., Taheri, A. (2014). Pay-As-You-Go Multi-user Feedback Model for Ontology Matching. In Knowledge Engineering and Knowledge Management. 19th International Conference, EKAW 2014, Linköping, Sweden, November 24-28, 2014. Proceedings (pp.80-96). Springer [10.1007/978-3-319-13704-9_7].

Pay-As-You-Go Multi-user Feedback Model for Ontology Matching

PALMONARI, MATTEO LUIGI;
2014

Abstract

Using our multi-user model, a community of users provides feedback in a pay-as-you-go fashion to the ontology matching process by validating the mappings found by automatic methods, with the following advantages over having a single user: the effort required from each user is reduced, user errors are corrected, and consensus is reached. We propose strategies that dynamically determine the order in which the candidate mappings are presented to the users for validation. These strategies are based on mapping quality measures that we define. Further, we use a propagation method to leverage the validation of one mapping to other mappings. We use an extension of the AgreementMaker ontology matching system and the Ontology Alignment Evaluation Initiative (OAEI) Benchmarks track to evaluate our approach. Our results show how Fmeasure and robustness vary as a function of the number of user validations. We consider different user error and revalidation rates (the latter measures the number of times that the same mapping is validated). Our results highlight complex trade-offs and point to the benefits of dynamically adjusting the revalidation rate.
paper
Economic and social effects; Knowledge engineering; Knowledge management; Management science; OntologY; Automatic method; Candidate mappings; Ontology alignment evaluation initiative (OAEI); Ontology matching; Pay-as-you-go; Propagation method; Quality measures; Single users
English
International Conference on Knowledge Engineering and Knowledge Management
2014
Schlobach, S; Janowicz, K; Hyvonen, E; Lambrix, P
Knowledge Engineering and Knowledge Management. 19th International Conference, EKAW 2014, Linköping, Sweden, November 24-28, 2014. Proceedings
978-3-319-13703-2
2014
8876
80
96
none
Cruz, I., Loprete, F., Palmonari, M., Stroe, C., Taheri, A. (2014). Pay-As-You-Go Multi-user Feedback Model for Ontology Matching. In Knowledge Engineering and Knowledge Management. 19th International Conference, EKAW 2014, Linköping, Sweden, November 24-28, 2014. Proceedings (pp.80-96). Springer [10.1007/978-3-319-13704-9_7].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/59022
Citazioni
  • Scopus 20
  • ???jsp.display-item.citation.isi??? 13
Social impact