In this paper, a new model for aggregating multiple criteria evaluations for relevance assessment is proposed. An information retrieval context is considered, where relevance is modelled as a multidimensional property of documents. In the paper, the proposed aggregation operator is applied to define amodel for personalized Information Retrieval (IR), in which four criteria are considered in order to assess document relevance:aboutness, coverage, appropriateness and reliability.The originality of this approach lies in the aggregation of the considered criteria in a prioritized way, by considering the existence of a prioritization relationship over the criteria. Such a prioritization is modeled by making the weights associated with a criterion dependent upon the satisfaction of the higher-priority criteria. This way, it is possible to take into account the fact that the weight of a less important criterion should be proportional to the satisfaction degree of the more important criterion.In the paper, some preliminary experimental results are also reported.
da Costa Pereira, C., Dragoni, M., Pasi, G. (2009). Multidimensional Relevance: A New Aggregation Criterion. In Advances in Information Retrieval 31th European Conference on IR Research, ECIR 2009, Toulouse, France, April 6-9, 2009. Proceedings (pp.264-275). Springer Berlin / Heidelberg [10.1007/978-3-642-00958-7_25].
Multidimensional Relevance: A New Aggregation Criterion
PASI, GABRIELLA
2009
Abstract
In this paper, a new model for aggregating multiple criteria evaluations for relevance assessment is proposed. An information retrieval context is considered, where relevance is modelled as a multidimensional property of documents. In the paper, the proposed aggregation operator is applied to define amodel for personalized Information Retrieval (IR), in which four criteria are considered in order to assess document relevance:aboutness, coverage, appropriateness and reliability.The originality of this approach lies in the aggregation of the considered criteria in a prioritized way, by considering the existence of a prioritization relationship over the criteria. Such a prioritization is modeled by making the weights associated with a criterion dependent upon the satisfaction of the higher-priority criteria. This way, it is possible to take into account the fact that the weight of a less important criterion should be proportional to the satisfaction degree of the more important criterion.In the paper, some preliminary experimental results are also reported.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.