Several researchers suggest that the Recommendation Systems (RSs) that are the "best" according to statistical metrics might not be the most satisfactory for the user. We explored this issue through an empirical study that involved 210 users and considered 7 RSs using different recommender algorithms on the same dataset. We measured user's perceived quality of each RS, and compared these results against measures of statistical quality of the considered algorithms as they have been assessed by past studies in the field, highlighting some interesting results.

Cremonesi, P., Garzotto, F., Negro, S., Papadopoulos, A., Turrin, R. (2011). Comparative evaluation of recommender system quality. In CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems (pp.1927-1932). Association for Computing Machinery [10.1145/1979742.1979896].

Comparative evaluation of recommender system quality

Garzotto F.;
2011

Abstract

Several researchers suggest that the Recommendation Systems (RSs) that are the "best" according to statistical metrics might not be the most satisfactory for the user. We explored this issue through an empirical study that involved 210 users and considered 7 RSs using different recommender algorithms on the same dataset. We measured user's perceived quality of each RS, and compared these results against measures of statistical quality of the considered algorithms as they have been assessed by past studies in the field, highlighting some interesting results.
paper
Quality metrics; Recommender systems; User study;
English
Conference on Human Factors in Computing Systems - May 7 - 12, 2011
2011
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems
9781450302289
2011
1927
1932
reserved
Cremonesi, P., Garzotto, F., Negro, S., Papadopoulos, A., Turrin, R. (2011). Comparative evaluation of recommender system quality. In CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems (pp.1927-1932). Association for Computing Machinery [10.1145/1979742.1979896].
File in questo prodotto:
File Dimensione Formato  
Cremonesi et al-2011-CHI2011-VoR.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 234.6 kB
Formato Adobe PDF
234.6 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/561985
Citazioni
  • Scopus 48
  • ???jsp.display-item.citation.isi??? ND
Social impact