Ensemble learning provides a theoretically well-founded approach to address the bias-variance trade-off by combining many learners to obtain an aggregated model with reduced bias or variance. This same idea of extracting knowledge from the predictions or choices of individuals has been also studied under different perspectives in the domains of social choice theory and collective intelligence. Despite this similarity, there has been little research comparing and relating the aggregation strategies proposed in these different domains. In this article, we aim to bridge the gap between these disciplines by means of an experimental evaluation, done on a set of standard datasets, of different aggregation criteria in the context of the training of ensembles of decision trees. We show that a social-science method known as surprisingly popular decision and the three-way reduction, achieve the best performance, while both bagging and boosting outperform social choice-based Borda and Copeland methods.

Campagner, A., Ciucci, D., Cabitza, F. (2020). Ensemble learning, social choice and collective intelligence: An experimental comparison of aggregation techniques. In Modeling Decisions for Artificial Intelligence (pp.53-65). Springer [10.1007/978-3-030-57524-3_5].

Ensemble learning, social choice and collective intelligence: An experimental comparison of aggregation techniques

Andrea Campagner
;
Davide Ciucci;Federico Cabitza
2020

Abstract

Ensemble learning provides a theoretically well-founded approach to address the bias-variance trade-off by combining many learners to obtain an aggregated model with reduced bias or variance. This same idea of extracting knowledge from the predictions or choices of individuals has been also studied under different perspectives in the domains of social choice theory and collective intelligence. Despite this similarity, there has been little research comparing and relating the aggregation strategies proposed in these different domains. In this article, we aim to bridge the gap between these disciplines by means of an experimental evaluation, done on a set of standard datasets, of different aggregation criteria in the context of the training of ensembles of decision trees. We show that a social-science method known as surprisingly popular decision and the three-way reduction, achieve the best performance, while both bagging and boosting outperform social choice-based Borda and Copeland methods.
paper
Aggregation criteria; Collective intelligence; Ensemble learning; Social choice theory
English
17th International Conference on Modeling Decisions for Artificial Intelligence, MDAI 2020 - 2 September 2020 through 4 September 2020
2020
Torra, V; Narukawa, Y; Nin, J; Agell, N
Modeling Decisions for Artificial Intelligence
9783030575236
2020
12256 LNAI
53
65
none
Campagner, A., Ciucci, D., Cabitza, F. (2020). Ensemble learning, social choice and collective intelligence: An experimental comparison of aggregation techniques. In Modeling Decisions for Artificial Intelligence (pp.53-65). Springer [10.1007/978-3-030-57524-3_5].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/327392
Citazioni
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
Social impact