In this article, we propose a conceptual and methodological framework for measuring the impact of the introduction of AI systems in decision settings, based on the concept of technological dominance, i.e. the influence that an AI system can exert on human judgment and decisions. We distinguish between a negative component of dominance (automation bias) and a positive one (algorithm appreciation) by focusing on and systematizing the patterns of interaction between human judgment and AI support, or reliance patterns, and their associated cognitive effects. We then define statistical approaches for measuring these dimensions of dominance, as well as corresponding qualitative visualizations. By reporting about four medical case studies, we illustrate how the proposed methods can be used to inform assessments of dominance and of related cognitive biases in real-world settings. Our study lays the groundwork for future investigations into the effects of introducing AI support into naturalistic and collaborative decision-making.

Cabitza, F., Campagner, A., Angius, R., Natali, C., Reverberi, F. (2023). AI Shall Have No Dominion: on How to Measure Technology Dominance in AI-supported Human decision-making. In CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp.1-20). Association for Computing Machinery, New York, NY, United States [10.1145/3544548.3581095].

AI Shall Have No Dominion: on How to Measure Technology Dominance in AI-supported Human decision-making

Cabitza, Federico
Co-primo
;
Campagner, Andrea
Co-primo
;
Angius, Riccardo;Natali, Chiara;Reverberi, Franco
Ultimo
2023

Abstract

In this article, we propose a conceptual and methodological framework for measuring the impact of the introduction of AI systems in decision settings, based on the concept of technological dominance, i.e. the influence that an AI system can exert on human judgment and decisions. We distinguish between a negative component of dominance (automation bias) and a positive one (algorithm appreciation) by focusing on and systematizing the patterns of interaction between human judgment and AI support, or reliance patterns, and their associated cognitive effects. We then define statistical approaches for measuring these dimensions of dominance, as well as corresponding qualitative visualizations. By reporting about four medical case studies, we illustrate how the proposed methods can be used to inform assessments of dominance and of related cognitive biases in real-world settings. Our study lays the groundwork for future investigations into the effects of introducing AI support into naturalistic and collaborative decision-making.
paper
Human AI interaction; technological dominance; Human AI collaboration
English
2023 ACM CHI Conference on Human Factors in Computing Systems (CHI 2023)
2023
Schmidt, A; Väänänen, K
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
9781450394215
2023
1
20
354
reserved
Cabitza, F., Campagner, A., Angius, R., Natali, C., Reverberi, F. (2023). AI Shall Have No Dominion: on How to Measure Technology Dominance in AI-supported Human decision-making. In CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp.1-20). Association for Computing Machinery, New York, NY, United States [10.1145/3544548.3581095].
File in questo prodotto:
File Dimensione Formato  
Cabitza-2023-CHI '23-VoR.pdf

Solo gestori archivio

Descrizione: Contributo in libro
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Tutti i diritti riservati
Dimensione 4.91 MB
Formato Adobe PDF
4.91 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/416357
Citazioni
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 5
Social impact