Artificial intelligence (AI) is increasingly integrated into clinical practice through Clinical Decision Support Systems (CDSSs). While such systems can approach or even surpass human expert performance, their true value lies in how they enhance human–AI teams. This study investigates whether structured interaction protocols can improve diagnostic accuracy in a simulated radiology double-reading task. Sixteen radiologists collaborated with an AI system under eight different coordination strategies. Results demonstrate that protocols such as Accuracy-Oriented, Confidence-Oriented, and Presumptuous produced the highest overall accuracy (up to 97% among strong clinicians and 92% among weak ones), outperforming majority voting and single-metric-optimized approaches. Critically, weaker clinicians with superior protocols outperformed stronger clinicians with inferior ones, validating Kasparov’s Law: Weak Human + Machine + Better Process > Strong Human + Machine + Inferior Process. These findings highlight process design as central to effective CDSS deployment, advocating for a paradigm shift toward process-centric evaluation and design.

Papale, A., Lopiano, G., Campagner, A., Cabitza, F. (2025). Validating Kasparov’s Law Through Human–AI Collaboration in Clinical Diagnosis. In Proceedings of the 1st Workshop on Human-AI Collaborative Systems co-located with 28th European Conference on Artificial Intelligence (ECAI 2025) (pp.108-112). CEUR-WS.

Validating Kasparov’s Law Through Human–AI Collaboration in Clinical Diagnosis

Papale, A
Co-primo
;
Lopiano, G
Co-primo
;
Campagner, A
Secondo
;
Cabitza, F
Ultimo
2025

Abstract

Artificial intelligence (AI) is increasingly integrated into clinical practice through Clinical Decision Support Systems (CDSSs). While such systems can approach or even surpass human expert performance, their true value lies in how they enhance human–AI teams. This study investigates whether structured interaction protocols can improve diagnostic accuracy in a simulated radiology double-reading task. Sixteen radiologists collaborated with an AI system under eight different coordination strategies. Results demonstrate that protocols such as Accuracy-Oriented, Confidence-Oriented, and Presumptuous produced the highest overall accuracy (up to 97% among strong clinicians and 92% among weak ones), outperforming majority voting and single-metric-optimized approaches. Critically, weaker clinicians with superior protocols outperformed stronger clinicians with inferior ones, validating Kasparov’s Law: Weak Human + Machine + Better Process > Strong Human + Machine + Inferior Process. These findings highlight process design as central to effective CDSS deployment, advocating for a paradigm shift toward process-centric evaluation and design.
paper
Clinical Decision Support Systems; Coordination; Double Reading; Human–AI Collaboration; Hybrid Intelligence; Interaction Protocols; Kasparov’s Law;
English
1st Workshop on Human-AI Collaborative Systems, HAIC 2025 - 25 October 2025 - 25 October 2025
2025
Braccini, M; De Filippo, A; Milano, M; Saffiotti, A; Vallati, M
Proceedings of the 1st Workshop on Human-AI Collaborative Systems co-located with 28th European Conference on Artificial Intelligence (ECAI 2025)
2025
4072
108
112
https://ceur-ws.org/Vol-4072/
open
Papale, A., Lopiano, G., Campagner, A., Cabitza, F. (2025). Validating Kasparov’s Law Through Human–AI Collaboration in Clinical Diagnosis. In Proceedings of the 1st Workshop on Human-AI Collaborative Systems co-located with 28th European Conference on Artificial Intelligence (ECAI 2025) (pp.108-112). CEUR-WS.
File in questo prodotto:
File Dimensione Formato  
Papale et al-2025-HAIC-CEUR.pdf

accesso aperto

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 773.95 kB
Formato Adobe PDF
773.95 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/589381
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
Social impact