Artificial intelligence (AI) is increasingly integrated into clinical practice through Clinical Decision Support Systems (CDSSs). While such systems can approach or even surpass human expert performance, their true value lies in how they enhance human–AI teams. This study investigates whether structured interaction protocols can improve diagnostic accuracy in a simulated radiology double-reading task. Sixteen radiologists collaborated with an AI system under eight different coordination strategies. Results demonstrate that protocols such as Accuracy-Oriented, Confidence-Oriented, and Presumptuous produced the highest overall accuracy (up to 97% among strong clinicians and 92% among weak ones), outperforming majority voting and single-metric-optimized approaches. Critically, weaker clinicians with superior protocols outperformed stronger clinicians with inferior ones, validating Kasparov’s Law: Weak Human + Machine + Better Process > Strong Human + Machine + Inferior Process. These findings highlight process design as central to effective CDSS deployment, advocating for a paradigm shift toward process-centric evaluation and design.
Papale, A., Lopiano, G., Campagner, A., Cabitza, F. (2025). Validating Kasparov’s Law Through Human–AI Collaboration in Clinical Diagnosis. In Proceedings of the 1st Workshop on Human-AI Collaborative Systems co-located with 28th European Conference on Artificial Intelligence (ECAI 2025) (pp.108-112). CEUR-WS.
Validating Kasparov’s Law Through Human–AI Collaboration in Clinical Diagnosis
Papale, A
Co-primo
;Lopiano, GCo-primo
;Campagner, ASecondo
;Cabitza, FUltimo
2025
Abstract
Artificial intelligence (AI) is increasingly integrated into clinical practice through Clinical Decision Support Systems (CDSSs). While such systems can approach or even surpass human expert performance, their true value lies in how they enhance human–AI teams. This study investigates whether structured interaction protocols can improve diagnostic accuracy in a simulated radiology double-reading task. Sixteen radiologists collaborated with an AI system under eight different coordination strategies. Results demonstrate that protocols such as Accuracy-Oriented, Confidence-Oriented, and Presumptuous produced the highest overall accuracy (up to 97% among strong clinicians and 92% among weak ones), outperforming majority voting and single-metric-optimized approaches. Critically, weaker clinicians with superior protocols outperformed stronger clinicians with inferior ones, validating Kasparov’s Law: Weak Human + Machine + Better Process > Strong Human + Machine + Inferior Process. These findings highlight process design as central to effective CDSS deployment, advocating for a paradigm shift toward process-centric evaluation and design.| File | Dimensione | Formato | |
|---|---|---|---|
|
Papale et al-2025-HAIC-CEUR.pdf
accesso aperto
Tipologia di allegato:
Publisher’s Version (Version of Record, VoR)
Licenza:
Creative Commons
Dimensione
773.95 kB
Formato
Adobe PDF
|
773.95 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


