The medical field is constantly evolving, integrating the latest technologies to enhance patient care and treatment efficacy. While various methodologies are available to evaluate the quality of research studies, checklists are often favored for their efficiency and ease of use. In this study, we contribute to this area of research by 1) analyzing the components of the most widely used checklists, and 2) proposing a more comprehensive checklist, CLARITY AI, which synthesizes the strengths of existing tools. This study analyzed several established checklists—CLAIM, CONSORT, DECIDE, FUTURE, IJMEDI, PRISMA, SPIRIT, STARD, STARE-HI, and TRIPOD—with the goal of developing a comprehensive checklist for evaluating research studies. Each item in these checklists was carefully cataloged, labeled, and assessed. The analysis aimed to identify the most critical items for inclusion in a definitive checklist for research study evaluation. The final version of the checklist is a coherent integration of structural elements—such as Title, Abstract, and Introduction—and essential parameters like Study Identification and Data Handling. This synthesis results in a comprehensive tool for thorough study and research evaluation. By integrating the strengths of multiple established checklists, CLARITY offers a robust, systematic, and user-friendly framework for assessing research quality. This tool not only elevates research standards but also enhances transparency, reproducibility, and overall credibility in the field of medical AI studies. Its application has the potential to produce more reliable and effective healthcare solutions, ultimately improving patient outcomes and advancing medical research.

Marconi, L., Pirovano, E., Cabitza, F. (2024). CLARITY AI: A Comprehensive Checklist Integrating Established Frameworks for Enhanced Research Quality in Medical AI Studies. In Proceedings of the 3rd AIxIA Workshop on Artificial Intelligence For Healthcare (HC@AIxIA 2024) co-located with the 23rd International Conference of the Italian Association for Artificial Intelligence (AIxIA 2024) (pp.1-14). CEUR-WS.

CLARITY AI: A Comprehensive Checklist Integrating Established Frameworks for Enhanced Research Quality in Medical AI Studies

Marconi L.
Co-primo
;
Pirovano E.
Co-primo
;
Cabitza F.
2024

Abstract

The medical field is constantly evolving, integrating the latest technologies to enhance patient care and treatment efficacy. While various methodologies are available to evaluate the quality of research studies, checklists are often favored for their efficiency and ease of use. In this study, we contribute to this area of research by 1) analyzing the components of the most widely used checklists, and 2) proposing a more comprehensive checklist, CLARITY AI, which synthesizes the strengths of existing tools. This study analyzed several established checklists—CLAIM, CONSORT, DECIDE, FUTURE, IJMEDI, PRISMA, SPIRIT, STARD, STARE-HI, and TRIPOD—with the goal of developing a comprehensive checklist for evaluating research studies. Each item in these checklists was carefully cataloged, labeled, and assessed. The analysis aimed to identify the most critical items for inclusion in a definitive checklist for research study evaluation. The final version of the checklist is a coherent integration of structural elements—such as Title, Abstract, and Introduction—and essential parameters like Study Identification and Data Handling. This synthesis results in a comprehensive tool for thorough study and research evaluation. By integrating the strengths of multiple established checklists, CLARITY offers a robust, systematic, and user-friendly framework for assessing research quality. This tool not only elevates research standards but also enhances transparency, reproducibility, and overall credibility in the field of medical AI studies. Its application has the potential to produce more reliable and effective healthcare solutions, ultimately improving patient outcomes and advancing medical research.
paper
AI in Healthcare; CLARITY Framework; Medical AI Studies; Reproducibility; Research Evaluation;
English
3rd Workshop on Artificial Intelligence For Healthcare (HC@AIxIA 2024), 23rd International Conference of the Italian Association for Artificial Intelligence (AIxIA 2024) - 27-28 November 2024
2024
Calimeri, F; Dragoni, M; Stella, F
Proceedings of the 3rd AIxIA Workshop on Artificial Intelligence For Healthcare (HC@AIxIA 2024) co-located with the 23rd International Conference of the Italian Association for Artificial Intelligence (AIxIA 2024)
2024
3880
1
14
https://ceur-ws.org/Vol-3880
open
Marconi, L., Pirovano, E., Cabitza, F. (2024). CLARITY AI: A Comprehensive Checklist Integrating Established Frameworks for Enhanced Research Quality in Medical AI Studies. In Proceedings of the 3rd AIxIA Workshop on Artificial Intelligence For Healthcare (HC@AIxIA 2024) co-located with the 23rd International Conference of the Italian Association for Artificial Intelligence (AIxIA 2024) (pp.1-14). CEUR-WS.
File in questo prodotto:
File Dimensione Formato  
Marconi-2024-HC@AIxIA AIxIA-VoR.pdf

accesso aperto

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 1.1 MB
Formato Adobe PDF
1.1 MB Adobe PDF Visualizza/Apri
Marconi-2024-HC@AIxIA AIxIA-AAM.pdf

accesso aperto

Descrizione: AAM
Tipologia di allegato: Author’s Accepted Manuscript, AAM (Post-print)
Licenza: Creative Commons
Dimensione 758 kB
Formato Adobe PDF
758 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/544421
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
Social impact