In this paper we propose a deep learning model based on graph machine learning (i.e. Graph Attention Convolution) and a pretrained transformer language model (i.e. ELECTRA). Our model was developed to detect harmful tweets about COVID-19 and was used to tackle subtask 1C (harmful tweet detection) at the CheckThat!Lab shared task organized as part of CLEF 2022. In this binary classification task, our proposed model reaches a binary F1 score (positive class label, i.e. harmful tweet) of 0.28 on the test set. We demonstrate that our approach outperforms the official baseline by 8% and describe our model as well as the experimental setup and results in detail. We also refer to limitations of the approach and future research directions.

Lomonaco, F., Donabauer, G., Siino, M. (2022). COURAGE at CheckThat! 2022: Harmful Tweet Detection using Graph Neural Networks and ELECTRA. In 2022 Conference and Labs of the Evaluation Forum, CLEF 2022 (pp.573-583).

COURAGE at CheckThat! 2022: Harmful Tweet Detection using Graph Neural Networks and ELECTRA

Francesco Lomonaco
Primo
;
2022

Abstract

In this paper we propose a deep learning model based on graph machine learning (i.e. Graph Attention Convolution) and a pretrained transformer language model (i.e. ELECTRA). Our model was developed to detect harmful tweets about COVID-19 and was used to tackle subtask 1C (harmful tweet detection) at the CheckThat!Lab shared task organized as part of CLEF 2022. In this binary classification task, our proposed model reaches a binary F1 score (positive class label, i.e. harmful tweet) of 0.28 on the test set. We demonstrate that our approach outperforms the official baseline by 8% and describe our model as well as the experimental setup and results in detail. We also refer to limitations of the approach and future research directions.
paper
COVID-19; ELECTRA; harmful tweets; text graph classification; Twitter;
English
2022 Conference and Labs of the Evaluation Forum, CLEF 2022 - 5 September 2022 through 8 September 2022
2022
Lomonaco, F ; Donabauer, G: Siino, M
Faggioli, G; Ferro, N; Hanbury, A; Potthast, M
2022 Conference and Labs of the Evaluation Forum, CLEF 2022
978-3-031-13642-9
2022
3180
573
583
open
Lomonaco, F., Donabauer, G., Siino, M. (2022). COURAGE at CheckThat! 2022: Harmful Tweet Detection using Graph Neural Networks and ELECTRA. In 2022 Conference and Labs of the Evaluation Forum, CLEF 2022 (pp.573-583).
File in questo prodotto:
File Dimensione Formato  
Lomonaco-2022-CLEF-VoR.pdf

accesso aperto

Descrizione: Intervento a convegno
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 1.07 MB
Formato Adobe PDF
1.07 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/391314
Citazioni
  • Scopus 11
  • ???jsp.display-item.citation.isi??? ND
Social impact