The paper describes the SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification (MAMI),which explores the detection of misogynous memes on the web by taking advantage of available texts and images. The task has been organised in two related sub-tasks: the first one is focused on recognising whether a meme is misogynous or not (Sub-task A), while the second one is devoted to recognising types of misogyny (Sub-task B). MAMI has been one of the most popular tasks at SemEval-2022 with more than 400 participants, 65 teams involved in Sub-task A and 41 in Sub-task B from 13 countries. The MAMI challenge received 4214 submitted runs (of which 166 uploaded on the leader-board), denoting an enthusiastic participation for the proposed problem. The collection and annotation is described for the task dataset. The paper provides an overview of the systems proposed for the challenge, reports the results achieved in both sub-tasks and outlines a description of the main errors for a comprehension of the systems capabilities and for detailing future research perspectives.

Fersini, E., Gasparini, F., Rizzi, G., Saibene, A., Chulvi, B., Rosso, P., et al. (2022). SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification. In SemEval 2022 - 16th International Workshop on Semantic Evaluation, Proceedings of the Workshop (pp.533-549). Association for Computational Linguistics [10.18653/v1/2022.semeval-1.74].

SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification

Elisabetta Fersini
Primo
;
Francesca Gasparini
Secondo
;
Giulia Rizzi;Aurora Saibene;
2022

Abstract

The paper describes the SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification (MAMI),which explores the detection of misogynous memes on the web by taking advantage of available texts and images. The task has been organised in two related sub-tasks: the first one is focused on recognising whether a meme is misogynous or not (Sub-task A), while the second one is devoted to recognising types of misogyny (Sub-task B). MAMI has been one of the most popular tasks at SemEval-2022 with more than 400 participants, 65 teams involved in Sub-task A and 41 in Sub-task B from 13 countries. The MAMI challenge received 4214 submitted runs (of which 166 uploaded on the leader-board), denoting an enthusiastic participation for the proposed problem. The collection and annotation is described for the task dataset. The paper provides an overview of the systems proposed for the challenge, reports the results achieved in both sub-tasks and outlines a description of the main errors for a comprehension of the systems capabilities and for detailing future research perspectives.
slide + paper
misogyny detection; challenge
English
16th International Workshop on Semantic Evaluation, SemEval 2022 - 14 July 2022through 15 July 2022
2022
Emerson, G; Schluter, N; Stanovsky, G; Kumar, R; Palmer, A; Schneider, N; Singh, S; Ratan, S;
SemEval 2022 - 16th International Workshop on Semantic Evaluation, Proceedings of the Workshop
9781955917803
2022
533
549
https://aclanthology.org/2022.semeval-1.74
open
Fersini, E., Gasparini, F., Rizzi, G., Saibene, A., Chulvi, B., Rosso, P., et al. (2022). SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification. In SemEval 2022 - 16th International Workshop on Semantic Evaluation, Proceedings of the Workshop (pp.533-549). Association for Computational Linguistics [10.18653/v1/2022.semeval-1.74].
File in questo prodotto:
File Dimensione Formato  
10281-390528_VoR.pdf

accesso aperto

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 2.29 MB
Formato Adobe PDF
2.29 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/390528
Citazioni
  • Scopus 87
  • ???jsp.display-item.citation.isi??? ND
Social impact