This paper presents the Visual Word Sense Disambiguation (Visual-WSD) task. The objective of Visual-WSD is to identify among a set of ten images the one that corresponds to the intended meaning of a given ambiguous word which is accompanied with minimal context. The task provides datasets for three different languages: English, Italian, and Farsi. We received a total of 96 different submissions. Out of these, 40 systems outperformed a strong zero-shot CLIP-based baseline (Radford et al., 2021). Participating systems proposed different zero- and few-shot approaches, often involving generative models and data augmentation. More information can be found on the task’s website: https://raganato.github.io/vwsd/.

Raganato, A., Calixto, I., Ushio, A., Camacho-Collados, J., Pilehvar, M. (2023). SemEval-2023 Task 1: Visual Word Sense Disambiguation. In 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop (pp.2227-2234). Association for Computational Linguistics [10.18653/v1/2023.semeval-1.308].

SemEval-2023 Task 1: Visual Word Sense Disambiguation

Raganato A.
;
2023

Abstract

This paper presents the Visual Word Sense Disambiguation (Visual-WSD) task. The objective of Visual-WSD is to identify among a set of ten images the one that corresponds to the intended meaning of a given ambiguous word which is accompanied with minimal context. The task provides datasets for three different languages: English, Italian, and Farsi. We received a total of 96 different submissions. Out of these, 40 systems outperformed a strong zero-shot CLIP-based baseline (Radford et al., 2021). Participating systems proposed different zero- and few-shot approaches, often involving generative models and data augmentation. More information can be found on the task’s website: https://raganato.github.io/vwsd/.
paper
Word Sense Disambiguation, Visual and Text, Multimodal
English
17th International Workshop on Semantic Evaluation, SemEval 2023, co-located with the 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023 - 13 July 2023 through 14 July 2023
2023
17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop
9781959429999
2023
2227
2234
https://aclanthology.org/2023.semeval-1.308.pdf
open
Raganato, A., Calixto, I., Ushio, A., Camacho-Collados, J., Pilehvar, M. (2023). SemEval-2023 Task 1: Visual Word Sense Disambiguation. In 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop (pp.2227-2234). Association for Computational Linguistics [10.18653/v1/2023.semeval-1.308].
File in questo prodotto:
File Dimensione Formato  
Raganato-2023-SemEval-VoR.pdf

accesso aperto

Descrizione: Intervento a convegno
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 4.82 MB
Formato Adobe PDF
4.82 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/454559
Citazioni
  • Scopus 24
  • ???jsp.display-item.citation.isi??? ND
Social impact