The annotation of image and video data of large datasets is a fundamental task in multimedia information retrieval and computer vision applications. The aim of annotation tools is to relieve the user from the burden of the manual annotation as much as possible. To achieve this ideal goal, many different functionalities are required in order to make the annotations process as automatic as possible. Motivated by the limitations of existing tools, we have developed the iVAT: an interactive Video Annotation Tool. It supports manual, semi-automatic and automatic annotations through the interaction of the user with various detection algorithms. To the best of our knowledge, it is the first tool that integrates several computer vision algorithms working in an interactive and incremental learning framework. This makes the tool flexible and suitable to be used in different application domains. A quantitative and qualitative evaluation of the proposed tool on a challenging case study domain is presented and discussed. Results demonstrate that the use of the semi-automatic, as well as the automatic, modality drastically reduces the human effort while preserving the quality of the annotations.

Bianco, S., Ciocca, G., Napoletano, P., Schettini, R. (2015). An interactive tool for manual, semi-automatic and automatic video annotation. COMPUTER VISION AND IMAGE UNDERSTANDING, 131, 88-99 [10.1016/j.cviu.2014.06.015].

An interactive tool for manual, semi-automatic and automatic video annotation

BIANCO, SIMONE;CIOCCA, GIANLUIGI;NAPOLETANO, PAOLO
;
SCHETTINI, RAIMONDO
2015

Abstract

The annotation of image and video data of large datasets is a fundamental task in multimedia information retrieval and computer vision applications. The aim of annotation tools is to relieve the user from the burden of the manual annotation as much as possible. To achieve this ideal goal, many different functionalities are required in order to make the annotations process as automatic as possible. Motivated by the limitations of existing tools, we have developed the iVAT: an interactive Video Annotation Tool. It supports manual, semi-automatic and automatic annotations through the interaction of the user with various detection algorithms. To the best of our knowledge, it is the first tool that integrates several computer vision algorithms working in an interactive and incremental learning framework. This makes the tool flexible and suitable to be used in different application domains. A quantitative and qualitative evaluation of the proposed tool on a challenging case study domain is presented and discussed. Results demonstrate that the use of the semi-automatic, as well as the automatic, modality drastically reduces the human effort while preserving the quality of the annotations.
Articolo in rivista - Articolo scientifico
Automatic annotation; Incremental learning; Interactive video annotation; Object detection; Semi-automatic annotation;
interactive video annotation, automatic annotation, semi-automatic annotation, incremental learning, object detection
English
88
99
12
Bianco, S., Ciocca, G., Napoletano, P., Schettini, R. (2015). An interactive tool for manual, semi-automatic and automatic video annotation. COMPUTER VISION AND IMAGE UNDERSTANDING, 131, 88-99 [10.1016/j.cviu.2014.06.015].
Bianco, S; Ciocca, G; Napoletano, P; Schettini, R
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S1077314214001544-main.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 3.84 MB
Formato Adobe PDF
3.84 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/56616
Citazioni
  • Scopus 60
  • ???jsp.display-item.citation.isi??? 44
Social impact