Nowadays, together with the increasing spread of the content available online, users’ information needs have become more complex. To fulfill them, users strongly rely on Web search engines, but traditional ways of presenting search results are often unsatisfactory. In fact, Web pages carry information that exists in multiple media formats, such as text, audio, image and video objects. Vertical search engines and medium-specific search services do not provide users with an integrated view of search results. Furthermore, multiple media objects are in most of the cases highly semantically interlinked, but the connections between them are not sufficiently exploited to provide a further exploration of the retrieved objects. To address these issues, in this paper we propose a graph-based approach aimed at providing users with the possibility to dynamically visualize and explore a search result space built over a repository of multimedia documents containing interconnected multiple media objects. To do this, we represent the search result space via a graph-based data model, where both the retrieved multimedia documents and connected relevant media objects are considered. Media objects, among them, are connected via different kinds of similarity relationships, which depend on the low-level features and metadata taken into consideration to access the media objects. The approach and the connected visualization and exploration interface have been implemented and tested on a publicly available dataset, and they have been evaluated by means of a usability test.

Rashid, U., Viviani, M., Pasi, G. (2016). A graph-based approach for visualizing and exploring a multimedia search result space. INFORMATION SCIENCES, 370-371, 303-322 [10.1016/j.ins.2016.07.072].

A graph-based approach for visualizing and exploring a multimedia search result space

VIVIANI, MARCO
Secondo
;
PASI, GABRIELLA
2016

Abstract

Nowadays, together with the increasing spread of the content available online, users’ information needs have become more complex. To fulfill them, users strongly rely on Web search engines, but traditional ways of presenting search results are often unsatisfactory. In fact, Web pages carry information that exists in multiple media formats, such as text, audio, image and video objects. Vertical search engines and medium-specific search services do not provide users with an integrated view of search results. Furthermore, multiple media objects are in most of the cases highly semantically interlinked, but the connections between them are not sufficiently exploited to provide a further exploration of the retrieved objects. To address these issues, in this paper we propose a graph-based approach aimed at providing users with the possibility to dynamically visualize and explore a search result space built over a repository of multimedia documents containing interconnected multiple media objects. To do this, we represent the search result space via a graph-based data model, where both the retrieved multimedia documents and connected relevant media objects are considered. Media objects, among them, are connected via different kinds of similarity relationships, which depend on the low-level features and metadata taken into consideration to access the media objects. The approach and the connected visualization and exploration interface have been implemented and tested on a publicly available dataset, and they have been evaluated by means of a usability test.
Articolo in rivista - Articolo scientifico
Aggregated search; Multimedia Information Retrieval; Search engines; Search result exploration; Search result space; Search result visualization;
Aggregated search; Multimedia Information Retrieval; Search engines; Search result exploration; Search result space; Search result visualization; Control and Systems Engineering; Theoretical Computer Science; Software; Computer Science Applications1707 Computer Vision and Pattern Recognition; Information Systems and Management; Artificial Intelligence
English
2016
370-371
303
322
reserved
Rashid, U., Viviani, M., Pasi, G. (2016). A graph-based approach for visualizing and exploring a multimedia search result space. INFORMATION SCIENCES, 370-371, 303-322 [10.1016/j.ins.2016.07.072].
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S0020025516305576-main.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 4.7 MB
Formato Adobe PDF
4.7 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/140904
Citazioni
  • Scopus 21
  • ???jsp.display-item.citation.isi??? 16
Social impact