In the field ofMultimodal Information Retrieval, one of the issue to tackle is how to effectively browse the search result space. In addressing this issue, it is particularly important to take into consideration that, especially nowadays, data is highly semantically interlinked. In this scenario, we present a tool to navigate and visualize the results produced by the evaluation of a query over a set ofmultiple media objects. The search result space can be represented via a graph-based data model where (i) multiple media objects are represented as nodes with multiple modalities of information associated with them, and (ii) media objects can be connected via different kinds of relationships. Our idea is to give to the user the possibility to navigate the space of the results of a query, constituted by multiple media objects, as s/he was exploring a graph of connected entities. As a preliminary work, in this paper we only deal with textual information for building similarity relationships among media objects and part-of relationships in the case of media objects belonging to a same (multimedia) document. This way, we show how a user can navigate and visualize the result space following different links connecting media objects. We illustrate our navigation and visualization tool with different examples.

Rashid, U., Viviani, M., Pasi, G., Bhatti, M. (2016). The browsing issue in multimodal information retrieval: A navigation tool over a multiple media search result space. In Advances in Intelligent Systems and Computing (pp.271-282). Springer Verlag [10.1007/978-3-319-26154-6_21].

The browsing issue in multimodal information retrieval: A navigation tool over a multiple media search result space

VIVIANI, MARCO
Secondo
;
PASI, GABRIELLA
Penultimo
;
2016

Abstract

In the field ofMultimodal Information Retrieval, one of the issue to tackle is how to effectively browse the search result space. In addressing this issue, it is particularly important to take into consideration that, especially nowadays, data is highly semantically interlinked. In this scenario, we present a tool to navigate and visualize the results produced by the evaluation of a query over a set ofmultiple media objects. The search result space can be represented via a graph-based data model where (i) multiple media objects are represented as nodes with multiple modalities of information associated with them, and (ii) media objects can be connected via different kinds of relationships. Our idea is to give to the user the possibility to navigate the space of the results of a query, constituted by multiple media objects, as s/he was exploring a graph of connected entities. As a preliminary work, in this paper we only deal with textual information for building similarity relationships among media objects and part-of relationships in the case of media objects belonging to a same (multimedia) document. This way, we show how a user can navigate and visualize the result space following different links connecting media objects. We illustrate our navigation and visualization tool with different examples.
slide + paper
Control and Systems Engineering; Computer Science (all)
English
International Conference on Flexible Query Answering Systems (FQAS) october 26-28
2015
Advances in Intelligent Systems and Computing
9783319261539
2016
400
271
282
http://www.springer.com/series/11156
none
Rashid, U., Viviani, M., Pasi, G., Bhatti, M. (2016). The browsing issue in multimodal information retrieval: A navigation tool over a multiple media search result space. In Advances in Intelligent Systems and Computing (pp.271-282). Springer Verlag [10.1007/978-3-319-26154-6_21].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/140912
Citazioni
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 6
Social impact