Fisher Linear Discriminant Analysis for Text-Image Combination in Multimedia Information Retrieval - Université Jean-Monnet-Saint-Étienne Access content directly
Journal Articles Pattern Recognition Year : 2014

Fisher Linear Discriminant Analysis for Text-Image Combination in Multimedia Information Retrieval

Christine Largeron
Christophe Ducottet
Mathias Géry
  • Function : Author
  • PersonId : 843869
Cécile Barat
  • Function : Author
  • PersonId : 844844

Abstract

With multimedia information retrieval, combining different modalities - text, image, audio or video provides additional information and generally improves the overall system performance. For this purpose, the linear combination method is presented as simple, flexible and effective. However, it requires to choose the weight assigned to each modality. This issue is still an open problem and is addressed in this paper. Our approach, based on Fisher Linear Discriminant Analysis, aims to learn these weights for multimedia documents composed of text and images. Text and images are both represented with the classical bag-of-words model. Our method was tested over the ImageCLEF datasets 2008 and 2009. Results demonstrate that our combination approach not only outperforms the use of the single textual modality but provides a nearly optimal learning of the weights with an efficient computation. Moreover, it is pointed out that the method allows to combine more than two modalities without increasing the complexity and thus the computing time
Fichier principal
Vignette du fichier
Moulin2013Fisher.pdf (749.65 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

ujm-00866140 , version 1 (26-09-2013)

Identifiers

Cite

Christophe Moulin, Christine Largeron, Christophe Ducottet, Mathias Géry, Cécile Barat. Fisher Linear Discriminant Analysis for Text-Image Combination in Multimedia Information Retrieval. Pattern Recognition, 2014, 47 (1), pp.260-269. ⟨10.1016/j.patcog.2013.06.003⟩. ⟨ujm-00866140⟩
190 View
732 Download

Altmetric

Share

Gmail Facebook X LinkedIn More