Sparse coding and normalization for deep Fisher score representation - Université Jean-Monnet-Saint-Étienne Accéder directement au contenu
Article Dans Une Revue Computer Vision and Image Understanding Année : 2022

Sparse coding and normalization for deep Fisher score representation

Sixiang Xu
  • Fonction : Auteur
  • PersonId : 1149811
  • IdRef : 263577163
Damien Muselet
Alain Trémeau
  • Fonction : Auteur
  • PersonId : 859601

Résumé

Fisher scores have been shown to be accurate global image features for classification. However, their performance is very dependent on the quality of the input features as well as the normalization steps applied to them. In this paper, we propose to embed the Fisher scores in an end-to-end trainable deep network by concentrating on two elements: adapting the encoding to the deep features and normalizing the extracted second-order statistics. Therefore, we make use of a deep sparse coding module that allows to sample the center of each Gaussian function from a learned subspace and thus to better fit the high dimensional data distribution. Second, we introduce a new normalization module that computes an approximate square root matrix normalization well adapted to the Fisher scores. These processing steps are embedded in a deep network so that all the modules work together for the sole purpose of improving classification performance. Experimental results show that this solution outperforms many alternatives in the context of material, indoor scene and fine-grained image classification.

Dates et versions

ujm-03726515 , version 1 (18-07-2022)

Identifiants

Citer

Sixiang Xu, Damien Muselet, Alain Trémeau. Sparse coding and normalization for deep Fisher score representation. Computer Vision and Image Understanding, 2022, 220, pp.103436. ⟨10.1016/j.cviu.2022.103436⟩. ⟨ujm-03726515⟩
11 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More