Mask-guided Image Classification with Siamese Networks - Université Jean-Monnet-Saint-Étienne Access content directly
Conference Papers Year : 2020

Mask-guided Image Classification with Siamese Networks

Hiba Alqasir
Damien Muselet
Christophe Ducottet


This paper deals with a CNN-based image classification task where the class of each image depends on a small detail in the image. Our original idea consists in providing a binary mask to the network so that it knows where is located the important information. This mask as well as the color image are provided as inputs to a siamese network. A contrastive loss function controls the projection of the network outputs in an embedding space enforcing the extraction of image features at the location proposed by the mask. This solution is tested on a real application whose aim is to secure the boarding on ski chairlifts by checking if the safety bar of the carrier is open or closed. Each chairlift has its own safety bar masks (open and close) and we propose to exploit this additional data to help the image classification between close or open safety bar. We show that the use of a siamese network allows to learn a single model that performs very well on 20 different skilifts.
Fichier principal
Vignette du fichier
main.pdf (738.96 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

ujm-02899908 , version 1 (15-07-2020)


  • HAL Id : ujm-02899908 , version 1


Hiba Alqasir, Damien Muselet, Christophe Ducottet. Mask-guided Image Classification with Siamese Networks. International Conference on Computer Vision Theory and Applications, Feb 2020, Valetta, Malta. ⟨ujm-02899908⟩
91 View
573 Download


Gmail Facebook X LinkedIn More