Mask-guided Image Classification with Siamese Networks - Université Jean-Monnet-Saint-Étienne Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Mask-guided Image Classification with Siamese Networks

Hiba Alqasir
Damien Muselet
Christophe Ducottet

Résumé

This paper deals with a CNN-based image classification task where the class of each image depends on a small detail in the image. Our original idea consists in providing a binary mask to the network so that it knows where is located the important information. This mask as well as the color image are provided as inputs to a siamese network. A contrastive loss function controls the projection of the network outputs in an embedding space enforcing the extraction of image features at the location proposed by the mask. This solution is tested on a real application whose aim is to secure the boarding on ski chairlifts by checking if the safety bar of the carrier is open or closed. Each chairlift has its own safety bar masks (open and close) and we propose to exploit this additional data to help the image classification between close or open safety bar. We show that the use of a siamese network allows to learn a single model that performs very well on 20 different skilifts.
Fichier principal
Vignette du fichier
main.pdf (738.96 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

ujm-02899908 , version 1 (15-07-2020)

Identifiants

  • HAL Id : ujm-02899908 , version 1

Citer

Hiba Alqasir, Damien Muselet, Christophe Ducottet. Mask-guided Image Classification with Siamese Networks. International Conference on Computer Vision Theory and Applications, Feb 2020, Valetta, Malta. ⟨ujm-02899908⟩
103 Consultations
600 Téléchargements

Partager

Gmail Facebook X LinkedIn More