Skip to Main content Skip to Navigation
Conference papers

Mask-guided Image Classification with Siamese Networks

Abstract : This paper deals with a CNN-based image classification task where the class of each image depends on a small detail in the image. Our original idea consists in providing a binary mask to the network so that it knows where is located the important information. This mask as well as the color image are provided as inputs to a siamese network. A contrastive loss function controls the projection of the network outputs in an embedding space enforcing the extraction of image features at the location proposed by the mask. This solution is tested on a real application whose aim is to secure the boarding on ski chairlifts by checking if the safety bar of the carrier is open or closed. Each chairlift has its own safety bar masks (open and close) and we propose to exploit this additional data to help the image classification between close or open safety bar. We show that the use of a siamese network allows to learn a single model that performs very well on 20 different skilifts.
Document type :
Conference papers
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download

https://hal-ujm.archives-ouvertes.fr/ujm-02899908
Contributor : Damien Muselet <>
Submitted on : Wednesday, July 15, 2020 - 4:24:38 PM
Last modification on : Monday, August 3, 2020 - 8:52:26 AM

File

main.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : ujm-02899908, version 1

Citation

Hiba Alqasir, Damien Muselet, Christophe Ducottet. Mask-guided Image Classification with Siamese Networks. International Conference on Computer Vision Theory and Applications, Feb 2020, Valetta, Malta. ⟨ujm-02899908⟩

Share

Metrics

Record views

36

Files downloads

64