Color-based and rotation invariant self-similarities

Abstract : One big challenge in computer vision is to extract robust and discriminative local descriptors. For many applications such as object tracking, image classification or image matching, there exist appearance-based descriptors such as SIFT or learned CNN-features that provide very good results. But for some other applications such as multimodal image comparison (infra-red versus color, color versus depth, ...) these descriptors failed and people resort to using the spatial distribution of self-similarities. The idea is to inform about the similarities between local regions in an image rather than the appearances of these regions at the pixel level. Nevertheless, the classical self-similarities are not invariant to rotation in the image space, so that two rotated versions of a local patch are not considered as similar and we think that many discriminative information is lost because of this weakness. In this paper, we present a method to extract rotation-invariant self similarities. In this aim, we propose to compare color descriptors of the local regions rather than the local regions themselves. Furthermore, since this comparison informs us about the relative orientations of the two local regions, we incorporate this information in the final image descriptor in order to increase the discriminative power of the system. We show that the self similarities extracted by this way are very discriminative.
Document type :
Conference papers
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download

https://hal-ujm.archives-ouvertes.fr/ujm-01486570
Contributor : Damien Muselet <>
Submitted on : Friday, March 10, 2017 - 9:37:05 AM
Last modification on : Tuesday, February 12, 2019 - 9:28:07 AM
Long-term archiving on : Sunday, June 11, 2017 - 1:35:09 PM

File

Visapp_Song.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : ujm-01486570, version 1

Citation

Xiaohu Song, Damien Muselet, Alain Tremeau. Color-based and rotation invariant self-similarities. International Conference on Computer Vision Theory and Applications (Visapp 2017), Feb 2017, Porto, Portugal. ⟨ujm-01486570⟩

Share

Metrics

Record views

152

Files downloads

292