Smart Mining for Deep Metric Learning

Ben Harwood, B. G. Vijay Kumar, Gustavo Carneiro, Ian Reid, Tom Drummond

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

72 Citations (Scopus)

Abstract

To solve deep metric learning problems and producing feature embeddings, current methodologies will commonly use a triplet model to minimise the relative distance between samples from the same class and maximise the relative distance between samples from different classes. Though successful, the training convergence of this triplet model can be compromised by the fact that the vast majority of the training samples will produce gradients with magnitudes that are close to zero. This issue has motivated the development of methods that explore the global structure of the embedding and other methods that explore hard negative/positive mining. The effectiveness of such mining methods is often associated with intractable computational requirements. In this paper, we propose a novel deep metric learning method that combines the triplet model and the global structure of the embedding space. We rely on a smart mining procedure that produces effective training samples for a low computational cost. In addition, we propose an adaptive controller that automatically adjusts the smart mining hyper-parameters and speeds up the convergence of the training process. We show empirically that our proposed method allows for fast and more accurate training of triplet ConvNets than other competing mining methods. Additionally, we show that our method achieves new state-of-the-art embedding results for CUB-200-2011 and Cars196 datasets.

Original languageEnglish
Title of host publicationProceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017
EditorsRita Cucchiara, Yasuyuki Matsushita, Nicu Sebe, Stefano Soatto
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages2840-2848
Number of pages9
ISBN (Electronic)9781538610329
ISBN (Print)9781538610336
DOIs
Publication statusPublished - 22 Dec 2017
EventIEEE International Conference on Computer Vision 2017 - Venice, Italy
Duration: 22 Oct 201729 Oct 2017
Conference number: 16th
http://iccv2017.thecvf.com/
https://ieeexplore.ieee.org/xpl/conhome/8234942/proceeding (Proceedings)

Conference

ConferenceIEEE International Conference on Computer Vision 2017
Abbreviated titleICCV 2017
CountryItaly
CityVenice
Period22/10/1729/10/17
Internet address

Cite this