Unbiased Evaluation of Deep Metric Learning Algorithms

by   Istvan Fehervari, et al.

Deep metric learning (DML) is a popular approach for images retrieval, solving verification (same or not) problems and addressing open set classification. Arguably, the most common DML approach is with triplet loss, despite significant advances in the area of DML. Triplet loss suffers from several issues such as collapse of the embeddings, high sensitivity to sampling schemes and more importantly a lack of performance when compared to more modern methods. We attribute this adoption to a lack of fair comparisons between various methods and the difficulty in adopting them for novel problem statements. In this paper, we perform an unbiased comparison of the most popular DML baseline methods under same conditions and more importantly, not obfuscating any hyper parameter tuning or adjustment needed to favor a particular method. We find, that under equal conditions several older methods perform significantly better than previously believed. In fact, our unified implementation of 12 recently introduced DML algorithms achieve state-of-the art performance on CUB200, CAR196, and Stanford Online products datasets which establishes a new set of baselines for future DML research. The codebase and all tuned hyperparameters will be open-sourced for reproducibility and to serve as a source of benchmark.


page 1

page 2

page 3

page 4


Hotel Recognition via Latent Image Embedding

We approach the problem of hotel recognition with deep metric learning. ...

Adaptive additive classification-based loss for deep metric learning

Recent works have shown that deep metric learning algorithms can benefit...

Multi-level Distance Regularization for Deep Metric Learning

We propose a novel distance-based regularization method for deep metric ...

In Defense of the Triplet Loss for Person Re-Identification

In the past few years, the field of computer vision has gone through a r...

Learning Embeddings for Product Visual Search with Triplet Loss and Online Sampling

In this paper, we propose learning an embedding function for content-bas...

A Theoretically Sound Upper Bound on the Triplet Loss for Improving the Efficiency of Deep Distance Metric Learning

We propose a method that substantially improves the efficiency of deep d...

WCE Polyp Detection with Triplet based Embeddings

Wireless capsule endoscopy is a medical procedure used to visualize the ...

Please sign up or login with your details

Forgot password? Click here to reset