Guided Deep Metric Learning

06/04/2022
by   Jorge Gonzalez-Zapata, et al.
40

Deep Metric Learning (DML) methods have been proven relevant for visual similarity learning. However, they sometimes lack generalization properties because they are trained often using an inappropriate sample selection strategy or due to the difficulty of the dataset caused by a distributional shift in the data. These represent a significant drawback when attempting to learn the underlying data manifold. Therefore, there is a pressing need to develop better ways of obtaining generalization and representation of the underlying manifold. In this paper, we propose a novel approach to DML that we call Guided Deep Metric Learning, a novel architecture oriented to learning more compact clusters, improving generalization under distributional shifts in DML. This novel architecture consists of two independent models: A multi-branch master model, inspired from a Few-Shot Learning (FSL) perspective, generates a reduced hypothesis space based on prior knowledge from labeled data, which guides or regularizes the decision boundary of a student model during training under an offline knowledge distillation scheme. Experiments have shown that the proposed method is capable of a better manifold generalization and representation to up to 40 et al. to perform a more fair and realistic comparison, which is currently absent in the literature

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/17/2020

Triplet Loss for Knowledge Distillation

In recent years, deep learning has spread rapidly, and deeper, larger mo...
research
07/20/2021

Characterizing Generalization under Out-Of-Distribution Shifts in Deep Metric Learning

Deep Metric Learning (DML) aims to find representations suitable for zer...
research
04/07/2022

Interval Bound Propagationx2013aided Fewx002dshot Learning

Few-shot learning aims to transfer the knowledge acquired from training ...
research
12/27/2016

End-to-End Data Visualization by Metric Learning and Coordinate Transformation

This paper presents a deep nonlinear metric learning framework for data ...
research
06/17/2020

Self-supervised Knowledge Distillation for Few-shot Learning

Real-world contains an overwhelmingly large number of object classes, le...
research
03/25/2022

Compare learning: bi-attention network for few-shot learning

Learning with few labeled data is a key challenge for visual recognition...
research
06/26/2018

EmbNum: Semantic labeling for numerical values with deep metric learning

Semantic labeling is a task of matching unknown data source to labeled d...

Please sign up or login with your details

Forgot password? Click here to reset