Mining on Manifolds: Metric Learning without Labels

03/29/2018
by   Ahmet Iscen, et al.
0

In this work we present a novel unsupervised framework for hard training example mining. The only input to the method is a collection of images relevant to the target application and a meaningful initial representation, provided e.g. by pre-trained CNN. Positive examples are distant points on a single manifold, while negative examples are nearby points on different manifolds. Both types of examples are revealed by disagreements between Euclidean and manifold similarities. The discovered examples can be used in training with any discriminative loss. The method is applied to unsupervised fine-tuning of pre-trained networks for fine-grained classification and particular object retrieval. Our models are on par or are outperforming prior models that are fully or partially supervised.

READ FULL TEXT

page 5

page 6

research
04/08/2016

CNN Image Retrieval Learns from BoW: Unsupervised Fine-Tuning with Hard Examples

Convolutional Neural Networks (CNNs) achieve state-of-the-art performanc...
research
02/05/2019

Metric Learning on Manifolds

Recent literature has shown that symbolic data, such as text and graphs,...
research
11/12/2020

Bi-tuning of Pre-trained Representations

It is common within the deep learning community to first pre-train a dee...
research
07/29/2022

Fine-grained Retrieval Prompt Tuning

Fine-grained object retrieval aims to learn discriminative representatio...
research
06/23/2020

Disentangling by Subspace Diffusion

We present a novel nonparametric algorithm for symmetry-based disentangl...
research
04/23/2020

Doubly-stochastic mining for heterogeneous retrieval

Modern retrieval problems are characterised by training sets with potent...
research
09/08/2023

Manifold-based Verbalizer Space Re-embedding for Tuning-free Prompt-based Classification

Prompt-based classification adapts tasks to a cloze question format util...

Please sign up or login with your details

Forgot password? Click here to reset