Active metric learning and classification using similarity queries

by   Namrata Nadagouda, et al.

Active learning is commonly used to train label-efficient models by adaptively selecting the most informative queries. However, most active learning strategies are designed to either learn a representation of the data (e.g., embedding or metric learning) or perform well on a task (e.g., classification) on the data. However, many machine learning tasks involve a combination of both representation learning and a task-specific goal. Motivated by this, we propose a novel unified query framework that can be applied to any problem in which a key component is learning a representation of the data that reflects similarity. Our approach builds on similarity or nearest neighbor (NN) queries which seek to select samples that result in improved embeddings. The queries consist of a reference and a set of objects, with an oracle selecting the object most similar (i.e., nearest) to the reference. In order to reduce the number of solicited queries, they are chosen adaptively according to an information theoretic criterion. We demonstrate the effectiveness of the proposed strategy on two tasks – active metric learning and active classification – using a variety of synthetic and real world datasets. In particular, we demonstrate that actively selected NN queries outperform recently developed active triplet selection methods in a deep metric learning setting. Further, we show that in classification, actively selecting class labels can be reformulated as a process of selecting the most informative NN query, allowing direct application of our method.


page 1

page 2

page 3

page 4


Query-augmented Active Metric Learning

In this paper we propose an active metric learning method for clustering...

A Fast and Easy Regression Technique for k-NN Classification Without Using Negative Pairs

This paper proposes an inexpensive way to learn an effective dissimilari...

Active ordinal tuplewise querying for similarity learning

Many machine learning tasks such as clustering, classification, and data...

Active Perceptual Similarity Modeling with Auxiliary Information

Learning a model of perceptual similarity from a collection of objects i...

The Importance of Metric Learning for Robotic Vision: Open Set Recognition and Active Learning

State-of-the-art deep neural network recognition systems are designed fo...

Active Classification: Theory and Application to Underwater Inspection

We discuss the problem in which an autonomous vehicle must classify an o...

Learning a metric for class-conditional KNN

Naive Bayes Nearest Neighbour (NBNN) is a simple and effective framework...

Please sign up or login with your details

Forgot password? Click here to reset