Diverse mini-batch Active Learning

01/17/2019
by   Fedor Zhdanov, et al.
0

We study the problem of reducing the amount of labeled training data required to train supervised classification models. We approach it by leveraging Active Learning, through sequential selection of examples which benefit the model most. Selecting examples one by one is not practical for the amount of training examples required by the modern Deep Learning models. We consider the mini-batch Active Learning setting, where several examples are selected at once. We present an approach which takes into account both informativeness of the examples for the model, as well as the diversity of the examples in a mini-batch. By using the well studied K-means clustering algorithm, this approach scales better than the previously proposed approaches, and achieves comparable or better performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/27/2019

Learning in Confusion: Batch Active Learning with Noisy Oracle

We study the problem of training machine learning models incrementally u...
research
11/30/2018

Are All Training Examples Created Equal? An Empirical Study

Modern computer vision algorithms often rely on very large training data...
research
04/28/2021

Diversity-Aware Batch Active Learning for Dependency Parsing

While the predictive performance of modern statistical dependency parser...
research
12/27/2021

BALanCe: Deep Bayesian Active Learning via Equivalence Class Annealing

Active learning has demonstrated data efficiency in many fields. Existin...
research
01/28/2023

Leveraging Importance Weights in Subset Selection

We present a subset selection algorithm designed to work with arbitrary ...
research
06/09/2019

Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds

We design a new algorithm for batch active learning with deep neural net...
research
06/27/2012

Batch Active Learning via Coordinated Matching

Most prior work on active learning of classifiers has focused on sequent...

Please sign up or login with your details

Forgot password? Click here to reset