Frugal Reinforcement-based Active Learning

by   Sebastien Deschamps, et al.

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on large collections of labeled data. Among the existing solutions, deep active learning is currently witnessing a major interest and its purpose is to train deep networks using as few labeled samples as possible. However, the success of active learning is highly dependent on how critical are these samples when training models. In this paper, we devise a novel active learning approach for label-efficient training. The proposed method is iterative and aims at minimizing a constrained objective function that mixes diversity, representativity and uncertainty criteria. The proposed approach is probabilistic and unifies all these criteria in a single objective function whose solution models the probability of relevance of samples (i.e., how critical) when learning a decision function. We also introduce a novel weighting mechanism based on reinforcement learning, which adaptively balances these criteria at each training iteration, using a particular stateless Q-learning model. Extensive experiments conducted on staple image classification data, including Object-DOTA, show the effectiveness of our proposed model w.r.t. several baselines including random, uncertainty and flat as well as other work.


page 1

page 2

page 3

page 4


Reinforcement-based frugal learning for satellite image change detection

In this paper, we introduce a novel interactive satellite image change d...

Toward Optimal Probabilistic Active Learning Using a Bayesian Approach

Gathering labeled data to train well-performing machine learning models ...

Reinforcement Learning Approach to Active Learning for Image Classification

Machine Learning requires large amounts of labeled data to fit a model. ...

Diffusion-based Deep Active Learning

The remarkable performance of deep neural networks depends on the availa...

Active learning for interactive satellite image change detection

We introduce in this paper a novel active learning algorithm for satelli...

Active Learning Using Uncertainty Information

Many active learning methods belong to the retraining-based approaches, ...

Graph-based Reinforcement Learning for Active Learning in Real Time: An Application in Modeling River Networks

Effective training of advanced ML models requires large amounts of label...

Please sign up or login with your details

Forgot password? Click here to reset