Minimizing Supervision in Multi-label Categorization

by   Rajat, et al.

Multiple categories of objects are present in most images. Treating this as a multi-class classification is not justified. We treat this as a multi-label classification problem. In this paper, we further aim to minimize the supervision required for providing supervision in multi-label classification. Specifically, we investigate an effective class of approaches that associate a weak localization with each category either in terms of the bounding box or segmentation mask. Doing so improves the accuracy of multi-label categorization. The approach we adopt is one of active learning, i.e., incrementally selecting a set of samples that need supervision based on the current model, obtaining supervision for these samples, retraining the model with the additional set of supervised samples and proceeding again to select the next set of samples. A crucial concern is the choice of the set of samples. In doing so, we provide a novel insight, and no specific measure succeeds in obtaining a consistently improved selection criterion. We, therefore, provide a selection criterion that consistently improves the overall baseline criterion by choosing the top k set of samples for a varied set of criteria. Using this criterion, we are able to show that we can retain more than 98 supervised performance with just 20 of the dataset on PASCAL VOC 2007 and 2012. Also, our proposed approach consistently outperforms all other baseline metrics for all benchmark datasets and model combinations.


page 5

page 6

page 7


Deep Active Learning for Multi-Label Classification of Remote Sensing Images

The use of deep neural networks (DNNs) has recently attracted great atte...

Bayes metaclassifier and Soft-confusion-matrix classifier in the task of multi-label classification

The aim of this paper was to compare soft confusion matrix approach and ...

Discovering Multi-Label Actor-Action Association in a Weakly Supervised Setting

Since collecting and annotating data for spatio-temporal action detectio...

Parity Partition Coding for Sharp Multi-Label Classification

The problem of efficiently training and evaluating image classifiers tha...

LaSO: Label-Set Operations networks for multi-label few-shot learning

Example synthesis is one of the leading methods to tackle the problem of...

Knowledge-driven Active Learning

In the last few years, Deep Learning models have become increasingly pop...

Post Selection Inference with Kernels

We propose a novel kernel based post selection inference (PSI) algorithm...

Please sign up or login with your details

Forgot password? Click here to reset