Multi-Task Consistency for Active Learning

by   Aral Hekimoglu, et al.

Learning-based solutions for vision tasks require a large amount of labeled training data to ensure their performance and reliability. In single-task vision-based settings, inconsistency-based active learning has proven to be effective in selecting informative samples for annotation. However, there is a lack of research exploiting the inconsistency between multiple tasks in multi-task networks. To address this gap, we propose a novel multi-task active learning strategy for two coupled vision tasks: object detection and semantic segmentation. Our approach leverages the inconsistency between them to identify informative samples across both tasks. We propose three constraints that specify how the tasks are coupled and introduce a method for determining the pixels belonging to the object detected by a bounding box, to later quantify the constraints as inconsistency scores. To evaluate the effectiveness of our approach, we establish multiple baselines for multi-task active learning and introduce a new metric, mean Detection Segmentation Quality (mDSQ), tailored for the multi-task active learning comparison that addresses the performance of both tasks. We conduct extensive experiments on the nuImages and A9 datasets, demonstrating that our approach outperforms existing state-of-the-art methods by up to 3.4 performance using only 67 labels compared to random selection and 5 state-of-the-art selection strategy. Our code will be made publicly available after the review process.


page 1

page 2

page 7


An Adaptive Supervision Framework for Active Learning in Object Detection

Active learning approaches in computer vision generally involve querying...

Multi-Task Active Learning for Neural Semantic Role Labeling on Low Resource Conversational Corpus

Most Semantic Role Labeling (SRL) approaches are supervised methods whic...

Multi-task Active Learning for Pre-trained Transformer-based Models

Multi-task learning, in which several tasks are jointly learned by a sin...

Towards General and Efficient Active Learning

Active learning aims to select the most informative samples to exploit l...

Man-recon: manifold learning for reconstruction with deep autoencoder for smart seismic interpretation

Deep learning can extract rich data representations if provided sufficie...

Active Multi-Task Representation Learning

To leverage the power of big data from source tasks and overcome the sca...

Entropy-based Active Learning for Object Detection with Progressive Diversity Constraint

Active learning is a promising alternative to alleviate the issue of hig...

Please sign up or login with your details

Forgot password? Click here to reset