Order-free Learning Alleviating Exposure Bias in Multi-label Classification

09/08/2019
by   Che-Ping Tsai, et al.
0

Multi-label classification (MLC) assigns multiple labels to each sample. Prior studies show that MLC can be transformed to a sequence prediction problem with a recurrent neural network (RNN) decoder to model the label dependency. However, training a RNN decoder requires a predefined order of labels, which is not directly available in the MLC specification. Besides, RNN thus trained tends to overfit the label combinations in the training set and have difficulty generating unseen label sequences. In this paper, we propose a new framework for MLC which does not rely on a predefined label order and thus alleviates exposure bias. The experimental results on three multi-label classification benchmark datasets show that our method outperforms competitive baselines by a large margin. We also find the proposed approach has a higher probability of generating label combinations not seen during training than the baseline models. The result shows that the proposed approach has better generalization capability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/22/2019

Orderless Recurrent Models for Multi-label Classification

Recurrent neural networks (RNN) are popular for many computer vision tas...
research
04/11/2019

Adapting RNN Sequence Prediction Model to Multi-label Set Prediction

We present an adaptation of RNN sequence models to the problem of multi-...
research
07/13/2021

Multi-Scale Label Relation Learning for Multi-Label Classification Using 1-Dimensional Convolutional Neural Networks

We present Multi-Scale Label Dependence Relation Networks (MSDN), a nove...
research
12/01/2021

Investigation of Training Label Error Impact on RNN-T

In this paper, we propose an approach to quantitatively analyze impacts ...
research
07/18/2017

Order-Free RNN with Visual Attention for Multi-Label Classification

In this paper, we propose the joint learning attention and recurrent neu...
research
06/06/2021

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

In multi-label text classification (MLTC), each given document is associ...
research
07/22/2020

Evolving Multi-label Classification Rules by Exploiting High-order Label Correlation

In multi-label classification tasks, each problem instance is associated...

Please sign up or login with your details

Forgot password? Click here to reset