Label-guided Learning for Text Classification

02/25/2020
by   Xien Liu, et al.
0

Text classification is one of the most important and fundamental tasks in natural language processing. Performance of this task mainly dependents on text representation learning. Currently, most existing learning frameworks mainly focus on encoding local contextual information between words. These methods always neglect to exploit global clues, such as label information, for encoding text information. In this study, we propose a label-guided learning framework LguidedLearn for text representation and classification. Our method is novel but simple that we only insert a label-guided encoding layer into the commonly used text representation learning schemas. That label-guided layer performs label-based attentive encoding to map the universal text embedding (encoded by a contextual information learner) into different label spaces, resulting in label-wise embeddings. In our proposed framework, the label-guided layer can be easily and directly applied with a contextual encoding method to perform jointly learning. Text information is encoded based on both the local contextual information and the global label clues. Therefore, the obtained text embeddings are more robust and discriminative for text classification. Extensive experiments are conducted on benchmark datasets to illustrate the effectiveness of our proposed method.

READ FULL TEXT

page 4

page 5

research
05/05/2022

Exploiting Global and Local Hierarchies for Hierarchical Text Classification

Hierarchical text classification aims to leverage label hierarchy in mul...
research
12/15/2022

Improve Text Classification Accuracy with Intent Information

Text classification, a core component of task-oriented dialogue systems,...
research
10/05/2021

TENT: Text Classification Based on ENcoding Tree Learning

Text classification is a primary task in natural language processing (NL...
research
07/26/2022

Contextual Text Block Detection towards Scene Text Understanding

Most existing scene text detectors focus on detecting characters or word...
research
01/12/2020

Tensor Graph Convolutional Networks for Text Classification

Compared to sequential learning models, graph-based neural networks exhi...
research
04/21/2023

Downstream Task-Oriented Neural Tokenizer Optimization with Vocabulary Restriction as Post Processing

This paper proposes a method to optimize tokenization for the performanc...
research
11/21/2019

Automatic Text-based Personality Recognition on Monologues and Multiparty Dialogues Using Attentive Networks and Contextual Embeddings

Previous works related to automatic personality recognition focus on usi...

Please sign up or login with your details

Forgot password? Click here to reset