Interlock-Free Multi-Aspect Rationalization for Text Classification

05/13/2022
by   Shuangqi Li, et al.
0

Explanation is important for text classification tasks. One prevalent type of explanation is rationales, which are text snippets of input text that suffice to yield the prediction and are meaningful to humans. A lot of research on rationalization has been based on the selective rationalization framework, which has recently been shown to be problematic due to the interlocking dynamics. In this paper, we show that we address the interlocking problem in the multi-aspect setting, where we aim to generate multiple rationales for multiple outputs. More specifically, we propose a multi-stage training method incorporating an additional self-supervised contrastive loss that helps to generate more semantically diverse rationales. Empirical results on the beer review dataset show that our method improves significantly the rationalization performance.

READ FULL TEXT
research
12/01/2022

Research on the application of contrastive learning in multi-label text classification

The effective application of contrastive learning technology in natural ...
research
05/25/2023

Perturbation-based Self-supervised Attention for Attention Bias in Text Classification

In text classification, the traditional attention mechanisms usually foc...
research
03/28/2023

Model and Evaluation: Towards Fairness in Multilingual Text Classification

Recently, more and more research has focused on addressing bias in text ...
research
10/17/2017

Multi-Task Label Embedding for Text Classification

Multi-task learning in text classification leverages implicit correlatio...
research
11/10/2022

Understanding Text Classification Data and Models Using Aggregated Input Salience

Realizing when a model is right for a wrong reason is not trivial and re...
research
09/07/2022

Semantic Interactive Learning for Text Classification: A Constructive Approach for Contextual Interactions

Interactive Machine Learning (IML) shall enable intelligent systems to i...

Please sign up or login with your details

Forgot password? Click here to reset