UniDU: Towards A Unified Generative Dialogue Understanding Framework

04/10/2022
by   Zhi Chen, et al.
0

With the development of pre-trained language models, remarkable success has been witnessed in dialogue understanding (DU) direction. However, the current DU approaches just employ an individual model for each DU task, independently, without considering the shared knowledge across different DU tasks. In this paper, we investigate a unified generative dialogue understanding framework, namely UniDU, to achieve information exchange among DU tasks. Specifically, we reformulate the DU tasks into unified generative paradigm. In addition, to consider different training data for each task, we further introduce model-agnostic training strategy to optimize unified model in a balanced manner. We conduct the experiments on ten dialogue understanding datasets, which span five fundamental tasks: dialogue summary, dialogue completion, slot filling, intent detection and dialogue state tracking. The proposed UniDU framework outperforms task-specific well-designed methods on all 5 tasks. We further conduct comprehensive analysis experiments to study the effect factors. The experimental results also show that the proposed method obtains promising performance on unseen dialogue domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/29/2021

Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System

Pre-trained language models have been recently shown to benefit task-ori...
research
04/09/2023

A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understanding

Zero-shot dialogue understanding aims to enable dialogue to track the us...
research
08/11/2023

Task Conditioned BERT for Joint Intent Detection and Slot-filling

Dialogue systems need to deal with the unpredictability of user intents ...
research
02/27/2021

Improving Longer-range Dialogue State Tracking

Dialogue state tracking (DST) is a pivotal component in task-oriented di...
research
07/30/2023

A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction

This paper focuses on term-status pair extraction from medical dialogues...
research
03/10/2023

AUTODIAL: Efficient Asynchronous Task-Oriented Dialogue Model

As large dialogue models become commonplace in practice, the problems su...
research
02/12/2023

Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue

With the power of large pretrained language models, various research wor...

Please sign up or login with your details

Forgot password? Click here to reset