Task-Oriented Conversation Generation Using Heterogeneous Memory Networks

09/25/2019
by   Zehao Lin, et al.
0

How to incorporate external knowledge into a neural dialogue model is critically important for dialogue systems to behave like real humans. To handle this problem, memory networks are usually a great choice and a promising way. However, existing memory networks do not perform well when leveraging heterogeneous information from different sources. In this paper, we propose a novel and versatile external memory networks called Heterogeneous Memory Networks (HMNs), to simultaneously utilize user utterances, dialogue history and background knowledge tuples. In our method, historical sequential dialogues are encoded and stored into the context-aware memory enhanced by gating mechanism while grounding knowledge tuples are encoded and stored into the context-free memory. During decoding, the decoder augmented with HMNs recurrently selects each word in one response utterance from these two memories and a general vocabulary. Experimental results on multiple real-world datasets show that HMNs significantly outperform the state-of-the-art data-driven task-oriented dialogue models in most domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/15/2019

Global-to-local Memory Pointer Networks for Task-Oriented Dialogue

End-to-end task-oriented dialogue is challenging since knowledge bases a...
research
12/10/2022

Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access

To alleviate the problem of structured databases' limited coverage, rece...
research
05/01/2018

Memory-augmented Dialogue Management for Task-oriented Dialogue Systems

Dialogue management (DM) decides the next action of a dialogue system ac...
research
05/03/2018

Hierarchical Pointer Memory Network for Task Oriented Dialogue

We observe that end-to-end memory networks (MN) trained for task-oriente...
research
12/29/2020

Interpretable NLG for Task-oriented Dialogue Systems with Heterogeneous Rendering Machines

End-to-end neural networks have achieved promising performances in natur...
research
10/12/2020

Dynamic Memory Enhanced Transformer for End-to-end Task-Oriented Dialogue System

Recent studies try to build task-oriented dialogue system in an end-to-e...
research
05/13/2020

Response-Anticipated Memory for On-Demand Knowledge Integration in Response Generation

Neural conversation models are known to generate appropriate but non-inf...

Please sign up or login with your details

Forgot password? Click here to reset