Personalizing a Dialogue System with Transfer Reinforcement Learning

by   Kaixiang Mo, et al.

It is difficult to train a personalized task-oriented dialogue system because the data collected from each individual is often insufficient. Personalized dialogue systems trained on a small dataset can overfit and make it difficult to adapt to different user needs. One way to solve this problem is to consider a collection of multiple users' data as a source domain and an individual user's data as a target domain, and to perform a transfer learning from the source to the target domain. By following this idea, we propose "PETAL"(PErsonalized Task-oriented diALogue), a transfer-learning framework based on POMDP to learn a personalized dialogue system. The system first learns common dialogue knowledge from the source domain and then adapts this knowledge to the target user. This framework can avoid the negative transfer problem by considering differences between source and target users. The policy in the personalized POMDP can learn to choose different actions appropriately for different users. Experimental results on a real-world coffee-shopping data and simulation data show that our personalized dialogue system can choose different optimal actions for different users, and thus effectively improve the dialogue quality under the personalized setting.


page 1

page 2

page 3

page 4


Fine Grained Knowledge Transfer for Personalized Task-oriented Dialogue Systems

Training a personalized dialogue system requires a lot of data, and the ...

Transferable Dialogue Systems and User Simulators

One of the difficulties in training dialogue systems is the lack of trai...

Cross-domain Dialogue Policy Transfer via Simultaneous Speech-act and Slot Alignment

Dialogue policy transfer enables us to build dialogue policies in a targ...

Goal-Oriented Chatbot Dialog Management Bootstrapping with Transfer Learning

Goal-Oriented (GO) Dialogue Systems, colloquially known as goal oriented...

A Personalized Utterance Style (PUS) based Dialogue Strategy for Efficient Service Requirement Elicitation

With the flourish of services on the Internet, a prerequisite for servic...

Personalized Dynamics Models for Adaptive Assistive Navigation Interfaces

We explore the role of personalization for assistive navigational system...

Incremental Learning from Scratch for Task-Oriented Dialogue Systems

Clarifying user needs is essential for existing task-oriented dialogue s...

Please sign up or login with your details

Forgot password? Click here to reset