Bootstrapping Conversational Agents With Weak Supervision

by   Neil Mallinar, et al.

Many conversational agents in the market today follow a standard bot development framework which requires training intent classifiers to recognize user input. The need to create a proper set of training examples is often the bottleneck in the development process. In many occasions agent developers have access to historical chat logs that can provide a good quantity as well as coverage of training examples. However, the cost of labeling them with tens to hundreds of intents often prohibits taking full advantage of these chat logs. In this paper, we present a framework called search, label, and propagate (SLP) for bootstrapping intents from existing chat logs using weak supervision. The framework reduces hours to days of labeling effort down to minutes of work by using a search engine to find examples, then relies on a data programming approach to automatically expand the labels. We report on a user study that shows positive user feedback for this new approach to build conversational agents, and demonstrates the effectiveness of using data programming for auto-labeling. While the system is developed for training conversational agents, the framework has broader application in significantly reducing labeling effort for training text classifiers.


page 1

page 2

page 3

page 4


Intent Mining from past conversations for Conversational Agent

Conversational systems are of primary interest in the AI community. Chat...

Improving Classification through Weak Supervision in Context-specific Conversational Agent Development for Teacher Education

Machine learning techniques applied to the Natural Language Processing (...

Iterative Data Programming for Expanding Text Classification Corpora

Real-world text classification tasks often require many labeled training...

Towards Building Economic Models of Conversational Search

Various conceptual and descriptive models of conversational search have ...

Label Augmentation with Reinforced Labeling for Weak Supervision

Weak supervision (WS) is an alternative to the traditional supervised le...

Snorkel DryBell: A Case Study in Deploying Weak Supervision at Industrial Scale

Labeling training data is one of the most costly bottlenecks in developi...

Nemo: Guiding and Contextualizing Weak Supervision for Interactive Data Programming

Weak Supervision (WS) techniques allow users to efficiently create large...

Please sign up or login with your details

Forgot password? Click here to reset