DeepProbe: Information Directed Sequence Understanding and Chatbot Design via Recurrent Neural Networks

by   Zi Yin, et al.

Information extraction and user intention identification are central topics in modern query understanding and recommendation systems. In this paper, we propose DeepProbe, a generic information-directed interaction framework which is built around an attention-based sequence to sequence (seq2seq) recurrent neural network. DeepProbe can rephrase, evaluate, and even actively ask questions, leveraging the generative ability and likelihood estimation made possible by seq2seq models. DeepProbe makes decisions based on a derived uncertainty (entropy) measure conditioned on user inputs, possibly with multiple rounds of interactions. Three applications, namely a rewritter, a relevance scorer and a chatbot for ad recommendation, were built around DeepProbe, with the first two serving as precursory building blocks for the third. We first use the seq2seq model in DeepProbe to rewrite a user query into one of standard query form, which is submitted to an ordinary recommendation system. Secondly, we evaluate DeepProbe's seq2seq model-based relevance scoring. Finally, we build a chatbot prototype capable of making active user interactions, which can ask questions that maximize information gain, allowing for a more efficient user intention idenfication process. We evaluate first two applications by 1) comparing with baselines by BLEU and AUC, and 2) human judge evaluation. Both demonstrate significant improvements compared with current state-of-the-art systems, proving their values as useful tools on their own, and at the same time laying a good foundation for the ongoing chatbot application.


page 1

page 2

page 3

page 4


Improving Rating and Relevance with Point-of-Interest Recommender System

The recommendation of points of interest (POIs) is essential in location...

D2RLIR : an improved and diversified ranking function in interactive recommendation systems based on deep reinforcement learning

Recently, interactive recommendation systems based on reinforcement lear...

A Large-Scale Rich Context Query and Recommendation Dataset in Online Knowledge-Sharing

Data plays a vital role in machine learning studies. In the research of ...

Real-Time Learning from An Expert in Deep Recommendation Systems with Marginal Distance Probability Distribution

Recommendation systems play an important role in today's digital world. ...

Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Information

Inquiry is fundamental to communication, and machines cannot effectively...

Improving Sequential Query Recommendation with Immediate User Feedback

We propose an algorithm for next query recommendation in interactive dat...

SSR-TA: Sequence to Sequence based expert recurrent recommendation for ticket automation

The ticket automation provides crucial support for the normal operation ...

Please sign up or login with your details

Forgot password? Click here to reset