Predicting Decisions in Language Based Persuasion Games

12/17/2020
by   Reut Apel, et al.
6

Sender-receiver interactions, and specifically persuasion games, are widely researched in economic modeling and artificial intelligence, and serve as a solid foundation for powerful applications. However, in the classic persuasion games setting, the messages sent from the expert to the decision-maker are abstract or well-structured application-specific signals rather than natural (human) language messages, although natural language is a very common communication signal in real-world persuasion setups. This paper addresses the use of natural language in persuasion games, exploring its impact on the decisions made by the players and aiming to construct effective models for the prediction of these decisions. For this purpose, we conduct an online repeated interaction experiment. At each trial of the interaction, an informed expert aims to sell an uninformed decision-maker a vacation in a hotel, by sending her a review that describes the hotel. While the expert is exposed to several scored reviews, the decision-maker observes only the single review sent by the expert, and her payoff in case she chooses to take the hotel is a random draw from the review score distribution available to the expert only. The expert's payoff, in turn, depends on the number of times the decision-maker chooses the hotel. We consider a number of modeling approaches for this setup, differing from each other in the model type (deep neural network (DNN) vs. linear classifier), the type of features used by the model (textual, behavioral or both) and the source of the textual features (DNN-based vs. hand-crafted). Our results demonstrate that given a prefix of the interaction sequence, our models can predict the future decisions of the decision-maker, particularly when a sequential modeling approach and hand-crafted textual features are applied.

READ FULL TEXT

page 7

page 23

page 26

page 28

page 37

research
05/11/2021

Designing an Automatic Agent for Repeated Language based Persuasion Games

Persuasion games are fundamental in economics and AI research and serve ...
research
04/06/2020

Predicting Strategic Behavior from Free Text

The connection between messaging and action is fundamental both to web a...
research
05/17/2023

Human Choice Prediction in Language-based Non-Cooperative Games: Simulation-based Off-Policy Evaluation

Persuasion games have been fundamental in economics and AI research, and...
research
06/06/2020

Guarded Deep Learning using Scenario-Based Modeling

Deep neural networks (DNNs) are becoming prevalent, often outperforming ...
research
08/11/2023

Learning to Guide Human Experts via Personalized Large Language Models

In learning to defer, a predictor identifies risky decisions and defers ...
research
02/19/2016

Learning to SMILE(S)

This paper shows how one can directly apply natural language processing ...
research
06/15/2016

Assessing Human Error Against a Benchmark of Perfection

An increasing number of domains are providing us with detailed trace dat...

Please sign up or login with your details

Forgot password? Click here to reset