Modeling Human Ad Hoc Coordination

02/11/2016
by   Peter M Krafft, et al.
0

Whether in groups of humans or groups of computer agents, collaboration is most effective between individuals who have the ability to coordinate on a joint strategy for collective action. However, in general a rational actor will only intend to coordinate if that actor believes the other group members have the same intention. This circular dependence makes rational coordination difficult in uncertain environments if communication between actors is unreliable and no prior agreements have been made. An important normative question with regard to coordination in these ad hoc settings is therefore how one can come to believe that other actors will coordinate, and with regard to systems involving humans, an important empirical question is how humans arrive at these expectations. We introduce an exact algorithm for computing the infinitely recursive hierarchy of graded beliefs required for rational coordination in uncertain environments, and we introduce a novel mechanism for multiagent coordination that uses it. Our algorithm is valid in any environment with a finite state space, and extensions to certain countably infinite state spaces are likely possible. We test our mechanism for multiagent coordination as a model for human decisions in a simple coordination game using existing experimental data. We then explore via simulations whether modeling humans in this way may improve human-agent collaboration.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/08/2022

On-the-fly Strategy Adaptation for ad-hoc Agent Coordination

Training agents in cooperative settings offers the promise of AI agents ...
research
10/13/2019

On the Utility of Learning about Humans for Human-AI Coordination

While we would like agents that can coordinate with humans, current algo...
research
06/03/2015

A Game-Theoretic Model and Best-Response Learning Method for Ad Hoc Coordination in Multiagent Systems

The ad hoc coordination problem is to design an autonomous agent which i...
research
06/11/2019

Deep learning control of artificial avatars in group coordination tasks

In many joint-action scenarios, humans and robots have to coordinate the...
research
04/12/2021

From partners to populations: A hierarchical Bayesian account of coordination and convention

Languages are powerful solutions to coordination problems: they provide ...
research
08/20/2020

The Curse of Shared Knowledge: Recursive Belief Reasoning in a Coordination Game with Imperfect Information

Common knowledge is a necessary condition for safe group coordination. W...
research
09/23/2020

The cost of coordination can exceed the benefit of collaboration in performing complex tasks

Collective decision-making is ubiquitous when observing the behavior of ...

Please sign up or login with your details

Forgot password? Click here to reset