Fictitious Play with Maximin Initialization

03/21/2022
by   Sam Ganzfried, et al.
0

Fictitious play has recently emerged as the most accurate scalable algorithm for approximating Nash equilibrium strategies in multiplayer games. We show that the degree of equilibrium approximation error of fictitious play can be significantly reduced by carefully selecting the initial strategies. We present several new procedures for strategy initialization and compare them to the classic approach, which initializes all pure strategies to have equal probability. The best-performing approach, called maximin, solves a nonconvex quadratic program to compute initial strategies and results in a nearly 75 reduction in approximation error compared to the classic approach when 5 initializations are used.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/05/2022

Random Initialization Solves Shapley's Fictitious Play Counterexample

In 1964 Shapley devised a family of games for which fictitious play fail...
research
12/12/2022

Bayesian Opponent Modeling in Multiplayer Imperfect-Information Games

In many real-world settings agents engage in strategic interactions with...
research
01/12/2022

Safe Equilibrium

The standard game-theoretic solution concept, Nash equilibrium, assumes ...
research
01/15/2013

Multi-agent learning using Fictitious Play and Extended Kalman Filter

Decentralised optimisation tasks are important components of multi-agent...
research
05/23/2018

On self-play computation of equilibrium in poker

We compare performance of the genetic algorithm and the counterfactual r...
research
07/01/2003

AWESOME: A General Multiagent Learning Algorithm that Converges in Self-Play and Learns a Best Response Against Stationary Opponents

A satisfactory multiagent learning algorithm should, at a minimum, lear...
research
12/30/2021

From Behavioral Theories to Econometrics: Inferring Preferences of Human Agents from Data on Repeated Interactions

We consider the problem of estimating preferences of human agents from d...

Please sign up or login with your details

Forgot password? Click here to reset