Sensitivity Analysis for Markov Decision Process Congestion Games

09/09/2019
by   Sarah H. Q. Li, et al.
0

We consider a non-atomic congestion game where each decision maker performs selfish optimization over states of a common MDP. The decision makers optimize for their own expected costs, and influence each other through congestion effects on the state-action costs. We analyze on the sensitivity of MDP congestion game equilibria to uncertainty and perturbations in the state-action costs by applying an implicit function type analysis. The occurrence of a stochastic Braess paradox is defined, analyzed based on sensitivity of game equilibria and demonstrated in simulation. We further analyze how the introduction of stochastic dynamics affects the magnitude of Braess paradox in comparison to deterministic dynamics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2019

Tolling for Constraint Satisfaction in Markov Decision Process Congestion Games

Markov decision process (MDP) congestion game is an extension of classic...
research
07/21/2019

Online Constraint Satisfaction via Tolls in MDP Congestion Games

We consider the toll design problem that arise for a game designer of a ...
research
07/28/2020

A sensitivity analysis for the price of anarchy in non-atomic congestion games

This paper shows that the PoA in non-atomic congestion games is Hölder c...
research
02/16/2021

Follow-the-Regularized-Leader Routes to Chaos in Routing Games

We study the emergence of chaotic behavior of Follow-the-Regularized Lea...
research
06/04/2022

Learning in Congestion Games with Bandit Feedback

Learning Nash equilibria is a central problem in multi-agent systems. In...
research
03/16/2018

Coordination via predictive assistants from a game-theoretic view

We study machine learning-based assistants that support coordination bet...
research
05/10/2021

Fast constraint satisfaction problem and learning-based algorithm for solving Minesweeper

Minesweeper is a popular spatial-based decision-making game that works w...

Please sign up or login with your details

Forgot password? Click here to reset