Neural Payoff Machines: Predicting Fair and Stable Payoff Allocations Among Team Members

by   Daphne Cornelisse, et al.

In many multi-agent settings, participants can form teams to achieve collective outcomes that may far surpass their individual capabilities. Measuring the relative contributions of agents and allocating them shares of the reward that promote long-lasting cooperation are difficult tasks. Cooperative game theory offers solution concepts identifying distribution schemes, such as the Shapley value, that fairly reflect the contribution of individuals to the performance of the team or the Core, which reduces the incentive of agents to abandon their team. Applications of such methods include identifying influential features and sharing the costs of joint ventures or team formation. Unfortunately, using these solutions requires tackling a computational barrier as they are hard to compute, even in restricted settings. In this work, we show how cooperative game-theoretic solutions can be distilled into a learned model by training neural networks to propose fair and stable payoff allocations. We show that our approach creates models that can generalize to games far from the training distribution and can predict solutions for more players than observed during training. An important application of our framework is Explainable AI: our approach can be used to speed-up Shapley value computations on many instances.


page 1

page 2

page 3

page 4


Negotiating Team Formation Using Deep Reinforcement Learning

When autonomous agents interact in the same environment, they must often...

Evaluating and Rewarding Teamwork Using Cooperative Game Abstractions

Can we predict how well a team of individuals will perform together? How...

Incentive-Based Software Security: Fair Micro-Payments for Writing Secure Code

We describe a mechanism to create fair and explainable incentives for so...

Cooperative Multi-Agent Fairness and Equivariant Policies

We study fairness through the lens of cooperative multi-agent learning. ...

Fair Multi-party Machine Learning – a Game Theoretic approach

High performance machine learning models have become highly dependent on...

Cooperative Optimization for Energy Minimization: A Case Study of Stereo Matching

Often times, individuals working together as a team can solve hard probl...

Dynamics and Allocation of Transaction Cost in Multiagent Industrial Symbiosis

This paper discusses the dynamics of Transaction Cost (TC) in Industrial...

Please sign up or login with your details

Forgot password? Click here to reset