Achieving Diverse Objectives with AI-driven Prices in Deep Reinforcement Learning Multi-agent Markets

by   Panayiotis Danassis, et al.

We propose a practical approach to computing market prices and allocations via a deep reinforcement learning policymaker agent, operating in an environment of other learning agents. Compared to the idealized market equilibrium outcome – which we use as a benchmark – our policymaker is much more flexible, allowing us to tune the prices with regard to diverse objectives such as sustainability and resource wastefulness, fairness, buyers' and sellers' welfare, etc. To evaluate our approach, we design a realistic market with multiple and diverse buyers and sellers. Additionally, the sellers, which are deep learning agents themselves, compete for resources in a common-pool appropriation environment based on bio-economic models of commercial fisheries. We demonstrate that: (a) The introduced policymaker is able to achieve comparable performance to the market equilibrium, showcasing the potential of such approaches in markets where the equilibrium prices can not be efficiently computed. (b) Our policymaker can notably outperform the equilibrium solution on certain metrics, while at the same time maintaining comparable performance for the remaining ones. (c) As a highlight of our findings, our policymaker is significantly more successful in maintaining resource sustainability, compared to the market outcome, in scarce resource environments.


page 1

page 2

page 3

page 4


Reinforcement Learning for Market Making in a Multi-agent Dealer Market

Market makers play an important role in providing liquidity to markets b...

Using Reinforcement Learning to Study Platform Economies under Market Shocks

Driven by rapid digitization and expansive internet access, market-drive...

Towards Multi-Agent Reinforcement Learning driven Over-The-Counter Market Simulations

We study a game between liquidity provider and liquidity taker agents in...

Approximating Energy Market Clearing and Bidding With Model-Based Reinforcement Learning

Energy markets can provide incentives for undesired behavior of market p...

Small-Scale Markets for Bilateral Resource Trading in the Sharing Economy

We consider a general small-scale market for agent-to-agent resource sha...

Reputation and Pricing Dynamics in Online Markets

We study the economic interactions among sellers and buyers in online ma...

Bounded strategic reasoning explains crisis emergence in multi-agent market games

The efficient market hypothesis (EMH), based on rational expectations an...

Please sign up or login with your details

Forgot password? Click here to reset