Expert Level control of Ramp Metering based on Multi-task Deep Reinforcement Learning

01/30/2017
by   Francois Belletti, et al.
0

This article shows how the recent breakthroughs in Reinforcement Learning (RL) that have enabled robots to learn to play arcade video games, walk or assemble colored bricks, can be used to perform other tasks that are currently at the core of engineering cyberphysical systems. We present the first use of RL for the control of systems modeled by discretized non-linear Partial Differential Equations (PDEs) and devise a novel algorithm to use non-parametric control techniques for large multi-agent systems. We show how neural network based RL enables the control of discretized PDEs whose parameters are unknown, random, and time-varying. We introduce an algorithm of Mutual Weight Regularization (MWR) which alleviates the curse of dimensionality of multi-agent control schemes by sharing experience between agents while giving each agent the opportunity to specialize its action policy so as to tailor it to the local parameters of the part of the system it is located in.

READ FULL TEXT

page 1

page 7

page 9

research
05/31/2022

Multi-Agent Learning of Numerical Methods for Hyperbolic PDEs with Factored Dec-MDP

Factored decentralized Markov decision process (Dec-MDP) is a framework ...
research
02/14/2023

Learning a model is paramount for sample efficiency in reinforcement learning control of PDEs

The goal of this paper is to make a strong point for the usage of dynami...
research
03/16/2022

Backpropagation through Time and Space: Learning Numerical Methods with Multi-Agent Reinforcement Learning

We introduce Backpropagation Through Time and Space (BPTTS), a method fo...
research
10/11/2021

Non-Parametric Neuro-Adaptive Coordination of Multi-Agent Systems

We develop a learning-based algorithm for the distributed formation cont...
research
08/06/2020

Deep Q-Network Based Multi-agent Reinforcement Learning with Binary Action Agents

Deep Q-Network (DQN) based multi-agent systems (MAS) for reinforcement l...
research
04/03/2019

Random Projection in Neural Episodic Control

End-to-end deep reinforcement learning has enabled agents to learn with ...
research
01/25/2023

Distributed Control of Partial Differential Equations Using Convolutional Reinforcement Learning

We present a convolutional framework which significantly reduces the com...

Please sign up or login with your details

Forgot password? Click here to reset