Deep Reinforcement Learning for Online Control of Stochastic Partial Differential Equations

10/21/2021
by   Erfan Pirmorad, et al.
0

In many areas, such as the physical sciences, life sciences, and finance, control approaches are used to achieve a desired goal in complex dynamical systems governed by differential equations. In this work we formulate the problem of controlling stochastic partial differential equations (SPDE) as a reinforcement learning problem. We present a learning-based, distributed control approach for online control of a system of SPDEs with high dimensional state-action space using deep deterministic policy gradient method. We tested the performance of our method on the problem of controlling the stochastic Burgers' equation, describing a turbulent fluid flow in an infinitely large domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2023

Distributed Control of Partial Differential Equations Using Convolutional Reinforcement Learning

We present a convolutional framework which significantly reduces the com...
research
06/13/2018

Reinforcement Learning with Function-Valued Action Spaces for Partial Differential Equation Control

Recent work has shown that reinforcement learning (RL) is a promising ap...
research
03/17/2023

Recent Developments in Machine Learning Methods for Stochastic Control and Games

Stochastic optimal control and games have found a wide range of applicat...
research
08/08/2019

Incremental Reinforcement Learning --- a New Continuous Reinforcement Learning Frame Based on Stochastic Differential Equation methods

Continuous reinforcement learning such as DDPG and A3C are widely used i...
research
03/27/2019

Dynamic Control of Stochastic Evolution: A Deep Reinforcement Learning Approach to Adaptively Targeting Emergent Drug Resistance

The challenge in controlling stochastic systems in which random events c...
research
10/20/2022

Accurate Extrinsic Prediction of Physical Systems Using Transformers

Accurate high-altitude wind forecasting is important for air traffic con...

Please sign up or login with your details

Forgot password? Click here to reset