Deep Learning Approximation for Stochastic Control Problems

11/02/2016
by   Jiequn Han, et al.
0

Many real world stochastic control problems suffer from the "curse of dimensionality". To overcome this difficulty, we develop a deep learning approach that directly solves high-dimensional stochastic control problems based on Monte-Carlo sampling. We approximate the time-dependent controls as feedforward neural networks and stack these networks together through model dynamics. The objective function for the control problem plays the role of the loss function for the deep neural network. We test this approach using examples from the areas of optimal trading and energy storage. Our results suggest that the algorithm presented here achieves satisfactory accuracy and at the same time, can handle rather high dimensional problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2018

Deep neural networks algorithms for stochastic control problems on finite horizon, part I: convergence analysis

This paper develops algorithms for high-dimensional stochastic control p...
research
11/05/2019

Quasi-Monte Carlo sampling for machine-learning partial differential equations

Solving partial differential equations in high dimensions by deep neural...
research
10/11/2018

Martingale Functional Control variates via Deep Learning

We propose black-box-type control variate for Monte Carlo simulations by...
research
03/09/2021

Deep neural network approximation for high-dimensional parabolic Hamilton-Jacobi-Bellman equations

The approximation of solutions to second order Hamilton–Jacobi–Bellman (...
research
09/20/2023

Drift Control of High-Dimensional RBM: A Computational Method Based on Neural Networks

Motivated by applications in queueing theory, we consider a stochastic c...
research
06/04/2018

Challenges in High-dimensional Reinforcement Learning with Evolution Strategies

Evolution Strategies (ESs) have recently become popular for training dee...
research
12/13/2018

Deep neural networks algorithms for stochastic control problems on finite horizon, Part 2: numerical applications

This paper presents several numerical applications of deep learning-base...

Please sign up or login with your details

Forgot password? Click here to reset