Optimal bounds for numerical approximations of infinite horizon problems based on dynamic programming approach

11/14/2021
by   Javier de Frutos, et al.
0

In this paper we get error bounds for fully discrete approximations of infinite horizon problems via the dynamic programming approach. It is well known that considering a time discretization with a positive step size h an error bound of size h can be proved for the difference between the value function (viscosity solution of the Hamilton-Jacobi-Bellman equation corresponding to the infinite horizon) and the value function of the discrete time problem. However, including also a spatial discretization based on elements of size k an error bound of size O(k/h) can be found in the literature for the error between the value functions of the continuous problem and the fully discrete problem. In this paper we revise the error bound of the fully discrete method and prove, under similar assumptions to those of the time discrete case, that the error of the fully discrete case is in fact O(h+k) which gives first order in time and space for the method. This error bound matches the numerical experiments of many papers in the literature in which the behaviour 1/h from the bound O(k/h) have not been observed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2021

On Discrete-Time Approximations to Infinite Horizon Differential Games

In this paper we study a discrete-time semidiscretization of an infinite...
research
12/26/2013

Shape-constrained Estimation of Value Functions

We present a fully nonparametric method to estimate the value function, ...
research
02/04/2021

Error analysis of some nonlocal diffusion discretization schemes

We study two numerical approximations of solutions of nonlocal diffusion...
research
01/19/2023

Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based control

For a receding-horizon controller with a known system and with an approx...
research
01/11/2020

Superconvergence of Online Optimization for Model Predictive Control

We develop a one-Newton-step-per-horizon, online, lag-L, model predictiv...
research
05/14/2019

An analytical bound on the fleet size in vehicle routing problems: a dynamic programming approach

We present an analytical upper bound on the number of required vehicles ...
research
11/02/2021

Conservative Time Discretization: A Comparative Study

We present the first review of methods to overapproximate the set of rea...

Please sign up or login with your details

Forgot password? Click here to reset