On Constructing the Value Function for Optimal Trajectory Problem and its Application to Image Processing

by   Myong-Song Ho, et al.

We proposed an algorithm for solving Hamilton-Jacobi equation associated to an optimal trajectory problem for a vehicle moving inside the pre-specified domain with the speed depending upon the direction of the motion and current position of the vehicle. The dynamics of the vehicle is defined by an ordinary differential equation, the right hand of which is given by product of control(a time dependent fuction) and a function dependent on trajectory and control. At some unspecified terminal time, the vehicle reaches the boundary of the pre-specified domain and incurs a terminal cost. We also associate the traveling cost with a type of integral to the trajectory followed by vehicle. We are interested in a numerical method for finding a trajectory that minimizes the sum of the traveling cost and terminal cost. We developed an algorithm solving the value function for general trajectory optimization problem. Our algorithm is closely related to the Tsitsiklis's Fast Marching Method and J. A. Sethian's OUM and SLF-LLL[1-4] and is a generalization of them. On the basis of these results, We applied our algorithm to the image processing such as fingerprint verification.


page 1

page 5


HJB Optimal Feedback Control with Deep Differential Value Functions and Action Constraints

Learning optimal feedback control laws capable of executing optimal traj...

On the Numerical Solution of Fourth-Order Linear Two-Point Boundary Value Problems

This paper introduces a fast and numerically stable algorithm for the so...

Interplanetary Transfers via Deep Representations of the Optimal Policy and/or of the Value Function

A number of applications to interplanetary trajectories have been recent...

Regularization of the movement of a material point along a flat trajectory: application to robotics problems

The control problem of the working tool movement along a predefined traj...

Deep Value Model Predictive Control

In this paper, we introduce an actor-critic algorithm called Deep Value ...

HJB and Fokker-Planck equations for river environmental management based on stochastic impulse control with discrete and random observation

We formulate a new two-variable river environmental restoration problem ...

Optimal Trajectories of a UAV Base Station Using Lagrangian Mechanics

In this paper, we consider the problem of optimizing the trajectory of a...

Please sign up or login with your details

Forgot password? Click here to reset