Data-Driven Chance Constrained Control using Kernel Distribution Embeddings

02/08/2022
by   Adam J. Thorpe, et al.
0

We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems. Our approach leverages the theory of kernel distribution embeddings, which allows representing expectation operators as inner products in a reproducing kernel Hilbert space. This framework enables approximately reformulating the original problem using a dataset of observed trajectories from the system without imposing prior assumptions on the parameterization of the system dynamics or the structure of the uncertainty. By optimizing over a finite subset of stochastic open-loop control trajectories, we relax the original problem to a linear program over the control parameters that can be efficiently solved using standard convex optimization techniques. We demonstrate our proposed approach in simulation on a system with nonlinear non-Markovian dynamics navigating in a cluttered environment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/12/2022

SOCKS: A Stochastic Optimal Control and Reachability Toolbox Using Kernel Methods

We present SOCKS, a data-driven stochastic optimal control toolbox based...
research
01/09/2023

Physics-Informed Kernel Embeddings: Integrating Prior System Knowledge with Data-Driven Control

Data-driven control algorithms use observations of system dynamics to co...
research
06/28/2020

A convex data-driven approach for nonlinear control synthesis

We consider a class of nonlinear control synthesis problems where the un...
research
11/24/2020

An end-to-end data-driven optimisation framework for constrained trajectories

Many real-world problems require to optimise trajectories under constrai...
research
09/14/2021

Koopman Linearization for Data-Driven Batch State Estimation of Control-Affine Systems

We present the Koopman State Estimator (KoopSE), a framework for model-f...
research
04/27/2023

Propagating Kernel Ambiguity Sets in Nonlinear Data-driven Dynamics Models

This paper provides answers to an open problem: given a nonlinear data-d...
research
03/04/2023

Data-Driven Distributionally Robust Optimal Control with State-Dependent Noise

This paper introduces innovative data-driven techniques for estimating t...

Please sign up or login with your details

Forgot password? Click here to reset