Learning-Based Optimal Control with Performance Guarantees for Unknown Systems with Latent States

by   Robert Lefringhausen, et al.

As control engineering methods are applied to increasingly complex systems, data-driven approaches for system identification appear as a promising alternative to physics-based modeling. While many of these approaches rely on the availability of state measurements, the states of a complex system are often not directly measurable. It may then be necessary to jointly estimate the dynamics and a latent state, making it considerably more challenging to design controllers with performance guarantees. This paper proposes a novel method for the computation of an optimal input trajectory for unknown nonlinear systems with latent states. Probabilistic performance guarantees are derived for the resulting input trajectory, and an approach to validate the performance of arbitrary control laws is presented. The effectiveness of the proposed method is demonstrated in a numerical simulation.


page 1

page 2

page 3

page 4


Non-Episodic Learning for Online LQR of Unknown Linear Gaussian System

This paper considers the data-driven linear-quadratic regulation (LQR) p...

Control Input Inference of Mobile Agents under Unknown Objective

Trajectory and control secrecy is an important issue in robotics securit...

Data-Driven Optimal Control of Tethered Space Robot Deployment with Learning Based Koopman Operator

To avoid complex constraints of the traditional nonlinear method for tet...

Learning to Reach, Swim, Walk and Fly in One Trial: Data-Driven Control with Scarce Data and Side Information

We develop a learning-based control algorithm for unknown dynamical syst...

Learning Hybrid Dynamics Models With Simulator-Informed Latent States

Dynamics model learning deals with the task of inferring unknown dynamic...

Data-Driven Multi-Objective Controller Optimization for a Magnetically-Levitated Nanopositioning System

The performance achieved with traditional model-based control system des...

Please sign up or login with your details

Forgot password? Click here to reset