Sufficiently Accurate Model Learning for Planning

02/11/2021
by   Clark Zhang, et al.
0

Data driven models of dynamical systems help planners and controllers to provide more precise and accurate motions. Most model learning algorithms will try to minimize a loss function between the observed data and the model's predictions. This can be improved using prior knowledge about the task at hand, which can be encoded in the form of constraints. This turns the unconstrained model learning problem into a constrained one. These constraints allow models with finite capacity to focus their expressive power on important aspects of the system. This can lead to models that are better suited for certain tasks. This paper introduces the constrained Sufficiently Accurate model learning approach, provides examples of such problems, and presents a theorem on how close some approximate solutions can be. The approximate solution quality will depend on the function parameterization, loss and constraint function smoothness, and the number of samples in model learning.

READ FULL TEXT

page 8

page 10

research
12/06/2019

Does Knowledge Transfer Always Help to Learn a Better Policy?

One of the key approaches to save samples when learning a policy for a r...
research
12/08/2021

Learning over All Stabilizing Nonlinear Controllers for a Partially-Observed Linear System

We propose a parameterization of nonlinear output feedback controllers f...
research
06/14/2020

Learning Stable Nonparametric Dynamical Systems with Gaussian Process Regression

Modelling real world systems involving humans such as biological process...
research
02/08/2023

Learning Dynamical Systems by Leveraging Data from Similar Systems

We consider the problem of learning the dynamics of a linear system when...
research
12/02/2021

Constrained Machine Learning: The Bagel Framework

Machine learning models are widely used for real-world applications, suc...
research
09/28/2022

Shape-constrained Symbolic Regression with NSGA-III

Shape-constrained symbolic regression (SCSR) allows to include prior kno...
research
08/01/2020

Learning with Safety Constraints: Sample Complexity of Reinforcement Learning for Constrained MDPs

Many physical systems have underlying safety considerations that require...

Please sign up or login with your details

Forgot password? Click here to reset