Localized active learning of Gaussian process state space models

by   Alexandre Capone, et al.
Technische Universität München

The performance of learning-based control techniques crucially depends on how effectively the system is explored. While most exploration techniques aim to achieve a globally accurate model, such approaches are generally unsuited for systems with unbounded state spaces. Furthermore, a globally accurate model is not required to achieve good performance in many common control applications, e.g., local stabilization tasks. In this paper, we propose an active learning strategy for Gaussian process state space models that aims to obtain an accurate model on a bounded subset of the state-action space. Our approach aims to maximize the mutual information of the exploration trajectories with respect to a discretization of the region of interest. By employing model predictive control, the proposed technique integrates information collected during exploration and adaptively improves its exploration strategy. To enable computational tractability, we decouple the choice of most informative data points from the model predictive control optimization step. This yields two optimization problems that can be solved in parallel. We apply the proposed method to explore the state space of various dynamical systems and compare our approach to a commonly used entropy-based exploration strategy. In all experiments, our method yields a better model within the region of interest than the entropy-based method.


page 1

page 2

page 3

page 4


Active Learning in Gaussian Process State Space Model

We investigate active learning in Gaussian Process state-space models (G...

Property-driven State-Space Coarsening for Continuous Time Markov Chains

Dynamical systems with large state-spaces are often expensive to thoroug...

Statistical Hardware Design With Multi-model Active Learning

With the rising complexity of numerous novel applications that serve our...

Active-learning-based non-intrusive Model Order Reduction

The Model Order Reduction (MOR) technique can provide compact numerical ...

Deep active learning for nonlinear system identification

The exploding research interest for neural networks in modeling nonlinea...

NExG: Provable and Guided State Space Exploration of Neural Network Control Systems using Sensitivity Approximation

We propose a new technique for performing state space exploration of clo...

Embedding Positive Process Models into Lognormal Bayesian State Space Frameworks using Moment Matching

In ecology it is common for processes to be bounded based on physical co...

Please sign up or login with your details

Forgot password? Click here to reset