Gaussian Process Uniform Error Bounds with Unknown Hyperparameters for Safety-Critical Applications

by   Alexandre Capone, et al.
Technische Universität München

Gaussian processes have become a promising tool for various safety-critical settings, since the posterior variance can be used to directly estimate the model error and quantify risk. However, state-of-the-art techniques for safety-critical settings hinge on the assumption that the kernel hyperparameters are known, which does not apply in general. To mitigate this, we introduce robust Gaussian process uniform error bounds in settings with unknown hyperparameters. Our approach computes a confidence region in the space of hyperparameters, which enables us to obtain a probabilistic upper bound for the model error of a Gaussian process with arbitrary hyperparameters. We do not require to know any bounds for the hyperparameters a priori, which is an assumption commonly found in related work. Instead, we are able to derive bounds from data in an intuitive fashion. We additionally employ the proposed technique to derive performance guarantees for a class of learning-based control problems. Experiments show that the bound performs significantly better than vanilla and fully Bayesian Gaussian processes.


page 1

page 2

page 3

page 4


Uniform Error Bounds for Gaussian Process Regression with Application to Safe Control

Data-driven models are subject to model errors due to limited and noisy ...

Error Bounds for Kernel-Based Linear System Identification with Unknown Hyperparameters

The kernel-based method has been successfully applied in linear system i...

Networked Online Learning for Control of Safety-Critical Resource-Constrained Systems based on Gaussian Processes

Safety-critical technical systems operating in unknown environments requ...

Scale invariant process regression

Gaussian processes are the leading method for non-parametric regression ...

Practical and Rigorous Uncertainty Bounds for Gaussian Process Regression

Gaussian Process Regression is a popular nonparametric regression method...

Learning Gaussian Processes by Minimizing PAC-Bayesian Generalization Bounds

Gaussian Processes (GPs) are a generic modelling tool for supervised lea...

Sharp Calibrated Gaussian Processes

While Gaussian processes are a mainstay for various engineering and scie...

Please sign up or login with your details

Forgot password? Click here to reset