Approximating Gaussian Process Emulators with Linear Inequality Constraints and Noisy Observations via MC and MCMC

01/15/2019
by   Andrés F. López-Lopera, et al.
0

Adding inequality constraints (e.g. boundedness, monotonicity, convexity) into Gaussian processes (GPs) can lead to more realistic stochastic emulators. Due to the truncated Gaussianity of the posterior, its distribution has to be approximated. In this work, we consider Monte Carlo (MC) and Markov chain Monte Carlo (MCMC). However, strictly interpolating the observations may entail expensive computations due to highly restrictive sample spaces. Having (constrained) GP emulators when data are actually noisy is also of interest. We introduce a noise term for the relaxation of the interpolation conditions, and we develop the corresponding approximation of GP emulators under linear inequality constraints. We show with various toy examples that the performance of MC and MCMC samplers improves when considering noisy observations. Finally, on a 5D monotonic example, we show that our framework still provides high effective sample rates with reasonable running times.

READ FULL TEXT
research
10/20/2017

Finite-dimensional Gaussian approximation with linear inequality constraints

Introducing inequality constraints in Gaussian process (GP) models can l...
research
02/03/2023

Towards Practical Preferential Bayesian Optimization with Skew Gaussian Processes

We study preferential Bayesian optimization (BO) where reliable feedback...
research
05/09/2019

On the Efficacy of Monte Carlo Implementation of CAVI

In Variational Inference (VI), coordinate-ascent and gradient-based appr...
research
01/10/2019

Gaussian processes with linear operator inequality constraints

This paper presents an approach for constrained Gaussian Process (GP) re...
research
01/28/2021

Model-Based Policy Search Using Monte Carlo Gradient Estimation with Real Systems Application

In this paper, we present a Model-Based Reinforcement Learning algorithm...
research
09/09/2020

Sequential construction and dimension reduction of Gaussian processes under inequality constraints

Accounting for inequality constraints, such as boundedness, monotonicity...
research
05/17/2022

High-dimensional additive Gaussian processes under monotonicity constraints

We introduce an additive Gaussian process framework accounting for monot...

Please sign up or login with your details

Forgot password? Click here to reset