Inducing Point Allocation for Sparse Gaussian Processes in High-Throughput Bayesian Optimisation

01/24/2023
by   Henry B. Moss, et al.
0

Sparse Gaussian Processes are a key component of high-throughput Bayesian Optimisation (BO) loops; however, we show that existing methods for allocating their inducing points severely hamper optimisation performance. By exploiting the quality-diversity decomposition of Determinantal Point Processes, we propose the first inducing point allocation strategy designed specifically for use in BO. Unlike existing methods which seek only to reduce global uncertainty in the objective function, our approach provides the local high-fidelity modelling of promising regions required for precise optimisation. More generally, we demonstrate that our proposed framework provides a flexible way to allocate modelling capacity in sparse models and so is suitable broad range of downstream sequential decision making tasks.

READ FULL TEXT

page 4

page 8

research
06/06/2022

Information-theoretic Inducing Point Placement for High-throughput Bayesian Optimisation

Sparse Gaussian Processes are a key component of high-throughput Bayesia...
research
10/19/2020

Probabilistic selection of inducing points in sparse Gaussian processes

Sparse Gaussian processes and various extensions thereof are enabled thr...
research
10/27/2015

Blitzkriging: Kronecker-structured Stochastic Gaussian Processes

We present Blitzkriging, a new approach to fast inference for Gaussian p...
research
10/17/2019

Achieving Robustness to Aleatoric Uncertainty with Heteroscedastic Bayesian Optimisation

Bayesian optimisation is an important decision-making tool for high-stak...
research
05/08/2020

BOP-Elites, a Bayesian Optimisation algorithm for Quality-Diversity search

Quality Diversity (QD) algorithms such as MAP-Elites are a class of opti...
research
03/19/2021

Sparse Algorithms for Markovian Gaussian Processes

Approximate Bayesian inference methods that scale to very large datasets...
research
05/11/2023

NUBO: A Transparent Python Package for Bayesian Optimisation

NUBO, short for Newcastle University Bayesian Optimisation, is a Bayesia...

Please sign up or login with your details

Forgot password? Click here to reset