Optimizing Bayesian acquisition functions in Gaussian Processes

11/09/2021
by   Ashish Anil Pawar, et al.
0

Bayesian Optimization is an effective method for searching the global maxima of an objective function especially if the function is unknown. The process comprises of using a surrogate function and choosing an acquisition function followed by optimizing the acquisition function to find the next sampling point. This paper analyzes different acquistion functions like Maximum Probability of Improvement and Expected Improvement and various optimizers like L-BFGS and TNC to optimize the acquisitions functions for finding the next sampling point. Along with the analysis of time taken, the paper also shows the importance of position of initial samples chosen.

READ FULL TEXT

page 1

page 2

page 3

page 4

01/24/2019

On Local Optimizers of Acquisition Functions in Bayesian Optimization

Bayesian optimization is a sample-efficient method for finding a global ...
04/01/2016

A sequential Monte Carlo approach to Thompson sampling for Bayesian optimization

Bayesian optimization through Gaussian process regression is an effectiv...
01/09/2020

Expected Improvement versus Predicted Value in Surrogate-Based Optimization

Surrogate-based optimization relies on so-called infill criteria (acquis...
12/31/2021

Bayesian Optimization of Function Networks

We consider Bayesian optimization of the output of a network of function...
05/21/2020

Global Optimization of Gaussian processes

Gaussian processes (Kriging) are interpolating data-driven models that a...
12/01/2017

The reparameterization trick for acquisition functions

Bayesian optimization is a sample-efficient approach to solving global o...
02/16/2023

Enhancing High-dimensional Bayesian Optimization by Optimizing the Acquisition Function Maximizer Initialization

Bayesian optimization (BO) is widely used to optimize black-box function...

Please sign up or login with your details

Forgot password? Click here to reset