Optimizing Bayesian acquisition functions in Gaussian Processes

by   Ashish Anil Pawar, et al.

Bayesian Optimization is an effective method for searching the global maxima of an objective function especially if the function is unknown. The process comprises of using a surrogate function and choosing an acquisition function followed by optimizing the acquisition function to find the next sampling point. This paper analyzes different acquistion functions like Maximum Probability of Improvement and Expected Improvement and various optimizers like L-BFGS and TNC to optimize the acquisitions functions for finding the next sampling point. Along with the analysis of time taken, the paper also shows the importance of position of initial samples chosen.


page 1

page 2

page 3

page 4


On Local Optimizers of Acquisition Functions in Bayesian Optimization

Bayesian optimization is a sample-efficient method for finding a global ...

A sequential Monte Carlo approach to Thompson sampling for Bayesian optimization

Bayesian optimization through Gaussian process regression is an effectiv...

Expected Improvement versus Predicted Value in Surrogate-Based Optimization

Surrogate-based optimization relies on so-called infill criteria (acquis...

Bayesian Optimization of Function Networks

We consider Bayesian optimization of the output of a network of function...

Global Optimization of Gaussian processes

Gaussian processes (Kriging) are interpolating data-driven models that a...

The reparameterization trick for acquisition functions

Bayesian optimization is a sample-efficient approach to solving global o...

Enhancing High-dimensional Bayesian Optimization by Optimizing the Acquisition Function Maximizer Initialization

Bayesian optimization (BO) is widely used to optimize black-box function...

Please sign up or login with your details

Forgot password? Click here to reset