Bayesian Optimization for Adaptive MCMC

10/29/2011
by   Nimalan Mahendran, et al.
0

This paper proposes a new randomized strategy for adaptive MCMC using Bayesian optimization. This approach applies to non-differentiable objective functions and trades off exploration and exploitation to reduce the number of potentially costly objective function evaluations. We demonstrate the strategy in the complex setting of sampling from constrained, discrete and densely connected probabilistic graphical models where, for each variation of the problem, one needs to adjust the parameters of the proposal mechanism automatically to ensure efficient mixing of the Markov chains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/18/2023

Constrained Bayesian Optimization Using a Lagrange Multiplier Applied to Power Transistor Design

We propose a novel constrained Bayesian Optimization (BO) algorithm opti...
research
06/03/2021

Semi-Empirical Objective Functions for MCMC Proposal Optimization

We introduce and demonstrate a semi-empirical procedure for determining ...
research
08/09/2014

Markov Chains on Orbits of Permutation Groups

We present a novel approach to detecting and utilizing symmetries in pro...
research
07/13/2022

Non-Myopic Multifidelity Bayesian Optimization

Bayesian optimization is a popular framework for the optimization of bla...
research
04/16/2021

Inverse Bayesian Optimization: Learning Human Search Strategies in a Sequential Optimization Task

Bayesian optimization is a popular algorithm for sequential optimization...
research
04/21/2020

Bayesian Optimization of Hyperparameters when the Marginal Likelihood is Estimated by MCMC

Bayesian models often involve a small set of hyperparameters determined ...
research
06/09/2023

Domain-Agnostic Batch Bayesian Optimization with Diverse Constraints via Bayesian Quadrature

Real-world optimisation problems often feature complex combinations of (...

Please sign up or login with your details

Forgot password? Click here to reset