Exact Convergence Rate Analysis of the Independent Metropolis-Hastings Algorithms

08/06/2020
by   Guanyang Wang, et al.
0

A well-known difficult problem regarding Metropolis-Hastings algorithms is to get sharp bounds on their convergence rates. Moreover, different initializations may have different convergence rates so a uniform upper bound may be too conservative to be used in practice. In this paper, we study the convergence properties of the Independent Metropolis-Hastings (IMH) algorithms on both general and discrete state spaces. Under mild conditions, we derive the exact convergence rate and prove that different initializations of the IMH algorithm have the same convergence rate. In particular, we get the exact convergence speed for IMH algorithms on general state spaces under certain conditions. Connections with the Random Walk Metropolis-Hastings (RWMH) algorithm are also discussed, which solve the conjecture proposed by Atchade and Perron using a counterexample.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/21/2020

On the limitations of single-step drift and minorization in Markov chain convergence analysis

Over the last three decades, there has been a considerable effort within...
research
07/09/2020

Geometric Bounds for Convergence Rates of Averaging Algorithms

We develop a generic method for bounding the convergence rate of an aver...
research
11/30/2021

Convergence Rate of Multiple-try Metropolis Independent sampler

The Multiple-try Metropolis (MTM) method is an interesting extension of ...
research
11/19/2021

Convergence rates for Metropolis-Hastings algorithms in the Wasserstein distance

We develop necessary conditions for geometrically fast convergence in th...
research
09/01/2020

Variational Regularization Theory Based on Image Space Approximation Rates

We present a new approach to convergence rate results for variational re...
research
05/07/2018

Convergence Rate Analysis for Periodic Gossip Algorithms in Wireless Sensor Networks

Periodic gossip algorithms have generated a lot of interest due to their...
research
10/26/2020

A Homotopic Method to Solve the Lasso Problems with an Improved Upper Bound of Convergence Rate

In optimization, it is known that when the objective functions are stric...

Please sign up or login with your details

Forgot password? Click here to reset