A Simple Proof of the Mixing of Metropolis-Adjusted Langevin Algorithm under Smoothness and Isoperimetry

04/08/2023
by   Yuansi Chen, et al.
0

We study the mixing time of Metropolis-Adjusted Langevin algorithm (MALA) for sampling a target density on ℝ^d. We assume that the target density satisfies ψ_μ-isoperimetry and that the operator norm and trace of its Hessian are bounded by L and Υ respectively. Our main result establishes that, from a warm start, to achieve ϵ-total variation distance to the target density, MALA mixes in O((LΥ)^1/2/ψ_μ^2log(1/ϵ)) iterations. Notably, this result holds beyond the log-concave sampling setting and the mixing time depends on only Υ rather than its upper bound L d. In the m-strongly logconcave and L-log-smooth sampling setting, our bound recovers the previous minimax mixing bound of MALA <cit.>.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/27/2021

Minimax Mixing Time of the Metropolis-Adjusted Langevin Algorithm for Log-Concave Sampling

We study the mixing time of the Metropolis-adjusted Langevin algorithm (...
research
04/10/2023

When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?

We analyze the mixing time of Metropolized Hamiltonian Monte Carlo (HMC)...
research
06/13/2022

On the Computational Complexity of Metropolis-Adjusted Langevin Algorithms for Bayesian Posterior Sampling

In this paper, we study the computational complexity of sampling from a ...
research
02/23/2023

Efficiently handling constraints with Metropolis-adjusted Langevin algorithm

In this study, we investigate the performance of the Metropolis-adjusted...
research
12/01/2021

On Mixing Times of Metropolized Algorithm With Optimization Step (MAO) : A New Framework

In this paper, we consider sampling from a class of distributions with t...
research
09/29/2020

On the mixing time of coordinate Hit-and-Run

We obtain a polynomial upper bound on the mixing time T_CHR(ϵ) of the co...
research
06/19/2022

Faster Sampling from Log-Concave Distributions over Polytopes via a Soft-Threshold Dikin Walk

We consider the problem of sampling from a d-dimensional log-concave dis...

Please sign up or login with your details

Forgot password? Click here to reset