A Condition Number for Hamiltonian Monte Carlo

05/23/2019
by   Ian Langmore, et al.
0

Hamiltonian Monte Carlo is a popular sampling technique for smooth target densities. The scale lengths of the target have long been believed to influence sampling efficiency, but quantitative measures intrinsic to the target have been lacking. In this paper, we restrict attention to multivariate Gaussian targets, and obtain a condition number corresponding to sampling efficiency. This number, based on a mix of spectral and Schatten norms, quantifies the number of leapfrog steps needed to efficiently sample. We demonstrate its utility by using the condition number to analyze preconditioning techniques for HMC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/27/2021

An Introduction to Hamiltonian Monte Carlo Method for Sampling

The goal of this article is to introduce the Hamiltonian Monte Carlo (HM...
research
04/11/2021

Couplings for Multinomial Hamiltonian Monte Carlo

Hamiltonian Monte Carlo (HMC) is a popular sampling method in Bayesian i...
research
07/22/2020

A Brief Note on the Convergence of Langevin Monte Carlo in Chi-Square Divergence

We study sampling from a target distribution ν_* ∝ e^-f using the unadju...
research
09/26/2022

Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random steps

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling f...
research
07/07/2023

On the convergence of dynamic implementations of Hamiltonian Monte Carlo and No U-Turn Samplers

There is substantial empirical evidence about the success of dynamic imp...
research
07/05/2022

Accelerating Hamiltonian Monte Carlo via Chebyshev Integration Time

Hamiltonian Monte Carlo (HMC) is a popular method in sampling. While the...
research
02/25/2016

Towards Unifying Hamiltonian Monte Carlo and Slice Sampling

We unify slice sampling and Hamiltonian Monte Carlo (HMC) sampling, demo...

Please sign up or login with your details

Forgot password? Click here to reset