Approximate spectral gaps for Markov chains mixing times in high-dimension

03/28/2019
by   Yves F. Atchadé, et al.
0

This paper introduces a concept of approximate spectral gap to analyze the mixing time of Markov Chain Monte Carlo (MCMC) algorithms for which the usual spectral gap is degenerate or almost degenerate. We use the idea to analyze a class of MCMC algorithms to sample from mixtures of densities. As an application we study the mixing time of a popular Gibbs sampler for variable selection in linear regression models. Under some regularity conditions on the signal and the design matrix of the regression problem, we show that for well-chosen initial distributions the mixing time of the Gibbs sampler is polynomial in the dimensional of the space.

READ FULL TEXT
research
05/29/2015

On the Computational Complexity of High-Dimensional Bayesian Variable Selection

We study the computational complexity of Markov chain Monte Carlo (MCMC)...
research
03/27/2018

Regularization and Computation with high-dimensional spike-and-slab posterior distributions

We consider the Bayesian analysis of a high-dimensional statistical mode...
research
05/24/2022

Stereographic Markov Chain Monte Carlo

High dimensional distributions, especially those with heavy tails, are n...
research
11/14/2021

Fast Doubly-Adaptive MCMC to Estimate the Gibbs Partition Function with Weak Mixing Time Bounds

We present a novel method for reducing the computational complexity of r...
research
04/29/2020

On the convergence complexity of Gibbs samplers for a family of simple Bayesian random effects models

The emergence of big data has led to so-called convergence complexity an...
research
04/03/2023

Improved Bound for Mixing Time of Parallel Tempering

In the field of sampling algorithms, MCMC (Markov Chain Monte Carlo) met...
research
08/02/2016

Fast Mixing Markov Chains for Strongly Rayleigh Measures, DPPs, and Constrained Sampling

We study probability measures induced by set functions with constraints....

Please sign up or login with your details

Forgot password? Click here to reset