Solving the Poisson equation using coupled Markov chains

06/12/2022
by   Randal Douc, et al.
0

This article draws connections between unbiased estimators constructed from coupled Markov chains that meet exactly after a random number of iterations, and solutions of the Poisson equation. We first show how such pairs of chains can be employed to obtain unbiased estimators of pointwise evaluations of solutions of the Poisson equation. We then propose new estimators of the asymptotic variance of Markov chain ergodic averages. We formally study the proposed estimators under realistic assumptions on the meeting times of the coupled chains and on the existence of moments of test functions under the target distribution. We illustrate their behaviour in toy examples and in a more challenging setting of high-dimensional Bayesian regression.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/11/2017

Unbiased Markov chain Monte Carlo with couplings

Markov chain Monte Carlo (MCMC) methods provide consistent approximation...
research
03/04/2022

Variance Reduction for Metropolis-Hastings Samplers

We introduce a general framework that constructs estimators with reduced...
research
11/13/2017

Circularly-Coupled Markov Chain Sampling

I show how to run an N-time-step Markov chain simulation in a circular f...
research
08/14/2023

Perfect simulation from unbiased simulation

We show that any application of the technique of unbiased simulation bec...
research
12/04/2022

Coupled Bootstrap Test Error Estimation for Poisson Variables

Test error estimation is a fundamental problem in statistics and machine...
research
09/01/2017

Unbiased Hamiltonian Monte Carlo with couplings

We propose a coupling approach to parallelize Hamiltonian Monte Carlo es...
research
03/10/2019

Extreme events of higher-order Markov chains: hidden tail chains and extremal Yule-Walker equations

We derive some key extremal features for kth order Markov chains, which ...

Please sign up or login with your details

Forgot password? Click here to reset