Concave-Convex PDMP-based sampling

12/24/2021
by   Matthew Sutton, et al.
0

Recently non-reversible samplers based on simulating piecewise deterministic Markov processes (PDMPs) have shown potential for efficient sampling in Bayesian inference problems. However, there remains a lack of guidance on how to best implement these algorithms. If implemented poorly, the computational costs of simulating event times can out-weigh the statistical efficiency of the non-reversible dynamics. Drawing on the adaptive rejection literature, we propose the concave-convex adaptive thinning approach for simulating a piecewise deterministic Markov process (CC-PDMP). This approach provides a general guide for constructing bounds that may be used to facilitate PDMP-based sampling. A key advantage of this method is its additive structure - adding concave-convex decompositions yields a concave-convex decomposition. This facilitates swapping priors, simple implementation and computationally efficient thinning. In particular, our approach is well suited to local PDMP simulation where known conditional independence of the target can be exploited for potentially huge computational gains. We provide an R package for implementing the CC-PDMP approach and illustrate how our method outperforms existing approaches to simulating events in the PDMP literature.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/30/2021

Non-reversible processes: GENERIC, Hypocoercivity and fluctuations

We consider two approaches to study non-reversible Markov processes, nam...
research
02/18/2022

Efficient computation of the volume of a polytope in high-dimensions using Piecewise Deterministic Markov Processes

Computing the volume of a polytope in high dimensions is computationally...
research
02/17/2023

Piecewise Deterministic Markov Processes for Bayesian Neural Networks

Inference on modern Bayesian Neural Networks (BNNs) often relies on a va...
research
07/24/2019

New frontiers in Bayesian modeling using the INLA package in R

The INLA package provides a tool for computationally efficient Bayesian ...
research
05/08/2019

Non-Reversible Parallel Tempering: an Embarassingly Parallel MCMC Scheme

Parallel tempering (PT) methods are a popular class of Markov chain Mont...
research
03/15/2021

Sticky PDMP samplers for sparse and local inference problems

We construct a new class of efficient Monte Carlo methods based on conti...
research
04/04/2022

Scalable random number generation for truncated log-concave distributions

Inverse transform sampling is an exceptionally general method to generat...

Please sign up or login with your details

Forgot password? Click here to reset