Rejection-free Ensemble MCMC with applications to Factorial Hidden Markov Models

by   Kaspar Märtens, et al.
University of Oxford
University of Birmingham
Athens University of Economics and Business

Bayesian inference for complex models is challenging due to the need to explore high-dimensional spaces and multimodality and standard Monte Carlo samplers can have difficulties effectively exploring the posterior. We introduce a general purpose rejection-free ensemble Markov Chain Monte Carlo (MCMC) technique to improve on existing poorly mixing samplers. This is achieved by combining parallel tempering and an auxiliary variable move to exchange information between the chains. We demonstrate this ensemble MCMC scheme on Bayesian inference in Factorial Hidden Markov Models. This high-dimensional inference problem is difficult due to the exponentially sized latent variable space. Existing sampling approaches mix slowly and can get trapped in local modes. We show that the performance of these samplers is improved by our rejection-free ensemble technique and that the method is attractive and "easy-to-use" since no parameter tuning is required.


page 9

page 11


Projected Latent Markov Chain Monte Carlo: Conditional Inference with Normalizing Flows

We introduce Projected Latent Markov Chain Monte Carlo (PL-MCMC), a tech...

A Nonparametric Bayesian Approach to Uncovering Rat Hippocampal Population Codes During Spatial Navigation

Rodent hippocampal population codes represent important spatial informat...

Improved Neuronal Ensemble Inference with Generative Model and MCMC

Neuronal ensemble inference is a significant problem in the study of bio...

Posterior-based proposals for speeding up Markov chain Monte Carlo

Markov chain Monte Carlo (MCMC) is widely used for Bayesian inference in...

Parallel tempering as a mechanism for facilitating inference in hierarchical hidden Markov models

The study of animal behavioural states inferred through hidden Markov mo...

Accelerated Inference for Latent Variable Models

Inference of latent feature models in the Bayesian nonparametric setting...

Efficient Bayesian model selection for coupled hidden Markov models with application to infectious diseases

Performing model selection for coupled hidden Markov models (CHMMs) is h...

Please sign up or login with your details

Forgot password? Click here to reset