Robust Coordinate Ascent Variational Inference with Markov chain Monte Carlo simulations

03/23/2022
by   Neil Dey, et al.
0

Variational Inference (VI) is a method that approximates a difficult-to-compute posterior density using better behaved distributional families. VI is an alternative to the already well-studied Markov chain Monte Carlo (MCMC) method of approximating densities. With each algorithm, there are of course benefits and drawbacks; does there exist a combination of the two that mitigates the flaws of both? We propose a method to combine Coordinate Ascent Variational Inference (CAVI) with MCMC. This new methodology, termed Hybrid CAVI, seeks to improve the sensitivity to initialization and convergence problems of CAVI by proposing an initialization using method of moments estimates obtained from a short MCMC burn-in period. Unlike CAVI, Hybrid CAVI proves to also be effective when the posterior is not from a conditionally conjugate exponential family.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2020

MetFlow: A New Efficient Method for Bridging the Gap between Markov Chain Monte Carlo and Variational Inference

In this contribution, we propose a new computationally efficient method ...
research
02/06/2023

Prior Density Learning in Variational Bayesian Phylogenetic Parameters Inference

The advances in variational inference are providing promising paths in B...
research
06/01/2023

On the Convergence of Coordinate Ascent Variational Inference

As a computational alternative to Markov chain Monte Carlo approaches, v...
research
10/02/2020

MCMC-Interactive Variational Inference

Leveraging well-established MCMC strategies, we propose MCMC-interactive...
research
05/31/2022

Variational inference via Wasserstein gradient flows

Along with Markov chain Monte Carlo (MCMC) methods, variational inferenc...
research
01/04/2016

Variational Inference: A Review for Statisticians

One of the core problems of modern statistics is to approximate difficul...
research
03/05/2022

Recursive Monte Carlo and Variational Inference with Auxiliary Variables

A key challenge in applying Monte Carlo and variational inference (VI) i...

Please sign up or login with your details

Forgot password? Click here to reset