A-NICE-MC: Adversarial Training for MCMC

by   Jiaming Song, et al.
Stanford University

Existing Markov Chain Monte Carlo (MCMC) methods are either based on general-purpose and domain-agnostic schemes which can lead to slow convergence, or hand-crafting of problem-specific proposals by an expert. We propose A-NICE-MC, a novel method to train flexible parametric Markov chain kernels to produce samples with desired properties. First, we propose an efficient likelihood-free adversarial training method to train a Markov chain and mimic a given data distribution. Then, we leverage flexible volume preserving flows to obtain parametric kernels for MCMC. Using a bootstrap approach, we show how to train efficient Markov chains to sample from a prescribed posterior distribution by iteratively improving the quality of both the model and the samples. A-NICE-MC provides the first framework to automatically design efficient domain-specific MCMC proposals. Empirical results demonstrate that A-NICE-MC combines the strong guarantees of MCMC with the expressiveness of deep neural networks, and is able to significantly outperform competing methods such as Hamiltonian Monte Carlo.


page 3

page 7

page 17

page 18

page 19


A Differential Evaluation Markov Chain Monte Carlo algorithm for Bayesian Model Updating

The use of the Bayesian tools in system identification and model updatin...

Metropolis Sampling

Monte Carlo (MC) sampling methods are widely applied in Bayesian inferen...

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring hi...

A Survey of Monte Carlo Methods for Parameter Estimation

Statistical signal processing applications usually require the estimatio...

Generative Flow Networks: a Markov Chain Perspective

While Markov chain Monte Carlo methods (MCMC) provide a general framewor...

Mental Sampling in Multimodal Representations

Both resources in the natural environment and concepts in a semantic spa...

Adversarial purification with Score-based generative models

While adversarial training is considered as a standard defense method ag...

Code Repositories


Code for "A-NICE-MC: Adversarial Training for MCMC"

view repo

Please sign up or login with your details

Forgot password? Click here to reset