Metropolis-Hastings via Classification

03/06/2021
by   Tetsuya Kaji, et al.
0

This paper develops a Bayesian computational platform at the interface between posterior sampling and optimization in models whose marginal likelihoods are difficult to evaluate. Inspired by adversarial optimization, namely Generative Adversarial Networks (GAN), we reframe the likelihood function estimation problem as a classification problem. Pitting a Generator, who simulates fake data, against a Classifier, who tries to distinguish them from the real data, one obtains likelihood (ratio) estimators which can be plugged into the Metropolis-Hastings algorithm. The resulting Markov chains generate, at a steady state, samples from an approximate posterior whose asymptotic properties we characterize. Drawing upon connections with empirical Bayes and Bayesian mis-specification, we quantify the convergence rate in terms of the contraction speed of the actual posterior and the convergence rate of the Classifier. Asymptotic normality results are also provided which justify inferential potential of our approach. We illustrate the usefulness of our approach on examples which have posed a challenge for existing Bayesian likelihood-free approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/25/2022

Adversarial Bayesian Simulation

In the absence of explicit or tractable likelihoods, Bayesians often res...
research
06/01/2022

Asymptotic Properties for Bayesian Neural Network in Besov Space

Neural networks have shown great predictive power when dealing with vari...
research
06/11/2019

Asymptotic Guarantees for Learning Generative Models with the Sliced-Wasserstein Distance

Minimum expected distance estimation (MEDE) algorithms have been widely ...
research
02/07/2022

Rates of convergence for nonparametric estimation of singular distributions using generative adversarial networks

We consider generative adversarial networks (GAN) for estimating paramet...
research
11/22/2021

Approximate Bayesian Computation via Classification

Approximate Bayesian Computation (ABC) enables statistical inference in ...
research
07/01/2020

Bayesian Coresets: An Optimization Perspective

Bayesian coresets have emerged as a promising approach for implementing ...
research
05/11/2021

Factoring Multidimensional Data to Create a Sophisticated Bayes Classifier

In this paper we derive an explicit formula for calculating the marginal...

Please sign up or login with your details

Forgot password? Click here to reset