Approximate Bayesian Computation via Classification

11/22/2021
by   Yuexi Wang, et al.
0

Approximate Bayesian Computation (ABC) enables statistical inference in complex models whose likelihoods are difficult to calculate but easy to simulate from. ABC constructs a kernel-type approximation to the posterior distribution through an accept/reject mechanism which compares summary statistics of real and simulated data. To obviate the need for summary statistics, we directly compare empirical distributions with a Kullback-Leibler (KL) divergence estimator obtained via classification. In particular, we blend flexible machine learning classifiers within ABC to automate fake/real data comparisons. We consider the traditional accept/reject kernel as well as an exponential weighting scheme which does not require the ABC acceptance threshold. Our theoretical results show that the rate at which our ABC posterior distributions concentrate around the true parameter depends on the estimation error of the classifier. We derive limiting posterior shape results and find that, with a properly scaled exponential kernel, asymptotic normality holds. We demonstrate the usefulness of our approach on simulated examples as well as real data in the context of stock volatility estimation.

READ FULL TEXT

page 21

page 34

research
03/30/2015

A Parzen-based distance between probability measures as an alternative of summary statistics in Approximate Bayesian Computation

Approximate Bayesian Computation (ABC) are likelihood-free Monte Carlo m...
research
10/28/2019

Approximate Bayesian Computation with the Sliced-Wasserstein Distance

Approximate Bayesian Computation (ABC) is a popular method for approxima...
research
02/15/2016

DR-ABC: Approximate Bayesian Computation with Kernel-Based Distribution Regression

Performing exact posterior inference in complex generative models is oft...
research
02/09/2015

K2-ABC: Approximate Bayesian Computation with Kernel Embeddings

Complicated generative models often result in a situation where computin...
research
01/28/2022

Learning Summary Statistics for Bayesian Inference with Autoencoders

For stochastic models with intractable likelihood functions, approximate...
research
03/06/2021

Metropolis-Hastings via Classification

This paper develops a Bayesian computational platform at the interface b...
research
03/27/2018

Stein Points

An important task in computational statistics and machine learning is to...

Please sign up or login with your details

Forgot password? Click here to reset