On Contrastive Learning for Likelihood-free Inference

02/10/2020
by   Conor Durkan, et al.
3

Likelihood-free methods perform parameter inference in stochastic simulator models where evaluating the likelihood is intractable but sampling synthetic data is possible. One class of methods for this likelihood-free problem uses a classifier to distinguish between pairs of parameter-observation samples generated using the simulator and pairs sampled from some reference distribution, which implicitly learns a density ratio proportional to the likelihood. Another popular class of methods fits a conditional distribution to the parameter posterior directly, and a particular recent variant allows for the use of flexible neural density estimators for this task. In this work, we show that both of these approaches can be unified under a general contrastive learning scheme, and clarify how they should be run and compared.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/20/2020

Score Matched Conditional Exponential Families for Likelihood-Free Inference

To perform Bayesian inference for stochastic simulator models for which ...
research
05/31/2022

Likelihood-Free Inference with Generative Neural Networks via Scoring Rule Minimization

Bayesian Likelihood-Free Inference methods yield posterior approximation...
research
12/09/2014

POPE: Post Optimization Posterior Evaluation of Likelihood Free Models

In many domains, scientists build complex simulators of natural phenomen...
research
04/29/2022

Statistical applications of contrastive learning

The likelihood function plays a crucial role in statistical inference an...
research
11/30/2018

Recurrent machines for likelihood-free inference

Likelihood-free inference is concerned with the estimation of the parame...
research
05/18/2018

Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows

We present Sequential Neural Likelihood (SNL), a new method for Bayesian...
research
11/27/2020

Simulation-efficient marginal posterior estimation with swyft: stop wasting your precious time

We present algorithms (a) for nested neural likelihood-to-evidence ratio...

Please sign up or login with your details

Forgot password? Click here to reset