The variational Laplace approach to approximate Bayesian inference

03/02/2017
by   Jean Daunizeau, et al.
0

Variational approaches to approximate Bayesian inference provide very efficient means of performing parameter estimation and model selection. Among these, so-called variational-Laplace or VL schemes rely on Gaussian approximations to posterior densities on model parameters. In this note, we review the main variants of VL approaches, that follow from considering nonlinear models of continuous and/or categorical data. En passant, we also derive a few novel theoretical results that complete the portfolio of existing analyses of variational Bayesian approaches, including investigations of their asymptotic convergence. We also suggest practical ways of extending existing VL approaches to hierarchical generative models that include (e.g., precision) hyperparameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/15/2019

Mixed Variational Inference

The Laplace approximation has been one of the workhorses of Bayesian inf...
research
07/03/2020

The FMRIB Variational Bayesian Inference Tutorial II: Stochastic Variational Bayes

Bayesian methods have proved powerful in many applications for the infer...
research
06/06/2019

Amortized Inference of Variational Bounds for Learning Noisy-OR

Classical approaches for approximate inference depend on cleverly design...
research
04/15/2019

Approximate Bayesian Inference via Sparse grid Quadrature Evaluation for Hierarchical Models

We combine conditioning techniques with sparse grid quadrature rules to ...
research
02/06/2016

A Tractable Fully Bayesian Method for the Stochastic Block Model

The stochastic block model (SBM) is a generative model revealing macrosc...
research
06/08/2020

A Variational View on Bootstrap Ensembles as Bayesian Inference

In this paper, we employ variational arguments to establish a connection...
research
01/08/2023

Skewed Bernstein-von Mises theorem and skew-modal approximations

Deterministic Gaussian approximations of intractable posterior distribut...

Please sign up or login with your details

Forgot password? Click here to reset