Unbiased Implicit Variational Inference

08/06/2018
by   Michalis K. Titsias, et al.
0

We develop unbiased implicit variational inference (UIVI), a method that expands the applicability of variational inference by defining an expressive variational family. UIVI considers an implicit variational distribution obtained in a hierarchical manner using a simple reparameterizable distribution whose variational parameters are defined by arbitrarily flexible deep neural networks. Unlike previous works, UIVI directly optimizes the evidence lower bound (ELBO) rather than an approximation to the ELBO. We demonstrate UIVI on several models, including Bayesian multinomial logistic regression and variational autoencoders, and show that UIVI achieves both tighter ELBO and better predictive performance than existing approaches at a similar computational cost.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/05/2018

Doubly Semi-Implicit Variational Inference

We extend the existing framework of semi-implicit variational inference ...
02/28/2017

Hierarchical Implicit Models and Likelihood-Free Variational Inference

Implicit probabilistic models are a flexible class of models defined by ...
06/23/2020

Variational Orthogonal Features

Sparse stochastic variational inference allows Gaussian process models t...
11/03/2017

Implicit Weight Uncertainty in Neural Networks

We interpret HyperNetworks within the framework of variational inference...
04/18/2019

Design of Communication Systems using Deep Learning: A Variational Inference Perspective

An approach to design end to end communication system using deep learnin...
06/18/2012

Nonparametric variational inference

Variational methods are widely used for approximate posterior inference....
06/07/2018

A Spectral Approach to Gradient Estimation for Implicit Distributions

Recently there have been increasing interests in learning and inference ...

Please sign up or login with your details

Forgot password? Click here to reset