Local Expectation Gradients for Doubly Stochastic Variational Inference

by   Michalis K. Titsias, et al.

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients through sampling from the variational distribution. This algorithm divides the problem of estimating the stochastic gradients over multiple variational parameters into smaller sub-tasks so that each sub-task exploits intelligently the information coming from the most relevant part of the variational distribution. This is achieved by performing an exact expectation over the single random variable that mostly correlates with the variational parameter of interest resulting in a Rao-Blackwellized estimate that has low variance and can work efficiently for both continuous and discrete random variables. Furthermore, the proposed algorithm has interesting similarities with Gibbs sampling but at the same time, unlike Gibbs sampling, it can be trivially parallelized.


page 12

page 14

page 15


Reparameterization Gradients through Acceptance-Rejection Sampling Algorithms

Variational inference using the reparameterization trick has enabled lar...

Differentiable Antithetic Sampling for Variance Reduction in Stochastic Variational Inference

Stochastic optimization techniques are standard in variational inference...

Perturbative estimation of stochastic gradients

In this paper we introduce a family of stochastic gradient estimation te...

Lifted Relational Variational Inference

Hybrid continuous-discrete models naturally represent many real-world ap...

Variational Inference for Shrinkage Priors: The R package vir

We present vir, an R package for variational inference with shrinkage pr...

Gibbs Sampling in Open-Universe Stochastic Languages

Languages for open-universe probabilistic models (OUPMs) can represent s...

Stochastic Backpropagation through Mixture Density Distributions

The ability to backpropagate stochastic gradients through continuous lat...

Code Repositories


Probabilistic programming for large datasets, via stochastic variational inference

view repo

Please sign up or login with your details

Forgot password? Click here to reset