Path-Gradient Estimators for Continuous Normalizing Flows

06/17/2022
by   Lorenz Vaitl, et al.
0

Recent work has established a path-gradient estimator for simple variational Gaussian distributions and has argued that the path-gradient is particularly beneficial in the regime in which the variational distribution approaches the exact target distribution. In many applications, this regime can however not be reached by a simple Gaussian variational distribution. In this work, we overcome this crucial limitation by proposing a path-gradient estimator for the considerably more expressive variational family of continuous normalizing flows. We outline an efficient algorithm to calculate this estimator and establish its superior performance empirically.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/27/2017

Sticking the Landing: Simple, Lower-Variance Gradient Estimators for Variational Inference

We propose a simple and general variant of the standard reparameterized ...
research
07/17/2022

Gradients should stay on Path: Better Estimators of the Reverse- and Forward KL Divergence for Normalizing Flows

We propose an algorithm to estimate the path-gradient of both the revers...
research
12/24/2020

Variational Determinant Estimation with Spherical Normalizing Flows

This paper introduces the Variational Determinant Estimator (VDE), a var...
research
06/02/2021

A Differentiable Point Process with Its Application to Spiking Neural Networks

This paper is concerned about a learning algorithm for a probabilistic m...
research
09/11/2022

Adaptive Perturbation-Based Gradient Estimation for Discrete Latent Variable Models

The integration of discrete algorithmic components in deep learning arch...
research
03/11/2023

Variational Gaussian filtering via Wasserstein gradient flows

We present a novel approach to approximate Gaussian and mixture-of-Gauss...
research
09/20/2023

Stein Variational Guided Model Predictive Path Integral Control: Proposal and Experiments with Fast Maneuvering Vehicles

This paper presents a novel Stochastic Optimal Control (SOC) method base...

Please sign up or login with your details

Forgot password? Click here to reset