Learning Discrete Structured Variational Auto-Encoder using Natural Evolution Strategies

by   Alon Berliner, et al.

Discrete variational auto-encoders (VAEs) are able to represent semantic latent spaces in generative learning. In many real-life settings, the discrete latent space consists of high-dimensional structures, and propagating gradients through the relevant structures often requires enumerating over an exponentially large latent space. Recently, various approaches were devised to propagate approximated gradients without enumerating over the space of possible structures. In this work, we use Natural Evolution Strategies (NES), a class of gradient-free black-box optimization algorithms, to learn discrete structured VAEs. The NES algorithms are computationally appealing as they estimate gradients with forward pass evaluations only, thus they do not require to propagate gradients through their discrete structures. We demonstrate empirically that optimizing discrete structured VAEs using NES is as effective as gradient-based approximations. Lastly, we prove NES converges for non-Lipschitz functions as appear in discrete structured VAEs.


page 1

page 2

page 3

page 4


Direct Optimization through for Discrete Variational Auto-Encoder

Reparameterization of variational auto-encoders with continuous latent s...

Local Latent Space Bayesian Optimization over Structured Inputs

Bayesian optimization over the latent spaces of deep autoencoder models ...

Discrete Auto-regressive Variational Attention Models for Text Modeling

Variational autoencoders (VAEs) have been widely applied for text modeli...

Chart Auto-Encoders for Manifold Structured Data

Auto-encoding and generative models have made tremendous successes in im...

Natural Evolutionary Strategies for Variational Quantum Computation

Natural evolutionary strategies (NES) are a family of gradient-free blac...

Gradient-Informed Quality Diversity for the Illumination of Discrete Spaces

Quality Diversity (QD) algorithms have been proposed to search for a lar...

Improving black-box optimization in VAE latent space using decoder uncertainty

Optimization in the latent space of variational autoencoders is a promis...

Please sign up or login with your details

Forgot password? Click here to reset