Direct Optimization through for Discrete Variational Auto-Encoder

06/07/2018
by   Guy Lorberbom, et al.
0

Reparameterization of variational auto-encoders with continuous latent spaces is an effective method for reducing the variance of their gradient estimates. However, using the same approach when latent variables are discrete is problematic, due to the resulting non-differentiable objective. In this work, we present a direct optimization method that propagates gradients through a non-differentiable prediction operation. We apply this method to discrete variational auto-encoders, by modeling a discrete random variable by the function of the Gumbel-Max perturbation model.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset