Wasserstein Auto-Encoders

by   Ilya Tolstikhin, et al.

We propose the Wasserstein Auto-Encoder (WAE)---a new algorithm for building a generative model of the data distribution. WAE minimizes a penalized form of the Wasserstein distance between the model distribution and the target distribution, which leads to a different regularizer than the one used by the Variational Auto-Encoder (VAE). This regularizer encourages the encoded training distribution to match the prior. We compare our algorithm with several other techniques and show that it is a generalization of adversarial auto-encoders (AAE). Our experiments show that WAE shares many of the properties of VAEs (stable training, encoder-decoder architecture, nice latent manifold structure) while generating samples of better quality, as measured by the FID score.


page 3

page 7

page 8


Tessellated Wasserstein Auto-Encoders

Non-adversarial generative models such as variational auto-encoder (VAE)...

Wasserstein-Wasserstein Auto-Encoders

To address the challenges in learning deep generative models (e.g.,the b...

Gaussian Auto-Encoder

Evaluating distance between sample distribution and the wanted one, usua...

Variational Diffusion Auto-encoder: Deep Latent Variable Model with Unconditional Diffusion Prior

Variational auto-encoders (VAEs) are one of the most popular approaches ...

Variational auto-encoders with Student's t-prior

We propose a new structure for the variational auto-encoders (VAEs) prio...

Vector Quantized Wasserstein Auto-Encoder

Learning deep discrete latent presentations offers a promise of better s...

Modeling the Biological Pathology Continuum with HSIC-regularized Wasserstein Auto-encoders

A crucial challenge in image-based modeling of biomedical data is to ide...

Please sign up or login with your details

Forgot password? Click here to reset