GMM-Based Generative Adversarial Encoder Learning

12/08/2020
by   Yuri Feigin, et al.
0

While GAN is a powerful model for generating images, its inability to infer a latent space directly limits its use in applications requiring an encoder. Our paper presents a simple architectural setup that combines the generative capabilities of GAN with an encoder. We accomplish this by combining the encoder with the discriminator using shared weights, then training them simultaneously using a new loss term. We model the output of the encoder latent space via a GMM, which leads to both good clustering using this latent space and improved image generation by the GAN. Our framework is generic and can be easily plugged into any GAN strategy. In particular, we demonstrate it both with Vanilla GAN and Wasserstein GAN, where in both it leads to an improvement in the generated images in terms of both the IS and FID scores. Moreover, we show that our encoder learns a meaningful representation as its clustering results are competitive with the current GAN-based state-of-the-art in clustering.

READ FULL TEXT

page 14

page 18

page 20

page 24

page 25

page 27

page 28

page 29

research
07/17/2018

Generative adversarial interpolative autoencoding: adversarial training on latent space interpolations encourage convex latent distributions

We present a neural network architecture based upon the Autoencoder (AE)...
research
03/24/2018

Comparing Generative Adversarial Network Techniques for Image Creation and Modification

Generative adversarial networks (GANs) have demonstrated to be successfu...
research
05/16/2019

Non-Parametric Priors For Generative Adversarial Networks

The advent of generative adversarial networks (GAN) has enabled new capa...
research
02/18/2020

LocoGAN – Locally Convolutional GAN

In the paper we construct a fully convolutional GAN model: LocoGAN, whic...
research
10/24/2019

Speaker diarization using latent space clustering in generative adversarial network

In this work, we propose deep latent space clustering for speaker diariz...
research
08/21/2020

MPCC: Matching Priors and Conditionals for Clustering

Clustering is a fundamental task in unsupervised learning that depends h...
research
05/06/2020

Generating Memorable Images Based on Human Visual Memory Schemas

This research study proposes using Generative Adversarial Networks (GAN)...

Please sign up or login with your details

Forgot password? Click here to reset