Learning to Generate Samples from Noise through Infusion Training

03/20/2017
by   Florian Bordes, et al.
0

In this work, we investigate a novel training procedure to learn a generative model as the transition operator of a Markov chain, such that, when applied repeatedly on an unstructured random noise sample, it will denoise it into a sample that matches the target distribution from the training set. The novel training procedure to learn this progressive denoising operation involves sampling from a slightly different chain than the model chain used for generation in the absence of a denoising target. In the training chain we infuse information from the training target example that we would like the chains to reach with a high probability. The thus learned transition operator is able to produce quality and varied samples in a small number of steps. Experiments show competitive results compared to the samples generated with a basic Generative Adversarial Net

READ FULL TEXT

page 3

page 5

page 10

page 11

page 16

page 17

page 18

page 19

research
12/22/2014

Generative Class-conditional Autoencoders

Recent work by Bengio et al. (2013) proposes a sampling procedure for de...
research
10/28/2016

Improving Sampling from Generative Autoencoders with Markov Chains

We focus on generative autoencoders, such as variational or adversarial ...
research
03/06/2021

Learning to Generate 3D Shapes with Generative Cellular Automata

We present a probabilistic 3D generative model, named Generative Cellula...
research
11/07/2017

Variational Walkback: Learning a Transition Operator as a Stochastic Recurrent Net

We propose a novel method to directly learn a stochastic transition oper...
research
03/18/2015

GSNs : Generative Stochastic Networks

We introduce a novel training principle for probabilistic models that is...
research
03/09/2023

Learning Stationary Markov Processes with Contrastive Adjustment

We introduce a new optimization algorithm, termed contrastive adjustment...
research
07/18/2019

Discrete Object Generation with Reversible Inductive Construction

The success of generative modeling in continuous domains has led to a su...

Please sign up or login with your details

Forgot password? Click here to reset