Generative Models as Distributions of Functions

02/09/2021
by   Emilien Dupont, et al.
0

Generative models are typically trained on grid-like data such as images. As a result, the size of these models usually scales directly with the underlying grid resolution. In this paper, we abandon discretized grids and instead parameterize individual data points by continuous functions. We then build generative models by learning distributions over such functions. By treating data points as functions, we can abstract away from the specific type of data we train on and construct models that scale independently of signal resolution and dimension. To train our model, we use an adversarial approach with a discriminator that acts directly on continuous signals. Through experiments on both images and 3D shapes, we demonstrate that our model can learn rich distributions of functions independently of data type and resolution.

READ FULL TEXT

page 2

page 6

page 7

page 8

page 14

page 15

page 20

page 21

research
10/31/2017

Flexible Prior Distributions for Deep Generative Models

We consider the problem of training generative models with deep neural n...
research
07/28/2017

Generator Reversal

We consider the problem of training generative models with deep neural n...
research
06/27/2019

Curriculum Learning for Deep Generative Models with Clustering

Training generative models like generative adversarial networks (GANs) a...
research
10/26/2020

Wavelet Flow: Fast Training of High Resolution Normalizing Flows

Normalizing flows are a class of probabilistic generative models which a...
research
02/13/2023

Variational Mixture of HyperGenerators for Learning Distributions Over Functions

Recent approaches build on implicit neural representations (INRs) to pro...
research
01/28/2022

From data to functa: Your data point is a function and you should treat it like one

It is common practice in deep learning to represent a measurement of the...
research
07/29/2023

Fingerprints of Generative Models in the Frequency Domain

It is verified in existing works that CNN-based generative models leave ...

Please sign up or login with your details

Forgot password? Click here to reset