Learning Implicit Generative Models by Matching Perceptual Features

Perceptual features (PFs) have been used with great success in tasks such as transfer learning, style transfer, and super-resolution. However, the efficacy of PFs as key source of information for learning generative models is not well studied. We investigate here the use of PFs in the context of learning implicit generative models through moment matching (MM). More specifically, we propose a new effective MM approach that learns implicit generative models by performing mean and covariance matching of features extracted from pretrained ConvNets. Our proposed approach improves upon existing MM methods by: (1) breaking away from the problematic min/max game of adversarial learning; (2) avoiding online learning of kernel functions; and (3) being efficient with respect to both number of used moments and required minibatch size. Our experimental results demonstrate that, due to the expressiveness of PFs from pretrained deep ConvNets, our method achieves state-of-the-art results for challenging benchmarks.

READ FULL TEXT

page 6

page 7

page 14

page 15

page 16

research
05/07/2020

Learning Implicit Text Generation via Feature Matching

Generative feature matching network (GFMN) is an approach for training i...
research
08/12/2019

Super-resolution of Omnidirectional Images Using Adversarial Learning

An omnidirectional image (ODI) enables viewers to look in every directio...
research
03/10/2023

Feature Unlearning for Generative Models via Implicit Feedback

We tackle the problem of feature unlearning from a pretrained image gene...
research
07/10/2018

Learning Implicit Generative Models by Teaching Explicit Ones

Implicit generative models are difficult to train as no explicit probabi...
research
07/31/2018

The Unreasonable Effectiveness of Texture Transfer for Single Image Super-resolution

While implicit generative models such as GANs have shown impressive resu...
research
02/08/2023

A Systematic Performance Analysis of Deep Perceptual Loss Networks Breaks Transfer Learning Conventions

Deep perceptual loss is a type of loss function in computer vision that ...
research
06/28/2018

Learning Implicit Generative Models with the Method of Learned Moments

We propose a method of moments (MoM) algorithm for training large-scale ...

Please sign up or login with your details

Forgot password? Click here to reset