Multimodal Image Outpainting With Regularized Normalized Diversification

10/25/2019
by   Lingzhi Zhang, et al.
29

In this paper, we study the problem of generating a set ofrealistic and diverse backgrounds when given only a smallforeground region. We refer to this task as image outpaint-ing. The technical challenge of this task is to synthesize notonly plausible but also diverse image outputs. Traditionalgenerative adversarial networks suffer from mode collapse.While recent approaches propose to maximize orpreserve the pairwise distance between generated sampleswith respect to their latent distance, they do not explicitlyprevent the diverse samples of different conditional inputsfrom collapsing. Therefore, we propose a new regulariza-tion method to encourage diverse sampling in conditionalsynthesis. In addition, we propose a feature pyramid dis-criminator to improve the image quality. Our experimen-tal results show that our model can produce more diverseimages without sacrificing visual quality compared to state-of-the-arts approaches in both the CelebA face dataset and the Cityscape scene dataset.

READ FULL TEXT

page 1

page 3

page 7

page 8

research
04/07/2019

Normalized Diversification

Generating diverse yet specific data is the goal of the generative adver...
research
03/14/2021

DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network

Conditional generative adversarial networks (cGANs) target at synthesizi...
research
03/11/2019

Pluralistic Image Completion

Most image completion methods produce only one result for each masked in...
research
03/13/2019

Mode Seeking Generative Adversarial Networks for Diverse Image Synthesis

Most conditional generation tasks expect diverse outputs given a single ...
research
10/21/2019

Learning to Make Generalizable and Diverse Predictions for Retrosynthesis

We propose a new model for making generalizable and diverse retrosynthet...
research
04/07/2020

Multimodal Image Synthesis with Conditional Implicit Maximum Likelihood Estimation

Many tasks in computer vision and graphics fall within the framework of ...
research
11/25/2020

How to train your conditional GAN: An approach using geometrically structured latent manifolds

Conditional generative modeling typically requires capturing one-to-many...

Please sign up or login with your details

Forgot password? Click here to reset