Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

04/14/2019
by   Jie Cao, et al.
0

Despite that the performance of image-to-image translation has been significantly improved by recent progress in generative models, current methods still suffer from severe degradation in training stability and sample quality when applied to the high-resolution situation. In this work, we present a novel training framework for GANs, namely biphasic learning, to achieve image-to-image translation in multiple visual domains at 1024^2 resolution. Our core idea is to design an adjustable objective function that varies across training phases. Within the biphasic learning framework, we propose a novel inherited adversarial loss to achieve the enhancement of model capacity and stabilize the training phase transition. Furthermore, we introduce a perceptual-level consistency loss through mutual information estimation and maximization. To verify the superiority of the proposed method, we apply it to a wide range of face-related synthesis tasks and conduct experiments on multiple large-scale datasets. Through comprehensive quantitative analyses, we demonstrate that our method significantly outperforms existing methods.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
08/08/2020

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

In this paper, we present a novel framework that can achieve multimodal ...
research
05/10/2021

Enhancing Photorealism Enhancement

We present an approach to enhancing the realism of synthetic images. The...
research
01/05/2020

Informative Sample Mining Network for Multi-Domain Image-to-Image Translation

The performance of multi-domain image-to-image translation has been sign...
research
02/07/2019

Reversible GANs for Memory-efficient Image-to-Image Translation

The Pix2pix and CycleGAN losses have vastly improved the qualitative and...
research
02/25/2019

Harmonizing Maximum Likelihood with GANs for Multimodal Conditional Generation

Recent advances in conditional image generation tasks, such as image-to-...
research
03/15/2019

Quality-aware Unpaired Image-to-Image Translation

Generative Adversarial Networks (GANs) have been widely used for the ima...
research
04/18/2019

A Novel BiLevel Paradigm for Image-to-Image Translation

Image-to-image (I2I) translation is a pixel-level mapping that requires ...

Please sign up or login with your details

Forgot password? Click here to reset