DeepAI AI Chat
Log In Sign Up

SiGAN: Siamese Generative Adversarial Network for Identity-Preserving Face Hallucination

07/22/2018
by   Chih-Chung Hsu, et al.
National Institute of Informatics
National Tsing Hua University
1, Shuefu Road, Neipu, Pingtung 91201, TAIWAN
0

Despite generative adversarial networks (GANs) can hallucinate photo-realistic high-resolution (HR) faces from low-resolution (LR) faces, they cannot guarantee preserving the identities of hallucinated HR faces, making the HR faces poorly recognizable. To address this problem, we propose a Siamese GAN (SiGAN) to reconstruct HR faces that visually resemble their corresponding identities. On top of a Siamese network, the proposed SiGAN consists of a pair of two identical generators and one discriminator. We incorporate reconstruction error and identity label information in the loss function of SiGAN in a pairwise manner. By iteratively optimizing the loss functions of the generator pair and discriminator of SiGAN, we cannot only achieve photo-realistic face reconstruction, but also ensures the reconstructed information is useful for identity recognition. Experimental results demonstrate that SiGAN significantly outperforms existing face hallucination GANs in objective face verification performance, while achieving photo-realistic reconstruction. Moreover, for input LR faces from unknown identities who are not included in training, SiGAN can still do a good job.

READ FULL TEXT

page 1

page 8

page 9

page 10

06/10/2017

Generate Identity-Preserving Faces by Generative Adversarial Networks

Generating identity-preserving faces aims to generate various face image...
05/22/2017

Semantically Decomposing the Latent Spaces of Generative Adversarial Networks

We propose a new algorithm for training generative adversarial networks ...
11/25/2018

WarpGAN: Automatic Caricature Generation

We propose, WarpGAN, a fully automatic network that can generate caricat...
12/07/2020

SuperFront: From Low-resolution to High-resolution Frontal Face Synthesis

Advances in face rotation, along with other face-based generative tasks,...
05/27/2022

Face Morphing: Fooling a Face Recognition System Is Simple!

State-of-the-art face recognition (FR) approaches have shown remarkable ...
10/21/2021

PROVES: Establishing Image Provenance using Semantic Signatures

Modern AI tools, such as generative adversarial networks, have transform...
05/16/2019

Learning Robust 3D Face Reconstruction and Discriminative Identity Representation

3D face reconstruction from a single 2D image is a very important topic ...