Exemplar Guided Face Image Super-Resolution without Facial Landmarks

by   Berk Dogan, et al.
ETH Zurich

Nowadays, due to the ubiquitous visual media there are vast amounts of already available high-resolution (HR) face images. Therefore, for super-resolving a given very low-resolution (LR) face image of a person it is very likely to find another HR face image of the same person which can be used to guide the process. In this paper, we propose a convolutional neural network (CNN)-based solution, namely GWAInet, which applies super-resolution (SR) by a factor 8x on face images guided by another unconstrained HR face image of the same person with possible differences in age, expression, pose or size. GWAInet is trained in an adversarial generative manner to produce the desired high quality perceptual image results. The utilization of the HR guiding image is realized via the use of a warper subnetwork that aligns its contents to the input image and the use of a feature fusion chain for the extracted features from the warped guiding image and the input image. In training, the identity loss further helps in preserving the identity related features by minimizing the distance between the embedding vectors of SR and HR ground truth images. Contrary to the current state-of-the-art in face super-resolution, our method does not require facial landmark points for its training, which helps its robustness and allows it to produce fine details also for the surrounding face region in a uniform manner. Our method GWAInet produces photo-realistic images in upscaling factor 8x and outperforms state-of-the-art in quantitative terms and perceptual quality.


page 1

page 3

page 6

page 7

page 8


Progressive Face Super-Resolution via Attention to Facial Landmark

Face Super-Resolution (SR) is a subfield of the SR domain that specifica...

GCFSR: a Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors

Face image super resolution (face hallucination) usually relies on facia...

Learning Warped Guidance for Blind Face Restoration

This paper studies the problem of blind face restoration from an unconst...

Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement

We introduce a highly robust GAN-based framework for digitizing a normal...

Joint Face Super-Resolution and Deblurring Using a Generative Adversarial Network

Facial image super-resolution (SR) is an important preprocessing for fac...

Effectiveness of State-of-the-Art Super Resolution Algorithms in Surveillance Environment

Image Super Resolution (SR) finds applications in areas where images nee...

Facial Attribute Capsules for Noise Face Super Resolution

Existing face super-resolution (SR) methods mainly assume the input imag...

Please sign up or login with your details

Forgot password? Click here to reset