Semantic Encoder Guided Generative Adversarial Face Ultra-Resolution Network

by   Xiang Wang, et al.
The University of British Columbia

Face super-resolution is a domain-specific image super-resolution, which aims to generate High-Resolution (HR) face images from their Low-Resolution (LR) counterparts. In this paper, we propose a novel face super-resolution method, namely Semantic Encoder guided Generative Adversarial Face Ultra-Resolution Network (SEGA-FURN) to ultra-resolve an unaligned tiny LR face image to its HR counterpart with multiple ultra-upscaling factors (e.g., 4x and 8x). The proposed network is composed of a novel semantic encoder that has the ability to capture the embedded semantics to guide adversarial learning and a novel generator that uses a hierarchical architecture named Residual in Internal Dense Block (RIDB). Moreover, we propose a joint discriminator which discriminates both image data and embedded semantics. The joint discriminator learns the joint probability distribution of the image space and latent space. We also use a Relativistic average Least Squares loss (RaLS) as the adversarial loss to alleviate the gradient vanishing problem and enhance the stability of the training procedure. Extensive experiments on large face datasets have proved that the proposed method can achieve superior super-resolution results and significantly outperform other state-of-the-art methods in both qualitative and quantitative comparisons.


page 1

page 2

page 3

page 4

page 6

page 7

page 10


FCSR-GAN: Joint Face Completion and Super-resolution via Multi-task Learning

Combined variations containing low-resolution and occlusion often presen...

A Latent Encoder Coupled Generative Adversarial Network (LE-GAN) for Efficient Hyperspectral Image Super-resolution

Realistic hyperspectral image (HSI) super-resolution (SR) techniques aim...

High-Quality Face Image SR Using Conditional Generative Adversarial Networks

We propose a novel single face image super-resolution method, which name...

Super-Resolving Cross-Domain Face Miniatures by Peeking at One-Shot Exemplar

Conventional face super-resolution methods usually assume testing low-re...

Component Attention Guided Face Super-Resolution Network: CAGFace

To make the best use of the underlying structure of faces, the collectiv...

A Unified Framework to Super-Resolve Face Images of Varied Low Resolutions

The existing face image super-resolution (FSR) algorithms usually train ...

Please sign up or login with your details

Forgot password? Click here to reset