Progressive Semantic-Aware Style Transformation for Blind Face Restoration

by   Chaofeng Chen, et al.

Face restoration is important in face image processing, and has been widely studied in recent years. However, previous works often fail to generate plausible high quality (HQ) results for real-world low quality (LQ) face images. In this paper, we propose a new progressive semantic-aware style transformation framework, named PSFR-GAN, for face restoration. Specifically, instead of using an encoder-decoder framework as previous methods, we formulate the restoration of LQ face images as a multi-scale progressive restoration procedure through semantic-aware style transformation. Given a pair of LQ face image and its corresponding parsing map, we first generate a multi-scale pyramid of the inputs, and then progressively modulate different scale features from coarse-to-fine in a semantic-aware style transfer way. Compared with previous networks, the proposed PSFR-GAN makes full use of the semantic (parsing maps) and pixel (LQ images) space information from different scales of input pairs. In addition, we further introduce a semantic aware style loss which calculates the feature style loss for each semantic region individually to improve the details of face textures. Finally, we pretrain a face parsing network which can generate decent parsing maps from real-world LQ face images. Experiment results show that our model trained with synthetic data can not only produce more realistic high-resolution results for synthetic LQ inputs and but also generalize better to natural LQ face images compared with state-of-the-art methods. Codes are available at


page 1

page 3

page 4

page 5

page 6

page 7


Blind Face Restoration via Deep Multi-scale Component Dictionaries

Recent reference-based face restoration methods have received considerab...

Semantic-Aware Latent Space Exploration for Face Image Restoration

For image restoration, most existing deep learning based methods tend to...

GAN Prior Embedded Network for Blind Face Restoration in the Wild

Blind face restoration (BFR) from severely degraded face images in the w...

SAPNet: Segmentation-Aware Progressive Network for Perceptual Contrastive Deraining

Deep learning algorithms have recently achieved promising deraining perf...

Multi-Scale Face Restoration with Sequential Gating Ensemble Network

Restoring face images from distortions is important in face recognition ...

Sequential Gating Ensemble Network for Noise Robust Multi-Scale Face Restoration

Face restoration from low resolution and noise is important for applicat...

3D Face Parsing via Surface Parameterization and 2D Semantic Segmentation Network

Face parsing assigns pixel-wise semantic labels as the face representati...

Please sign up or login with your details

Forgot password? Click here to reset