Attention-Aware Face Hallucination via Deep Reinforcement Learning

by   Qingxing Cao, et al.

Face hallucination is a domain-specific super-resolution problem with the goal to generate high-resolution (HR) faces from low-resolution (LR) input images. In contrast to existing methods that often learn a single patch-to-patch mapping from LR to HR images and are regardless of the contextual interdependency between patches, we propose a novel Attention-aware Face Hallucination (Attention-FH) framework which resorts to deep reinforcement learning for sequentially discovering attended patches and then performing the facial part enhancement by fully exploiting the global interdependency of the image. Specifically, in each time step, the recurrent policy network is proposed to dynamically specify a new attended region by incorporating what happened in the past. The state (i.e., face hallucination result for the whole image) can thus be exploited and updated by the local enhancement network on the selected region. The Attention-FH approach jointly learns the recurrent policy network and local enhancement network through maximizing the long-term reward that reflects the hallucination performance over the whole image. Therefore, our proposed Attention-FH is capable of adaptively personalizing an optimal searching path for each face image according to its own characteristic. Extensive experiments show our approach significantly surpasses the state-of-the-arts on in-the-wild faces with large pose and illumination variations.


page 2

page 4

page 6

page 8


Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

Face hallucination is a domain-specific super-resolution problem that ai...

Joint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement

We address the problem of restoring a high-resolution face image from a ...

Global-Local Face Upsampling Network

Face hallucination, which is the task of generating a high-resolution fa...

Identity-Preserving Pose-Robust Face Hallucination Through Face Subspace Prior

Over the past few decades, numerous attempts have been made to address t...

Context-Patch Face Hallucination Based on Thresholding Locality-constrained Representation and Reproducing Learning

Face hallucination is a technique that reconstruct high-resolution (HR) ...

Face Hallucination Using Split-Attention in Split-Attention Network

Face hallucination is a domain-specific super-resolution (SR), that gene...

Learning from Longitudinal Face Demonstration - Where Tractable Deep Modeling Meets Inverse Reinforcement Learning

This paper presents a novel Generative Probabilistic Modeling under an I...

Please sign up or login with your details

Forgot password? Click here to reset