RestoreFormer: High-Quality Blind Face Restoration From Undegraded Key-Value Pairs

by   Zhouxia Wang, et al.

Blind face restoration is to recover a high-quality face image from unknown degradations. As face image contains abundant contextual information, we propose a method, RestoreFormer, which explores fully-spatial attentions to model contextual information and surpasses existing works that use local operators. RestoreFormer has several benefits compared to prior arts. First, unlike the conventional multi-head self-attention in previous Vision Transformers (ViTs), RestoreFormer incorporates a multi-head cross-attention layer to learn fully-spatial interactions between corrupted queries and high-quality key-value pairs. Second, the key-value pairs in ResotreFormer are sampled from a reconstruction-oriented high-quality dictionary, whose elements are rich in high-quality facial features specifically aimed for face reconstruction, leading to superior restoration results. Third, RestoreFormer outperforms advanced state-of-the-art methods on one synthetic dataset and three real-world datasets, as well as produces images with better visual quality.


page 1

page 7

page 8


RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs

Blind face restoration aims at recovering high-quality face images from ...

Towards Robust Blind Face Restoration with Codebook Lookup Transformer

Blind face restoration is a highly ill-posed problem that often requires...

Towards Authentic Face Restoration with Iterative Diffusion Models and Beyond

An authentic face restoration system is becoming increasingly demanding ...

A Mountain-Shaped Single-Stage Network for Accurate Image Restoration

Image restoration is the task of aiming to obtain a high-quality image f...

Learning Dual Memory Dictionaries for Blind Face Restoration

To improve the performance of blind face restoration, recent works mainl...

Mixed Hierarchy Network for Image Restoration

Image restoration is a long-standing low-level vision problem, e.g., deb...

DifFace: Blind Face Restoration with Diffused Error Contraction

While deep learning-based methods for blind face restoration have achiev...

Please sign up or login with your details

Forgot password? Click here to reset