LI-Net: Large-Pose Identity-Preserving Face Reenactment Network

04/07/2021
by   Jin Liu, et al.
0

Face reenactment is a challenging task, as it is difficult to maintain accurate expression, pose and identity simultaneously. Most existing methods directly apply driving facial landmarks to reenact source faces and ignore the intrinsic gap between two identities, resulting in the identity mismatch issue. Besides, they neglect the entanglement of expression and pose features when encoding driving faces, leading to inaccurate expressions and visual artifacts on large-pose reenacted faces. To address these problems, we propose a Large-pose Identity-preserving face reenactment network, LI-Net. Specifically, the Landmark Transformer is adopted to adjust driving landmark images, which aims to narrow the identity gap between driving and source landmark images. Then the Face Rotation Module and the Expression Enhancing Generator decouple the transformed landmark image into pose and expression features, and reenact those attributes separately to generate identity-preserving faces with accurate expressions and poses. Both qualitative and quantitative experimental results demonstrate the superiority of our method.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
10/10/2021

Fine-grained Identity Preserving Landmark Synthesis for Face Reenactment

Recent face reenactment works are limited by the coarse reference landma...
research
11/26/2019

LaFIn: Generative Landmark Guided Face Inpainting

It is challenging to inpaint face images in the wild, due to the large v...
research
04/26/2020

One-Shot Identity-Preserving Portrait Reenactment

We present a deep learning-based framework for portrait reenactment from...
research
11/19/2019

MarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen Targets

When there is a mismatch between the target identity and the driver iden...
research
04/20/2020

Pose Manipulation with Identity Preservation

This paper describes a new model which generates images in novel poses e...
research
10/04/2021

Causal Representation Learning for Fine-Grained Face Transfer

Identity transfer often faces the challenge of generalizing to new situa...
research
05/28/2019

FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment

Recent face reenactment studies have achieved remarkable success either ...

Please sign up or login with your details

Forgot password? Click here to reset