Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

by   Jingwang Ling, et al.

Morphable models are essential for the statistical modeling of 3D faces. Previous works on morphable models mostly focus on large-scale facial geometry but ignore facial details. This paper augments morphable models in representing facial details by learning a Structure-aware Editable Morphable Model (SEMM). SEMM introduces a detail structure representation based on the distance field of wrinkle lines, jointly modeled with detail displacements to establish better correspondences and enable intuitive manipulation of wrinkle structure. Besides, SEMM introduces two transformation modules to translate expression blendshape weights and age values into changes in latent space, allowing effective semantic detail editing while maintaining identity. Extensive experiments demonstrate that the proposed model compactly represents facial details, outperforms previous methods in expression animation qualitatively and quantitatively, and achieves effective age editing and wrinkle line editing of facial details. Code and model are available at


page 11

page 13

page 22

page 25

page 26

page 27

page 28

page 29


Semantic Facial Expression Editing using Autoencoded Flow

High-level manipulation of facial expressions in images --- such as chan...

CCR: Facial Image Editing with Continuity, Consistency and Reversibility

Three problems exist in sequential facial image editing: incontinuous ed...

ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulation

Editing real facial images is a crucial task in computer vision with sig...

Deep Semantic Manipulation of Facial Videos

Editing and manipulating facial features in videos is an interesting and...

Adaptive Nonlinear Latent Transformation for Conditional Face Editing

Recent works for face editing usually manipulate the latent space of Sty...

Semantic Latent Decomposition with Normalizing Flows for Face Editing

Navigating in the latent space of StyleGAN has shown effectiveness for f...

Perceptually Validated Precise Local Editing for Facial Action Units with StyleGAN

The ability to edit facial expressions has a wide range of applications ...

Please sign up or login with your details

Forgot password? Click here to reset