IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis

by   Jingxiang Sun, et al.

Existing 3D-aware facial generation methods face a dilemma in quality versus editability: they either generate editable results in low resolution or high-quality ones with no editing flexibility. In this work, we propose a new approach that brings the best of both worlds together. Our system consists of three major components: (1) a 3D-semantics-aware generative model that produces view-consistent, disentangled face images and semantic masks; (2) a hybrid GAN inversion approach that initialize the latent codes from the semantic and texture encoder, and further optimized them for faithful reconstruction; and (3) a canonical editor that enables efficient manipulation of semantic masks in canonical view and product high-quality editing results. Our approach is competent for many applications, e.g. free-view face drawing, editing, and style control. Both quantitative and qualitative results show that our method reaches the state-of-the-art in terms of photorealism, faithfulness, and efficiency.


page 1

page 6

page 7

page 10

page 11

page 12

page 13

page 14


Designing a 3D-Aware StyleNeRF Encoder for Face Editing

GAN inversion has been exploited in many face manipulation tasks, but 2D...

StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pretrained StyleGAN

One-shot talking face generation aims at synthesizing a high-quality tal...

Face Generation and Editing with StyleGAN: A Survey

Our goal with this survey is to provide an overview of the state of the ...

FENeRF: Face Editing in Neural Radiance Fields

Previous portrait image generation methods roughly fall into two categor...

K-Hairstyle: A Large-scale Korean hairstyle dataset for virtual hair editing and hairstyle classification

The hair and beauty industry is one of the fastest growing industries. T...

NARRATE: A Normal Assisted Free-View Portrait Stylizer

In this work, we propose NARRATE, a novel pipeline that enables simultan...

NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fields

Recent methods for synthesizing 3D-aware face images have achieved rapid...

Please sign up or login with your details

Forgot password? Click here to reset