Portrait Eyeglasses and Shadow Removal by Leveraging 3D Synthetic Data

by   Junfeng Lyu, et al.

In portraits, eyeglasses may occlude facial regions and generate cast shadows on faces, which degrades the performance of many techniques like face verification and expression recognition. Portrait eyeglasses removal is critical in handling these problems. However, completely removing the eyeglasses is challenging because the lighting effects (e.g., cast shadows) caused by them are often complex. In this paper, we propose a novel framework to remove eyeglasses as well as their cast shadows from face images. The method works in a detect-then-remove manner, in which eyeglasses and cast shadows are both detected and then removed from images. Due to the lack of paired data for supervised training, we present a new synthetic portrait dataset with both intermediate and final supervisions for both the detection and removal tasks. Furthermore, we apply a cross-domain technique to fill the gap between the synthetic and real data. To the best of our knowledge, the proposed technique is the first to remove eyeglasses and their cast shadows simultaneously. The code and synthetic dataset are available at https://github.com/StoryMY/take-off-eyeglasses.


page 1

page 6

page 8

page 12

page 13

page 14

page 15

page 16


Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition

Systems that analyse faces have seen significant improvements in recent ...

Unsupervised Eyeglasses Removal in the Wild

Eyeglasses removal is challenging in removing different kinds of eyeglas...

Face Image Reflection Removal

Face images captured through the glass are usually contaminated by refle...

Portrait Shadow Manipulation

Casually-taken portrait photographs often suffer from unflattering light...

FaceEraser: Removing Facial Parts for Augmented Reality

Our task is to remove all facial parts (e.g., eyebrows, eyes, mouth and ...

Distributionally Robust Removal of Malicious Nodes from Networks

An important problem in networked systems is detection and removal of su...

Shortcut Removal for Improved OOD-Generalization

Machine learning is a data-driven discipline, and learning success is la...

Please sign up or login with your details

Forgot password? Click here to reset