Robust Face-Swap Detection Based on 3D Facial Shape Information

by   Weinan Guan, et al.

Maliciously-manipulated images or videos - so-called deep fakes - especially face-swap images and videos have attracted more and more malicious attackers to discredit some key figures. Previous pixel-level artifacts based detection techniques always focus on some unclear patterns but ignore some available semantic clues. Therefore, these approaches show weak interpretability and robustness. In this paper, we propose a biometric information based method to fully exploit the appearance and shape feature for face-swap detection of key figures. The key aspect of our method is obtaining the inconsistency of 3D facial shape and facial appearance, and the inconsistency based clue offers natural interpretability for the proposed face-swap detection method. Experimental results show the superiority of our method in robustness on various laundering and cross-domain data, which validates the effectiveness of the proposed method.


page 4

page 6


A Hierarchical Probabilistic Model for Facial Feature Detection

Facial feature detection from facial images has attracted great attentio...

Robust Facial Landmark Detection via Aggregation on Geometrically Manipulated Faces

In this work, we present a practical approach to the problem of facial l...

Deep Kinship Verification via Appearance-shape Joint Prediction and Adaptation-based Approach

Kinship verification aims to identify the kin relation between two given...

Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Features

Deepfakes is a branch of malicious techniques that transplant a target f...

Cross-Domain Local Characteristic Enhanced Deepfake Video Detection

As ultra-realistic face forgery techniques emerge, deepfake detection ha...

Collaborative Feature Learning for Fine-grained Facial Forgery Detection and Segmentation

Detecting maliciously falsified facial images and videos has attracted e...

Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection

One of the most pressing challenges for the detection of face-manipulate...

Please sign up or login with your details

Forgot password? Click here to reset