A New Approach to Improve Learning-based Deepfake Detection in Realistic Conditions

03/22/2022
by   Yuhang Lu, et al.
0

Deep convolutional neural networks have achieved exceptional results on multiple detection and recognition tasks. However, the performance of such detectors are often evaluated in public benchmarks under constrained and non-realistic situations. The impact of conventional distortions and processing operations found in imaging workflows such as compression, noise, and enhancement are not sufficiently studied. Currently, only a few researches have been done to improve the detector robustness to unseen perturbations. This paper proposes a more effective data augmentation scheme based on real-world image degradation process. This novel technique is deployed for deepfake detection tasks and has been evaluated by a more realistic assessment framework. Extensive experiments show that the proposed data augmentation scheme improves generalization ability to unpredictable data distortions and unseen datasets.

READ FULL TEXT
research
03/22/2022

A Novel Framework for Assessment of Learning-based Detectors in Realistic Conditions with Application to Deepfake Detection

Deep convolutional neural networks have shown remarkable results on mult...
research
04/12/2023

Assessment Framework for Deepfake Detection in Real-world Situations

Detecting digital face manipulation in images and video has attracted ex...
research
11/14/2021

Impact of Benign Modifications on Discriminative Performance of Deepfake Detectors

Deepfakes are becoming increasingly popular in both good faith applicati...
research
03/30/2023

Impact of Video Processing Operations in Deepfake Detection

The detection of digital face manipulation in video has attracted extens...
research
02/06/2022

Block shuffling learning for Deepfake Detection

Although the deepfake detection based on convolutional neural network ha...
research
05/03/2021

Consistency and Monotonicity Regularization for Neural Knowledge Tracing

Knowledge Tracing (KT), tracking a human's knowledge acquisition, is a c...
research
04/11/2018

Attention Cropping: A Novel Data Augmentation Method for Real-world Plant Species Identification

This paper investigates the issue of realistic plant species identificat...

Please sign up or login with your details

Forgot password? Click here to reset