Towards the Detection of Diffusion Model Deepfakes

by   Jonas Ricker, et al.
Ruhr University Bochum

Diffusion models (DMs) have recently emerged as a promising method in image synthesis. They have surpassed generative adversarial networks (GANs) in both diversity and quality, and have achieved impressive results in text-to-image and image-to-image modeling. However, to date, only little attention has been paid to the detection of DM-generated images, which is critical to prevent adverse impacts on our society. Although prior work has shown that GAN-generated images can be reliably detected using automated methods, it is unclear whether the same methods are effective against DMs. In this work, we address this challenge and take a first look at detecting DM-generated images. We approach the problem from two different angles: First, we evaluate the performance of state-of-the-art detectors on a variety of DMs. Second, we analyze DM-generated images in the frequency domain and study different factors that influence the spectral properties of these images. Most importantly, we demonstrate that GANs and DMs produce images with different characteristics, which requires adaptation of existing classifiers to ensure reliable detection. We believe this work provides the foundation and starting point for further research to detect DM deepfakes effectively.


page 6

page 7

page 8

page 14

page 18

page 19

page 20

page 23


Comparison and Analysis of Image-to-Image Generative Adversarial Networks: A Survey

Generative Adversarial Networks (GANs) have recently introduced effectiv...

GIQA: Generated Image Quality Assessment

Generative adversarial networks (GANs) have achieved impressive results ...

Look ATME: The Discriminator Mean Entropy Needs Attention

Generative adversarial networks (GANs) are successfully used for image s...

Automatic Measures for Evaluating Generative Design Methods for Architects

The recent explosion of high-quality image-to-image methods has prompted...

T-GD: Transferable GAN-generated Images Detection Framework

Recent advancements in Generative Adversarial Networks (GANs) enable the...

Detecting Images Generated by Diffusers

This paper explores the task of detecting images generated by text-to-im...

Please sign up or login with your details

Forgot password? Click here to reset