DeepAI AI Chat
Log In Sign Up

Towards the Detection of Diffusion Model Deepfakes

10/26/2022
by   Jonas Ricker, et al.
Ruhr University Bochum
0

Diffusion models (DMs) have recently emerged as a promising method in image synthesis. They have surpassed generative adversarial networks (GANs) in both diversity and quality, and have achieved impressive results in text-to-image and image-to-image modeling. However, to date, only little attention has been paid to the detection of DM-generated images, which is critical to prevent adverse impacts on our society. Although prior work has shown that GAN-generated images can be reliably detected using automated methods, it is unclear whether the same methods are effective against DMs. In this work, we address this challenge and take a first look at detecting DM-generated images. We approach the problem from two different angles: First, we evaluate the performance of state-of-the-art detectors on a variety of DMs. Second, we analyze DM-generated images in the frequency domain and study different factors that influence the spectral properties of these images. Most importantly, we demonstrate that GANs and DMs produce images with different characteristics, which requires adaptation of existing classifiers to ensure reliable detection. We believe this work provides the foundation and starting point for further research to detect DM deepfakes effectively.

READ FULL TEXT

page 6

page 7

page 8

page 14

page 18

page 19

page 20

page 23

12/23/2021

Comparison and Analysis of Image-to-Image Generative Adversarial Networks: A Survey

Generative Adversarial Networks (GANs) have recently introduced effectiv...
03/19/2020

GIQA: Generated Image Quality Assessment

Generative adversarial networks (GANs) have achieved impressive results ...
03/16/2023

DIRE for Diffusion-Generated Image Detection

Diffusion models have shown remarkable success in visual synthesis, but ...
03/09/2023

Detecting Images Generated by Diffusers

This paper explores the task of detecting images generated by text-to-im...
03/20/2023

Automatic Measures for Evaluating Generative Design Methods for Architects

The recent explosion of high-quality image-to-image methods has prompted...
04/01/2020

Manifold-Aware CycleGAN for High Resolution Structural-to-DTI Synthesis

Unpaired image-to-image translation has been applied successfully to nat...