DeepAI AI Chat
Log In Sign Up

Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images

by   Roberto Amoroso, et al.
University of Modena and Reggio Emilia

Recent advancements in diffusion models have enabled the generation of realistic deepfakes by writing textual prompts in natural language. While these models have numerous benefits across various sectors, they have also raised concerns about the potential misuse of fake images and cast new pressures on fake image detection. In this work, we pioneer a systematic study of the authenticity of fake images generated by state-of-the-art diffusion models. Firstly, we conduct a comprehensive study on the performance of contrastive and classification-based visual features. Our analysis demonstrates that fake images share common low-level cues, which render them easily recognizable. Further, we devise a multimodal setting wherein fake images are synthesized by different textual captions, which are used as seeds for a generator. Under this setting, we quantify the performance of fake detection strategies and introduce a contrastive-based disentangling strategy which let us analyze the role of the semantics of textual descriptions and low-level perceptual cues. Finally, we release a new dataset, called COCOFake, containing about 600k images generated from original COCO images.


page 2

page 8

page 9

page 11

page 14


Generalizable Synthetic Image Detection via Language-guided Contrastive Learning

The heightened realism of AI-generated images can be attributed to the r...

FakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstruction

The recently rapid advances of generative adversarial networks (GANs) in...

Exposing the Fake: Effective Diffusion-Generated Images Detection

Image synthesis has seen significant advancements with the advent of dif...

GenImage: A Million-Scale Benchmark for Detecting AI-Generated Image

The extraordinary ability of generative models to generate photographic ...

Fake Colorized Image Detection

Image forensics aims to detect the manipulation of digital images. Curre...

Fake Visual Content Detection Using Two-Stream Convolutional Neural Networks

Rapid progress in adversarial learning has enabled the generation of rea...

Deepfake in the Metaverse: An Outlook Survey

We envision deepfake technologies, which synthesize realistic fake image...