DeepAI AI Chat
Log In Sign Up

Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images

by   Vishal Asnani, et al.

State-of-the-art (SOTA) Generative Models (GMs) can synthesize photo-realistic images that are hard for humans to distinguish from genuine photos. We propose to perform reverse engineering of GMs to infer the model hyperparameters from the images generated by these models. We define a novel problem, "model parsing", as estimating GM network architectures and training loss functions by examining their generated images – a task seemingly impossible for human beings. To tackle this problem, we propose a framework with two components: a Fingerprint Estimation Network (FEN), which estimates a GM fingerprint from a generated image by training with four constraints to encourage the fingerprint to have desired properties, and a Parsing Network (PN), which predicts network architecture and loss functions from the estimated fingerprints. To evaluate our approach, we collect a fake image dataset with 100K images generated by 100 GMs. Extensive experiments show encouraging results in parsing the hyperparameters of the unseen models. Finally, our fingerprint estimation can be leveraged for deepfake detection and image attribution, as we show by reporting SOTA results on both the recent Celeb-DF and image attribution benchmarks.


page 2

page 10

page 11

page 17

page 18

page 19

page 20

page 21


Responsible Disclosure of Generative Models Using Scalable Fingerprinting

Over the past six years, deep generative models have achieved a qualitat...

WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models

The rapid advancement of generative models, facilitating the creation of...

Comparative analysis of segmentation and generative models for fingerprint retrieval task

Biometric Authentication like Fingerprints has become an integral part o...

Finger-GAN: Generating Realistic Fingerprint Images Using Connectivity Imposed GAN

Generating realistic biometric images has been an interesting and, at th...

Synthesis and Reconstruction of Fingerprints using Generative Adversarial Networks

Deep learning-based models have been shown to improve the accuracy of fi...

Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots

Automated understanding of user interfaces (UIs) from their pixels can i...

Self-supervised GAN Detector

Although the recent advancement in generative models brings diverse adva...

Code Repositories


Official Pytorch implementation of paper "Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images"

view repo