Diffusion Models in Vision: A Survey

09/10/2022
by   Florinel-Alin Croitoru, et al.
187

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward diffusion stage and a reverse diffusion stage. In the forward diffusion stage, the input data is gradually perturbed over several steps by adding Gaussian noise. In the reverse stage, a model is tasked at recovering the original input data by learning to gradually reverse the diffusion process, step by step. Diffusion models are widely appreciated for the quality and diversity of the generated samples, despite their known computational burdens, i.e. low speeds due to the high number of steps involved during sampling. In this survey, we provide a comprehensive review of articles on denoising diffusion models applied in vision, comprising both theoretical and practical contributions in the field. First, we identify and present three generic diffusion modeling frameworks, which are based on denoising diffusion probabilistic models, noise conditioned score networks, and stochastic differential equations. We further discuss the relations between diffusion models and other deep generative models, including variational auto-encoders, generative adversarial networks, energy-based models, autoregressive models and normalizing flows. Then, we introduce a multi-perspective categorization of diffusion models applied in computer vision. Finally, we illustrate the current limitations of diffusion models and envision some interesting directions for future research.

READ FULL TEXT

page 2

page 6

page 7

page 8

page 11

page 20

research
11/14/2022

Diffusion Models for Medical Image Analysis: A Comprehensive Survey

Denoising diffusion models, a class of generative models, have garnered ...
research
09/02/2022

Diffusion Models: A Comprehensive Survey of Methods and Applications

Diffusion models are a class of deep generative models that have shown i...
research
05/31/2022

On Analyzing Generative and Denoising Capabilities of Diffusion-based Deep Generative Models

Diffusion-based Deep Generative Models (DDGMs) offer state-of-the-art pe...
research
06/07/2023

On the Design Fundamentals of Diffusion Models: A Survey

Diffusion models are generative models, which gradually add and remove n...
research
05/25/2022

Accelerating Diffusion Models via Early Stop of the Diffusion Process

Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressiv...
research
01/25/2023

On the Mathematics of Diffusion Models

This paper attempts to present the stochastic differential equations of ...
research
07/09/2023

Seismic Data Interpolation based on Denoising Diffusion Implicit Models with Resampling

The incompleteness of the seismic data caused by missing traces along th...

Please sign up or login with your details

Forgot password? Click here to reset