Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolution

04/04/2023
by   Brian Moser, et al.
0

This paper presents a novel Diffusion-Wavelet (DiWa) approach for Single-Image Super-Resolution (SISR). It leverages the strengths of Denoising Diffusion Probabilistic Models (DDPMs) and Discrete Wavelet Transformation (DWT). By enabling DDPMs to operate in the DWT domain, our DDPM models effectively hallucinate high-frequency information for super-resolved images on the wavelet spectrum, resulting in high-quality and detailed reconstructions in image space. Quantitatively, we outperform state-of-the-art diffusion-based SISR methods, namely SR3 and SRDiff, regarding PSNR, SSIM, and LPIPS on both face (8x scaling) and general (4x scaling) SR benchmarks. Meanwhile, using DWT enabled us to use fewer parameters than the compared models: 92M parameters instead of 550M compared to SR3 and 9.3M instead of 12M compared to SRDiff. Additionally, our method outperforms other state-of-the-art generative methods on classical general SR datasets while saving inference time. Finally, our work highlights its potential for various applications.

READ FULL TEXT

page 5

page 6

page 7

research
09/09/2013

Single image super resolution in spatial and wavelet domain

Recently single image super resolution is very important research area t...
research
07/10/2023

DWA: Differential Wavelet Amplifier for Image Super-Resolution

This work introduces Differential Wavelet Amplifier (DWA), a drop-in mod...
research
03/15/2023

ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution

Adapting the Diffusion Probabilistic Model (DPM) for direct image super-...
research
06/01/2023

Low-Light Image Enhancement with Wavelet-based Diffusion Models

Diffusion models have achieved promising results in image restoration ta...
research
07/27/2023

Spatial-Frequency U-Net for Denoising Diffusion Probabilistic Models

In this paper, we study the denoising diffusion probabilistic model (DDP...
research
08/15/2023

YODA: You Only Diffuse Areas. An Area-Masked Diffusion Approach For Image Super-Resolution

This work introduces "You Only Diffuse Areas" (YODA), a novel method for...
research
02/07/2021

SR-Affine: High-quality 3D hand model reconstruction from UV Maps

Under various poses and heavy occlusions,3D hand model reconstruction ba...

Please sign up or login with your details

Forgot password? Click here to reset