SwinIA: Self-Supervised Blind-Spot Image Denoising with Zero Convolutions

05/09/2023
by   Mikhail Papkov, et al.
0

The essence of self-supervised image denoising is to restore the signal from the noisy image alone. State-of-the-art solutions for this task rely on the idea of masking pixels and training a fully-convolutional neural network to impute them. This most often requires multiple forward passes, information about the noise model, and intricate regularization functions. In this paper, we propose a Swin Transformer-based Image Autoencoder (SwinIA), the first convolution-free architecture for self-supervised denoising. It can be trained end-to-end with a simple mean squared error loss without masking and does not require any prior knowledge about clean data or noise distribution. Despite its simplicity, SwinIA establishes state-of-the-art on several common benchmarks.

READ FULL TEXT

page 7

page 8

page 13

page 14

page 15

page 16

research
02/16/2021

Joint self-supervised blind denoising and noise estimation

We propose a novel self-supervised image blind denoising approach in whi...
research
12/07/2020

Noise2Kernel: Adaptive Self-Supervised Blind Denoising using a Dilated Convolutional Kernel Architecture

With the advent of recent advances in unsupervised learning, efficient t...
research
08/25/2020

Efficient Blind-Spot Neural Network Architecture for Image Denoising

Image denoising is an essential tool in computational photography. Stand...
research
06/16/2020

Noise2Inpaint: Learning Referenceless Denoising by Inpainting Unrolling

Deep learning based image denoising methods have been recently popular d...
research
04/04/2023

Self-Supervised Image Denoising for Real-World Images with Context-aware Transformer

In recent years, the development of deep learning has been pushing image...
research
11/01/2021

Self-Verification in Image Denoising

We devise a new regularization, called self-verification, for image deno...
research
11/15/2022

N2V2 – Fixing Noise2Void Checkerboard Artifacts with Modified Sampling Strategies and a Tweaked Network Architecture

In recent years, neural network based image denoising approaches have re...

Please sign up or login with your details

Forgot password? Click here to reset