CycleISP: Real Image Restoration via Improved Data Synthesis

by   Syed Waqas Zamir, et al.

The availability of large-scale datasets has helped unleash the true potential of deep convolutional neural networks (CNNs). However, for the single-image denoising problem, capturing a real dataset is an unacceptably expensive and cumbersome procedure. Consequently, image denoising algorithms are mostly developed and evaluated on synthetic data that is usually generated with a widespread assumption of additive white Gaussian noise (AWGN). While the CNNs achieve impressive results on these synthetic datasets, they do not perform well when applied on real camera images, as reported in recent benchmark datasets. This is mainly because the AWGN is not adequate for modeling the real camera noise which is signal-dependent and heavily transformed by the camera imaging pipeline. In this paper, we present a framework that models camera imaging pipeline in forward and reverse directions. It allows us to produce any number of realistic image pairs for denoising both in RAW and sRGB spaces. By training a new image denoising network on realistic synthetic data, we achieve the state-of-the-art performance on real camera benchmark datasets. The parameters in our model are  5 times lesser than the previous best method for RAW denoising. Furthermore, we demonstrate that the proposed framework generalizes beyond image denoising problem e.g., for color matching in stereoscopic cinema. The source code and pre-trained models are available at


page 1

page 3

page 7

page 8


Real-world Noisy Image Denoising: A New Benchmark

Most of previous image denoising methods focus on additive white Gaussia...

Unprocessing Images for Learned Raw Denoising

Machine learning techniques work best when the data used for training re...

Adaptive Denoising via GainTuning

Deep convolutional neural networks (CNNs) for image denoising are usuall...

Lighting Every Darkness in Two Pairs: A Calibration-Free Pipeline for RAW Denoising

Calibration-based methods have dominated RAW image denoising under extre...

Shallow camera pipeline for night photography rendering

We introduce a camera pipeline for rendering visually pleasing photograp...

FSID: Fully Synthetic Image Denoising via Procedural Scene Generation

For low-level computer vision and image processing ML tasks, training on...

A Comparison of Image Denoising Methods

The advancement of imaging devices and countless images generated everyd...

Please sign up or login with your details

Forgot password? Click here to reset