A Fully Progressive Approach to Single-Image Super-Resolution

04/09/2018
by   Federico Perazzi, et al.
0

Recent deep learning approaches to single image super-resolution have achieved impressive results in terms of traditional error measures and perceptual quality. However, in each case it remains challenging to achieve high quality results for large upsampling factors. To this end, we propose a method (ProSR) that is progressive both in architecture and training: the network upsamples an image in intermediate steps, while the learning process is organized from easy to hard, as is done in curriculum learning. To obtain more photorealistic results, we design a generative adversarial network (GAN), named ProGanSR, that follows the same progressive multi-scale design principle. This not only allows to scale well to high upsampling factors (e.g., 8x) but constitutes a principled multi-scale approach that increases the reconstruction quality for all upsampling factors simultaneously. In particular ProSR ranks 2nd in terms of SSIM and 4th in terms of PSNR in the NTIRE2018 SISR challenge [34]. Compared to the top-ranking team, our model is marginally lower, but runs 5 times faster.

READ FULL TEXT

page 1

page 7

page 8

research
07/22/2017

Single Image Super-Resolution with Dilated Convolution based Multi-Scale Information Learning Inception Module

Traditional works have shown that patches in a natural image tend to red...
research
11/20/2019

Dual Reconstruction with Densely Connected Residual Network for Single Image Super-Resolution

Deep learning-based single image super-resolution enables very fast and ...
research
07/19/2020

Progressive Multi-Scale Residual Network for Single Image Super-Resolution

Super-resolution is a classical issue in image restoration field. In rec...
research
03/08/2020

Perceptual Image Super-Resolution with Progressive Adversarial Network

Single Image Super-Resolution (SISR) aims to improve resolution of small...
research
03/08/2020

Domain-Specific Image Super-Resolution with Progressive Adversarial Network

Single Image Super-Resolution (SISR) aims to improve resolution of small...
research
06/29/2021

TUCaN: Progressively Teaching Colourisation to Capsules

Automatic image colourisation is the computer vision research path that ...
research
11/18/2019

Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Training

Multi-scale (MS) approaches have been widely investigated for blind sing...

Please sign up or login with your details

Forgot password? Click here to reset