Analyzing Perception-Distortion Tradeoff using Enhanced Perceptual Super-resolution Network

by   Subeesh Vasu, et al.

Convolutional neural network (CNN) based methods have recently achieved great success for image super-resolution (SR). However, most deep CNN based SR models attempt to improve distortion measures (e.g. PSNR, SSIM, IFC, VIF) while resulting in poor quantified perceptual quality (e.g. human opinion score, no-reference quality measures such as NIQE). Few works have attempted to improve the perceptual quality at the cost of performance reduction in distortion measures. A very recent study has revealed that distortion and perceptual quality are at odds with each other and there is always a trade-off between the two. Often the restoration algorithms that are superior in terms of perceptual quality, are inferior in terms of distortion measures. Our work attempts to analyze the trade-off between distortion and perceptual quality for the problem of single image SR. To this end, we use the well-known SR architecture- enhanced deep super-resolution (EDSR) network and show that it can be adapted to achieve better perceptual quality for a specific range of the distortion measure. While the original network of EDSR was trained to minimize the error defined based on per-pixel accuracy alone, we train our network using a generative adversarial network framework with EDSR as the generator module. Our proposed network, called enhanced perceptual super-resolution network (EPSR), is trained with a combination of mean squared error loss, perceptual loss, and adversarial loss. Our experiments reveal that EPSR achieves the state-of-the-art trade-off between distortion and perceptual quality while the existing methods perform well in either of these measures alone.


page 5

page 10

page 12


Generative adversarial network-based image super-resolution using perceptual content losses

In this paper, we propose a deep generative adversarial network for supe...

Perception-Distortion Balanced ADMM Optimization for Single-Image Super-Resolution

In image super-resolution, both pixel-wise accuracy and perceptual fidel...

The Perception-Distortion Tradeoff

Image restoration algorithms are typically evaluated by some distortion ...

Generative Adversarial Networks and Perceptual Losses for Video Super-Resolution

Video super-resolution has become one of the most critical problems in v...

Perception-Distortion Trade-off in the SR Space Spanned by Flow Models

Flow-based generative super-resolution (SR) models learn to produce a di...

2018 PIRM Challenge on Perceptual Image Super-resolution

This paper reports on the 2018 PIRM challenge on perceptual super-resolu...

CFSNet: Toward a Controllable Feature Space for Image Restoration

Deep learning methods have witnessed the great progress in image restora...

Please sign up or login with your details

Forgot password? Click here to reset