Efficient Super Resolution For Large-Scale Image Using Attentional GAN

12/12/2018
by   Harsh Nilesh Pathak, et al.
11

Single Image Super Resolution (SISR) is a well-researched problem with broad commercial relevance. However, most of the SISR literature focuses on small-size images under 500px, whereas business needs can mandate the generation of very high resolution images. At Expedia Group, we were tasked with generating images of at least 2000px for display on the website, four times greater than the sizes typically reported in the literature. This requirement poses a challenge that state-of-the-art models, validated on small images, have not been proven to handle. In this paper, we investigate solutions to the problem of generating high-quality images for large-scale super resolution in a commercial setting. We find that training a generative adversarial network (GAN) with attention from scratch using a large-scale lodging image data set generates images with high PSNR and SSIM scores. We describe a novel attentional SISR model for large-scale images, A-SRGAN, that uses a Flexible Self Attention layer to enable processing of large-scale images. We also describe a distributed algorithm which speeds up training by around a factor of five.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 11

research
12/12/2018

Efficient Super Resolution For Large-Scale Images Using Attentional GAN

Single Image Super Resolution (SISR) is a well-researched problem with b...
research
09/15/2020

AIM 2020 Challenge on Efficient Super-Resolution: Methods and Results

This paper reviews the AIM 2020 challenge on efficient single image supe...
research
01/28/2019

TGAN: Deep Tensor Generative Adversarial Nets for Large Image Generation

Deep generative models have been successfully applied to many applicatio...
research
09/22/2012

A Bayesian Nonparametric Approach to Image Super-resolution

Super-resolution methods form high-resolution images from low-resolution...
research
06/29/2021

A Mixed-Supervision Multilevel GAN Framework for Image Quality Enhancement

Deep neural networks for image quality enhancement typically need large ...
research
10/21/2021

Super-resolution of multiphase materials by combining complementary 2D and 3D image data using generative adversarial networks

Modelling the impact of a material's mesostructure on device level perfo...
research
02/15/2018

Image Tranformer

Image generation has been successfully cast as an autoregressive sequenc...

Please sign up or login with your details

Forgot password? Click here to reset