ARM: Any-Time Super-Resolution Method

by   Bohong Chen, et al.

This paper proposes an Any-time super-Resolution Method (ARM) to tackle the over-parameterized single image super-resolution (SISR) models. Our ARM is motivated by three observations: (1) The performance of different image patches varies with SISR networks of different sizes. (2) There is a tradeoff between computation overhead and performance of the reconstructed image. (3) Given an input image, its edge information can be an effective option to estimate its PSNR. Subsequently, we train an ARM supernet containing SISR subnets of different sizes to deal with image patches of various complexity. To that effect, we construct an Edge-to-PSNR lookup table that maps the edge score of an image patch to the PSNR performance for each subnet, together with a set of computation costs for the subnets. In the inference, the image patches are individually distributed to different subnets for a better computation-performance tradeoff. Moreover, each SISR subnet shares weights of the ARM supernet, thus no extra parameters are introduced. The setting of multiple subnets can well adapt the computational cost of SISR model to the dynamically available hardware resources, allowing the SISR task to be in service at any time. Extensive experiments on resolution datasets of different sizes with popular SISR networks as backbones verify the effectiveness and the versatility of our ARM. The source code is available at <>.


page 2

page 6

page 7

page 8

page 12

page 20


Image Super-resolution with An Enhanced Group Convolutional Neural Network

CNNs with strong learning abilities are widely chosen to resolve super-r...

Edge-Informed Single Image Super-Resolution

The recent increase in the extensive use of digital imaging technologies...

Super-resolving Compressed Images via Parallel and Series Integration of Artifact Reduction and Resolution Enhancement

In this paper, we propose a novel compressed image super resolution (CIS...

Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network

We propose a highly efficient and faster Single Image Super-Resolution (...

Spatially-Adaptive Feature Modulation for Efficient Image Super-Resolution

Although numerous solutions have been proposed for image super-resolutio...

Unfolding Once is Enough: A Deployment-Friendly Transformer Unit for Super-Resolution

Recent years have witnessed a few attempts of vision transformers for si...

Boosting Video Super Resolution with Patch-Based Temporal Redundancy Optimization

The success of existing video super-resolution (VSR) algorithms stems ma...

Please sign up or login with your details

Forgot password? Click here to reset