Video Super-Resolution with Recurrent Structure-Detail Network

by   Takashi Isobe, et al.

Most video super-resolution methods super-resolve a single reference frame with the help of neighboring frames in a temporal sliding window. They are less efficient compared to the recurrent-based methods. In this work, we propose a novel recurrent video super-resolution method which is both effective and efficient in exploiting previous frames to super-resolve the current frame. It divides the input into structure and detail components which are fed to a recurrent unit composed of several proposed two-stream structure-detail blocks. In addition, a hidden state adaptation module that allows the current frame to selectively use information from hidden state is introduced to enhance its robustness to appearance change and error accumulation. Extensive ablation study validate the effectiveness of the proposed modules. Experiments on several benchmark datasets demonstrate the superior performance of the proposed method compared to state-of-the-art methods on video super-resolution.


page 2

page 5

page 7

page 13

page 14


Frame-Recurrent Video Super-Resolution

Recent advances in video super-resolution have shown that convolutional ...

Recurrent Back-Projection Network for Video Super-Resolution

We proposed a novel architecture for the problem of video super-resoluti...

Sliding Window Recurrent Network for Efficient Video Super-Resolution

Video super-resolution (VSR) is the task of restoring high-resolution fr...

Fast Online Video Super-Resolution with Deformable Attention Pyramid

Video super-resolution (VSR) has many applications that pose strict caus...

Mitigating Artifacts in Real-World Video Super-Resolution Models

The recurrent structure is a prevalent framework for the task of video s...

AnimeSR: Learning Real-World Super-Resolution Models for Animation Videos

This paper studies the problem of real-world video super-resolution (VSR...

VESR-Net: The Winning Solution to Youku Video Enhancement and Super-Resolution Challenge

This paper introduces VESR-Net, a method for video enhancement and super...

Please sign up or login with your details

Forgot password? Click here to reset