Real-Time Video Super-Resolution on Smartphones with Deep Learning, Mobile AI 2021 Challenge: Report

by   Andrey Ignatov, et al.
HUAWEI Technologies Co., Ltd.
ZTE Corporation
Alibaba Cloud
ETH Zurich

Video super-resolution has recently become one of the most important mobile-related problems due to the rise of video communication and streaming services. While many solutions have been proposed for this task, the majority of them are too computationally expensive to run on portable devices with limited hardware resources. To address this problem, we introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based video super-resolution solutions that can achieve a real-time performance on mobile GPUs. The participants were provided with the REDS dataset and trained their models to do an efficient 4X video upscaling. The runtime of all models was evaluated on the OPPO Find X2 smartphone with the Snapdragon 865 SoC capable of accelerating floating-point networks on its Adreno GPU. The proposed solutions are fully compatible with any mobile GPU and can upscale videos to HD resolution at up to 80 FPS while demonstrating high fidelity results. A detailed description of all models developed in the challenge is provided in this paper.


page 2

page 3

page 5


Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Report

Image super-resolution is one of the most popular computer vision proble...

Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Report

Image denoising is one of the most critical problems in mobile photo pro...

Tiny Video Networks

Video understanding is a challenging problem with great impact on the ab...

Fast and Accurate Quantized Camera Scene Detection on Smartphones, Mobile AI 2021 Challenge: Report

Camera scene detection is among the most popular computer vision problem...

Sliding Window Recurrent Network for Efficient Video Super-Resolution

Video super-resolution (VSR) is the task of restoring high-resolution fr...

Enabling Real-time On-chip Audio Super Resolution for Bone Conduction Microphones

Voice communication using the air conduction microphone in noisy environ...

Real-Time Super-Resolution System of 4K-Video Based on Deep Learning

Video super-resolution (VSR) technology excels in reconstructing low-qua...

Please sign up or login with your details

Forgot password? Click here to reset