Improving Deep Video Compression by Resolution-adaptive Flow Coding

09/13/2020
by   Zhihao Hu, et al.
3

In the learning based video compression approaches, it is an essential issue to compress pixel-level optical flow maps by developing new motion vector (MV) encoders. In this work, we propose a new framework called Resolution-adaptive Flow Coding (RaFC) to effectively compress the flow maps globally and locally, in which we use multi-resolution representations instead of single-resolution representations for both the input flow maps and the output motion features of the MV encoder. To handle complex or simple motion patterns globally, our frame-level scheme RaFC-frame automatically decides the optimal flow map resolution for each video frame. To cope different types of motion patterns locally, our block-level scheme called RaFC-block can also select the optimal resolution for each local block of motion features. In addition, the rate-distortion criterion is applied to both RaFC-frame and RaFC-block and select the optimal motion coding mode for effective flow coding. Comprehensive experiments on four benchmark datasets HEVC, VTL, UVG and MCL-JCV clearly demonstrate the effectiveness of our overall RaFC framework after combing RaFC-frame and RaFC-block for video compression.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/05/2023

Hierarchical B-frame Video Coding Using Two-Layer CANF without Motion Coding

Typical video compression systems consist of two main modules: motion co...
12/26/2021

Learning Cross-Scale Prediction for Efficient Neural Video Compression

In this paper, we present the first neural video codec that can compete ...
08/06/2020

Optical Flow and Mode Selection for Learning-based Video Coding

This paper introduces a new method for inter-frame coding based on two c...
08/05/2021

End-to-end Neural Video Coding Using a Compound Spatiotemporal Representation

Recent years have witnessed rapid advances in learnt video coding. Most ...
09/05/2022

Investigation on Principles for Cost Assignment in Motion Vector-based Video Steganography

Cost assignment in the motion vector domain remains a research focus in ...

Please sign up or login with your details

Forgot password? Click here to reset