CBANet: Towards Complexity and Bitrate Adaptive Deep Image Compression using a Single Network

by   Jinyang Guo, et al.

In this paper, we propose a new deep image compression framework called Complexity and Bitrate Adaptive Network (CBANet), which aims to learn one single network to support variable bitrate coding under different computational complexity constraints. In contrast to the existing state-of-the-art learning based image compression frameworks that only consider the rate-distortion trade-off without introducing any constraint related to the computational complexity, our CBANet considers the trade-off between the rate and distortion under dynamic computational complexity constraints. Specifically, to decode the images with one single decoder under various computational complexity constraints, we propose a new multi-branch complexity adaptive module, in which each branch only takes a small portion of the computational budget of the decoder. The reconstructed images with different visual qualities can be readily generated by using different numbers of branches. Furthermore, to achieve variable bitrate decoding with one single decoder, we propose a bitrate adaptive module to project the representation from a base bitrate to the expected representation at a target bitrate for transmission. Then it will project the transmitted representation at the target bitrate back to that at the base bitrate for the decoding process. The proposed bit adaptive module can significantly reduce the storage requirement for deployment platforms. As a result, our CBANet enables one single codec to support multiple bitrate decoding under various computational complexity constraints. Comprehensive experiments on two benchmark datasets demonstrate the effectiveness of our CBANet for deep image compression.


A Unified End-to-End Framework for Efficient Deep Image Compression

Image compression is a widely used technique to reduce the spatial redun...

Computationally Efficient Neural Image Compression

Image compression using neural networks have reached or exceeded non-neu...

Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blocks

Recently deep learning-based image compression has shown the potential t...

Asymmetrically-powered Neural Image Compression with Shallow Decoders

Neural image compression methods have seen increasingly strong performan...

Rate Distortion Characteristic Modeling for Neural Image Compression

End-to-end optimization capability offers neural image compression (NIC)...

Comprehensive Complexity Assessment of Emerging Learned Image Compression on CPU and GPU

Learned Compression (LC) is the emerging technology for compressing imag...

Universal Efficient Variable-rate Neural Image Compression

Recently, Learning-based image compression has reached comparable perfor...

Please sign up or login with your details

Forgot password? Click here to reset