HVS-Inspired Signal Degradation Network for Just Noticeable Difference Estimation

by   Jian Jin, et al.

Significant improvement has been made on just noticeable difference (JND) modelling due to the development of deep neural networks, especially for the recently developed unsupervised-JND generation models. However, they have a major drawback that the generated JND is assessed in the real-world signal domain instead of in the perceptual domain in the human brain. There is an obvious difference when JND is assessed in such two domains since the visual signal in the real world is encoded before it is delivered into the brain with the human visual system (HVS). Hence, we propose an HVS-inspired signal degradation network for JND estimation. To achieve this, we carefully analyze the HVS perceptual process in JND subjective viewing to obtain relevant insights, and then design an HVS-inspired signal degradation (HVS-SD) network to represent the signal degradation in the HVS. On the one hand, the well learnt HVS-SD enables us to assess the JND in the perceptual domain. On the other hand, it provides more accurate prior information for better guiding JND generation. Additionally, considering the requirement that reasonable JND should not lead to visual attention shifting, a visual attention loss is proposed to control JND generation. Experimental results demonstrate that the proposed method achieves the SOTA performance for accurately estimating the redundancy of the HVS. Source code will be available at https://github.com/jianjin008/HVS-SD-JND.


page 1

page 2

page 5

page 7

page 8

page 9


Unsupervised Degradation Representation Learning for Blind Super-Resolution

Most existing CNN-based super-resolution (SR) methods are developed base...

Brain-Inspired Deep Imitation Learning for Autonomous Driving Systems

Autonomous driving has attracted great attention from both academics and...

Domain Intersection and Domain Difference

We present a method for recovering the shared content between two visual...

CFEA: Collaborative Feature Ensembling Adaptation for Domain Adaptation in Unsupervised Optic Disc and Cup Segmentation

Recently, deep neural networks have demonstrated comparable and even bet...

Physics-Driven Turbulence Image Restoration with Stochastic Refinement

Image distortion by atmospheric turbulence is a stochastic degradation, ...

Full RGB Just Noticeable Difference (JND) Modelling

Just Noticeable Difference (JND) has many applications in multimedia sig...

Towards Top-Down Just Noticeable Difference Estimation of Natural Images

Existing efforts on Just noticeable difference (JND) estimation mainly d...

Please sign up or login with your details

Forgot password? Click here to reset