Consistency-aware Shading Orders Selective Fusion for Intrinsic Image Decomposition

by   Yuanliu Liu, et al.

We address the problem of decomposing a single image into reflectance and shading. The difficulty comes from the fact that the components of image---the surface albedo, the direct illumination, and the ambient illumination---are coupled heavily in observed image. We propose to infer the shading by ordering pixels by their relative brightness, without knowing the absolute values of the image components beforehand. The pairwise shading orders are estimated in two ways: brightness order and low-order fittings of local shading field. The brightness order is a non-local measure, which can be applied to any pair of pixels including those whose reflectance and shading are both different. The low-order fittings are used for pixel pairs within local regions of smooth shading. Together, they can capture both global order structure and local variations of the shading. We propose a Consistency-aware Selective Fusion (CSF) to integrate the pairwise orders into a globally consistent order. The iterative selection process solves the conflicts between the pairwise orders obtained by different estimation methods. Inconsistent or unreliable pairwise orders will be automatically excluded from the fusion to avoid polluting the global order. Experiments on the MIT Intrinsic Image dataset show that the proposed model is effective at recovering the shading including deep shadows. Our model also works well on natural images from the IIW dataset, the UIUC Shadow dataset and the NYU-Depth dataset, where the colors of direct lights and ambient lights are quite different.


page 1

page 2

page 3

page 5

page 7

page 10

page 17

page 18


NLHD: A Pixel-Level Non-Local Retinex Model for Low-Light Image Enhancement

Retinex model has been applied to low-light image enhancement in many ex...

Affinity CNN: Learning Pixel-Centric Pairwise Relations for Figure/Ground Embedding

Spectral embedding provides a framework for solving perceptual organizat...

Flash Lightens Gray Pixels

In the real world, a scene is usually cast by multiple illuminants and h...

Instance-aware Image and Sentence Matching with Selective Multimodal LSTM

Effective image and sentence matching depends on how to well measure the...

Self-Supervised Intrinsic Image Decomposition Network Considering Reflectance Consistency

We propose a novel intrinsic image decomposition network considering ref...

STAR: A Structure and Texture Aware Retinex Model

Retinex theory is developed mainly to decompose an image into the illumi...

Please sign up or login with your details

Forgot password? Click here to reset