Visible and NIR Image Fusion Algorithm Based on Information Complementarity

by   Zhuo Li, et al.

Visible and near-infrared(NIR) band sensors provide images that capture complementary spectral radiations from a scene. And the fusion of the visible and NIR image aims at utilizing their spectrum properties to enhance image quality. However, currently visible and NIR fusion algorithms cannot well take advantage of spectrum properties, as well as lack information complementarity, which results in color distortion and artifacts. Therefore, this paper designs a complementary fusion model from the level of physical signals. First, in order to distinguish between noise and useful information, we use two layers of the weight-guided filter and guided filter to obtain texture and edge layers, respectively. Second, to generate the initial visible-NIR complementarity weight map, the difference maps of visible and NIR are filtered by the extend-DoG filter. After that, the significant region of NIR night-time compensation guides the initial complementarity weight map by the arctanI function. Finally, the fusion images can be generated by the complementarity weight maps of visible and NIR images, respectively. The experimental results demonstrate that the proposed algorithm can not only well take advantage of the spectrum properties and the information complementarity, but also avoid color unnatural while maintaining naturalness, which outperforms the state-of-the-art.


page 2

page 5

page 8

page 9


When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

Infrared and visible image fusion, as a hot topic in image processing an...

Near-Infrared Depth-Independent Image Dehazing using Haar Wavelets

We propose a fusion algorithm for haze removal that combines color infor...

Fusion of Infrared and Visible Images based on Spatial-Channel Attentional Mechanism

In the study, we present AMFusionNet, an innovative approach to infrared...

Near-Infrared Image Dehazing Via Color Regularization

Near-infrared imaging can capture haze-free near-infrared gray images an...

Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models

Color plays an important role in human visual perception, reflecting the...

High-Freedom Inverse Design with Deep Neural Network for Metasurface Filter in the Visible

In order to obtain a metasurface structure capable of filtering the ligh...

VIFB: A Visible and Infrared Image Fusion Benchmark

Visible and infrared image fusion is one of the most important areas in ...

Please sign up or login with your details

Forgot password? Click here to reset