Visible and NIR Image Fusion Algorithm Based on Information Complementarity

09/19/2023
by   Zhuo Li, et al.
0

Visible and near-infrared(NIR) band sensors provide images that capture complementary spectral radiations from a scene. And the fusion of the visible and NIR image aims at utilizing their spectrum properties to enhance image quality. However, currently visible and NIR fusion algorithms cannot well take advantage of spectrum properties, as well as lack information complementarity, which results in color distortion and artifacts. Therefore, this paper designs a complementary fusion model from the level of physical signals. First, in order to distinguish between noise and useful information, we use two layers of the weight-guided filter and guided filter to obtain texture and edge layers, respectively. Second, to generate the initial visible-NIR complementarity weight map, the difference maps of visible and NIR are filtered by the extend-DoG filter. After that, the significant region of NIR night-time compensation guides the initial complementarity weight map by the arctanI function. Finally, the fusion images can be generated by the complementarity weight maps of visible and NIR images, respectively. The experimental results demonstrate that the proposed algorithm can not only well take advantage of the spectrum properties and the information complementarity, but also avoid color unnatural while maintaining naturalness, which outperforms the state-of-the-art.

READ FULL TEXT

page 2

page 5

page 8

page 9

research
09/02/2020

When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

Infrared and visible image fusion, as a hot topic in image processing an...
research
03/26/2022

Near-Infrared Depth-Independent Image Dehazing using Haar Wavelets

We propose a fusion algorithm for haze removal that combines color infor...
research
08/25/2023

Fusion of Infrared and Visible Images based on Spatial-Channel Attentional Mechanism

In the study, we present AMFusionNet, an innovative approach to infrared...
research
10/01/2016

Near-Infrared Image Dehazing Via Color Regularization

Near-infrared imaging can capture haze-free near-infrared gray images an...
research
01/19/2023

Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models

Color plays an important role in human visual perception, reflecting the...
research
12/08/2019

High-Freedom Inverse Design with Deep Neural Network for Metasurface Filter in the Visible

In order to obtain a metasurface structure capable of filtering the ligh...
research
02/09/2020

VIFB: A Visible and Infrared Image Fusion Benchmark

Visible and infrared image fusion is one of the most important areas in ...

Please sign up or login with your details

Forgot password? Click here to reset