Registration and Fusion of Multi-Spectral Images Using a Novel Edge Descriptor

11/05/2017
by   Nati Ofir, et al.
0

In this paper we introduce a fully end-to-end approach for multi-spectral image registration and fusion. Our method for fusion combines images from different spectral channels into a single fused image by different approaches for low and high frequency signals. A prerequisite of fusion is a stage of geometric alignment between the spectral bands, commonly referred to as registration. Unfortunately, common methods for image registration of a single spectral channel do not yield reasonable results on images from different modalities. For that end, we introduce a new algorithm for multi-spectral image registration, based on a novel edge descriptor of feature points. Our method achieves an accurate alignment of a level that allows us to further fuse the images. As our experiments show, we produce a high quality of multi-spectral image registration and fusion under many challenging scenarios.

READ FULL TEXT

page 1

page 3

page 6

page 7

research
01/16/2018

Deep Multi-Spectral Registration Using Invariant Descriptor Learning

In this paper, we introduce a novel deep-learning method to align cross-...
research
08/22/2023

Improving Misaligned Multi-modality Image Fusion with One-stage Progressive Dense Registration

Misalignments between multi-modality images pose challenges in image fus...
research
02/15/2022

Deep Learning-Assisted Co-registration of Full-Spectral Autofluorescence Lifetime Microscopic Images with H E-Stained Histology Images

Autofluorescence lifetime images reveal unique characteristics of endoge...
research
08/05/2022

Driving Points Prediction For Abdominal Probabilistic Registration

Inter-patient abdominal registration has various applications, from phar...
research
07/07/2023

Registration-Free Hybrid Learning Empowers Simple Multimodal Imaging System for High-quality Fusion Detection

Multimodal fusion detection always places high demands on the imaging sy...
research
06/28/2018

Towards automatic initialization of registration algorithms using simulated endoscopy images

Registering images from different modalities is an active area of resear...
research
10/04/2021

BPFNet: A Unified Framework for Bimodal Palmprint Alignment and Fusion

Bimodal palmprint recognition leverages palmprint and palm vein images s...

Please sign up or login with your details

Forgot password? Click here to reset