Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance

11/12/2020
by   Zhe Xu, et al.
0

Multimodal image registration (MIR) is a fundamental procedure in many image-guided therapies. Recently, unsupervised learning-based methods have demonstrated promising performance over accuracy and efficiency in deformable image registration. However, the estimated deformation fields of the existing methods fully rely on the to-be-registered image pair. It is difficult for the networks to be aware of the mismatched boundaries, resulting in unsatisfactory organ boundary alignment. In this paper, we propose a novel multimodal registration framework, which leverages the deformation fields estimated from both: (i) the original to-be-registered image pair, (ii) their corresponding gradient intensity maps, and adaptively fuses them with the proposed gated fusion module. With the help of auxiliary gradient-space guidance, the network can concentrate more on the spatial relationship of the organ boundary. Experimental results on two clinically acquired CT-MRI datasets demonstrate the effectiveness of our proposed approach.

READ FULL TEXT

page 1

page 4

research
07/06/2020

Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration

Deformable image registration between Computed Tomography (CT) images an...
research
02/13/2018

BIRNet: Brain Image Registration Using Dual-Supervised Fully Convolutional Networks

In this paper, we propose a deep learning approach for image registratio...
research
09/15/2020

F3RNet: Full-Resolution Residual Registration Network for Multimodal Image Registration

Multimodal deformable image registration is essential for many image-gui...
research
06/09/2021

PCNet: A Structure Similarity Enhancement Method for Multispectral and Multimodal Image Registration

Multispectral and multimodal image processing is important in the commun...
research
11/12/2020

Unimodal Cyclic Regularization for Training Multimodal Image Registration Networks

The loss function of an unsupervised multimodal image registration frame...
research
10/19/2021

Cross-Sim-NGF: FFT-Based Global Rigid Multimodal Alignment of Image Volumes using Normalized Gradient Fields

Multimodal image alignment involves finding spatial correspondences betw...
research
10/30/2020

CNN-Driven Quasiconformal Model for Large Deformation Image Registration

Image registration has been widely studied over the past several decades...

Please sign up or login with your details

Forgot password? Click here to reset