A Segmentation-aware Deep Fusion Network for Compressed Sensing MRI

by   Zhiwen Fan, et al.

Compressed sensing MRI is a classic inverse problem in the field of computational imaging, accelerating the MR imaging by measuring less k-space data. The deep neural network models provide the stronger representation ability and faster reconstruction compared with "shallow" optimization-based methods. However, in the existing deep-based CS-MRI models, the high-level semantic supervision information from massive segmentation-labels in MRI dataset is overlooked. In this paper, we proposed a segmentation-aware deep fusion network called SADFN for compressed sensing MRI. The multilayer feature aggregation (MLFA) method is introduced here to fuse all the features from different layers in the segmentation network. Then, the aggregated feature maps containing semantic information are provided to each layer in the reconstruction network with a feature fusion strategy. This guarantees the reconstruction network is aware of the different regions in the image it reconstructs, simplifying the function mapping. We prove the utility of the cross-layer and cross-task information fusion strategy by comparative study. Extensive experiments on brain segmentation benchmark MRBrainS validated that the proposed SADFN model achieves state-of-the-art accuracy in compressed sensing MRI. This paper provides a novel approach to guide the low-level visual task using the information from mid- or high-level task.


page 2

page 8

page 12

page 14


Joint CS-MRI Reconstruction and Segmentation with a Unified Deep Network

The need for fast acquisition and automatic analysis of MRI data is grow...

GA-HQS: MRI reconstruction via a generically accelerated unfolding approach

Deep unfolding networks (DUNs) are the foremost methods in the realm of ...

A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstruction

In multi-contrast magnetic resonance imaging (MRI), compressed sensing t...

MRI Reconstruction via Cascaded Channel-wise Attention Network

We consider an MRI reconstruction problem with input of k-space data at ...

Image Resizing by Reconstruction from Deep Features

Traditional image resizing methods usually work in pixel space and use v...

Universal Generative Modeling for Calibration-free Parallel Mr Imaging

The integration of compressed sensing and parallel imaging (CS-PI) provi...

Compressed Sensing MRI via a Multi-scale Dilated Residual Convolution Network

Magnetic resonance imaging (MRI) reconstruction is an active inverse pro...

Please sign up or login with your details

Forgot password? Click here to reset