One Network to Solve Them All: A Sequential Multi-Task Joint Learning Network Framework for MR Imaging Pipeline

by   Zhiwen Wang, et al.

Magnetic resonance imaging (MRI) acquisition, reconstruction, and segmentation are usually processed independently in the conventional practice of MRI workflow. It is easy to notice that there are significant relevances among these tasks and this procedure artificially cuts off these potential connections, which may lead to losing clinically important information for the final diagnosis. To involve these potential relations for further performance improvement, a sequential multi-task joint learning network model is proposed to train a combined end-to-end pipeline in a differentiable way, aiming at exploring the mutual influence among those tasks simultaneously. Our design consists of three cascaded modules: 1) deep sampling pattern learning module optimizes the k-space sampling pattern with predetermined sampling rate; 2) deep reconstruction module is dedicated to reconstructing MR images from the undersampled data using the learned sampling pattern; 3) deep segmentation module encodes MR images reconstructed from the previous module to segment the interested tissues. The proposed model retrieves the latently interactive and cyclic relations among those tasks, from which each task will be mutually beneficial. The proposed framework is verified on MRB dataset, which achieves superior performance on other SOTA methods in terms of both reconstruction and segmentation.


page 5

page 6

page 7

page 11


JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI

Multi-contrast Magnetic Resonance Imaging (MRI) generates multiple medic...

End-to-End Sequential Sampling and Reconstruction for MR Imaging

Accelerated MRI shortens acquisition time by subsampling in the measurem...

Multi-task MR Imaging with Iterative Teacher Forcing and Re-weighted Deep Learning

Noises, artifacts, and loss of information caused by the magnetic resona...

Fast T2w/FLAIR MRI Acquisition by Optimal Sampling of Information Complementary to Pre-acquired T1w MRI

Recent studies on T1-assisted MRI reconstruction for under-sampled image...

Reconstruction and Segmentation of Parallel MR Data using Image Domain DEEP-SLR

The main focus of this work is a novel framework for the joint reconstru...

A Unifying Multi-sampling-ratio CS-MRI Framework With Two-grid-cycle Correction and Geometric Prior Distillation

CS is an efficient method to accelerate the acquisition of MR images fro...

Multitask Learning for Improved Late Mechanical Activation Detection of Heart from Cine DENSE MRI

The selection of an optimal pacing site, which is ideally scar-free and ...

Please sign up or login with your details

Forgot password? Click here to reset