Progressively Volumetrized Deep Generative Models for Data-Efficient Contextual Learning of MR Image Recovery

by   Mahmut Yurt, et al.

Magnetic resonance imaging (MRI) offers the flexibility to image a given anatomic volume under a multitude of tissue contrasts. Yet, scan time considerations put stringent limits on the quality and diversity of MRI data. The gold-standard approach to alleviate this limitation is to recover high-quality images from data undersampled across various dimensions such as the Fourier domain or contrast sets. A central divide among recovery methods is whether the anatomy is processed per volume or per cross-section. Volumetric models offer enhanced capture of global contextual information, but they can suffer from suboptimal learning due to elevated model complexity. Cross-sectional models with lower complexity offer improved learning behavior, yet they ignore contextual information across the longitudinal dimension of the volume. Here, we introduce a novel data-efficient progressively volumetrized generative model (ProvoGAN) that decomposes complex volumetric image recovery tasks into a series of simpler cross-sectional tasks across individual rectilinear dimensions. ProvoGAN effectively captures global context and recovers fine-structural details across all dimensions, while maintaining low model complexity and data-efficiency advantages of cross-sectional models. Comprehensive demonstrations on mainstream MRI reconstruction and synthesis tasks show that ProvoGAN yields superior performance to state-of-the-art volumetric and cross-sectional models.


page 5

page 10

page 12

page 24

page 25

page 26


Recon-GLGAN: A Global-Local context based Generative Adversarial Network for MRI Reconstruction

Magnetic resonance imaging (MRI) is one of the best medical imaging moda...

Learning from a Handful Volumes: MRI Resolution Enhancement with Volumetric Super-Resolution Forests

Magnetic resonance imaging (MRI) enables 3-D imaging of anatomical struc...

Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis

Cross-modality medical image synthesis is a critical topic and has the p...

K-space and Image Domain Collaborative Energy based Model for Parallel MRI Reconstruction

Decreasing magnetic resonance (MR) image acquisition times can potential...

Context-Sensitive Super-Resolution for Fast Fetal Magnetic Resonance Imaging

3D Magnetic Resonance Imaging (MRI) is often a trade-off between fast bu...

Bayesian Volumetric Autoregressive generative models for better semisupervised learning

Deep generative models are rapidly gaining traction in medical imaging. ...

Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models

We describe Countersynth, a conditional generative model of diffeomorphi...

Please sign up or login with your details

Forgot password? Click here to reset