Flexible Conditional Image Generation of Missing Data with Learned Mental Maps

08/29/2019
by   Benjamin Hou, et al.
13

Real-world settings often do not allow acquisition of high-resolution volumetric images for accurate morphological assessment and diagnostic. In clinical practice it is frequently common to acquire only sparse data (e.g. individual slices) for initial diagnostic decision making. Thereby, physicians rely on their prior knowledge (or mental maps) of the human anatomy to extrapolate the underlying 3D information. Accurate mental maps require years of anatomy training, which in the first instance relies on normative learning, i.e. excluding pathology. In this paper, we leverage Bayesian Deep Learning and environment mapping to generate full volumetric anatomy representations from none to a small, sparse set of slices. We evaluate proof of concept implementations based on Generative Query Networks (GQN) and Conditional BRUNO using abdominal CT and brain MRI as well as in a clinical application involving sparse, motion-corrupted MR acquisition for fetal imaging. Our approach allows to reconstruct 3D volumes from 1 to 4 tomographic slices, with a SSIM of 0.7+ and cross-correlation of 0.8+ compared to the 3D ground truth.

READ FULL TEXT

page 6

page 9

page 10

11/11/2022

Self-Supervised Isotropic Superresolution Fetal Brain MRI

Superresolution T2-weighted fetal-brain magnetic-resonance imaging (FBMR...
05/28/2018

Deep CT to MR Synthesis using Paired and Unpaired Data

MR imaging will play a very important role in radiotherapy treatment pla...
11/30/2020

Improved Diagnosis of Tibiofemoral Cartilage Defects on MRI Images Using Deep Learning

Background: MRI is the modality of choice for cartilage imaging; however...
01/04/2023

UNAEN: Unsupervised Abnomality Extraction Network for MRI Motion Artifact Reduction

Motion artifact reduction is one of the most concerned problems in magne...
12/18/2021

A Streaming Volumetric Image Generation Framework for Development and Evaluation of Out-of-Core Methods

Advances in 3D imaging technology in recent years have allowed for incre...
02/08/2022

Learning Similarity Metrics for Volumetric Simulations with Multiscale CNNs

Simulations that produce three-dimensional data are ubiquitous in scienc...

Please sign up or login with your details

Forgot password? Click here to reset