Semi-supervised Learning Approach to Generate Neuroimaging Modalities with Adversarial Training

by   Harrison Nguyen, et al.

Magnetic Resonance Imaging (MRI) of the brain can come in the form of different modalities such as T1-weighted and Fluid Attenuated Inversion Recovery (FLAIR) which has been used to investigate a wide range of neurological disorders. Current state-of-the-art models for brain tissue segmentation and disease classification require multiple modalities for training and inference. However, the acquisition of all of these modalities are expensive, time-consuming, inconvenient and the required modalities are often not available. As a result, these datasets contain large amounts of unpaired data, where examples in the dataset do not contain all modalities. On the other hand, there is smaller fraction of examples that contain all modalities (paired data) and furthermore each modality is high dimensional when compared to number of datapoints. In this work, we develop a method to address these issues with semi-supervised learning in translating between two neuroimaging modalities. Our proposed model, Semi-Supervised Adversarial CycleGAN (SSA-CGAN), uses an adversarial loss to learn from unpaired data points, cycle loss to enforce consistent reconstructions of the mappings and another adversarial loss to take advantage of paired data points. Our experiments demonstrate that our proposed framework produces an improvement in reconstruction error and reduced variance for the pairwise translation of multiple modalities and is more robust to thermal noise when compared to existing methods.


page 2

page 8

page 9

page 10


DS3-Net: Difficulty-perceived Common-to-T1ce Semi-Supervised Multimodal MRI Synthesis Network

Contrast-enhanced T1 (T1ce) is one of the most essential magnetic resona...

Semi-supervised mp-MRI Data Synthesis with StitchLayer and Auxiliary Distance Maximization

In this paper, we address the problem of synthesizing multi-parameter ma...

TCGM: An Information-Theoretic Framework for Semi-Supervised Multi-Modality Learning

Fusing data from multiple modalities provides more information to train ...

Learning Multi-Modal Brain Tumor Segmentation from Privileged Semi-Paired MRI Images with Curriculum Disentanglement Learning

Due to the difficulties of obtaining multimodal paired images in clinica...

Few-shot Learning with Deep Triplet Networks for Brain Imaging Modality Recognition

Image modality recognition is essential for efficient imaging workflows ...

Semi-Supervised Graph-to-Graph Translation

Graph translation is very promising research direction and has a wide ra...

Please sign up or login with your details

Forgot password? Click here to reset