TBI-GAN: An Adversarial Learning Approach for Data Synthesis on Traumatic Brain Segmentation

by   Xiangyu Zhao, et al.
Shanghai Jiao Tong University
ShanghaiTech University
NetEase, Inc
FUDAN University

Brain network analysis for traumatic brain injury (TBI) patients is critical for its consciousness level assessment and prognosis evaluation, which requires the segmentation of certain consciousness-related brain regions. However, it is difficult to construct a TBI segmentation model as manually annotated MR scans of TBI patients are hard to collect. Data augmentation techniques can be applied to alleviate the issue of data scarcity. However, conventional data augmentation strategies such as spatial and intensity transformation are unable to mimic the deformation and lesions in traumatic brains, which limits the performance of the subsequent segmentation task. To address these issues, we propose a novel medical image inpainting model named TBI-GAN to synthesize TBI MR scans with paired brain label maps. The main strength of our TBI-GAN method is that it can generate TBI images and corresponding label maps simultaneously, which has not been achieved in the previous inpainting methods for medical images. We first generate the inpainted image under the guidance of edge information following a coarse-to-fine manner, and then the synthesized intensity image is used as the prior for label inpainting. Furthermore, we introduce a registration-based template augmentation pipeline to increase the diversity of the synthesized image pairs and enhance the capacity of data augmentation. Experimental results show that the proposed TBI-GAN method can produce sufficient synthesized TBI images with high quality and valid label maps, which can greatly improve the 2D and 3D traumatic brain segmentation performance compared with the alternatives.


page 1

page 3

page 4

page 5

page 7

page 9


Synthesizing brain tumor images and annotations by combining progressive growing GAN and SPADE

Training segmentation networks requires large annotated datasets, but ma...

The Brain Tumor Segmentation (BraTS) Challenge 2023: Local Synthesis of Healthy Brain Tissue via Inpainting

A myriad of algorithms for the automatic analysis of brain MR images is ...

AdLER: Adversarial Training with Label Error Rectification for One-Shot Medical Image Segmentation

Accurate automatic segmentation of medical images typically requires lar...

FMRI data augmentation via synthesis

We present an empirical evaluation of fMRI data augmentation via synthes...

Learning More with Less: GAN-based Medical Image Augmentation

Accurate computer-assisted diagnosis using Convolutional Neural Networks...

Training of a Skull-Stripping Neural Network with efficient data augmentation

Skull-stripping methods aim to remove the non-brain tissue from acquisit...

Please sign up or login with your details

Forgot password? Click here to reset