Two-stage MR Image Segmentation Method for Brain Tumors based on Attention Mechanism

by   Li Zhu, et al.

Multimodal magnetic resonance imaging (MRI) can reveal different patterns of human tissue and is crucial for clinical diagnosis. However, limited by cost, noise and manual labeling, obtaining diverse and reliable multimodal MR images remains a challenge. For the same lesion, different MRI manifestations have great differences in background information, coarse positioning and fine structure. In order to obtain better generation and segmentation performance, a coordination-spatial attention generation adversarial network (CASP-GAN) based on the cycle-consistent generative adversarial network (CycleGAN) is proposed. The performance of the generator is optimized by introducing the Coordinate Attention (CA) module and the Spatial Attention (SA) module. The two modules can make full use of the captured location information, accurately locating the interested region, and enhancing the generator model network structure. The ability to extract the structure information and the detailed information of the original medical image can help generate the desired image with higher quality. There exist some problems in the original CycleGAN that the training time is long, the parameter amount is too large, and it is difficult to converge. In response to this problem, we introduce the Coordinate Attention (CA) module to replace the Res Block to reduce the number of parameters, and cooperate with the spatial information extraction network above to strengthen the information extraction ability. On the basis of CASP-GAN, an attentional generative cross-modality segmentation (AGCMS) method is further proposed. This method inputs the modalities generated by CASP-GAN and the real modalities into the segmentation network for brain tumor segmentation. Experimental results show that CASP-GAN outperforms CycleGAN and some state-of-the-art methods in PSNR, SSMI and RMSE in most tasks.


page 13

page 14

page 17

page 18


High Tissue Contrast MRI Synthesis Using Multi-Stage Attention-GAN for Glioma Segmentation

Magnetic resonance imaging (MRI) provides varying tissue contrast images...

Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans

The magnetic resonance (MR) analysis of brain tumors is widely used for ...

SA-GAN: Structure-Aware Generative Adversarial Network for Shape-Preserving Synthetic CT Generation

In medical image synthesis, model training could be challenging due to t...

Dual Adversarial Learning with Attention Mechanism for Fine-grained Medical Image Synthesis

Medical imaging plays a critical role in various clinical applications. ...

Multi-Task Generative Adversarial Network for Handling Imbalanced Clinical Data

We propose a new generative adversarial architecture to mitigate imbalan...

Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

Data-driven automatic approaches have demonstrated their great potential...

Structure Unbiased Adversarial Model for Medical Image Segmentation

Generative models have been widely proposed in image recognition to gene...

Please sign up or login with your details

Forgot password? Click here to reset