DeepNAT: Deep Convolutional Neural Network for Segmenting Neuroanatomy

by   Christian Wachinger, et al.

We introduce DeepNAT, a 3D Deep convolutional neural network for the automatic segmentation of NeuroAnaTomy in T1-weighted magnetic resonance images. DeepNAT is an end-to-end learning-based approach to brain segmentation that jointly learns an abstract feature representation and a multi-class classification. We propose a 3D patch-based approach, where we do not only predict the center voxel of the patch but also neighbors, which is formulated as multi-task learning. To address a class imbalance problem, we arrange two networks hierarchically, where the first one separates foreground from background, and the second one identifies 25 brain structures on the foreground. Since patches lack spatial context, we augment them with coordinates. To this end, we introduce a novel intrinsic parameterization of the brain volume, formed by eigenfunctions of the Laplace-Beltrami operator. As network architecture, we use three convolutional layers with pooling, batch normalization, and non-linearities, followed by fully connected layers with dropout. The final segmentation is inferred from the probabilistic output of the network with a 3D fully connected conditional random field, which ensures label agreement between close voxels. The roughly 2.7 million parameters in the network are learned with stochastic gradient descent. Our results show that DeepNAT compares favorably to state-of-the-art methods. Finally, the purely learning-based method may have a high potential for the adaptation to young, old, or diseased brains by fine-tuning the pre-trained network with a small training sample on the target application, where the availability of larger datasets with manual annotations may boost the overall segmentation accuracy in the future.


page 3

page 5

page 10

page 11

page 12


Hebbian Semi-Supervised Learning in a Sample Efficiency Setting

We propose to address the issue of sample efficiency, in Deep Convolutio...

Low-Rank Deep Convolutional Neural Network for Multi-Task Learning

In this paper, we propose a novel multi-task learning method based on th...

FD-FCN: 3D Fully Dense and Fully Convolutional Network for Semantic Segmentation of Brain Anatomy

In this paper, a 3D patch-based fully dense and fully convolutional netw...

Bayesian convolutional neural network based MRI brain extraction on nonhuman primates

Brain extraction or skull stripping of magnetic resonance images (MRI) i...

Segmentation of Glioma Tumors in Brain Using Deep Convolutional Neural Network

Detection of brain tumor using a segmentation based approach is critical...

Geometry in Active Learning for Binary and Multi-class Image Segmentation

We propose an Active Learning approach to image segmentation that exploi...

Please sign up or login with your details

Forgot password? Click here to reset