Deep learning of fMRI big data: a novel approach to subject-transfer decoding

by   Sotetsu Koyamada, et al.
Kyoto University

As a technology to read brain states from measurable brain activities, brain decoding are widely applied in industries and medical sciences. In spite of high demands in these applications for a universal decoder that can be applied to all individuals simultaneously, large variation in brain activities across individuals has limited the scope of many studies to the development of individual-specific decoders. In this study, we used deep neural network (DNN), a nonlinear hierarchical model, to construct a subject-transfer decoder. Our decoder is the first successful DNN-based subject-transfer decoder. When applied to a large-scale functional magnetic resonance imaging (fMRI) database, our DNN-based decoder achieved higher decoding accuracy than other baseline methods, including support vector machine (SVM). In order to analyze the knowledge acquired by this decoder, we applied principal sensitivity analysis (PSA) to the decoder and visualized the discriminative features that are common to all subjects in the dataset. Our PSA successfully visualized the subject-independent features contributing to the subject-transferability of the trained decoder.


page 14

page 17


Deep Transfer Learning For Whole-Brain fMRI Analyses

The application of deep learning (DL) models to the decoding of cognitiv...

Domain Independent SVM for Transfer Learning in Brain Decoding

Brain imaging data are important in brain sciences yet expensive to obta...

Real-time fMRI-based Brain Computer Interface: A Review

In recent years, the rapid development of neuroimaging technology has be...

Deep Neural Generative Model of Functional MRI Images for Psychiatric Disorder Diagnosis

Accurate diagnosis of psychiatric disorders plays a critical role in imp...

Attention module improves both performance and interpretability of 4D fMRI decoding neural network

Decoding brain cognitive states from neuroimaging signals is an importan...

Evaluating deep transfer learning for whole-brain cognitive decoding

Research in many fields has shown that transfer learning (TL) is well-su...

Unsupervised deep learning for individualized brain functional network identification

A novel unsupervised deep learning method is developed to identify indiv...

Please sign up or login with your details

Forgot password? Click here to reset