Multi-modal Dynamic Graph Network: Coupling Structural and Functional Connectome for Disease Diagnosis and Classification

by   Yanwu Yang, et al.

Multi-modal neuroimaging technology has greatlly facilitated the efficiency and diagnosis accuracy, which provides complementary information in discovering objective disease biomarkers. Conventional deep learning methods, e.g. convolutional neural networks, overlook relationships between nodes and fail to capture topological properties in graphs. Graph neural networks have been proven to be of great importance in modeling brain connectome networks and relating disease-specific patterns. However, most existing graph methods explicitly require known graph structures, which are not available in the sophisticated brain system. Especially in heterogeneous multi-modal brain networks, there exists a great challenge to model interactions among brain regions in consideration of inter-modal dependencies. In this study, we propose a Multi-modal Dynamic Graph Convolution Network (MDGCN) for structural and functional brain network learning. Our method benefits from modeling inter-modal representations and relating attentive multi-model associations into dynamic graphs with a compositional correspondence matrix. Moreover, a bilateral graph convolution layer is proposed to aggregate multi-modal representations in terms of multi-modal associations. Extensive experiments on three datasets demonstrate the superiority of our proposed method in terms of disease classification, with the accuracy of 90.4 predicting Mild Cognitive Impairment (MCI), Parkinson's disease (PD), and schizophrenia (SCHZ) respectively. Furthermore, our statistical evaluations on the correspondence matrix exhibit a high correspondence with previous evidence of biomarkers.


page 1

page 6


Multi-modal Graph Neural Network for Early Diagnosis of Alzheimer's Disease from sMRI and PET Scans

In recent years, deep learning models have been applied to neuroimaging ...

Input Agnostic Deep Learning for Alzheimer's Disease Classification Using Multimodal MRI Images

Alzheimer's disease (AD) is a progressive brain disorder that causes mem...

Self-Attention Equipped Graph Convolutions for Disease Prediction

Multi-modal data comprising imaging (MRI, fMRI, PET, etc.) and non-imagi...

Multi-modal Multi-kernel Graph Learning for Autism Prediction and Biomarker Discovery

Multi-modal integration and classification based on graph learning is am...

Multi-resolution Graph Neural Network for Identifying Disease-specific Variations in Brain Connectivity

Convolution Neural Network (CNN) recently have been adopted in several n...

Machine Learning Partners in Criminal Networks

Recent research has shown that criminal networks have complex organizati...

Multi-modal Disease Classification in Incomplete Datasets Using Geometric Matrix Completion

In large population-based studies and in clinical routine, tasks like di...

Please sign up or login with your details

Forgot password? Click here to reset