Extracting Universal Representations of Cognition across Brain-Imaging Studies

09/17/2018
by   Arthur Mensch, et al.
4

The size of publicly available data in cognitive neuro-imaging has increased a lot in recent years, thanks to strong research and community efforts. Exploiting this wealth of data demands new methods to turn the heterogeneous cognitive information held in different task-fMRI studies into common-universal-cognitive models. In this paper, we pool data from large fMRI repositories to predict psychological conditions from statistical brain maps across different studies and subjects. We leverage advances in deep learning, intermediate representations and multi-task learning to learn universal interpretable low-dimensional representations of brain images, usable for predicting psychological stimuli in all input studies. The method improves decoding performance for 80 flow from every study to the others: it notably gives a strong performance boost when decoding studies of small size. The trained low-dimensional representation-task-optimized networks-is interpretable as a set of basis cognitive dimensions relevant to meaningful categories of cognitive stimuli. Our approach opens new ways of extracting information from brain maps, overcoming the low power of typical fMRI studies.

READ FULL TEXT

page 3

page 5

page 7

page 9

page 22

page 23

research
10/31/2017

Learning Neural Representations of Human Cognition across Many fMRI Studies

Cognitive neuroscience is enjoying rapid increase in extensive public br...
research
01/09/2017

Deep driven fMRI decoding of visual categories

Deep neural networks have been developed drawing inspiration from the br...
research
09/19/2022

On the benefits of self-taught learning for brain decoding

We study the benefits of using a large public neuroimaging database comp...
research
11/15/2013

Mapping cognitive ontologies to and from the brain

Imaging neuroscience links brain activation maps to behavior and cogniti...
research
03/05/2020

Fine-grain atlases of functional modes for fMRI analysis

Population imaging markedly increased the size of functional-imaging dat...
research
03/03/2023

The Grossberg Code: Universal Neural Network Signatures of Perceptual Experience

Two universal functional principles of Adaptive Resonance Theory simulat...
research
11/16/2021

Grounding Psychological Shape Space in Convolutional Neural Networks

Shape information is crucial for human perception and cognition, and sho...

Please sign up or login with your details

Forgot password? Click here to reset