Natural Image Reconstruction from fMRI using Deep Learning: A Survey

10/18/2021
by   Zarina Rakhimberdina, et al.
12

With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain decoding tasks is the accurate reconstruction of the perceived natural images from brain activities measured by functional magnetic resonance imaging (fMRI). In this work, we survey the most recent deep learning methods for natural image reconstruction from fMRI. We examine these methods in terms of architectural design, benchmark datasets, and evaluation metrics and present a fair performance evaluation across standardized evaluation metrics. Finally, we discuss the strengths and limitations of existing studies and present potential future directions.

READ FULL TEXT

page 4

page 10

page 18

page 19

page 20

page 30

page 31

page 33

research
05/27/2022

Multiscale Voxel Based Decoding For Enhanced Natural Image Reconstruction From Brain Activity

Reconstructing perceived images from human brain activity monitored by f...
research
08/09/2021

Using Deep Learning for Visual Decoding and Reconstruction from Brain Activity: A Review

This literature review will discuss the use of deep learning methods for...
research
02/25/2023

BrainCLIP: Bridging Brain and Visual-Linguistic Representation via CLIP for Generic Natural Visual Stimulus Decoding from fMRI

Reconstructing perceived natural images or decoding their categories fro...
research
06/20/2023

Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputs

The integration of deep learning and neuroscience has been advancing rap...
research
05/26/2023

Contrast, Attend and Diffuse to Decode High-Resolution Images from Brain Activities

Decoding visual stimuli from neural responses recorded by functional Mag...
research
10/07/2022

Computational imaging with the human brain

Brain-computer interfaces (BCIs) are enabling a range of new possibiliti...
research
04/25/2017

Sharing deep generative representation for perceived image reconstruction from human brain activity

Decoding human brain activities via functional magnetic resonance imagin...

Please sign up or login with your details

Forgot password? Click here to reset