Attention-based Interpretable Regression of Gene Expression in Histology

by   Mara Graziani, et al.

Interpretability of deep learning is widely used to evaluate the reliability of medical imaging models and reduce the risks of inaccurate patient recommendations. For models exceeding human performance, e.g. predicting RNA structure from microscopy images, interpretable modelling can be further used to uncover highly non-trivial patterns which are otherwise imperceptible to the human eye. We show that interpretability can reveal connections between the microscopic appearance of cancer tissue and its gene expression profiling. While exhaustive profiling of all genes from the histology images is still challenging, we estimate the expression values of a well-known subset of genes that is indicative of cancer molecular subtype, survival, and treatment response in colorectal cancer. Our approach successfully identifies meaningful information from the image slides, highlighting hotspots of high gene expression. Our method can help characterise how gene expression shapes tissue morphology and this may be beneficial for patient stratification in the pathology unit. The code is available on GitHub.


page 6

page 15

page 16

page 17


hist2RNA: An efficient deep learning architecture to predict gene expression from breast cancer histopathology images

Gene expression can be used to subtype breast cancer with improved predi...

Warp: a method for neural network interpretability applied to gene expression profiles

We show a proof of principle for warping, a method to interpret the inne...

Predicting phenotypes from microarrays using amplified, initially marginal, eigenvector regression

Motivation: The discovery of relationships between gene expression measu...

A SVM Model for Candidate Y-chromosome Gene Discovery in Prostate Cancer

Prostate cancer is widely known to be one of the most common cancers amo...

Predicting molecular phenotypes from histopathology images: a transcriptome-wide expression-morphology analysis in breast cancer

Molecular phenotyping is central in cancer precision medicine, but remai...

Computational Pathology: Challenges and Promises for Tissue Analysis

The histological assessment of human tissue has emerged as the key chall...

Please sign up or login with your details

Forgot password? Click here to reset