Explainable Diabetic Retinopathy Detection and Retinal Image Generation

by   Yuhao Niu, et al.

Though deep learning has shown successful performance in classifying the label and severity stage of certain diseases, most of them give few explanations on how to make predictions. Inspired by Koch's Postulates, the foundation in evidence-based medicine (EBM) to identify the pathogen, we propose to exploit the interpretability of deep learning application in medical diagnosis. By determining and isolating the neuron activation patterns on which diabetic retinopathy (DR) detector relies to make decisions, we demonstrate the direct relation between the isolated neuron activation and lesions for a pathological explanation. To be specific, we first define novel pathological descriptors using activated neurons of the DR detector to encode both spatial and appearance information of lesions. Then, to visualize the symptom encoded in the descriptor, we propose Patho-GAN, a new network to synthesize medically plausible retinal images. By manipulating these descriptors, we could even arbitrarily control the position, quantity, and categories of generated lesions. We also show that our synthesized images carry the symptoms directly related to diabetic retinopathy diagnosis. Our generated images are both qualitatively and quantitatively superior to the ones by previous methods. Besides, compared to existing methods that take hours to generate an image, our second level speed endows the potential to be an effective solution for data augmentation.


page 1

page 2

page 4

page 5

page 7

page 8

page 9

page 10


Pathological Evidence Exploration in Deep Retinal Image Diagnosis

Though deep learning has shown successful performance in classifying the...

A deep learning model for classification of diabetic retinopathy in eye fundus images based on retinal lesion detection

Diabetic retinopathy (DR) is the result of a complication of diabetes af...

Deep image mining for diabetic retinopathy screening

Deep learning is quickly becoming the leading methodology for medical im...

Strategy for Rapid Diabetic Retinopathy Exposure Based on Enhanced Feature Extraction Processing

In the modern world, one of the most severe eye infections brought on by...

Iterative augmentation of visual evidence for weakly-supervised lesion localization in deep interpretability frameworks

Interpretability of deep learning (DL) systems is gaining attention in m...

Evidence Based Prediction and Progression Monitoring on Retinal Images from Three Nations

Purpose: The aim of this work is to demonstrate how a retinal image anal...

Please sign up or login with your details

Forgot password? Click here to reset