ProtoSeg: Interpretable Semantic Segmentation with Prototypical Parts

01/28/2023
by   Mikołaj Sacha, et al.
0

We introduce ProtoSeg, a novel model for interpretable semantic image segmentation, which constructs its predictions using similar patches from the training set. To achieve accuracy comparable to baseline methods, we adapt the mechanism of prototypical parts and introduce a diversity loss function that increases the variety of prototypes within each class. We show that ProtoSeg discovers semantic concepts, in contrast to standard segmentation models. Experiments conducted on Pascal VOC and Cityscapes datasets confirm the precision and transparency of the presented method.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 7

page 8

research
04/05/2019

Multiphase Level-Set Loss for Semi-Supervised and Unsupervised Segmentation with Deep Learning

Recent state-of-the-art image segmentation algorithms are mostly based o...
research
07/07/2021

Hierarchical Semantic Segmentation using Psychometric Learning

Assigning meaning to parts of image data is the goal of semantic image s...
research
05/12/2021

Segmenter: Transformer for Semantic Segmentation

Image segmentation is often ambiguous at the level of individual image p...
research
03/08/2022

Generating 3D Bio-Printable Patches Using Wound Segmentation and Reconstruction to Treat Diabetic Foot Ulcers

We introduce AiD Regen, a novel system that generates 3D wound models co...
research
02/26/2020

Towards Interpretable Semantic Segmentation via Gradient-weighted Class Activation Mapping

Convolutional neural networks have become state-of-the-art in a wide ran...
research
04/10/2017

Loss Max-Pooling for Semantic Image Segmentation

We introduce a novel loss max-pooling concept for handling imbalanced tr...
research
06/05/2016

Better Image Segmentation by Exploiting Dense Semantic Predictions

It is well accepted that image segmentation can benefit from utilizing m...

Please sign up or login with your details

Forgot password? Click here to reset