Efficacy of Pixel-Level OOD Detection for Semantic Segmentation

11/07/2019
by   Matt Angus, et al.
58

The detection of out of distribution samples for image classification has been widely researched. Safety critical applications, such as autonomous driving, would benefit from the ability to localise the unusual objects causing the image to be out of distribution. This paper adapts state-of-the-art methods for detecting out of distribution images for image classification to the new task of detecting out of distribution pixels, which can localise the unusual objects. It further experimentally compares the adapted methods on two new datasets derived from existing semantic segmentation datasets using PSPNet and DeeplabV3+ architectures, as well as proposing a new metric for the task. The evaluation shows that the performance ranking of the compared methods does not transfer to the new task and every method performs significantly worse than their image-level counterparts.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
05/21/2021

Safety Metrics for Semantic Segmentation in Autonomous Driving

Within the context of autonomous driving, safety-related metrics for dee...
research
07/21/2021

Weighted Intersection over Union (wIoU): A New Evaluation Metric for Image Segmentation

In this paper, we propose a novel evaluation metric for performance eval...
research
09/02/2019

This is not what I imagined: Error Detection for Semantic Segmentation through Visual Dissimilarity

There has been a remarkable progress in the accuracy of semantic segment...
research
10/12/2020

Increasing the Robustness of Semantic Segmentation Models with Painting-by-Numbers

For safety-critical applications such as autonomous driving, CNNs have t...
research
04/05/2019

The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentation

Deep learning has enabled impressive progress in the accuracy of semanti...
research
07/19/2021

OODformer: Out-Of-Distribution Detection Transformer

A serious problem in image classification is that a trained model might ...
research
08/19/2021

FSNet: A Failure Detection Framework for Semantic Segmentation

Semantic segmentation is an important task that helps autonomous vehicle...

Please sign up or login with your details

Forgot password? Click here to reset