Prototype Guided Network for Anomaly Segmentation

by   Yiqing Hao, et al.

Semantic segmentation methods can not directly identify abnormal objects in images. Anomaly Segmentation algorithm from this realistic setting can distinguish between in-distribution objects and Out-Of-Distribution (OOD) objects and output the anomaly probability for pixels. In this paper, a Prototype Guided Anomaly segmentation Network (PGAN) is proposed to extract semantic prototypes for in-distribution training data from limited annotated images. In the model, prototypes are used to model the hierarchical category semantic information and distinguish OOD pixels. The proposed PGAN model includes a semantic segmentation network and a prototype extraction network. Similarity measures are adopted to optimize the prototypes. The learned semantic prototypes are used as category semantics to compare the similarity with features extracted from test images and then to generate semantic segmentation prediction. The proposed prototype extraction network can also be integrated into most semantic segmentation networks and recognize OOD pixels. On the StreetHazards dataset, the proposed PGAN model produced mIoU of 53.4 for anomaly segmentation. The experimental results demonstrate PGAN may achieve the SOTA performance in the anomaly segmentation tasks.


page 1

page 2

page 3


Detecting Anomalies in Semantic Segmentation with Prototypes

Traditional semantic segmentation methods can recognize at test time onl...

Semi-supervised Semantic Segmentation with Prototype-based Consistency Regularization

Semi-supervised semantic segmentation requires the model to effectively ...

Number-Adaptive Prototype Learning for 3D Point Cloud Semantic Segmentation

3D point cloud semantic segmentation is one of the fundamental tasks for...

Global Semantic Description of Objects based on Prototype Theory

In this paper, we introduce a novel semantic description approach inspir...

Instance-Aware Observer Network for Out-of-Distribution Object Segmentation

Recent work on Observer Network has shown promising results on Out-Of-Di...

Attentional Prototype Inference for Few-Shot Semantic Segmentation

This paper aims to address few-shot semantic segmentation. While existin...

Rethinking Semantic Segmentation: A Prototype View

Prevalent semantic segmentation solutions, despite their different netwo...

Please sign up or login with your details

Forgot password? Click here to reset