Edge-aware Plug-and-play Scheme for Semantic Segmentation

by   Jianye Yi, et al.

Semantic segmentation is a classic and fundamental computer vision problem dedicated to assigning each pixel with its corresponding class. Some recent methods introduce edge-based information for improving the segmentation performance. However these methods are specific and limited to certain network architectures, and they can not be transferred to other models or tasks. Therefore, we propose an abstract and universal edge supervision method called Edge-aware Plug-and-play Scheme (EPS), which can be easily and quickly applied to any semantic segmentation models. The core is edge-width/thickness preserving guided for semantic segmentation. The EPS first extracts the Edge Ground Truth (Edge GT) with a predefined edge thickness from the training data; and then for any network architecture, it directly copies the decoder head for the auxiliary task with the Edge GT supervision. To ensure the edge thickness preserving consistantly, we design a new boundarybased loss, called Polar Hausdorff (PH) Loss, for the auxiliary supervision. We verify the effectiveness of our EPS on the Cityscapes dataset using 22 models. The experimental results indicate that the proposed method can be seamlessly integrated into any state-of-the-art (SOTA) models with zero modification, resulting in promising enhancement of the segmentation performance.


page 4

page 6


Edge-Preserving Guided Semantic Segmentation for VIPriors Challenge

Semantic segmentation is one of the most attractive research fields in c...

JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds

Semantic segmentation and semantic edge detection can be seen as two dua...

TriangleNet: Edge Prior Augmented Network for Semantic Segmentation through Cross-Task Consistency

Semantic segmentation is a classic computer vision problem dedicated to ...

ELKPPNet: An Edge-aware Neural Network with Large Kernel Pyramid Pooling for Learning Discriminative Features in Semantic Segmentation

Semantic segmentation has been a hot topic across diverse research field...

CASENet: Deep Category-Aware Semantic Edge Detection

Boundary and edge cues are highly beneficial in improving a wide variety...

Triply Supervised Decoder Networks for Joint Detection and Segmentation

Joint object detection and semantic segmentation can be applied to many ...

Semantic Edge Detection with Diverse Deep Supervision

Semantic edge detection (SED), which aims at jointly extracting edges as...

Please sign up or login with your details

Forgot password? Click here to reset