Prior Guided Feature Enrichment Network for Few-Shot Segmentation

by   Zhuotao Tian, et al.

State-of-the-art semantic segmentation methods require sufficient labeled data to achieve good results and hardly work on unseen classes without fine-tuning. Few-shot segmentation is thus proposed to tackle this problem by learning a model that quickly adapts to new classes with a few labeled support samples. Theses frameworks still face the challenge of generalization ability reduction on unseen classes due to inappropriate use of high-level semantic information of training classes and spatial inconsistency between query and support targets. To alleviate these issues, we propose the Prior Guided Feature Enrichment Network (PFENet). It consists of novel designs of (1) a training-free prior mask generation method that not only retains generalization power but also improves model performance and (2) Feature Enrichment Module (FEM) that overcomes spatial inconsistency by adaptively enriching query features with support features and prior masks. Extensive experiments on PASCAL-5^i and COCO prove that the proposed prior generation method and FEM both improve the baseline method significantly. Our PFENet also outperforms state-of-the-art methods by a large margin without efficiency loss. It is surprising that our model even generalizes to cases without labeled support samples. Our code is available at


page 1

page 3

page 4

page 5

page 9

page 11

page 14


PFENet++: Boosting Few-shot Semantic Segmentation with the Noise-filtered Context-aware Prior Mask

In this work, we revisit the prior mask guidance proposed in "Prior Guid...

Quaternion-valued Correlation Learning for Few-Shot Semantic Segmentation

Few-shot segmentation (FSS) aims to segment unseen classes given only a ...

Visual and Textual Prior Guided Mask Assemble for Few-Shot Segmentation and Beyond

Few-shot segmentation (FSS) aims to segment the novel classes with a few...

Boosting Few-shot Semantic Segmentation with Transformers

Due to the fact that fully supervised semantic segmentation methods requ...

Contrastive Enhancement Using Latent Prototype for Few-Shot Segmentation

Few-shot segmentation enables the model to recognize unseen classes with...

Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancement

Although extensive research has been conducted on 3D point cloud segment...

MIANet: Aggregating Unbiased Instance and General Information for Few-Shot Semantic Segmentation

Existing few-shot segmentation methods are based on the meta-learning st...

Please sign up or login with your details

Forgot password? Click here to reset