FreeSOLO: Learning to Segment Objects without Annotations

02/24/2022
by   Xinlong Wang, et al.
59

Instance segmentation is a fundamental vision task that aims to recognize and segment each object in an image. However, it requires costly annotations such as bounding boxes and segmentation masks for learning. In this work, we propose a fully unsupervised learning method that learns class-agnostic instance segmentation without any annotations. We present FreeSOLO, a self-supervised instance segmentation framework built on top of the simple instance segmentation method SOLO. Our method also presents a novel localization-aware pre-training framework, where objects can be discovered from complicated scenes in an unsupervised manner. FreeSOLO achieves 9.8 COCO dataset, which even outperforms several segmentation proposal methods that use manual annotations. For the first time, we demonstrate unsupervised class-agnostic instance segmentation successfully. FreeSOLO's box localization significantly outperforms state-of-the-art unsupervised object detection/discovery methods, with about 100 FreeSOLO further demonstrates superiority as a strong pre-training method, outperforming state-of-the-art self-supervised pre-training methods by +9.8 when fine-tuning instance segmentation with only 5

READ FULL TEXT

page 1

page 3

page 7

page 8

page 13

research
05/11/2023

FreePoint: Unsupervised Point Cloud Instance Segmentation

Instance segmentation of point clouds is a crucial task in 3D field with...
research
03/25/2023

UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenes

3D instance segmentation is fundamental to geometric understanding of th...
research
08/26/2021

LocTex: Learning Data-Efficient Visual Representations from Localized Textual Supervision

Computer vision tasks such as object detection and semantic/instance seg...
research
04/25/2022

DArch: Dental Arch Prior-assisted 3D Tooth Instance Segmentation

Automatic tooth instance segmentation on 3D dental models is a fundament...
research
02/02/2023

Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Prompt

Recently, inspired by DETR variants, query-based end-to-end instance seg...
research
12/12/2021

Multimodal-based Scene-Aware Framework for Aquatic Animal Segmentation

Recent years have witnessed great advances in object segmentation resear...
research
04/05/2019

ShapeMask: Learning to Segment Novel Objects by Refining Shape Priors

Instance segmentation aims to detect and segment individual objects in a...

Please sign up or login with your details

Forgot password? Click here to reset