Semantic Instance Labeling Leveraging Hierarchical Segmentation

08/02/2017
by   Steven Hickson, et al.
0

Most of the approaches for indoor RGBD semantic la- beling focus on using pixels or superpixels to train a classi- fier. In this paper, we implement a higher level segmentation using a hierarchy of superpixels to obtain a better segmen- tation for training our classifier. By focusing on meaningful segments that conform more directly to objects, regardless of size, we train a random forest of decision trees as a clas- sifier using simple features such as the 3D size, LAB color histogram, width, height, and shape as specified by a his- togram of surface normals. We test our method on the NYU V2 depth dataset, a challenging dataset of cluttered indoor environments. Our experiments using the NYU V2 depth dataset show that our method achieves state of the art re- sults on both a general semantic labeling introduced by the dataset (floor, structure, furniture, and objects) and a more object specific semantic labeling. We show that training a classifier on a segmentation from a hierarchy of super pixels yields better results than training directly on super pixels, patches, or pixels as in previous work.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 7

page 8

research
02/04/2014

Scene Labeling with Contextual Hierarchical Models

Scene labeling is the problem of assigning an object label to each pixel...
research
06/27/2019

Hard Pixels Mining: Learning Using Privileged Information for Semantic Segmentation

Semantic segmentation has achieved significant progress but is still cha...
research
12/22/2022

SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environments

Object instance segmentation is a key challenge for indoor robots naviga...
research
02/21/2017

PixelNet: Representation of the pixels, by the pixels, and for the pixels

We explore design principles for general pixel-level prediction problems...
research
01/16/2013

Indoor Semantic Segmentation using depth information

This work addresses multi-class segmentation of indoor scenes with RGB-D...
research
07/22/2014

Learning Rich Features from RGB-D Images for Object Detection and Segmentation

In this paper we study the problem of object detection for RGB-D images ...
research
02/10/2012

Scene Parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers

Scene parsing, or semantic segmentation, consists in labeling each pixel...

Please sign up or login with your details

Forgot password? Click here to reset