From depth image to semantic scene synthesis through point cloud classification and labeling: Application to assistive systems

08/09/2020
by   Chayma Zatout, et al.
0

The aim of this work is to provide a semantic scene synthesis from depth image. First, depth image is segmented and each segment is classified in the context of assistive systems using a deep learning network. Second, inspired by the Braille system and the Japanese writing system Kanji, the obtained classes are coded with semantic labels. A semantic scene is then synthesized using the labels and extracted features. Experiments are conducted on noisy, occluded, cropped and incomplete data including acquired depth images of indoor scenes and datasets from the RMRC challenge. The obtained results are reported and discussed.

READ FULL TEXT

page 15

page 18

page 24

page 25

page 26

page 27

research
08/24/2020

Semantic View Synthesis

We tackle a new problem of semantic view synthesis – generating free-vie...
research
08/23/2021

Realistic Image Synthesis with Configurable 3D Scene Layouts

Recent conditional image synthesis approaches provide high-quality synth...
research
08/11/2021

A Real-Time Online Learning Framework for Joint 3D Reconstruction and Semantic Segmentation of Indoor Scenes

This paper presents a real-time online vision framework to jointly recov...
research
08/17/2016

Scene Labeling Through Knowledge-Based Rules Employing Constrained Integer Linear Programing

Scene labeling task is to segment the image into meaningful regions and ...
research
09/12/2019

3D Ken Burns Effect from a Single Image

The Ken Burns effect allows animating still images with a virtual camera...
research
12/30/2013

Constrained Parametric Proposals and Pooling Methods for Semantic Segmentation in RGB-D Images

We focus on the problem of semantic segmentation based on RGB-D data, wi...
research
03/17/2023

Semantic Scene Completion with Cleaner Self

Semantic Scene Completion (SSC) transforms an image of single-view depth...

Please sign up or login with your details

Forgot password? Click here to reset