Deep Semantic Classification for 3D LiDAR Data

by   Ayush Dewan, et al.

Robots are expected to operate autonomously in dynamic environments. Understanding the underlying dynamic characteristics of objects is a key enabler for achieving this goal. In this paper, we propose a method for pointwise semantic classification of 3D LiDAR data into three classes: non-movable, movable and dynamic. We concentrate on understanding these specific semantics because they characterize important information required for an autonomous system. Non-movable points in the scene belong to unchanging segments of the environment, whereas the remaining classes corresponds to the changing parts of the scene. The difference between the movable and dynamic class is their motion state. The dynamic points can be perceived as moving, whereas movable objects can move, but are perceived as static. To learn the distinction between movable and non-movable points in the environment, we introduce an approach based on deep neural network and for detecting the dynamic points, we estimate pointwise motion. We propose a Bayes filter framework for combining the learned semantic cues with the motion cues to infer the required semantic classification. In extensive experiments, we compare our approach with other methods on a standard benchmark dataset and report competitive results in comparison to the existing state-of-the-art. Furthermore, we show an improvement in the classification of points by combining the semantic cues retrieved from the neural network with the motion cues.


GMC: Grid Based Motion Clustering in Dynamic Environment

Conventional SLAM algorithms takes a strong assumption of scene motionle...

Attentional Separation-and-Aggregation Network for Self-supervised Depth-Pose Learning in Dynamic Scenes

Learning depth and ego-motion from unlabeled videos via self-supervision...

DeepTemporalSeg: Temporally Consistent Semantic Segmentation of 3D LiDAR Scans

Understanding the semantic characteristics of the environment is a key e...

Dynamic Body VSLAM with Semantic Constraints

Image based reconstruction of urban environments is a challenging proble...

Robust Moving Objects Detection in Lidar Data Exploiting Visual Cues

Detecting moving objects in dynamic scenes from sequences of lidar scans...

Automatic Labeling to Generate Training Data for Online LiDAR-based Moving Object Segmentation

Understanding the scene is key for autonomously navigating vehicles and ...

PREF: Predictability Regularized Neural Motion Fields

Knowing the 3D motions in a dynamic scene is essential to many vision ap...

Please sign up or login with your details

Forgot password? Click here to reset