Learning-Based Human Segmentation and Velocity Estimation Using Automatic Labeled LiDAR Sequence for Training

by   Wonjik Kim, et al.

In this paper, we propose an automatic labeled sequential data generation pipeline for human segmentation and velocity estimation with point clouds. Considering the impact of deep neural networks, state-of-the-art network architectures have been proposed for human recognition using point clouds captured by Light Detection and Ranging (LiDAR). However, one disadvantage is that legacy datasets may only cover the image domain without providing important label information and this limitation has disturbed the progress of research to date. Therefore, we develop an automatic labeled sequential data generation pipeline, in which we can control any parameter or data generation environment with pixel-wise and per-frame ground truth segmentation and pixel-wise velocity information for human recognition. Our approach uses a precise human model and reproduces a precise motion to generate realistic artificial data. We present more than 7K video sequences which consist of 32 frames generated by the proposed pipeline. With the proposed sequence generator, we confirm that human segmentation performance is improved when using the video domain compared to when using the image domain. We also evaluate our data by comparing with data generated under different conditions. In addition, we estimate pedestrian velocity with LiDAR by only utilizing data generated by the proposed pipeline.


page 1

page 2

page 4

page 5

page 6

page 7

page 8

page 9


Automatic Labeled LiDAR Data Generation based on Precise Human Model

Following improvements in deep neural networks, state-of-the-art network...

Human Segmentation with Dynamic LiDAR Data

Consecutive LiDAR scans compose dynamic 3D sequences, which contain more...

A Realism Metric for Generated LiDAR Point Clouds

A considerable amount of research is concerned with the generation of re...

Vegetation Stratum Occupancy Prediction from Airborne LiDAR 3D Point Clouds

We propose a new deep learning-based method for estimating the occupancy...

DSCnet: Replicating Lidar Point Clouds with Deep Sensor Cloning

Convolutional neural networks (CNNs) have become increasingly popular fo...

Predicting Vegetation Stratum Occupancy from Airborne LiDAR Data with Deep Learning

We propose a new deep learning-based method for estimating the occupancy...

LIDAR-based Driving Path Generation Using Fully Convolutional Neural Networks

In this work, a novel learning-based approach has been developed to gene...

Please sign up or login with your details

Forgot password? Click here to reset