Multi-Echo LiDAR for 3D Object Detection

by   Yunze Man, et al.

LiDAR sensors can be used to obtain a wide range of measurement signals other than a simple 3D point cloud, and those signals can be leveraged to improve perception tasks like 3D object detection. A single laser pulse can be partially reflected by multiple objects along its path, resulting in multiple measurements called echoes. Multi-echo measurement can provide information about object contours and semi-transparent surfaces which can be used to better identify and locate objects. LiDAR can also measure surface reflectance (intensity of laser pulse return), as well as ambient light of the scene (sunlight reflected by objects). These signals are already available in commercial LiDAR devices but have not been used in most LiDAR-based detection models. We present a 3D object detection model which leverages the full spectrum of measurement signals provided by LiDAR. First, we propose a multi-signal fusion (MSF) module to combine (1) the reflectance and ambient features extracted with a 2D CNN, and (2) point cloud features extracted using a 3D graph neural network (GNN). Second, we propose a multi-echo aggregation (MEA) module to combine the information encoded in different set of echo points. Compared with traditional single echo point cloud methods, our proposed Multi-Signal LiDAR Detector (MSLiD) extracts richer context information from a wider range of sensing measurements and achieves more accurate 3D object detection. Experiments show that by incorporating the multi-modality of LiDAR, our method outperforms the state-of-the-art by up to 9.1


page 3

page 13


Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud

In this paper, we propose a graph neural network to detect objects from ...

Temp-Frustum Net: 3D Object Detection with Temporal Fusion

3D object detection is a core component of automated driving systems. St...

Estimation of Looming from LiDAR

Looming, traditionally defined as the relative expansion of objects in t...

AOP-Net: All-in-One Perception Network for Joint LiDAR-based 3D Object Detection and Panoptic Segmentation

LiDAR-based 3D object detection and panoptic segmentation are two crucia...

OCM3D: Object-Centric Monocular 3D Object Detection

Image-only and pseudo-LiDAR representations are commonly used for monocu...

A Maximum Likelihood Approach to Extract Finite Planes from 3-D Laser Scans

Whether it is object detection, model reconstruction, laser odometry, or...

Lidar Measurement Bias Estimation via Return Waveform Modelling in a Context of 3D Mapping

In a context of 3D mapping, it is very important to get accurate measure...

Please sign up or login with your details

Forgot password? Click here to reset