Hierarchical Adaptive Voxel-guided Sampling for Real-time Applications in Large-scale Point Clouds

05/23/2023
by   Junyuan Ouyang, et al.
0

While point-based neural architectures have demonstrated their efficacy, the time-consuming sampler currently prevents them from performing real-time reasoning on scene-level point clouds. Existing methods attempt to overcome this issue by using random sampling strategy instead of the commonly-adopted farthest point sampling (FPS), but at the expense of lower performance. So the effectiveness/efficiency trade-off remains under-explored. In this paper, we reveal the key to high-quality sampling is ensuring an even spacing between points in the subset, which can be naturally obtained through a grid. Based on this insight, we propose a hierarchical adaptive voxel-guided point sampler with linear complexity and high parallelization for real-time applications. Extensive experiments on large-scale point cloud detection and segmentation tasks demonstrate that our method achieves competitive performance with the most powerful FPS, at an amazing speed that is more than 100 times faster. This breakthrough in efficiency addresses the bottleneck of the sampling step when handling scene-level point clouds. Furthermore, our sampler can be easily integrated into existing models and achieves a 20∼80% reduction in runtime with minimal effort. The code will be available at https://github.com/OuyangJunyuan/pointcloud-3d-detector-tensorrt

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/04/2023

OctFormer: Octree-based Transformers for 3D Point Clouds

We propose octree-based transformers, named OctFormer, for 3D point clou...
research
06/20/2022

Voxel-MAE: Masked Autoencoders for Pre-training Large-scale Point Clouds

Mask-based pre-training has achieved great success for self-supervised l...
research
03/31/2023

IC-FPS: Instance-Centroid Faster Point Sampling Module for 3D Point-base Object Detection

3D object detection is one of the most important tasks in autonomous dri...
research
07/09/2021

Beyond Farthest Point Sampling in Point-Wise Analysis

Sampling, grouping, and aggregation are three important components in th...
research
12/09/2021

Fast Point Transformer

The recent success of neural networks enables a better interpretation of...
research
11/22/2021

Real-time ground filtering algorithm of cloud points acquired using Terrestrial Laser Scanner (TLS)

3D modeling based on point clouds requires ground-filtering algorithms t...
research
03/30/2022

Meta-Sampler: Almost-Universal yet Task-Oriented Sampling for Point Clouds

Sampling is a key operation in point-cloud task and acts to increase com...

Please sign up or login with your details

Forgot password? Click here to reset