Improving 3D Object Detection with Channel-wise Transformer

by   Hualian Sheng, et al.

Though 3D object detection from point clouds has achieved rapid progress in recent years, the lack of flexible and high-performance proposal refinement remains a great hurdle for existing state-of-the-art two-stage detectors. Previous works on refining 3D proposals have relied on human-designed components such as keypoints sampling, set abstraction and multi-scale feature fusion to produce powerful 3D object representations. Such methods, however, have limited ability to capture rich contextual dependencies among points. In this paper, we leverage the high-quality region proposal network and a Channel-wise Transformer architecture to constitute our two-stage 3D object detection framework (CT3D) with minimal hand-crafted design. The proposed CT3D simultaneously performs proposal-aware embedding and channel-wise context aggregation for the point features within each proposal. Specifically, CT3D uses proposal's keypoints for spatial contextual modelling and learns attention propagation in the encoding module, mapping the proposal to point embeddings. Next, a new channel-wise decoding module enriches the query-key interaction via channel-wise re-weighting to effectively merge multi-level contexts, which contributes to more accurate object predictions. Extensive experiments demonstrate that our CT3D method has superior performance and excellent scalability. Remarkably, CT3D achieves the AP of 81.77 category on the KITTI test 3D detection benchmark, outperforms state-of-the-art 3D detectors.


page 1

page 2

page 4

page 5

page 6

page 7

page 9

page 10


3D Object Detection with Pointformer

Feature learning for 3D object detection from point clouds is very chall...

SIENet: Spatial Information Enhancement Network for 3D Object Detection from Point Cloud

LiDAR-based 3D object detection pushes forward an immense influence on a...

Hierarchical Context Embedding for Region-based Object Detection

State-of-the-art two-stage object detectors apply a classifier to a spar...

PSFormer: Point Transformer for 3D Salient Object Detection

We propose PSFormer, an effective point transformer model for 3D salient...

Attention-based Proposals Refinement for 3D Object Detection

Recent advances in 3D object detection is made by developing the refinem...

IQDet: Instance-wise Quality Distribution Sampling for Object Detection

We propose a dense object detector with an instance-wise sampling strate...

Deformable Proposal-Aware P2PNet: A Universal Network for Cell Recognition under Point Supervision

Point-based cell recognition, which aims to localize and classify cells ...

Please sign up or login with your details

Forgot password? Click here to reset