CurveFormer: 3D Lane Detection by Curve Propagation with Curve Queries and Attention

by   Yifeng Bai, et al.

3D lane detection is an integral part of autonomous driving systems. Previous CNN and Transformer-based methods usually first generate a bird's-eye-view (BEV) feature map from the front view image, and then use a sub-network with BEV feature map as input to predict 3D lanes. Such approaches require an explicit view transformation between BEV and front view, which itself is still a challenging problem. In this paper, we propose CurveFormer, a single-stage Transformer-based method that directly calculates 3D lane parameters and can circumvent the difficult view transformation step. Specifically, we formulate 3D lane detection as a curve propagation problem by using curve queries. A 3D lane query is represented by a dynamic and ordered anchor point set. In this way, queries with curve representation in Transformer decoder iteratively refine the 3D lane detection results. Moreover, a curve cross-attention module is introduced to compute the similarities between curve queries and image features. Additionally, a context sampling module that can capture more relative image features of a curve query is provided to further boost the 3D lane detection performance. We evaluate our method for 3D lane detection on both synthetic and real-world datasets, and the experimental results show that our method achieves promising performance compared with the state-of-the-art approaches. The effectiveness of each component is validated via ablation studies as well.


An Efficient Transformer for Simultaneous Learning of BEV and Lane Representations in 3D Lane Detection

Accurately detecting lane lines in 3D space is crucial for autonomous dr...

CircleFormer: Circular Nuclei Detection in Whole Slide Images with Circle Queries and Attention

Both CNN-based and Transformer-based object detection with bounding box ...

LATR: 3D Lane Detection from Monocular Images with Transformer

3D lane detection from monocular images is a fundamental yet challenging...

Decoupling the Curve Modeling and Pavement Regression for Lane Detection

The curve-based lane representation is a popular approach in many lane d...

Rethinking Efficient Lane Detection via Curve Modeling

This paper presents a novel parametric curve-based method for lane detec...

CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending

We address the curve lane detection problem which poses more realistic c...

Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detection

We present a generalized and scalable method, called Gen-LaneNet, to det...

Please sign up or login with your details

Forgot password? Click here to reset