Multimodal Detection of Unknown Objects on Roads for Autonomous Driving

by   Daniel Bogdoll, et al.
FZI Forschungszentrum Informatik

Tremendous progress in deep learning over the last years has led towards a future with autonomous vehicles on our roads. Nevertheless, the performance of their perception systems is strongly dependent on the quality of the utilized training data. As these usually only cover a fraction of all object classes an autonomous driving system will face, such systems struggle with handling the unexpected. In order to safely operate on public roads, the identification of objects from unknown classes remains a crucial task. In this paper, we propose a novel pipeline to detect unknown objects. Instead of focusing on a single sensor modality, we make use of lidar and camera data by combining state-of-the art detection models in a sequential manner. We evaluate our approach on the Waymo Open Perception Dataset and point out current research gaps in anomaly detection.


page 1

page 5


Anomaly Detection in Autonomous Driving: A Survey

Nowadays, there are outstanding strides towards a future with autonomous...

SalienDet: A Saliency-based Feature Enhancement Algorithm for Object Detection for Autonomous Driving

Object detection (OD) is crucial to autonomous driving. Unknown objects ...

Perception Datasets for Anomaly Detection in Autonomous Driving: A Survey

Deep neural networks (DNN) which are employed in perception systems for ...

Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for Autonomous Driving

Recent years have witnessed huge successes in 3D object detection to rec...

Corner Cases for Visual Perception in Automated Driving: Some Guidance on Detection Approaches

Automated driving has become a major topic of interest not only in the a...

Identifying Unknown Instances for Autonomous Driving

In the past few years, we have seen great progress in perception algorit...

Towards Corner Case Detection for Autonomous Driving

The progress in autonomous driving is also due to the increased availabi...

Please sign up or login with your details

Forgot password? Click here to reset