Traffic Context Aware Data Augmentation for Rare Object Detection in Autonomous Driving

by   Naifan Li, et al.

Detection of rare objects (e.g., traffic cones, traffic barrels and traffic warning triangles) is an important perception task to improve the safety of autonomous driving. Training of such models typically requires a large number of annotated data which is expensive and time consuming to obtain. To address the above problem, an emerging approach is to apply data augmentation to automatically generate cost-free training samples. In this work, we propose a systematic study on simple Copy-Paste data augmentation for rare object detection in autonomous driving. Specifically, local adaptive instance-level image transformation is introduced to generate realistic rare object masks from source domain to the target domain. Moreover, traffic scene context is utilized to guide the placement of masks of rare objects. To this end, our data augmentation generates training data with high quality and realistic characteristics by leveraging both local and global consistency. In addition, we build a new dataset named NM10k consisting 10k training images, 4k validation images and the corresponding labels with a diverse range of scenarios in autonomous driving. Experiments on NM10k show that our method achieves promising results on rare object detection. We also present a thorough study to illustrate the effectiveness of our local-adaptive and global constraints based Copy-Paste data augmentation for rare object detection. The data, development kit and more information of NM10k dataset are available online at: <>.


page 1

page 3

page 4

page 6


Domain Adaptive Object Detection for Autonomous Driving under Foggy Weather

Most object detection methods for autonomous driving usually assume a co...

Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for Autonomous Driving

Recent years have witnessed huge successes in 3D object detection to rec...

A Customizable Dynamic Scenario Modeling and Data Generation Platform for Autonomous Driving

Safely interacting with humans is a significant challenge for autonomous...

3D Data Augmentation for Driving Scenes on Camera

Driving scenes are extremely diverse and complicated that it is impossib...

TL-GAN: Improving Traffic Light Recognition via Data Synthesis for Autonomous Driving

Traffic light recognition, as a critical component of the perception mod...

Counterexample-Guided Data Augmentation

We present a novel framework for augmenting data sets for machine learni...

Improving Crowded Object Detection via Copy-Paste

Crowdedness caused by overlapping among similar objects is a ubiquitous ...

Please sign up or login with your details

Forgot password? Click here to reset