DeepAI AI Chat
Log In Sign Up

Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing

by   Izzeddin Teeti, et al.
Oxford Brookes University

In an autonomous driving system, perception - identification of features and objects from the environment - is crucial. In autonomous racing, high speeds and small margins demand rapid and accurate detection systems. During the race, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres. In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions - the collection of which is a tedious, laborious, and costly process. However, recent developments in CycleGAN architectures allow the synthesis of highly realistic scenes in multiple weather conditions. To this end, we introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors by an average of 42.7 and 4.4 mAP percentage points in the presence of night-time conditions and droplets, respectively. Furthermore, we present a comparative analysis of five object detectors - identifying the optimal pairing of detector and training data for use during autonomous racing in challenging conditions.


page 4

page 6

page 8


Robustness of Object Detectors in Degrading Weather Conditions

State-of-the-art object detection systems for autonomous driving achieve...

Artificial Dummies for Urban Dataset Augmentation

Existing datasets for training pedestrian detectors in images suffer fro...

DisPlacing Objects: Improving Dynamic Vehicle Detection via Visual Place Recognition under Adverse Conditions

Can knowing where you are assist in perceiving objects in your surroundi...

Robustness of Segment Anything Model (SAM) for Autonomous Driving in Adverse Weather Conditions

Segment Anything Model (SAM) has gained considerable interest in recent ...

Task-Driven Deep Image Enhancement Network for Autonomous Driving in Bad Weather

Visual perception in autonomous driving is a crucial part of a vehicle t...