Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditions

by   Carlos A. Diaz-Ruiz, et al.

Advances in perception for self-driving cars have accelerated in recent years due to the availability of large-scale datasets, typically collected at specific locations and under nice weather conditions. Yet, to achieve the high safety requirement, these perceptual systems must operate robustly under a wide variety of weather conditions including snow and rain. In this paper, we present a new dataset to enable robust autonomous driving via a novel data collection process - data is repeatedly recorded along a 15 km route under diverse scene (urban, highway, rural, campus), weather (snow, rain, sun), time (day/night), and traffic conditions (pedestrians, cyclists and cars). The dataset includes images and point clouds from cameras and LiDAR sensors, along with high-precision GPS/INS to establish correspondence across routes. The dataset includes road and object annotations using amodal masks to capture partial occlusions and 3D bounding boxes. We demonstrate the uniqueness of this dataset by analyzing the performance of baselines in amodal segmentation of road and objects, depth estimation, and 3D object detection. The repeated routes opens new research directions in object discovery, continual learning, and anomaly detection. Link to Ithaca365:


page 2

page 3

page 4

page 5

page 7

page 11

page 12

page 14


RADIATE: A Radar Dataset for Automotive Perception

Datasets for autonomous cars are essential for the development and bench...

Development of Open Informal Dataset Affecting Autonomous Driving

This document is a document that has written procedures and methods for ...

WEDGE: A multi-weather autonomous driving dataset built from generative vision-language models

The open road poses many challenges to autonomous perception, including ...

3D tracking of water hazards with polarized stereo cameras

Current self-driving car systems operate well in sunny weather but strug...

A*3D Dataset: Towards Autonomous Driving in Challenging Environments

With the increasing global popularity of self-driving cars, there is an ...

Hindsight is 20/20: Leveraging Past Traversals to Aid 3D Perception

Self-driving cars must detect vehicles, pedestrians, and other traffic p...

AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Driving

Unlike humans, who can effortlessly estimate the entirety of objects eve...

Please sign up or login with your details

Forgot password? Click here to reset