Learning Off-Road Terrain Traversability with Self-Supervisions Only

by   Junwon Seo, et al.

Estimating the traversability of terrain should be reliable and accurate in diverse conditions for autonomous driving in off-road environments. However, learning-based approaches often yield unreliable results when confronted with unfamiliar contexts, and it is challenging to obtain manual annotations frequently for new circumstances. In this paper, we introduce a method for learning traversability from images that utilizes only self-supervision and no manual labels, enabling it to easily learn traversability in new circumstances. To this end, we first generate self-supervised traversability labels from past driving trajectories by labeling regions traversed by the vehicle as highly traversable. Using the self-supervised labels, we then train a neural network that identifies terrains that are safe to traverse from an image using a one-class classification algorithm. Additionally, we supplement the limitations of self-supervised labels by incorporating methods of self-supervised learning of visual representations. To conduct a comprehensive evaluation, we collect data in a variety of driving environments and perceptual conditions and show that our method produces reliable estimations in various environments. In addition, the experimental results validate that our method outperforms other self-supervised traversability estimation methods and achieves comparable performances with supervised learning methods trained on manually labeled data.


page 1

page 4

page 6

page 7


ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environments

For the safe and successful navigation of autonomous vehicles in unstruc...

Contrastive Label Disambiguation for Self-Supervised Terrain Traversability Learning in Off-Road Environments

Discriminating the traversability of terrains is a crucial task for auto...

Self-Supervised Drivable Area and Road Anomaly Segmentation using RGB-D Data for Robotic Wheelchairs

The segmentation of drivable areas and road anomalies are critical capab...

Self-Supervised Simultaneous Multi-Step Prediction of Road Dynamics and Cost Map

While supervised learning is widely used for perception modules in conve...

Self-supervised learning for autonomous vehicles perception: A conciliation between analytical and learning methods

This article mainly aims at motivating more investigations on self-super...

Self-Supervised Visual Terrain Classification from Unsupervised Acoustic Feature Learning

Mobile robots operating in unknown urban environments encounter a wide r...

Self-Supervised Traversability Prediction by Learning to Reconstruct Safe Terrain

Navigating off-road with a fast autonomous vehicle depends on a robust p...

Please sign up or login with your details

Forgot password? Click here to reset