ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environments

by   Junwon Seo, et al.

For the safe and successful navigation of autonomous vehicles in unstructured environments, the traversability of terrain should vary based on the driving capabilities of the vehicles. Actual driving experience can be utilized in a self-supervised fashion to learn vehicle-specific traversability. However, existing methods for learning self-supervised traversability are not highly scalable for learning the traversability of various vehicles. In this work, we introduce a scalable framework for learning self-supervised traversability, which can learn the traversability directly from vehicle-terrain interaction without any human supervision. We train a neural network that predicts the proprioceptive experience that a vehicle would undergo from 3D point clouds. Using a novel PU learning method, the network simultaneously identifies non-traversable regions where estimations can be overconfident. With driving data of various vehicles gathered from simulation and the real world, we show that our framework is capable of learning the self-supervised traversability of various vehicles. By integrating our framework with a model predictive controller, we demonstrate that estimated traversability results in effective navigation that enables distinct maneuvers based on the driving characteristics of the vehicles. In addition, experimental results validate the ability of our method to identify and avoid non-traversable regions.


page 1

page 2

page 4

page 5

page 6

page 7


Learning Off-Road Terrain Traversability with Self-Supervisions Only

Estimating the traversability of terrain should be reliable and accurate...

RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learning

Under shared autonomy, wheelchair users expect vehicles to provide safe ...

WayFAST: Traversability Predictive Navigation for Field Robots

We present a self-supervised approach for learning to predict traversabl...

METAVerse: Meta-Learning Traversability Cost Map for Off-Road Navigation

Autonomous navigation in off-road conditions requires an accurate estima...

Self-Supervised Traversability Prediction by Learning to Reconstruct Safe Terrain

Navigating off-road with a fast autonomous vehicle depends on a robust p...

ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles

A key component in autonomous driving is the ability of the self-driving...

Self-Supervised Steering Angle Prediction for Vehicle Control Using Visual Odometry

Vision-based learning methods for self-driving cars have primarily used ...

Please sign up or login with your details

Forgot password? Click here to reset