LOPR: Latent Occupancy PRediction using Generative Models

10/03/2022
by   Bernard Lange, et al.
0

Environment prediction frameworks are essential for autonomous vehicles to facilitate safe maneuvers in a dynamic environment. Previous approaches have used occupancy grid maps as a bird's eye-view representation of the scene and optimized the prediction architectures directly in pixel space. Although these methods have had some success in spatiotemporal prediction, they are, at times, hindered by unrealistic and incorrect predictions. We postulate that the quality and realism of the forecasted occupancy grids can be improved with the use of generative models. We propose a framework that decomposes occupancy grid prediction into task-independent low-dimensional representation learning and task-dependent prediction in the latent space. We demonstrate that our approach achieves state-of-the-art performance on the real-world autonomous driving dataset, NuScenes.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
01/11/2023

Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks

Prediction of dynamic environment is crucial to safe navigation of an au...
research
10/19/2020

Attention Augmented ConvLSTM for Environment Prediction

Safe and proactive planning in robotic systems generally requires accura...
research
05/16/2023

Urban-StyleGAN: Learning to Generate and Manipulate Images of Urban Scenes

A promise of Generative Adversarial Networks (GANs) is to provide cheap ...
research
05/11/2022

NMR: Neural Manifold Representation for Autonomous Driving

Autonomous driving requires efficient reasoning about the Spatio-tempora...
research
04/28/2019

Dynamic Environment Prediction in Urban Scenes using Recurrent Representation Learning

A key challenge for autonomous driving is safe trajectory planning in cl...
research
12/21/2018

Multi-Step Prediction of Occupancy Grid Maps with Recurrent Neural Networks

We investigate the multi-step prediction of the drivable space, represen...
research
11/18/2020

Double-Prong ConvLSTM for Spatiotemporal Occupancy Prediction in Dynamic Environments

Predicting the future occupancy state of an environment is important to ...

Please sign up or login with your details

Forgot password? Click here to reset