Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving

by   Shunli Ren, et al.

Cooperative perception enabled by V2X Communication technologies can significantly improve the perception performance of autonomous vehicles beyond the limited perception ability of the individual vehicles, therefore, improving the safety and efficiency of autonomous driving in intelligent transportation systems. However, in order to fully reap the benefits of cooperative perception in practice, the impacts of imperfect V2X communication, i.e., communication errors and disruptions, need to be understood and effective remedies need to be developed to alleviate their adverse impacts. Motivated by this need, we propose a novel INterruption-aware robust COoperative Perception (V2X-INCOP) solution for V2X communication-aided autonomous driving, which leverages historical information to recover missing information due to interruption. To achieve comprehensive recovery, we design a communication adaptive multi-scale spatial-temporal prediction model to extract multi-scale spatial-temporal features based on V2X communication conditions and capture the most significant information for the prediction of the missing information. To further improve recovery performance, we adopt a knowledge distillation framework to give direct supervision to the prediction model and a curriculum learning strategy to stabilize the training of the model. Our experiments on three public cooperative perception datasets demonstrate that our proposed method is effective in alleviating the impacts of communication interruption on cooperative perception.


page 1

page 2

page 5

page 9

page 11

page 12


Selective Communication for Cooperative Perception in End-to-End Autonomous Driving

The reliability of current autonomous driving systems is often jeopardiz...

Data Games: A Game-Theoretic Approach to Swarm Robotic Data Collection

Fleets of networked autonomous vehicles (AVs) collect terabytes of senso...

Knowledge-based Entity Prediction for Improved Machine Perception in Autonomous Systems

Knowledge-based entity prediction (KEP) is a novel task that aims to imp...

Control-aware Communication for Cooperative Adaptive Cruise Control

Utilizing vehicle-to-everything (V2X) communication technologies, vehicl...

NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception

Multi-agent multi-lidar sensor fusion between connected vehicles for coo...

Generating Evidential BEV Maps in Continuous Driving Space

Safety is critical for autonomous driving, and one aspect of improving s...

AuNa: Modularly Integrated Simulation Framework for Cooperative Autonomous Navigation

In the near future, the development of autonomous driving will get more ...

Please sign up or login with your details

Forgot password? Click here to reset