DeepAI AI Chat
Log In Sign Up

A Quality Index Metric and Method for Online Self-Assessment of Autonomous Vehicles Sensory Perception

by   Ce Zhang, et al.
Virginia Polytechnic Institute and State University

Perception is critical to autonomous driving safety. Camera-based object detection is one of the most important methods for autonomous vehicle perception. Current camera-based object detection solutions for autonomous driving cannot provide feedback on the detection performance for each frame. We propose an evaluation metric, namely the perception quality index (PQI), to assess the camera-based object detection algorithm performance and provide the perception quality feedback frame by frame. The method of the PQI generation is by combining the fine-grained saliency map intensity with the object detection algorithm's output results. Furthermore, we developed a superpixel-based attention network (SPA-NET) to predict the proposed PQI evaluation metric by using raw image pixels and superpixels as input. The proposed evaluation metric and prediction network are tested on three open-source datasets. The proposed evaluation metric can correctly assess the camera-based perception quality under the autonomous driving environment according to the experiment results. The network regression R-square values determine the comparison among models. It is shown that a Perception Quality Index is useful in self-evaluating a cameras visual scene perception.


page 1

page 3

page 4

page 5

page 6

page 7

page 8

page 10


3D Object Detection for Autonomous Driving: A Review and New Outlooks

Autonomous driving, in recent years, has been receiving increasing atten...

Group Regression for Query Based Object Detection and Tracking

Group regression is commonly used in 3D object detection to predict box ...

OccupancyDETR: Making Semantic Scene Completion as Straightforward as Object Detection

Visual-based 3D semantic occupancy perception (also known as 3D semantic...

Learning to Evaluate Perception Models Using Planner-Centric Metrics

Variants of accuracy and precision are the gold-standard by which the co...

Mainline Automatic Train Horn and Brake Performance Metric

This paper argues for the introduction of a mainline rail-oriented perfo...

Exploring Credibility Scoring Metrics of Perception Systems for Autonomous Driving

Autonomous and semi-autonomous vehicles' perception algorithms can encou...

Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehicles

We propose a perception imitation method to simulate results of a certai...