LMR: Lane Distance-Based Metric for Trajectory Prediction

by   Julian Schmidt, et al.

The development of approaches for trajectory prediction requires metrics to validate and compare their performance. Currently established metrics are based on Euclidean distance, which means that errors are weighted equally in all directions. Euclidean metrics are insufficient for structured environments like roads, since they do not properly capture the agent's intent relative to the underlying lane. In order to provide a reasonable assessment of trajectory prediction approaches with regard to the downstream planning task, we propose a new metric that is lane distance-based: Lane Miss Rate (LMR). For the calculation of LMR, the ground-truth and predicted endpoints are assigned to lane segments, more precisely their centerlines. Measured by the distance along the lane segments, predictions that are within a certain threshold distance to the ground-truth count as hits, otherwise they count as misses. LMR is then defined as the ratio of sequences that yield a miss. Our results on three state-of-the-art trajectory prediction models show that LMR preserves the order of Euclidean distance-based metrics. In contrast to the Euclidean Miss Rate, qualitative results show that LMR yields misses for sequences where predictions are located on wrong lanes. Hits on the other hand result for sequences where predictions are located on the correct lane. This means that LMR implicitly weights Euclidean error relative to the lane and goes into the direction of capturing intents of traffic agents. The source code of LMR for Argoverse 2 is publicly available.


page 1

page 5


Improving Diversity of Multiple Trajectory Prediction based on Map-adaptive Lane Loss

Prior arts in the field of motion predictions for autonomous driving ten...

MEAT: Maneuver Extraction from Agent Trajectories

Advances in learning-based trajectory prediction are enabled by large-sc...

Trajectory Prediction in Autonomous Driving with a Lane Heading Auxiliary Loss

Predicting a vehicle's trajectory is an essential ability for autonomous...

The PREVENTION Challenge: How Good Are Humans Predicting Lane Changes?

While driving on highways, every driver tries to be aware of the behavio...

What's Wrong with the Absolute Trajectory Error?

One of the main limitations of the commonly used Absolute Trajectory Err...

Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimation

Best-of-N (BoN) Average Displacement Error (ADE)/ Final Displacement Err...

Hierarchical Recurrent Attention Networks for Structured Online Maps

In this paper, we tackle the problem of online road network extraction f...

Please sign up or login with your details

Forgot password? Click here to reset