Learnable Online Graph Representations for 3D Multi-Object Tracking

04/23/2021
by   Jan-Nico Zaech, et al.
0

Tracking of objects in 3D is a fundamental task in computer vision that finds use in a wide range of applications such as autonomous driving, robotics or augmented reality. Most recent approaches for 3D multi object tracking (MOT) from LIDAR use object dynamics together with a set of handcrafted features to match detections of objects. However, manually designing such features and heuristics is cumbersome and often leads to suboptimal performance. In this work, we instead strive towards a unified and learning based approach to the 3D MOT problem. We design a graph structure to jointly process detection and track states in an online manner. To this end, we employ a Neural Message Passing network for data association that is fully trainable. Our approach provides a natural way for track initialization and handling of false positive detections, while significantly improving track stability. We show the merit of the proposed approach on the publicly available nuScenes dataset by achieving state-of-the-art performance of 65.6

READ FULL TEXT
research
07/15/2022

Multi-Object Tracking and Segmentation via Neural Message Passing

Graphs offer a natural way to formulate Multiple Object Tracking (MOT) a...
research
12/26/2020

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

Multi-object tracking is an important ability for an autonomous vehicle ...
research
06/04/2018

Deep Continuous Conditional Random Fields with Asymmetric Inter-object Constraints for Online Multi-object Tracking

Online Multi-Object Tracking (MOT) is a challenging problem and has many...
research
12/16/2019

Learning a Neural Solver for Multiple Object Tracking

Graphs offer a natural way to formulate Multiple Object Tracking (MOT) w...
research
09/30/2020

GCNNMatch: Graph Convolutional Neural Networks for Multi-Object Tracking via Sinkhorn Normalization

This paper proposes a novel method for online Multi-Object Tracking (MOT...
research
01/11/2021

TrackMPNN: A Message Passing Graph Neural Architecture for Multi-Object Tracking

This study follows many previous approaches to multi-object tracking (MO...
research
12/10/2020

AutoSelect: Automatic and Dynamic Detection Selection for 3D Multi-Object Tracking

3D multi-object tracking is an important component in robotic perception...

Please sign up or login with your details

Forgot password? Click here to reset