Need for Speed: A Benchmark for Higher Frame Rate Object Tracking

by   Hamed Kiani Galoogahi, et al.

In this paper, we propose the first higher frame rate video dataset (called Need for Speed - NfS) and benchmark for visual object tracking. The dataset consists of 100 videos (380K frames) captured with now commonly available higher frame rate (240 FPS) cameras from real world scenarios. All frames are annotated with axis aligned bounding boxes and all sequences are manually labelled with nine visual attributes - such as occlusion, fast motion, background clutter, etc. Our benchmark provides an extensive evaluation of many recent and state-of-the-art trackers on higher frame rate sequences. We ranked each of these trackers according to their tracking accuracy and real-time performance. One of our surprising conclusions is that at higher frame rates, simple trackers such as correlation filters outperform complex methods based on deep networks. This suggests that for practical applications (such as in robotics or embedded vision), one needs to carefully tradeoff bandwidth constraints associated with higher frame rate acquisition, computational costs of real-time analysis, and the required application accuracy. Our dataset and benchmark allows for the first time (to our knowledge) systematic exploration of such issues, and will be made available to allow for further research in this space.


page 1

page 4

page 5

page 7

page 8


Is First Person Vision Challenging for Object Tracking? The TREK-100 Benchmark Dataset

Understanding human-object interactions is fundamental in First Person V...

Towards Frame Rate Agnostic Multi-Object Tracking

Multi-Object Tracking (MOT) is one of the most fundamental computer visi...

DroTrack: High-speed Drone-based Object Tracking Under Uncertainty

We present DroTrack, a high-speed visual single-object tracking framewor...

Mobile Face Tracking: A Survey and Benchmark

With the rapid development of smartphones, facial analysis has been play...

360VOT: A New Benchmark Dataset for Omnidirectional Visual Object Tracking

360 images can provide an omnidirectional field of view which is importa...

Real-Time Multiple Object Tracking - A Study on the Importance of Speed

In this project, we implement a multiple object tracker, following the t...

GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild

In this work, we introduce a large high-diversity database for generic o...

Please sign up or login with your details

Forgot password? Click here to reset