Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking

by   Heng Fan, et al.

Being intensively studied, visual tracking has seen great recent advances in either speed (e.g., with correlation filters) or accuracy (e.g., with deep features). Real-time and high accuracy tracking algorithms, however, remain scarce. In this paper we study the problem from a new perspective and present a novel parallel tracking and verifying (PTAV) framework, by taking advantage of the ubiquity of multi-thread techniques and borrowing from the success of parallel tracking and mapping in visual SLAM. Our PTAV framework typically consists of two components, a tracker T and a verifier V, working in parallel on two separate threads. The tracker T aims to provide a super real-time tracking inference and is expected to perform well most of the time; by contrast, the verifier V checks the tracking results and corrects T when needed. The key innovation is that, V does not work on every frame but only upon the requests from T; on the other end, T may adjust the tracking according to the feedback from V. With such collaboration, PTAV enjoys both the high efficiency provided by T and the strong discriminative power by V. In our extensive experiments on popular benchmarks including OTB2013, OTB2015, TC128 and UAV20L, PTAV achieves the best tracking accuracy among all real-time trackers, and in fact performs even better than many deep learning based solutions. Moreover, as a general framework, PTAV is very flexible and has great rooms for improvement and generalization.


page 2

page 3

page 5

page 7


Parallel Tracking and Verifying

Being intensively studied, visual object tracking has witnessed great ad...

SiamVGG: Visual Tracking using Deeper Siamese Networks

Recently, we have seen a rapid development of Deep Neural Network (DNN) ...

Robust and Real-time Deep Tracking Via Multi-Scale Domain Adaptation

Visual tracking is a fundamental problem in computer vision. Recently, s...

Attentive Deep Regression Networks for Real-Time Visual Face Tracking in Video Surveillance

Visual face tracking is one of the most important tasks in video surveil...

3D Visual Tracking Framework with Deep Learning for Asteroid Exploration

3D visual tracking is significant to deep space exploration programs, wh...

Confidence Trigger Detection: An Approach to Build Real-time Tracking-by-detection System

With deep learning based image analysis getting popular in recent years,...

Handling Structural Mismatches in Real-time Opera Tracking

Algorithms for reliable real-time score following in live opera promise ...

Please sign up or login with your details

Forgot password? Click here to reset