OmniTrack: Real-time detection and tracking of objects, text and logos in video

by   Hannes Fassold, et al.

The automatic detection and tracking of general objects (like persons, animals or cars), text and logos in a video is crucial for many video understanding tasks, and usually real-time processing as required. We propose OmniTrack, an efficient and robust algorithm which is able to automatically detect and track objects, text as well as brand logos in real-time. It combines a powerful deep learning based object detector (YoloV3) with high-quality optical flow methods. Based on the reference YoloV3 C++ implementation, we did some important performance optimizations which will be described. The major steps in the training procedure for the combined detector for text and logo will be presented. We will describe then the OmniTrack algorithm, consisting of the phases preprocessing, feature calculation, prediction, matching and update. Several performance optimizations have been implemented there as well, like doing the object detection and optical flow calculation asynchronously. Experiments show that the proposed algorithm runs in real-time for standard definition (720x576) video on a PC with a Quadro RTX 5000 GPU.


page 2

page 4


A real-time algorithm for human action recognition in RGB and thermal video

Monitoring the movement and actions of humans in video in real-time is a...

Image-based monitoring of bolt loosening through deep-learning-based integrated detection and tracking

Structural bolts are critical components used in different structural el...

Deep Learning based Virtual Point Tracking for Real-Time Target-less Dynamic Displacement Measurement in Railway Applications

In the application of computer-vision based displacement measurement, an...

Real-time Embedded Person Detection and Tracking for Shopping Behaviour Analysis

Shopping behaviour analysis through counting and tracking of people in s...

Very Fast Keyword Spotting System with Real Time Factor below 0.01

In the paper we present an architecture of a keyword spotting (KWS) syst...

Real-time AdaBoost cascade face tracker based on likelihood map and optical flow

The authors present a novel face tracking approach where optical flow in...

Video text tracking for dense and small text based on pp-yoloe-r and sort algorithm

Although end-to-end video text spotting methods based on Transformer can...

Please sign up or login with your details

Forgot password? Click here to reset