Multi-timescale Trajectory Prediction for Abnormal Human Activity Detection

by   Royston Rodrigues, et al.

A classical approach to abnormal activity detection is to learn a representation for normal activities from the training data and then use this learned representation to detect abnormal activities while testing. Typically, the methods based on this approach operate at a fixed timescale - either a single time-instant (eg. frame-based) or a constant time duration (eg. video-clip based). But human abnormal activities can take place at different timescales. For example, jumping is a short term anomaly and loitering is a long term anomaly in a surveillance scenario. A single and pre-defined timescale is not enough to capture the wide range of anomalies occurring with different time duration. In this paper, we propose a multi-timescale model to capture the temporal dynamics at different timescales. In particular, the proposed model makes future and past predictions at different timescales for a given input pose trajectory. The model is multi-layered where intermediate layers are responsible to generate predictions corresponding to different timescales. These predictions are combined to detect abnormal activities. In addition, we also introduce an abnormal activity data-set for research use that contains 4,83,566 annotated frames. Data-set will be made available at Our experiments show that the proposed model can capture the anomalies of different time duration and outperforms existing methods.


page 2

page 3

page 4

page 7


Multi-representations Space Separation based Graph-level Anomaly-aware Detection

Graph structure patterns are widely used to model different area data re...

A Logic Programming Approach to Activity Recognition

We have been developing a system for recognising human activity given a ...

FastAno: Fast Anomaly Detection via Spatio-temporal Patch Transformation

Video anomaly detection has gained significant attention due to the incr...

Lost in Time: Temporal Analytics for Long-Term Video Surveillance

Video surveillance is a well researched area of study with substantial w...

An AIoT-enabled Autonomous Dementia Monitoring System

An autonomous Artificial Internet of Things (AIoT) system for elderly de...

Anomaly Detection and Localization in Crowded Scenes by Motion-field Shape Description and Similarity-based Statistical Learning

In crowded scenes, detection and localization of abnormal behaviors is c...

Please sign up or login with your details

Forgot password? Click here to reset