A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videos

by   Xianlin Zeng, et al.

Deep learning models have been widely used for anomaly detection in surveillance videos. Typical models are equipped with the capability to reconstruct normal videos and evaluate the reconstruction errors on anomalous videos to indicate the extent of abnormalities. However, existing approaches suffer from two disadvantages. Firstly, they can only encode the movements of each identity independently, without considering the interactions among identities which may also indicate anomalies. Secondly, they leverage inflexible models whose structures are fixed under different scenes, this configuration disables the understanding of scenes. In this paper, we propose a Hierarchical Spatio-Temporal Graph Convolutional Neural Network (HSTGCNN) to address these problems, the HSTGCNN is composed of multiple branches that correspond to different levels of graph representations. High-level graph representations encode the trajectories of people and the interactions among multiple identities while low-level graph representations encode the local body postures of each person. Furthermore, we propose to weightedly combine multiple branches that are better at different scenes. An improvement over single-level graph representations is achieved in this way. An understanding of scenes is achieved and serves anomaly detection. High-level graph representations are assigned higher weights to encode moving speed and directions of people in low-resolution videos while low-level graph representations are assigned higher weights to encode human skeletons in high-resolution videos. Experimental results show that the proposed HSTGCNN significantly outperforms current state-of-the-art models on four benchmark datasets (UCSD Pedestrian, ShanghaiTech, CUHK Avenue and IITB-Corridor) by using much less learnable parameters.


page 1

page 2

page 6

page 8

page 10

page 11


Anomaly detection using prediction error with Spatio-Temporal Convolutional LSTM

In this paper, we propose a novel method for video anomaly detection mot...

A Self-Reasoning Framework for Anomaly Detection Using Video-Level Labels

Anomalous event detection in surveillance videos is a challenging and pr...

An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos

Videos represent the primary source of information for surveillance appl...

Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Prediction

Better machine understanding of pedestrian behaviors enables faster prog...

Towards Anomaly Detection in Dashcam Videos

Inexpensive sensing and computation, as well as insurance innovations, h...

Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos

Appearance features have been widely used in video anomaly detection eve...

Privacy-Protecting Behaviours of Risk Detection in People with Dementia using Videos

People living with dementia often exhibit behavioural and psychological ...

Please sign up or login with your details

Forgot password? Click here to reset