A linear time method for the detection of point and collective anomalies

The challenge of efficiently identifying anomalies in data sequences is an important statistical problem that now arises in many applications. Whilst there has been substantial work aimed at making statistical analyses robust to outliers, or point anomalies, there has been much less work on detecting anomalous segments, or collective anomalies. By bringing together ideas from changepoint detection and robust statistics, we introduce Collective And Point Anomalies (CAPA), a computationally efficient approach that is suitable when collective anomalies are characterised by either a change in mean, variance, or both, and distinguishes them from point anomalies. Theoretical results establish the consistency of CAPA at detecting collective anomalies and empirical results show that CAPA has close to linear computational cost as well as being more accurate at detecting and locating collective anomalies than other approaches. We demonstrate the utility of CAPA through its ability to detect exoplanets from light curve data from the Kepler telescope.

READ FULL TEXT

page 8

page 27

page 29

page 30

research
09/04/2019

Subset Multivariate Collective And Point Anomaly Detection

In recent years, there has been a growing interest in identifying anomal...
research
06/08/2021

Detecting Anomalous Event Sequences with Temporal Point Processes

Automatically detecting anomalies in event data can provide substantial ...
research
06/05/2019

Detecting linear trend changes and point anomalies in data sequences

We propose TrendSegment, a methodology for detecting multiple change-poi...
research
01/03/2020

Statistical Detection of Collective Data Fraud

Statistical divergence is widely applied in multimedia processing, basic...
research
06/29/2020

Random Partitioning Forest for Point-Wise and Collective Anomaly Detection – Application to Intrusion Detection

In this paper, we propose DiFF-RF, an ensemble approach composed of rand...
research
05/16/2021

Collective anomaly detection in High-dimensional VAR Models

There is increasing interest in detecting collective anomalies: potentia...
research
08/22/2023

NLP-based detection of systematic anomalies among the narratives of consumer complaints

We develop an NLP-based procedure for detecting systematic nonmeritoriou...

Please sign up or login with your details

Forgot password? Click here to reset