Innovations Autoencoder and its Application in Real-Time Anomaly Detection

by   Xinyi Wang, et al.

An innovations sequence of a time series is a sequence of independent and identically distributed random variables with which the original time series has a causal representation. The innovation at a time is statistically independent of the prior history of the time series. As such, it represents the new information contained at present but not in the past. Because of its simple probability structure, an innovations sequence is the most efficient signature of the original. Unlike the principle or independent analysis (PCA/ICA) representations, an innovations sequence preserves not only the complete statistical properties but also the temporal order of the original time series. An long-standing open problem is to find a computationally tractable way to extract an innovations sequence of non-Gaussian processes. This paper presents a deep learning approach, referred to as Innovations Autoencoder (IAE), that extracts innovations sequences using a causal convolutional neural network. An application of IAE to nonparametric anomaly detection with unknown anomaly and anomaly-free models is also presented.


page 9

page 16


RePAD2: Real-Time, Lightweight, and Adaptive Anomaly Detection for Open-Ended Time Series

An open-ended time series refers to a series of data points indexed in t...

Novelty Detection in Time Series via Weak Innovations Representation: A Deep Learning Approach

We consider novelty detection in time series with unknown and nonparamet...

LSTM-Autoencoder based Anomaly Detection for Indoor Air Quality Time Series Data

Anomaly detection for indoor air quality (IAQ) data has become an import...

Forward Neural Network for Time Series Anomaly Detection

Time series anomaly detection is usually formulated as finding outlier d...

THAAD: Efficient Matching Queries under Temporal Abstraction for Anomaly Detection

In this paper we present a novel algorithm and efficient data structure ...

Syntactic sensitive complexity for symbol-free sequence

This work uses the L-system to construct a tree structure for the text s...

Please sign up or login with your details

Forgot password? Click here to reset