Robust and efficient change point detection using novel multivariate rank-energy GoF test

10/29/2021
by   Shoaib Bin Masud, et al.
0

In this paper, we use and further develop upon a recently proposed multivariate, distribution-free Goodness-of-Fit (GoF) test based on the theory of Optimal Transport (OT) called the Rank Energy (RE) [1], for non-parametric and unsupervised Change Point Detection (CPD) in multivariate time series data. We show that directly using RE leads to high sensitivity to very small changes in distributions (causing high false alarms) and it requires large sample complexity and huge computational cost. To alleviate these drawbacks, we propose a new GoF test statistic called as soft-Rank Energy (sRE) that is based on entropy regularized OT and employ it towards CPD. We discuss the advantages of using sRE over RE and demonstrate that the proposed sRE based CPD outperforms all the existing methods in terms of Area Under the Curve (AUC) and F1-score on real and synthetic data sets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/16/2021

Soft and subspace robust multivariate rank tests based on entropy regularized optimal transport

In this paper, we extend the recently proposed multivariate rank energy ...
research
02/15/2023

On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection

This paper considers the use of recently proposed optimal transport-base...
research
10/29/2021

Learning generative models for valid knockoffs using novel multivariate-rank based statistics

We consider the problem of generating valid knockoffs for knockoff filte...
research
04/29/2023

Change point detection in low-rank VAR processes

Vector autoregressive (VAR) models are widely used in multivariate time ...
research
02/07/2020

Unsupervised non-parametric change point detection in quasi-periodic signals

We propose a new unsupervised and non-parametric method to detect change...
research
04/10/2018

Learning Latent Events from Network Message Logs: A Decomposition Based Approach

In this communication, we describe a novel technique for event mining us...
research
06/09/2020

On Matched Filtering for Statistical Change Point Detection

Non-parametric and distribution-free two-sample tests have been the foun...

Please sign up or login with your details

Forgot password? Click here to reset