DeepAI AI Chat
Log In Sign Up

Statistical Detection of Collective Data Fraud

by   Ruoyu Wang, et al.
Shanghai Jiao Tong University

Statistical divergence is widely applied in multimedia processing, basically due to regularity and explainable features displayed in data. However, in a broader range of data realm, these advantages may not out-stand, and therefore a more general approach is required. In data detection, statistical divergence can be used as an similarity measurement based on collective features. In this paper, we present a collective detection technique based on statistical divergence. The technique extracts distribution similarities among data collections, and then uses the statistical divergence to detect collective anomalies. Our technique continuously evaluates metrics as evolving features and calculates adaptive threshold to meet the best mathematical expectation. To illustrate details of the technique and explore its efficiency, we case-studied a real world problem of click farming detection against malicious online sellers. The evaluation shows that these techniques provided efficient classifiers. They were also sufficiently sensitive to a much smaller magnitude of data alteration, compared with real world malicious behaviours. Thus, it is applicable in the real world.


A linear time method for the detection of point and collective anomalies

The challenge of efficiently identifying anomalies in data sequences is ...

Subset Multivariate Collective And Point Anomaly Detection

In recent years, there has been a growing interest in identifying anomal...

Statistical and Topological Properties of Sliced Probability Divergences

The idea of slicing divergences has been proven to be successful when co...

Robust Inference Using the Exponential-Polynomial Divergence

Density-based minimum divergence procedures represent popular techniques...

Model-Based Event Detection in Wireless Sensor Networks

In this paper we present an application of techniques from statistical s...

Online Critical-State Detection of Sepsis Among ICU Patients using Jensen-Shannon Divergence

Sepsis is a severe medical condition caused by a dysregulated host respo...

Statistical Methods for Microbiome Analysis: A brief review

Recent attacks of various viruses with having deep and extensive impact ...