Detection of Thin Boundaries between Different Types of Anomalies in Outlier Detection using Enhanced Neural Networks

01/24/2020
by   Rasoul Kiani, et al.
3

Outlier detection has received special attention in various fields, mainly for those dealing with machine learning and artificial intelligence. As strong outliers, anomalies are divided into the point, contextual and collective outliers. The most important challenges in outlier detection include the thin boundary between the remote points and natural area, the tendency of new data and noise to mimic the real data, unlabelled datasets and different definitions for outliers in different applications. Considering the stated challenges, we defined new types of anomalies called Collective Normal Anomaly and Collective Point Anomaly in order to improve a much better detection of the thin boundary between different types of anomalies. Basic domain-independent methods are introduced to detect these defined anomalies in both unsupervised and supervised datasets. The Multi-Layer Perceptron Neural Network is enhanced using the Genetic Algorithm to detect newly defined anomalies with higher precision so as to ensure a test error less than that calculated for the conventional Multi-Layer Perceptron Neural Network. Experimental results on benchmark datasets indicated reduced error of anomaly detection process in comparison to baselines.

READ FULL TEXT

page 14

page 16

page 18

research
12/21/2019

AEGR: A simple approach to gradient reversal in autoencoders for network anomaly detection

Anomaly detection is referred to as a process in which the aim is to det...
research
04/23/2020

How to find a unicorn: a novel model-free, unsupervised anomaly detection method for time series

Recognition of anomalous events is a challenging but critical task in ma...
research
03/07/2020

RCC-Dual-GAN: An Efficient Approach for Outlier Detection with Few Identified Anomalies

Outlier detection is an important task in data mining and many technolog...
research
06/07/2020

A Novel Algorithm for Optimized Real Time Anomaly Detection in Timeseries

Observations in data which are significantly different from its neighbou...
research
03/06/2019

Explaining Anomalies Detected by Autoencoders Using SHAP

Anomaly detection algorithms are often thought to be limited because the...
research
09/04/2019

Subset Multivariate Collective And Point Anomaly Detection

In recent years, there has been a growing interest in identifying anomal...
research
05/20/2023

Technical outlier detection via convolutional variational autoencoder for the ADMANI breast mammogram dataset

The ADMANI datasets (annotated digital mammograms and associated non-ima...

Please sign up or login with your details

Forgot password? Click here to reset