A Unifying Review of Deep and Shallow Anomaly Detection

09/24/2020
by   Lukas Ruff, et al.
49

Deep learning approaches to anomaly detection have recently improved the state of the art in detection performance on complex datasets such as large collections of images or text. These results have sparked a renewed interest in the anomaly detection problem and led to the introduction of a great variety of new methods. With the emergence of numerous such methods, including approaches based on generative models, one-class classification, and reconstruction, there is a growing need to bring methods of this field into a systematic and unified perspective. In this review we aim to identify the common underlying principles as well as the assumptions that are often made implicitly by various methods. In particular, we draw connections between classic 'shallow' and novel deep approaches and show how this relation might cross-fertilize or extend both directions. We further provide an empirical assessment of major existing methods that is enriched by the use of recent explainability techniques, and present specific worked-through examples together with practical advice. Finally, we outline critical open challenges and identify specific paths for future research in anomaly detection.

READ FULL TEXT

page 1

page 3

page 12

research
09/27/2021

Visual Anomaly Detection for Images: A Survey

Visual anomaly detection is an important and challenging problem in the ...
research
01/10/2019

Deep Learning for Anomaly Detection: A Survey

Anomaly detection is an important problem that has been well-studied wit...
research
07/06/2020

Deep Learning for Anomaly Detection: A Review

Anomaly detection, a.k.a. outlier detection, has been a lasting yet acti...
research
12/04/2020

Deep Learning for Medical Anomaly Detection – A Survey

Machine learning-based medical anomaly detection is an important problem...
research
09/20/2018

Challenges for Toxic Comment Classification: An In-Depth Error Analysis

Toxic comment classification has become an active research field with ma...
research
10/26/2021

A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges

Machine learning models often encounter samples that are diverged from t...
research
07/08/2022

Deep Learning for Anomaly Detection in Log Data: A Survey

Automatic log file analysis enables early detection of relevant incident...

Please sign up or login with your details

Forgot password? Click here to reset