Anomaly Detection using Contrastive Normalizing Flows

08/30/2022
by   Robert Schmier, et al.
11

Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perform poorly as an anomaly score. We propose to use an unlabelled auxiliary dataset and a probabilistic outlier score for anomaly detection. We use a self-supervised feature extractor trained on the auxiliary dataset and train a normalizing flow on the extracted features by maximizing the likelihood on in-distribution data and minimizing the likelihood on the auxiliary dataset. We show that this is equivalent to learning the normalized positive difference between the in-distribution and the auxiliary feature density. We conduct experiments on benchmark datasets and show a robust improvement compared to likelihood, likelihood ratio methods and state-of-the-art anomaly detection methods.

READ FULL TEXT

page 7

page 15

page 19

page 20

page 21

research
04/12/2019

Supervised Anomaly Detection based on Deep Autoregressive Density Estimators

We propose a supervised anomaly detection method based on neural density...
research
10/06/2022

Env-Aware Anomaly Detection: Ignore Style Changes, Stay True to Content!

We introduce a formalization and benchmark for the unsupervised anomaly ...
research
01/22/2020

Safe Robot Navigation via Multi-Modal Anomaly Detection

Navigation in natural outdoor environments requires a robust and reliabl...
research
10/25/2020

Multiscale Score Matching for Out-of-Distribution Detection

We present a new methodology for detecting out-of-distribution (OOD) ima...
research
06/18/2020

Understanding Anomaly Detection with Deep Invertible Networks through Hierarchies of Distributions and Features

Deep generative networks trained via maximum likelihood on a natural ima...
research
05/24/2023

Real time dense anomaly detection by learning on synthetic negative data

Most approaches to dense anomaly detection rely on generative modeling o...
research
03/19/2022

No Shifted Augmentations (NSA): compact distributions for robust self-supervised Anomaly Detection

Unsupervised Anomaly detection (AD) requires building a notion of normal...

Please sign up or login with your details

Forgot password? Click here to reset