On the Foundations of Adversarial Single-Class Classification

10/21/2010
by   Ran El-Yaniv, et al.
0

Motivated by authentication, intrusion and spam detection applications we consider single-class classification (SCC) as a two-person game between the learner and an adversary. In this game the learner has a sample from a target distribution and the goal is to construct a classifier capable of distinguishing observations from the target distribution from observations emitted from an unknown other distribution. The ideal SCC classifier must guarantee a given tolerance for the false-positive error (false alarm rate) while minimizing the false negative error (intruder pass rate). Viewing SCC as a two-person zero-sum game we identify both deterministic and randomized optimal classification strategies for different game variants. We demonstrate that randomized classification can provide a significant advantage. In the deterministic setting we show how to reduce SCC to two-class classification where in the two-class problem the other class is a synthetically generated distribution. We provide an efficient and practical algorithm for constructing and solving the two class problem. The algorithm distinguishes low density regions of the target distribution and is shown to be consistent.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/19/2018

Positive-Unlabeled Classification under Class Prior Shift and Asymmetric Error

A bottleneck of binary classification from positive and unlabeled data (...
research
02/10/2020

Playing to Learn Better: Repeated Games for Adversarial Learning with Multiple Classifiers

We consider the problem of prediction by a machine learning algorithm, c...
research
02/26/2020

Randomization matters. How to defend against strong adversarial attacks

Is there a classifier that ensures optimal robustness against all advers...
research
10/06/2022

On Optimal Learning Under Targeted Data Poisoning

Consider the task of learning a hypothesis class ℋ in the presence of an...
research
06/24/2019

A Game-Theoretic Approach to Adversarial Linear Support Vector Classification

In this paper, we employ a game-theoretic model to analyze the interacti...
research
06/06/2019

Robust Attacks against Multiple Classifiers

We address the challenge of designing optimal adversarial noise algorith...
research
02/08/2018

Detection Games Under Fully Active Adversaries

We study a binary hypothesis testing problem in which a defender must de...

Please sign up or login with your details

Forgot password? Click here to reset