Class Anchor Clustering: a Distance-based Loss for Training Open Set Classifiers

04/06/2020
by   Dimity Miller, et al.
26

Existing open set classifiers distinguish between known and unknown inputs by measuring distance in a network's logit space, assuming that known inputs cluster closer to the training data than unknown inputs. However, this approach is typically applied post-hoc to networks trained with cross-entropy loss, which neither guarantees nor encourages the hoped-for clustering behaviour. To overcome this limitation, we introduce Class Anchor Clustering (CAC) loss. CAC is an entirely distance-based loss that explicitly encourages training data to form tight clusters around class-dependent anchor points in the logit space. We show that an open set classifier trained with CAC loss outperforms all state-of-the-art techniques on the challenging TinyImageNet dataset, achieving a 2.4 other state-of-the-art distance-based approaches on a number of further relevant datasets. We will make the code for CAC publicly available.

READ FULL TEXT

page 2

page 12

page 13

page 14

page 19

research
08/10/2023

𝒢^2Pxy: Generative Open-Set Node Classification on Graphs with Proxy Unknowns

Node classification is the task of predicting the labels of unlabeled no...
research
08/24/2023

LORD: Leveraging Open-Set Recognition with Unknown Data

Handling entirely unknown data is a challenge for any deployed classifie...
research
12/11/2018

Classification-Reconstruction Learning for Open-Set Recognition

Open-set classification is a problem of handling `unknown' classes that ...
research
03/16/2022

Is it all a cluster game? – Exploring Out-of-Distribution Detection based on Clustering in the Embedding Space

It is essential for safety-critical applications of deep neural networks...
research
03/07/2020

Adaptive Offline Quintuplet Loss for Image-Text Matching

Existing image-text matching approaches typically leverage triplet loss ...
research
11/09/2018

Reducing Network Agnostophobia

Agnostophobia, the fear of the unknown, can be experienced by deep learn...
research
02/13/2021

ThetA – fast and robust clustering via a distance parameter

Clustering is a fundamental problem in machine learning where distance-b...

Please sign up or login with your details

Forgot password? Click here to reset