Continual Novelty Detection

06/24/2021
by   Rahaf Aljundi, et al.
5

Novelty Detection methods identify samples that are not representative of a model's training set thereby flagging misleading predictions and bringing a greater flexibility and transparency at deployment time. However, research in this area has only considered Novelty Detection in the offline setting. Recently, there has been a growing realization in the computer vision community that applications demand a more flexible framework - Continual Learning - where new batches of data representing new domains, new classes or new tasks become available at different points in time. In this setting, Novelty Detection becomes more important, interesting and challenging. This work identifies the crucial link between the two problems and investigates the Novelty Detection problem under the Continual Learning setting. We formulate the Continual Novelty Detection problem and present a benchmark, where we compare several Novelty Detection methods under different Continual Learning settings. We show that Continual Learning affects the behaviour of novelty detection algorithms, while novelty detection can pinpoint insights in the behaviour of a continual learner. We further propose baselines and discuss possible research directions. We believe that the coupling of the two problems is a promising direction to bring vision models into practice.

READ FULL TEXT

page 5

page 6

page 7

04/20/2023

Open-World Continual Learning: Unifying Novelty Detection and Continual Learning

As AI agents are increasingly used in the real open world with unknowns ...
10/07/2022

CLAD: A realistic Continual Learning benchmark for Autonomous Driving

In this paper we describe the design and the ideas motivating a new Cont...
09/05/2023

Continual Improvement of Threshold-Based Novelty Detection

When evaluated in dynamic, open-world situations, neural networks strugg...
04/30/2016

An Improved System for Sentence-level Novelty Detection in Textual Streams

Novelty detection in news events has long been a difficult problem. A nu...
08/02/2021

Sequoia: A Software Framework to Unify Continual Learning Research

The field of Continual Learning (CL) seeks to develop algorithms that ac...
06/28/2022

SHELS: Exclusive Feature Sets for Novelty Detection and Continual Learning Without Class Boundaries

While deep neural networks (DNNs) have achieved impressive classificatio...

Please sign up or login with your details

Forgot password? Click here to reset