Continual Novelty Detection

by   Rahaf Aljundi, et al.

Novelty Detection methods identify samples that are not representative of a model's training set thereby flagging misleading predictions and bringing a greater flexibility and transparency at deployment time. However, research in this area has only considered Novelty Detection in the offline setting. Recently, there has been a growing realization in the computer vision community that applications demand a more flexible framework - Continual Learning - where new batches of data representing new domains, new classes or new tasks become available at different points in time. In this setting, Novelty Detection becomes more important, interesting and challenging. This work identifies the crucial link between the two problems and investigates the Novelty Detection problem under the Continual Learning setting. We formulate the Continual Novelty Detection problem and present a benchmark, where we compare several Novelty Detection methods under different Continual Learning settings. We show that Continual Learning affects the behaviour of novelty detection algorithms, while novelty detection can pinpoint insights in the behaviour of a continual learner. We further propose baselines and discuss possible research directions. We believe that the coupling of the two problems is a promising direction to bring vision models into practice.


page 5

page 6

page 7


Open-World Continual Learning: Unifying Novelty Detection and Continual Learning

As AI agents are increasingly used in the real open world with unknowns ...

CLAD: A realistic Continual Learning benchmark for Autonomous Driving

In this paper we describe the design and the ideas motivating a new Cont...

Continual Improvement of Threshold-Based Novelty Detection

When evaluated in dynamic, open-world situations, neural networks strugg...

An Improved System for Sentence-level Novelty Detection in Textual Streams

Novelty detection in news events has long been a difficult problem. A nu...

Sequoia: A Software Framework to Unify Continual Learning Research

The field of Continual Learning (CL) seeks to develop algorithms that ac...

SHELS: Exclusive Feature Sets for Novelty Detection and Continual Learning Without Class Boundaries

While deep neural networks (DNNs) have achieved impressive classificatio...

Please sign up or login with your details

Forgot password? Click here to reset