STUDD: A Student-Teacher Method for Unsupervised Concept Drift Detection

03/01/2021
by   Vítor Cerqueira, et al.
0

Concept drift detection is a crucial task in data stream evolving environments. Most of state of the art approaches designed to tackle this problem monitor the loss of predictive models. However, this approach falls short in many real-world scenarios, where the true labels are not readily available to compute the loss. In this context, there is increasing attention to approaches that perform concept drift detection in an unsupervised manner, i.e., without access to the true labels. We propose a novel approach to unsupervised concept drift detection based on a student-teacher learning paradigm. Essentially, we create an auxiliary model (student) to mimic the behaviour of the primary model (teacher). At run-time, our approach is to use the teacher for predicting new instances and monitoring the mimicking loss of the student for concept drift detection. In a set of experiments using 19 data streams, we show that the proposed approach can detect concept drift and present a competitive behaviour relative to the state of the art approaches.

READ FULL TEXT
research
11/23/2022

Unsupervised Unlearning of Concept Drift with Autoencoders

The phenomena of concept drift refers to a change of the data distributi...
research
07/05/2021

Detecting Concept Drift With Neural Network Model Uncertainty

Deployed machine learning models are confronted with the problem of chan...
research
02/10/2020

Model adaptation and unsupervised learning with non-stationary batch data under smooth concept drift

Most predictive models assume that training and test data are generated ...
research
06/25/2018

Request-and-Reverify: Hierarchical Hypothesis Testing for Concept Drift Detection with Expensive Labels

One important assumption underlying common classification models is the ...
research
08/12/2019

Automatic Model Monitoring for Data Streams

Detecting concept drift is a well known problem that affects production ...
research
04/20/2020

Multi-label Stream Classification with Self-Organizing Maps

Several learning algorithms have been proposed for offline multi-label c...
research
09/07/2017

Reservoir of Diverse Adaptive Learners and Stacking Fast Hoeffding Drift Detection Methods for Evolving Data Streams

The last decade has seen a surge of interest in adaptive learning algori...

Please sign up or login with your details

Forgot password? Click here to reset