Drift anticipation with forgetting to improve evolving fuzzy system

by   Clement Leroy, et al.

Working with a non-stationary stream of data requires for the analysis system to evolve its model (the parameters as well as the structure) over time. In particular, concept drifts can occur, which makes it necessary to forget knowledge that has become obsolete. However, the forgetting is subjected to the stability-plasticity dilemma, that is, increasing forgetting improve reactivity of adapting to the new data while reducing the robustness of the system. Based on a set of inference rules, Evolving Fuzzy Systems-EFS-have proven to be effective in solving the data stream learning problem. However tackling the stability-plasticity dilemma is still an open question. This paper proposes a coherent method to integrate forgetting in Evolving Fuzzy System, based on the recently introduced notion of concept drift anticipation. The forgetting is applied with two methods: an exponential forgetting of the premise part and a deferred directional forgetting of the conclusion part of EFS to preserve the coherence between both parts. The originality of the approach consists in applying the forgetting only in the anticipation module and in keeping the EFS (called principal system) learned without any forgetting. Then, when a drift is detected in the stream, a selection mechanism is proposed to replace the obsolete parameters of the principal system with more suitable parameters of the anticipation module. An evaluation of the proposed methods is carried out on benchmark online datasets, with a comparison with state-of-the-art online classifiers (Learn++.NSE, PENsemble, pclass) as well as with the original system using different forgetting strategies.


page 1

page 2

page 3

page 4


ParaFIS:A new online fuzzy inference system based on parallel drift anticipation

This paper proposes a new architecture of incremen-tal fuzzy inference s...

Bilevel Online Deep Learning in Non-stationary Environment

Recent years have witnessed enormous progress of online learning. Howeve...

Adaptive Online Incremental Learning for Evolving Data Streams

Recent years have witnessed growing interests in online incremental lear...

On the Inter-relationships among Drift rate, Forgetting rate, Bias/variance profile and Error

We propose two general and falsifiable hypotheses about expectations on ...

Prototype-based classifiers in the presence of concept drift: A modelling framework

We present a modelling framework for the investigation of prototype-base...

An Incremental Construction of Deep Neuro Fuzzy System for Continual Learning of Non-stationary Data Streams

Existing fuzzy neural networks (FNNs) are mostly developed under a shall...

Supervised Learning in the Presence of Concept Drift: A modelling framework

We present a modelling framework for the investigation of supervised lea...

Please sign up or login with your details

Forgot password? Click here to reset