Evolving Multi-Label Fuzzy Classifier

by   Edwin Lughofer, et al.

Multi-label classification has attracted much attention in the machine learning community to address the problem of assigning single samples to more than one class at the same time. We propose an evolving multi-label fuzzy classifier (EFC-ML) which is able to self-adapt and self-evolve its structure with new incoming multi-label samples in an incremental, single-pass manner. It is based on a multi-output Takagi-Sugeno type architecture, where for each class a separate consequent hyper-plane is defined. The learning procedure embeds a locally weighted incremental correlation-based algorithm combined with (conventional) recursive fuzzily weighted least squares and Lasso-based regularization. The correlation-based part ensures that the interrelations between class labels, a specific well-known property in multi-label classification for improved performance, are preserved properly; the Lasso-based regularization reduces the curse of dimensionality effects in the case of a higher number of inputs. Antecedent learning is achieved by product-space clustering and conducted for all class labels together, which yields a single rule base, allowing a compact knowledge view. Furthermore, our approach comes with an online active learning (AL) strategy for updating the classifier on just a number of selected samples, which in turn makes the approach applicable for scarcely labelled streams in applications, where the annotation effort is typically expensive. Our approach was evaluated on several data sets from the MULAN repository and showed significantly improved classification accuracy compared to (evolving) one-versus-rest or classifier chaining concepts. A significant result was that, due to the online AL method, a 90% reduction in the number of samples used for classifier updates had little effect on the accumulated accuracy trend lines compared to a full update in most data set cases.


page 1

page 2

page 3

page 4


A Novel Online Real-time Classifier for Multi-label Data Streams

In this paper, a novel extreme learning machine based online multi-label...

Class-Incremental Lifelong Learning in Multi-Label Classification

Existing class-incremental lifelong learning studies only the data is wi...

Inducing Generalized Multi-Label Rules with Learning Classifier Systems

In recent years, multi-label classification has attracted a significant ...

A Novel Online Stacked Ensemble for Multi-Label Stream Classification

As data streams become more prevalent, the necessity for online algorith...

Weighting Scheme for a Pairwise Multi-label Classifier Based on the Fuzzy Confusion Matrix

In this work we addressed the issue of applying a stochastic classifier ...

Multi-label Classification using Labels as Hidden Nodes

Competitive methods for multi-label classification typically invest in l...

Multi-label Stream Classification with Self-Organizing Maps

Several learning algorithms have been proposed for offline multi-label c...

Please sign up or login with your details

Forgot password? Click here to reset