Building an Ensemble of Classifiers via Randomized Models of Ensemble Members

by   Pawel Trajdos, et al.

Many dynamic ensemble selection (DES) methods are known in the literature. A previously-developed by the authors, method consists in building a randomized classifier which is treated as a model of the base classifier. The model is equivalent to the base classifier in a certain probabilistic sense. Next, the probability of correct classification of randomized classifier is taken as the competence of the evaluated classifier. In this paper, a novel randomized model of base classifier is developed. In the proposed method, the random operation of the model results from a random selection of the learning set from the family of learning sets of a fixed size. The paper presents the mathematical foundations of this approach and shows how, for a practical application when learning and validation sets are given, one can determine the measure of competence and build a MC system with the DES scheme. The DES scheme with the proposed model of competence was experimentally evaluated on the collection of 67 benchmark datasets and compared in terms of eight quality criteria with two ensemble classifiers which use the previously-proposed concepts of randomized model. The proposed approach achieved the lowest ranks for almost all investigated quality criteria.


page 1

page 2

page 3

page 4


Relearning ensemble selection based on new generated features

The ensemble methods are meta-algorithms that combine several base machi...

Probability-driven scoring functions in combining linear classifiers

Although linear classifiers are one of the oldest methods in machine lea...

META-DES: A Dynamic Ensemble Selection Framework using Meta-Learning

Dynamic ensemble selection systems work by estimating the level of compe...

Dynamic classifier chains for multi-label learning

In this paper, we deal with the task of building a dynamic ensemble of c...

Aggregation of Classifiers: A Justifiable Information Granularity Approach

In this study, we introduce a new approach to combine multi-classifiers ...

A Nonparametric Ensemble Binary Classifier and its Statistical Properties

In this work, we propose an ensemble of classification trees (CT) and ar...

A Normative Model of Classifier Fusion

Combining the outputs of multiple classifiers or experts into a single p...

Please sign up or login with your details

Forgot password? Click here to reset