Dynamic Ensemble Selection VS K-NN: why and when Dynamic Selection obtains higher classification performance?

04/21/2018
by   Rafael M. O. Cruz, et al.
0

Multiple classifier systems focus on the combination of classifiers to obtain better performance than a single robust one. These systems unfold three major phases: pool generation, selection and integration. One of the most promising MCS approaches is Dynamic Selection (DS), which relies on finding the most competent classifier or ensemble of classifiers to predict each test sample. The majority of the DS techniques are based on the K-Nearest Neighbors (K-NN) definition, and the quality of the neighborhood has a huge impact on the performance of DS methods. In this paper, we perform an analysis comparing the classification results of DS techniques and the K-NN classifier under different conditions. Experiments are performed on 18 state-of-the-art DS techniques over 30 classification datasets and results show that DS methods present a significant boost in classification accuracy even though they use the same neighborhood as the K-NN. The reasons behind the outperformance of DS techniques over the K-NN classifier reside in the fact that DS techniques can deal with samples with a high degree of instance hardness (samples that are located close to the decision border) as opposed to the K-NN. In this paper, not only we explain why DS techniques achieve higher classification performance than the K-NN but also when DS should be used.

READ FULL TEXT
research
11/01/2018

Analyzing different prototype selection techniques for dynamic classifier and ensemble selection

In dynamic selection (DS) techniques, only the most competent classifier...
research
01/08/2010

Boosting k-NN for categorization of natural scenes

The k-nearest neighbors (k-NN) classification rule has proven extremely ...
research
04/02/2021

A Comparison of Similarity Based Instance Selection Methods for Cross Project Defect Prediction

Context: Previous studies have shown that training data instance selecti...
research
09/05/2018

Online local pool generation for dynamic classifier selection: an extended version

Dynamic Classifier Selection (DCS) techniques have difficulty in selecti...
research
06/17/2008

Supervised functional classification: A theoretical remark and some comparisons

The problem of supervised classification (or discrimination) with functi...
research
12/14/2020

Cost-sensitive Hierarchical Clustering for Dynamic Classifier Selection

We consider the dynamic classifier selection (DCS) problem: Given an ens...

Please sign up or login with your details

Forgot password? Click here to reset