Optimal-margin evolutionary classifier

by   Mohammad Reza Bonyadi, et al.

We introduce a novel approach for discriminative classification using evolutionary algorithms. We first propose an algorithm to optimize the total loss value using a modified 0-1 loss function in a one-dimensional space for classification. We then extend this algorithm for multi-dimensional classification using an evolutionary algorithm. The proposed evolutionary algorithm aims to find a hyperplane which best classifies instances while minimizes the classification risk. We test particle swarm optimization, evolutionary strategy, and covariance matrix adaptation evolutionary strategy for optimization purpose. Finally, we compare our results with well-established and state-of-the-art classification algorithms, for both binary and multi-class classification, on 19 benchmark classification problems, with and without noise and outliers. Results show that the performance of the proposed algorithm is significantly (t-test) better than all other methods in almost all problems tested. We also show that the proposed algorithm is significantly more robust against noise and outliers comparing to other methods. The running time of the algorithm is within a reasonable range for the solution of real-world classification problems.


page 1

page 2

page 3

page 4


A novel multiobjective evolutionary algorithm based on decomposition and multi-reference points strategy

Many real-world optimization problems such as engineering design can be ...

Multiobjective Optimization of Classifiers by Means of 3-D Convex Hull Based Evolutionary Algorithm

Finding a good classifier is a multiobjective optimization problem with ...

Finding Morton-Like Layouts for Multi-Dimensional Arrays Using Evolutionary Algorithms

The layout of multi-dimensional data can have a significant impact on th...

Self-adaptive Multi-task Particle Swarm Optimization

Multi-task optimization (MTO) studies how to simultaneously solve multip...

Invariant backpropagation: how to train a transformation-invariant neural network

In many classification problems a classifier should be robust to small v...

DOC3-Deep One Class Classification using Contradictions

This paper introduces the notion of learning from contradictions (a.k.a ...

An Evolutionary Algorithm of Linear complexity: Application to Training of Deep Neural Networks

The performance of deep neural networks, such as Deep Belief Networks fo...

Please sign up or login with your details

Forgot password? Click here to reset