A unifying view for performance measures in multi-class prediction

08/17/2010
by   Giuseppe Jurman, et al.
0

In the last few years, many different performance measures have been introduced to overcome the weakness of the most natural metric, the Accuracy. Among them, Matthews Correlation Coefficient has recently gained popularity among researchers not only in machine learning but also in several application fields such as bioinformatics. Nonetheless, further novel functions are being proposed in literature. We show that Confusion Entropy, a recently introduced classifier performance measure for multi-class problems, has a strong (monotone) relation with the multi-class generalization of a classical metric, the Matthews Correlation Coefficient. Computational evidence in support of the claim is provided, together with an outline of the theoretical explanation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/11/2022

Goodness of Fit Metrics for Multi-class Predictor

The multi-class prediction had gained popularity over recent years. Thus...
research
01/01/2015

Consistent Classification Algorithms for Multi-class Non-Decomposable Performance Metrics

We study consistency of learning algorithms for a multi-class performanc...
research
08/13/2020

Metrics for Multi-Class Classification: an Overview

Classification tasks in machine learning involving more than two classes...
research
11/24/2018

MEMOIR: Multi-class Extreme Classification with Inexact Margin

Multi-class classification with a very large number of classes, or extre...
research
10/11/2020

Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation

Commonly used evaluation measures including Recall, Precision, F-Measure...
research
08/24/2020

Correlations with tailored extremal properties

Recently, Chatterjee has introduced a new coefficient of correlation whi...
research
10/18/2022

Multi-Source Transformer Architectures for Audiovisual Scene Classification

In this technical report, the systems we submitted for subtask 1B of the...

Please sign up or login with your details

Forgot password? Click here to reset