DeepAI AI Chat
Log In Sign Up

Learning Gradient Boosted Multi-label Classification Rules

by   Michael Rapp, et al.
Technische Universität Darmstadt
Universität Paderborn

In multi-label classification, where the evaluation of predictions is less straightforward than in single-label classification, various meaningful, though different, loss functions have been proposed. Ideally, the learning algorithm should be customizable towards a specific choice of the performance measure. Modern implementations of boosting, most prominently gradient boosted decision trees, appear to be appealing from this point of view. However, they are mostly limited to single-label classification, and hence not amenable to multi-label losses unless these are label-wise decomposable. In this work, we develop a generalization of the gradient boosting framework to multi-output problems and propose an algorithm for learning multi-label classification rules that is able to minimize decomposable as well as non-decomposable loss functions. Using the well-known Hamming loss and subset 0/1 loss as representatives, we analyze the abilities and limitations of our approach on synthetic data and evaluate its predictive performance on multi-label benchmarks.


page 1

page 2

page 3

page 4


A Flexible Class of Dependence-aware Multi-Label Loss Functions

Multi-label classification is the task of assigning a subset of labels t...

Gradient-based Label Binning in Multi-label Classification

In multi-label classification, where a single example may be associated ...

A Comparative Study of Deep Learning Loss Functions for Multi-Label Remote Sensing Image Classification

This paper analyzes and compares different deep learning loss functions ...

ZLPR: A Novel Loss for Multi-label Classification

In the era of deep learning, loss functions determine the range of tasks...

On the benefits of output sparsity for multi-label classification

The multi-label classification framework, where each observation can be ...

Handling Imbalanced Dataset in Multi-label Text Categorization using Bagging and Adaptive Boosting

Imbalanced dataset is occurred due to uneven distribution of data availa...

On the Trade-off Between Consistency and Coverage in Multi-label Rule Learning Heuristics

Recently, several authors have advocated the use of rule learning algori...