A generalized meta-loss function for distillation and learning using privileged information for classification and regression

11/16/2018
by   Amina Asif, et al.
0

Learning using privileged information and distillation are powerful machine learning frameworks that allow a machine learning model to be learned from an existing model or from a classifier trained over another feature space. Existing implementations of learning using privileged information are limited to classification only. In this work, we have proposed a novel meta-loss function that allows the general application of learning using privileged information and distillation to not only classification but also regression and other related problems. Our experimental results show the usefulness of the proposed scheme.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/03/2019

Generalized Learning with Rejection for Classification and Regression Problems

Learning with rejection (LWR) allows development of machine learning sys...
research
03/24/2021

Unsupervised collaborative learning using privileged information

In the collaborative clustering framework, the hope is that by combining...
research
03/08/2019

Everything old is new again: A multi-view learning approach to learning using privileged information and distillation

We adopt a multi-view approach for analyzing two knowledge transfer sett...
research
01/04/2022

Knowledge Informed Machine Learning using a Weibull-based Loss Function

Machine learning can be enhanced through the integration of external kno...
research
03/31/2022

A unified theory of learning

Recently machine learning using neural networks (NN) has been developed,...
research
05/19/2020

Privileged Information Dropout in Reinforcement Learning

Using privileged information during training can improve the sample effi...
research
07/16/2023

Dataset Distillation Meets Provable Subset Selection

Deep learning has grown tremendously over recent years, yielding state-o...

Please sign up or login with your details

Forgot password? Click here to reset