A Closer Look at Few-shot Classification Again

01/28/2023
by   Xu Luo, et al.
0

Few-shot classification consists of a training phase where a model is learned on a relatively large dataset and an adaptation phase where the learned model is adapted to previously-unseen tasks with limited labeled samples. In this paper, we empirically prove that the training algorithm and the adaptation algorithm can be completely disentangled, which allows algorithm analysis and design to be done individually for each phase. Our meta-analysis for each phase reveals several interesting insights that may help better understand key aspects of few-shot classification and connections with other fields such as visual representation learning and transfer learning. We hope the insights and research challenges revealed in this paper can inspire future work in related directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2021

Universal Representation Learning from Multiple Domains for Few-shot Classification

In this paper, we look at the problem of few-shot classification that ai...
research
06/16/2021

Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation

Multi-task learning (MTL) aims to improve the generalization of several ...
research
07/01/2021

Improving Task Adaptation for Cross-domain Few-shot Learning

In this paper, we look at the problem of cross-domain few-shot classific...
research
12/30/2021

On the Role of Neural Collapse in Transfer Learning

We study the ability of foundation models to learn representations for c...
research
04/26/2022

Meta-free few-shot learning via representation learning with weight averaging

Recent studies on few-shot classification using transfer learning pose c...
research
06/18/2019

Fast and Flexible Multi-Task Classification Using Conditional Neural Adaptive Processes

The goal of this paper is to design image classification systems that, a...
research
01/11/2020

Intelligence, physics and information – the tradeoff between accuracy and simplicity in machine learning

How can we enable machines to make sense of the world, and become better...

Please sign up or login with your details

Forgot password? Click here to reset