Trainable Class Prototypes for Few-Shot Learning

06/21/2021
by   Jianyi Li, et al.
0

Metric learning is a widely used method for few shot learning in which the quality of prototypes plays a key role in the algorithm. In this paper we propose the trainable prototypes for distance measure instead of the artificial ones within the meta-training and task-training framework. Also to avoid the disadvantages that the episodic meta-training brought, we adopt non-episodic meta-training based on self-supervised learning. Overall we solve the few-shot tasks in two phases: meta-training a transferable feature extractor via self-supervised learning and training the prototypes for metric classification. In addition, the simple attention mechanism is used in both meta-training and task-training. Our method achieves state-of-the-art performance in a variety of established few-shot tasks on the standard few-shot visual classification dataset, with about 20 few-shot learning methods.

READ FULL TEXT
research
08/23/2020

Few-Shot Image Classification via Contrastive Self-Supervised Learning

Most previous few-shot learning algorithms are based on meta-training wi...
research
10/07/2022

Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps

Learning a new task from a handful of examples remains an open challenge...
research
12/07/2019

Improved Few-Shot Visual Classification

Few-shot learning is a fundamental task in computer vision that carries ...
research
05/14/2023

Meta-DM: Applications of Diffusion Models on Few-Shot Learning

In the field of few-shot learning (FSL), extensive research has focused ...
research
09/17/2022

Few-Shot Classification with Contrastive Learning

A two-stage training paradigm consisting of sequential pre-training and ...
research
01/13/2022

Beyond Simple Meta-Learning: Multi-Purpose Models for Multi-Domain, Active and Continual Few-Shot Learning

Modern deep learning requires large-scale extensively labelled datasets ...
research
02/22/2019

Centroid Networks for Few-Shot Clustering and Unsupervised Few-Shot Classification

Traditional clustering algorithms such as K-means rely heavily on the na...

Please sign up or login with your details

Forgot password? Click here to reset