MetaMix: Improved Meta-Learning with Interpolation-based Consistency Regularization

09/29/2020
by   Yangbin Chen, et al.
46

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt quickly to new tasks. However, current MAML-based algorithms have limitations in forming generalizable decision boundaries. In this paper, we propose an approach called MetaMix. It generates virtual feature-target pairs within each episode to regularize the backbone models. MetaMix can be integrated with any of the MAML-based algorithms and learn the decision boundaries generalizing better to new tasks. Experiments on the mini-ImageNet, CUB, and FC100 datasets show that MetaMix improves the performance of MAML-based algorithms and achieves state-of-the-art result when integrated with Meta-Transfer Learning.

READ FULL TEXT

page 3

page 7

research
01/26/2023

Invariant Meta Learning for Out-of-Distribution Generalization

Modern deep learning techniques have illustrated their excellent capabil...
research
06/04/2021

Meta-Learning with Fewer Tasks through Task Interpolation

Meta-learning enables algorithms to quickly learn a newly encountered ta...
research
02/01/2022

Fully Online Meta-Learning Without Task Boundaries

While deep networks can learn complex functions such as classifiers, det...
research
08/05/2019

Learning to Generalize to Unseen Tasks with Bilevel Optimization

Recent metric-based meta-learning approaches, which learn a metric space...
research
10/31/2019

Hierarchical Expert Networks for Meta-Learning

The goal of meta-learning is to train a model on a variety of learning t...
research
04/16/2020

Divergent Search for Few-Shot Image Classification

When data is unlabelled and the target task is not known a priori, diver...
research
02/04/2022

TIML: Task-Informed Meta-Learning for Agriculture

Labeled datasets for agriculture are extremely spatially imbalanced. Whe...

Please sign up or login with your details

Forgot password? Click here to reset