A Unified Framework with Meta-dropout for Few-shot Learning

10/12/2022
by   Shaobo Lin, et al.
0

Conventional training of deep neural networks usually requires a substantial amount of data with expensive human annotations. In this paper, we utilize the idea of meta-learning to explain two very different streams of few-shot learning, i.e., the episodic meta-learning-based and pre-train finetune-based few-shot learning, and form a unified meta-learning framework. In order to improve the generalization power of our framework, we propose a simple yet effective strategy named meta-dropout, which is applied to the transferable knowledge generalized from base categories to novel categories. The proposed strategy can effectively prevent neural units from co-adapting excessively in the meta-training stage. Extensive experiments on the few-shot object detection and few-shot image classification datasets, i.e., Pascal VOC, MS COCO, CUB, and mini-ImageNet, validate the effectiveness of our method.

READ FULL TEXT
research
01/26/2023

Explore the Power of Dropout on Few-shot Learning

The generalization power of the pre-trained model is the key for few-sho...
research
10/22/2018

How to train your MAML

The field of few-shot learning has recently seen substantial advancement...
research
06/15/2020

Automatic Validation of Textual Attribute Values in E-commerce Catalog by Learning with Limited Labeled Data

Product catalogs are valuable resources for eCommerce website. In the ca...
research
02/27/2020

Is the Meta-Learning Idea Able to Improve the Generalization of Deep Neural Networks on the Standard Supervised Learning?

Substantial efforts have been made on improving the generalization abili...
research
07/20/2022

Bitwidth-Adaptive Quantization-Aware Neural Network Training: A Meta-Learning Approach

Deep neural network quantization with adaptive bitwidths has gained incr...
research
04/08/2019

L2AE-D: Learning to Aggregate Embeddings for Few-shot Learning with Meta-level Dropout

Few-shot learning focuses on learning a new visual concept with very lim...
research
07/30/2020

Learning from Few Samples: A Survey

Deep neural networks have been able to outperform humans in some cases l...

Please sign up or login with your details

Forgot password? Click here to reset