Infinite Mixture Prototypes for Few-Shot Learning

02/12/2019
by   Kelsey R. Allen, et al.
18

We propose infinite mixture prototypes to adaptively represent both simple and complex data distributions for few-shot learning. Our infinite mixture prototypes represent each class by a set of clusters, unlike existing prototypical methods that represent each class by a single cluster. By inferring the number of clusters, infinite mixture prototypes interpolate between nearest neighbor and prototypical representations, which improves accuracy and robustness in the few-shot regime. We show the importance of adaptive capacity for capturing complex data distributions such as alphabets, with 25 maintaining or improving accuracy on the standard Omniglot and mini-ImageNet benchmarks. In clustering labeled and unlabeled data by the same clustering rule, infinite mixture prototypes achieves state-of-the-art semi-supervised accuracy. As a further capability, we show that infinite mixture prototypes can perform purely unsupervised clustering, unlike existing prototypical methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2018

Metalearning with Hebbian Fast Weights

We unify recent neural approaches to one-shot learning with older ideas ...
research
03/06/2019

Semi-Supervised Few-Shot Learning with Local and Global Consistency

Learning from a few examples is a key characteristic of human intelligen...
research
09/07/2021

Few-shot Learning via Dependency Maximization and Instance Discriminant Analysis

We study the few-shot learning (FSL) problem, where a model learns to re...
research
02/22/2019

Centroid Networks for Few-Shot Clustering and Unsupervised Few-Shot Classification

Traditional clustering algorithms such as K-means rely heavily on the na...
research
04/18/2018

One-Shot Learning using Mixture of Variational Autoencoders: a Generalization Learning approach

Deep learning, even if it is very successful nowadays, traditionally nee...
research
07/13/2021

IID Sampling from Intractable Distributions

We propose a novel methodology for drawing iid realizations from any tar...
research
09/18/2022

Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classification

Transductive Few-Shot learning has gained increased attention nowadays c...

Please sign up or login with your details

Forgot password? Click here to reset