Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot Tasks

02/17/2020
by   Micah Goldblum, et al.
0

Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods, little is known about why the resulting feature extractors perform so well. We develop a better understanding of the underlying mechanics of meta-learning and the difference between models trained using meta-learning and models which are trained classically. In doing so, we develop several hypotheses for why meta-learned models perform better. In addition to visualizations, we design several regularizers inspired by our hypotheses which improve performance on few-shot classification.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset