Adaptive Deep Kernel Learning

by   Prudencio Tossou, et al.
Université Laval
Element AI Inc
InVivo AI

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, it consists of learning a kernel operator which is combined with a differentiable kernel algorithm for inference. While previous work within this framework has mostly explored learning a single kernel for large datasets, we focus herein on learning a kernel family for a variety of tasks in few-shot regression settings. Compared to single deep kernel learning, our novel algorithm permits finding the appropriate kernel for each task during inference, rather than using the same for all tasks. As such, our algorithm performs more effectively with complex task distributions in few-shot learning, which we demonstrate by benchmarking against existing state-of-the-art algorithms using real-world, few-shot regression tasks related to drug discovery.


page 1

page 2

page 3

page 4


Deep Kernel Transfer in Gaussian Processes for Few-shot Learning

Humans tackle new problems by making inferences that go far beyond the i...

Meta-learning Feature Representations for Adaptive Gaussian Processes via Implicit Differentiation

We propose Adaptive Deep Kernel Fitting (ADKF), a general framework for ...

Bayesian Nonparametric Kernel-Learning

Kernel methods are ubiquitous tools in machine learning. They have prove...

A Unified View of Localized Kernel Learning

Multiple Kernel Learning, or MKL, extends (kernelized) SVM by attempting...

Diverse Few-Shot Text Classification with Multiple Metrics

We study few-shot learning in natural language domains. Compared to many...

A Comparative Study of Pairwise Learning Methods based on Kernel Ridge Regression

Many machine learning problems can be formulated as predicting labels fo...

Adaptive Matching of Kernel Means

As a promising step, the performance of data analysis and feature learni...

Please sign up or login with your details

Forgot password? Click here to reset