DeepAI AI Chat
Log In Sign Up

Ensemble Kernel Methods, Implicit Regularization and Determinental Point Processes

by   Joachim Schreurs, et al.
KU Leuven

By using the framework of Determinantal Point Processes (DPPs), some theoretical results concerning the interplay between diversity and regularization can be obtained. In this paper we show that sampling subsets with kDPPs results in implicit regularization in the context of ridgeless Kernel Regression. Furthermore, we leverage the common setup of state-of-the-art DPP algorithms to sample multiple small subsets and use them in an ensemble of ridgeless regressions. Our first empirical results indicate that ensemble of ridgeless regressors can be interesting to use for datasets including redundant information.


page 1

page 2

page 3

page 4


Diversity sampling is an implicit regularization for kernel methods

Kernel methods have achieved very good performance on large scale regres...

Kronecker Determinantal Point Processes

Determinantal Point Processes (DPPs) are probabilistic models over all s...

Determinantal consensus clustering

Random restart of a given algorithm produces many partitions to yield a ...

Limitation of characterizing implicit regularization by data-independent functions

In recent years, understanding the implicit regularization of neural net...

Determinantal Point Processes for Coresets

When one is faced with a dataset too large to be used all at once, an ob...

Just Interpolate: Kernel "Ridgeless" Regression Can Generalize

In the absence of explicit regularization, Kernel "Ridgeless" Regression...

Fast Estimation of Causal Interactions using Wold Processes

We here focus on the task of learning Granger causality matrices for mul...