Learning Kernels for Structured Prediction using Polynomial Kernel Transformations

by   Chetan Tonde, et al.
Rutgers University

Learning the kernel functions used in kernel methods has been a vastly explored area in machine learning. It is now widely accepted that to obtain 'good' performance, learning a kernel function is the key challenge. In this work we focus on learning kernel representations for structured regression. We propose use of polynomials expansion of kernels, referred to as Schoenberg transforms and Gegenbaur transforms, which arise from the seminal result of Schoenberg (1938). These kernels can be thought of as polynomial combination of input features in a high dimensional reproducing kernel Hilbert space (RKHS). We learn kernels over input and output for structured data, such that, dependency between kernel features is maximized. We use Hilbert-Schmidt Independence Criterion (HSIC) to measure this. We also give an efficient, matrix decomposition-based algorithm to learn these kernel transformations, and demonstrate state-of-the-art results on several real-world datasets.


page 10

page 11


Symmetric and antisymmetric kernels for machine learning problems in quantum physics and chemistry

We derive symmetric and antisymmetric kernels by symmetrizing and antisy...

Post Selection Inference with Kernels

We propose a novel kernel based post selection inference (PSI) algorithm...

Generalization Properties of hyper-RKHS and its Application to Out-of-Sample Extensions

Hyper-kernels endowed by hyper-Reproducing Kernel Hilbert Space (hyper-R...

Learning Inconsistent Preferences with Kernel Methods

We propose a probabilistic kernel approach for preferential learning fro...

Recursive Multikernel Filters Exploiting Nonlinear Temporal Structure

In kernel methods, temporal information on the data is commonly included...

A Framework and Benchmark for Deep Batch Active Learning for Regression

We study the performance of different pool-based Batch Mode Deep Active ...

The Matrix Hilbert Space and Its Application to Matrix Learning

Theoretical studies have proven that the Hilbert space has remarkable pe...

Please sign up or login with your details

Forgot password? Click here to reset