Recursive Multikernel Filters Exploiting Nonlinear Temporal Structure

by   Steven Van Vaerenbergh, et al.
Universidad de Cantabria
Sapienza University of Rome

In kernel methods, temporal information on the data is commonly included by using time-delayed embeddings as inputs. Recently, an alternative formulation was proposed by defining a gamma-filter explicitly in a reproducing kernel Hilbert space, giving rise to a complex model where multiple kernels operate on different temporal combinations of the input signal. In the original formulation, the kernels are then simply combined to obtain a single kernel matrix (for instance by averaging), which provides computational benefits but discards important information on the temporal structure of the signal. Inspired by works on multiple kernel learning, we overcome this drawback by considering the different kernels separately. We propose an efficient strategy to adaptively combine and select these kernels during the training phase. The resulting batch and online algorithms automatically learn to process highly nonlinear temporal information extracted from the input signal, which is implicitly encoded in the kernel values. We evaluate our proposal on several artificial and real tasks, showing that it can outperform classical approaches both in batch and online settings.


page 1

page 2

page 3

page 4


An Online Multiple Kernel Parallelizable Learning Scheme

The performance of reproducing kernel Hilbert space-based methods is kno...

Learning Kernels for Structured Prediction using Polynomial Kernel Transformations

Learning the kernel functions used in kernel methods has been a vastly e...

A kernel function for Signal Temporal Logic formulae

We discuss how to define a kernel for Signal Temporal Logic (STL) formul...

Symmetric and antisymmetric kernels for machine learning problems in quantum physics and chemistry

We derive symmetric and antisymmetric kernels by symmetrizing and antisy...

Learning Multiple Levels of Representations with Kernel Machines

We propose a connectionist-inspired kernel machine model with three key ...

A Unified SVM Framework for Signal Estimation

This paper presents a unified framework to tackle estimation problems in...

Arbitrary-sized Image Training and Residual Kernel Learning: Towards Image Fraud Identification

Preserving original noise residuals in images are critical to image frau...

Please sign up or login with your details

Forgot password? Click here to reset