DeepAI AI Chat
Log In Sign Up

A Unified SVM Framework for Signal Estimation

by   José Luis Rojo-Álvarez, et al.
Universidad Rey Juan Carlos
University of New Mexico

This paper presents a unified framework to tackle estimation problems in Digital Signal Processing (DSP) using Support Vector Machines (SVMs). The use of SVMs in estimation problems has been traditionally limited to its mere use as a black-box model. Noting such limitations in the literature, we take advantage of several properties of Mercer's kernels and functional analysis to develop a family of SVM methods for estimation in DSP. Three types of signal model equations are analyzed. First, when a specific time-signal structure is assumed to model the underlying system that generated the data, the linear signal model (so called Primal Signal Model formulation) is first stated and analyzed. Then, non-linear versions of the signal structure can be readily developed by following two different approaches. On the one hand, the signal model equation is written in reproducing kernel Hilbert spaces (RKHS) using the well-known RKHS Signal Model formulation, and Mercer's kernels are readily used in SVM non-linear algorithms. On the other hand, in the alternative and not so common Dual Signal Model formulation, a signal expansion is made by using an auxiliary signal model equation given by a non-linear regression of each time instant in the observed time series. These building blocks can be used to generate different novel SVM-based methods for problems of signal estimation, and we deal with several of the most important ones in DSP. We illustrate the usefulness of this methodology by defining SVM algorithms for linear and non-linear system identification, spectral analysis, nonuniform interpolation, sparse deconvolution, and array processing. The performance of the developed SVM methods is compared to standard approaches in all these settings. The experimental results illustrate the generality, simplicity, and capabilities of the proposed SVM framework for DSP.


page 1

page 2

page 3

page 4


A Unified Framework for Multiclass and Multilabel Support Vector Machines

We propose a novel integrated formulation for multiclass and multilabel ...

Wavelet Time Shift Properties Integration with Support Vector Machines

This paper presents a short evaluation about the integration of informat...

Complex Support Vector Machines for Regression and Quaternary Classification

The paper presents a new framework for complex Support Vector Regression...

Enhancing Pattern Classification in Support Vector Machines through Matrix Formulation

Support Vector Machines (SVM) have gathered significant acclaim as class...

Theory of Connections Applied to Support Vector Machines to Solve Differential Equations

Differential equations are used as numerical models to describe physical...

TrIK-SVM : an alternative decomposition for kernel methods in Krein spaces

The proposed work aims at proposing a alternative kernel decomposition i...

Recursive Multikernel Filters Exploiting Nonlinear Temporal Structure

In kernel methods, temporal information on the data is commonly included...