Solving Support Vector Machines in Reproducing Kernel Banach Spaces with Positive Definite Functions

by   Gregory E. Fasshauer, et al.
Illinois Institute of Technology
Syracuse University

In this paper we solve support vector machines in reproducing kernel Banach spaces with reproducing kernels defined on nonsymmetric domains instead of the traditional methods in reproducing kernel Hilbert spaces. Using the orthogonality of semi-inner-products, we can obtain the explicit representations of the dual (normalized-duality-mapping) elements of support vector machine solutions. In addition, we can introduce the reproduction property in a generalized native space by Fourier transform techniques such that it becomes a reproducing kernel Banach space, which can be even embedded into Sobolev spaces, and its reproducing kernel is set up by the related positive definite function. The representations of the optimal solutions of support vector machines (regularized empirical risks) in these reproducing kernel Banach spaces are formulated explicitly in terms of positive definite functions, and their finite numbers of coefficients can be computed by fixed point iteration. We also give some typical examples of reproducing kernel Banach spaces induced by Matérn functions (Sobolev splines) so that their support vector machine solutions are well computable as the classical algorithms. Moreover, each of their reproducing bases includes information from multiple training data points. The concept of reproducing kernel Banach spaces offers us a new numerical tool for solving support vector machines.


page 1

page 2

page 3

page 4


Asymptotic Normality of Support Vector Machine Variants and Other Regularized Kernel Methods

In nonparametric classification and regression problems, regularized ker...

Localisation of Regularised and Multiview Support Vector Machine Learning

We prove a few representer theorems for a localised version of the regul...

Splitting Method for Support Vector Machine with Lower Semi-continuous Loss

In this paper, we study the splitting method based on alternating direct...

Lecture notes: Efficient approximation of kernel functions

These lecture notes endeavour to collect in one place the mathematical b...

Complex Support Vector Machines for Regression and Quaternary Classification

The paper presents a new framework for complex Support Vector Regression...

An Empirical Approach For Probing the Definiteness of Kernels

Models like support vector machines or Gaussian process regression often...

Please sign up or login with your details

Forgot password? Click here to reset