Learning Discriminative Stein Kernel for SPD Matrices and Its Applications

07/08/2014
by   Jianjia Zhang, et al.
0

Stein kernel has recently shown promising performance on classifying images represented by symmetric positive definite (SPD) matrices. It evaluates the similarity between two SPD matrices through their eigenvalues. In this paper, we argue that directly using the original eigenvalues may be problematic because: i) Eigenvalue estimation becomes biased when the number of samples is inadequate, which may lead to unreliable kernel evaluation; ii) More importantly, eigenvalues only reflect the property of an individual SPD matrix. They are not necessarily optimal for computing Stein kernel when the goal is to discriminate different sets of SPD matrices. To address the two issues in one shot, we propose a discriminative Stein kernel, in which an extra parameter vector is defined to adjust the eigenvalues of the input SPD matrices. The optimal parameter values are sought by optimizing a proxy of classification performance. To show the generality of the proposed method, three different kernel learning criteria that are commonly used in the literature are employed respectively as a proxy. A comprehensive experimental study is conducted on a variety of image classification tasks to compare our proposed discriminative Stein kernel with the original Stein kernel and other commonly used methods for evaluating the similarity between SPD matrices. The experimental results demonstrate that, the discriminative Stein kernel can attain greater discrimination and better align with classification tasks by altering the eigenvalues. This makes it produce higher classification performance than the original Stein kernel and other commonly used methods.

READ FULL TEXT

page 17

page 19

research
04/11/2023

An Adaptive Factorized Nyström Preconditioner for Regularized Kernel Matrices

The spectrum of a kernel matrix significantly depends on the parameter v...
research
06/16/2018

Component SPD Matrices: A lower-dimensional discriminative data descriptor for image set classification

In the domain of pattern recognition, using the SPD (Symmetric Positive ...
research
02/14/2012

New Probabilistic Bounds on Eigenvalues and Eigenvectors of Random Kernel Matrices

Kernel methods are successful approaches for different machine learning ...
research
01/27/2016

Neighborhood Preserved Sparse Representation for Robust Classification on Symmetric Positive Definite Matrices

Due to its promising classification performance, sparse representation b...
research
02/10/2016

Optimized Kernel-based Projection Space of Riemannian Manifolds

It is proven that encoding images and videos through Symmetric Positive ...
research
08/03/2022

A new deflation criterion for the QZ algorithm

The QZ algorithm computes the Schur form of a matrix pencil. It is an it...
research
12/16/2011

Insights from Classifying Visual Concepts with Multiple Kernel Learning

Combining information from various image features has become a standard ...

Please sign up or login with your details

Forgot password? Click here to reset