Hierarchical Subspace Learning for Dimensionality Reduction to Improve Classification Accuracy in Large Data Sets

Manifold learning is used for dimensionality reduction, with the goal of finding a projection subspace to increase and decrease the inter- and intraclass variances, respectively. However, a bottleneck for subspace learning methods often arises from the high dimensionality of datasets. In this paper, a hierarchical approach is proposed to scale subspace learning methods, with the goal of improving classification in large datasets by a range of 3 Different combinations of methods are studied. We assess the proposed method on five publicly available large datasets, for different eigen-value based subspace learning methods such as linear discriminant analysis, principal component analysis, generalized discriminant analysis, and reconstruction independent component analysis. To further examine the effect of the proposed method on various classification methods, we fed the generated result to linear discriminant analysis, quadratic linear analysis, k-nearest neighbor, and random forest classifiers. The resulting classification accuracies are compared to show the effectiveness of the hierarchical approach, reporting results of an average of 5


page 1

page 2

page 3

page 4


Comparison among dimensionality reduction techniques based on Random Projection for cancer classification

Random Projection (RP) technique has been widely applied in many scenari...

Class Mean Vector Component and Discriminant Analysis for Kernel Subspace Learning

The kernel matrix used in kernel methods encodes all the information req...

Linear Tensor Projection Revealing Nonlinearity

Dimensionality reduction is an effective method for learning high-dimens...

Common Mode Patterns for Supervised Tensor Subspace Learning

In this work we propose a method for reducing the dimensionality of tens...

Mycorrhiza: genotype assignment using phylogenetic networks

Motivation The genotype assignment problem consists of predicting, from ...

SqueezeFit: Label-aware dimensionality reduction by semidefinite programming

Given labeled points in a high-dimensional vector space, we seek a low-d...

Null Space Analysis for Class-Specific Discriminant Learning

In this paper, we carry out null space analysis for Class-Specific Discr...

Please sign up or login with your details

Forgot password? Click here to reset