Penalized Non-Linear Principal Components Analysis for Ordinal Variables with an Application to International Classification of Functioning Core Sets

10/06/2021
by   Aisouda Hoshiyar, et al.
0

Ordinal data occur frequently in the social sciences. When applying principal components analysis (PCA), however, those data are often treated as numeric implying linear relationships between the variables at hand, or non-linear PCA is applied where the obtained quantifications are sometimes hard to interpret. Non-linear PCA for categorical data, also called optimal scoring/scaling, constructs new variables by assigning numerical values to categories such that the proportion of variance in those new variables that is explained by a predefined number of principal components is maximized. We propose a penalized version of non-linear PCA for ordinal variables that is an intermediate between standard PCAon category labels and non-linear PCA as used so far. The new approach is by no means limited to monotonic effects, and offers both better interpretability of the non-linear transformation of the category labels as well as better performance on validation data than unpenalized non-linear PCA and/or standard linear PCA. In particular, an application of penalized non-linear PCA to ordinal data as given with the International Classification of Functioning, Disability and Health (ICF) is provided.

READ FULL TEXT
research
07/28/2019

Approximating the Span of Principal Components via Iterative Least-Squares

In the course of the last century, Principal Component Analysis (PCA) ha...
research
10/05/2022

A novel non-linear transformation based multi-user identification algorithm for fixed text keystroke behavioral dynamics

In this paper, we propose a new technique to uniquely classify and ident...
research
08/17/2020

Principal Ellipsoid Analysis (PEA): Efficient non-linear dimension reduction clustering

Even with the rise in popularity of over-parameterized models, simple di...
research
11/29/2021

PCA-based Category Encoder for Categorical to Numerical Variable Conversion

Increasing the cardinality of categorical variables might decrease the o...
research
10/23/2020

Ordinal analysis of partial combinatory algebras

For every partial combinatory algebra (pca), we define a hierarchy of ex...
research
05/12/2021

Convergence Analysis of Over-parameterized Deep Linear Networks, and the Principal Components Bias

Convolutional Neural networks of different architectures seem to learn t...
research
09/05/2017

Linear Optimal Low Rank Projection for High-Dimensional Multi-Class Data

Classification of individual samples into one or more categories is crit...

Please sign up or login with your details

Forgot password? Click here to reset