Compactness Score: A Fast Filter Method for Unsupervised Feature Selection

01/31/2022
by   Peican Zhu, et al.
0

For feature engineering, feature selection seems to be an important research content in which is anticipated to select "excellent" features from candidate ones. Different functions can be realized through feature selection, such as dimensionality reduction, model effect improvement, and model performance improvement. Along with the flourish of the information age, huge amounts of high-dimensional data are generated day by day, while we need to spare great efforts and time to label such data. Therefore, various algorithms are proposed to address such data, among which unsupervised feature selection has attracted tremendous interests. In many classification tasks, researchers found that data seem to be usually close to each other if they are from the same class; thus, local compactness is of great importance for the evaluation of a feature. In this manuscript, we propose a fast unsupervised feature selection method, named as, Compactness Score (CSUFS), to select desired features. To demonstrate the efficiency and accuracy, several data sets are chosen with intensive experiments being performed. Later, the effectiveness and superiority of our method are revealed through addressing clustering tasks. Here, the performance is indicated by several well-known evaluation metrics, while the efficiency is reflected by the corresponding running time. As revealed by the simulation results, our proposed algorithm seems to be more accurate and efficient compared with existing algorithms.

READ FULL TEXT
research
08/25/2018

Unsupervised Hypergraph Feature Selection via a Novel Point-Weighting Framework and Low-Rank Representation

Feature selection methods are widely used in order to solve the 'curse o...
research
12/11/2020

Feature Selection Based on Sparse Neural Network Layer with Normalizing Constraints

Feature selection is important step in machine learning since it has sho...
research
05/31/2023

Distance Rank Score: Unsupervised filter method for feature selection on imbalanced dataset

This paper presents a new filter method for unsupervised feature selecti...
research
10/19/2020

A Uniformly Stable Algorithm For Unsupervised Feature Selection

High-dimensional data presents challenges for data management. Feature s...
research
09/18/2023

Noise-Augmented Boruta: The Neural Network Perturbation Infusion with Boruta Feature Selection

With the surge in data generation, both vertically (i.e., volume of data...
research
05/29/2020

Unsupervised Feature Selection via Multi-step Markov Transition Probability

Feature selection is a widely used dimension reduction technique to sele...
research
04/27/2019

Incremental personalized E-mail spam filter using novel TFDCR feature selection with dynamic feature update

Communication through e-mails remains to be highly formalized, conventio...

Please sign up or login with your details

Forgot password? Click here to reset