Text Mining using Nonnegative Matrix Factorization and Latent Semantic Analysis

by   Ali Hassani, et al.

Text clustering is arguably one of the most important topics in modern data mining. Nevertheless, text data require tokenization which usually yields a very large and highly sparse term-document matrix, which is usually difficult to process using conventional machine learning algorithms. Methods such as Latent Semantic Analysis have helped mitigate this issue, but are nevertheless not completely stable in practice. As a result, we propose a new feature agglomeration method based on Nonnegative Matrix Factorization. NMF is employed to separate the terms into groups, and then each group`s term vectors are agglomerated into a new feature vector. Together, these feature vectors create a new feature space much more suitable for clustering. In addition, we propose a new deterministic initialization for spherical K-Means, which proves very useful for this specific type of data. In order to evaluate the proposed method, we compare it to some of the latest research done in this field, as well as some of the most practiced methods. In our experiments, we conclude that the proposed method either significantly improves clustering performance, or maintains the performance of other methods, while improving stability in results.


page 8

page 9

page 12

page 13

page 14

page 16

page 17


Algorithms, Initializations, and Convergence for the Nonnegative Matrix Factorization

It is well known that good initializations can improve the speed and acc...

Hybrid Clustering based on Content and Connection Structure using Joint Nonnegative Matrix Factorization

We present a hybrid method for latent information discovery on the data ...

Regularized Orthogonal Nonnegative Matrix Factorization and K-means Clustering

In this work, we focus on connections between K-means clustering approac...

Mimicking Human Process: Text Representation via Latent Semantic Clustering for Classification

Considering that words with different characteristic in the text have di...

Investigation of Topic Modelling Methods for Understanding the Reports of the Mining Projects in Queensland

In the mining industry, many reports are generated in the project manage...

Comparing of Term Clustering Frameworks for Modular Ontology Learning

This paper aims to use term clustering to build a modular ontology accor...

Machine Learning Treasury Yields

We give explicit algorithms and source code for extracting factors under...

Please sign up or login with your details

Forgot password? Click here to reset