A Nonconvex Splitting Method for Symmetric Nonnegative Matrix Factorization: Convergence Analysis and Optimality

03/24/2017
by   Songtao Lu, et al.
0

Symmetric nonnegative matrix factorization (SymNMF) has important applications in data analytics problems such as document clustering, community detection and image segmentation. In this paper, we propose a novel nonconvex variable splitting method for solving SymNMF. The proposed algorithm is guaranteed to converge to the set of Karush-Kuhn-Tucker (KKT) points of the nonconvex SymNMF problem. Furthermore, it achieves a global sublinear convergence rate. We also show that the algorithm can be efficiently implemented in parallel. Further, sufficient conditions are provided which guarantee the global and local optimality of the obtained solutions. Extensive numerical results performed on both synthetic and real data sets suggest that the proposed algorithm converges quickly to a local minimum solution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2015

Coordinate Descent Methods for Symmetric Nonnegative Matrix Factorization

Given a symmetric nonnegative matrix A, symmetric nonnegative matrix fac...
research
06/20/2017

Frank-Wolfe Optimization for Symmetric-NMF under Simplicial Constraint

We propose a Frank-Wolfe (FW) solver to optimize the symmetric nonnegati...
research
10/20/2021

A Row-Wise Update Algorithm for Sparse Stochastic Matrix Factorization

Nonnegative matrix factorization arises widely in machine learning and d...
research
12/12/2014

Expanded Alternating Optimization of Nonconvex Functions with Applications to Matrix Factorization and Penalized Regression

We propose a general technique for improving alternating optimization (A...
research
01/25/2023

A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization

The symmetric Nonnegative Matrix Factorization (NMF), a special but impo...
research
10/19/2017

Efficient Robust Matrix Factorization with Nonconvex Penalties

Robust matrix factorization (RMF) is a fundamental tool with lots of app...
research
09/17/2016

Fast and Effective Algorithms for Symmetric Nonnegative Matrix Factorization

Symmetric Nonnegative Matrix Factorization (SNMF) models arise naturally...

Please sign up or login with your details

Forgot password? Click here to reset