A Manifold Proximal Linear Method for Sparse Spectral Clustering with Application to Single-Cell RNA Sequencing Data Analysis

07/18/2020
by   Zhongruo Wang, et al.
11

Spectral clustering is one of the fundamental unsupervised learning methods widely used in data analysis. Sparse spectral clustering (SSC) imposes sparsity to the spectral clustering and it improves the interpretability of the model. This paper considers a widely adopted model for SSC, which can be formulated as an optimization problem over the Stiefel manifold with nonsmooth and nonconvex objective. Such an optimization problem is very challenging to solve. Existing methods usually solve its convex relaxation or need to smooth its nonsmooth part using certain smoothing techniques. In this paper, we propose a manifold proximal linear method (ManPL) that solves the original SSC formulation. We also extend the algorithm to solve the multiple-kernel SSC problems, for which an alternating ManPL algorithm is proposed. Convergence and iteration complexity results of the proposed methods are established. We demonstrate the advantage of our proposed methods over existing methods via the single-cell RNA sequencing data analysis.

READ FULL TEXT

page 9

page 11

research
12/08/2017

Nonconvex Sparse Spectral Clustering by Alternating Direction Method of Multipliers and Its Convergence Analysis

Spectral Clustering (SC) is a widely used data clustering method which f...
research
04/25/2023

A New Inexact Proximal Linear Algorithm with Adaptive Stopping Criteria for Robust Phase Retrieval

This paper considers the robust phase retrieval problem, which can be ca...
research
03/04/2014

The Hidden Convexity of Spectral Clustering

In recent years, spectral clustering has become a standard method for da...
research
09/30/2014

Backhaul-Constrained Multi-Cell Cooperation Leveraging Sparsity and Spectral Clustering

Multi-cell cooperative processing with limited backhaul traffic is studi...
research
12/03/2010

An Inverse Power Method for Nonlinear Eigenproblems with Applications in 1-Spectral Clustering and Sparse PCA

Many problems in machine learning and statistics can be formulated as (g...
research
11/18/2021

The self-consistent field iteration for p-spectral clustering

The self-consistent field (SCF) iteration, combined with its variants, i...
research
05/16/2023

Spectral Clustering via Orthogonalization-Free Methods

Graph Signal Filter used as dimensionality reduction in spectral cluster...

Please sign up or login with your details

Forgot password? Click here to reset