Scalable Bottom-Up Hierarchical Clustering

by   Nicholas Monath, et al.

Bottom-up algorithms such as the classic hierarchical agglomerative clustering, are highly effective for hierarchical as well as flat clustering. However, the large number of rounds and their sequential nature limit the scalability of agglomerative clustering. In this paper, we present an alternative round-based bottom-up hierarchical clustering, the Sub-Cluster Component Algorithm (SCC), that scales gracefully to massive datasets. Our method builds many sub-clusters in parallel in a given round and requires many fewer rounds – usually an order of magnitude smaller than classic agglomerative clustering. Our theoretical analysis shows that, under a modest separability assumption, SCC will contain the optimal flat clustering. SCC also provides a 2-approx solution to the DP-means objective, thereby introducing a novel application of hierarchical clustering methods. Empirically, SCC finds better hierarchies and flat clusterings even when the data does not satisfy the separability assumption. We demonstrate the scalability of our method by applying it to a dataset of 30 billion points and showing that SCC produces higher quality clusterings than the state-of-the-art.


An Online Hierarchical Algorithm for Extreme Clustering

Many modern clustering methods scale well to a large number of data item...

Hierarchical Maximum-Margin Clustering

We present a hierarchical maximum-margin clustering method for unsupervi...

Contrastive Hierarchical Clustering

Deep clustering has been dominated by flat models, which split a dataset...

Stable and consistent density-based clustering

We present a consistent approach to density-based clustering, which sati...

Clustering with Fast, Automated and Reproducible assessment applied to longitudinal neural tracking

Across many areas, from neural tracking to database entity resolution, m...

Bayesian Hierarchical Clustering with Exponential Family: Small-Variance Asymptotics and Reducibility

Bayesian hierarchical clustering (BHC) is an agglomerative clustering me...

Please sign up or login with your details

Forgot password? Click here to reset