Deep Attention-guided Graph Clustering with Dual Self-supervision

11/10/2021
by   Zhihao Peng, et al.
1

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance limitation. To this end, we propose a novel method, namely deep attention-guided graph clustering with dual self-supervision (DAGC). Specifically, DAGC first utilizes a heterogeneity-wise fusion module to adaptively integrate the features of an auto-encoder and a graph convolutional network in each layer and then uses a scale-wise fusion module to dynamically concatenate the multi-scale features in different layers. Such modules are capable of learning a discriminative feature embedding via an attention-based mechanism. In addition, we design a distribution-wise fusion module that leverages cluster assignments to acquire clustering results directly. To better explore the discriminative information from the cluster assignments, we develop a dual self-supervision solution consisting of a soft self-supervision strategy with a triplet Kullback-Leibler divergence loss and a hard self-supervision strategy with a pseudo supervision loss. Extensive experiments validate that our method consistently outperforms state-of-the-art methods on six benchmark datasets. Especially, our method improves the ARI by more than 18.14 best baseline.

READ FULL TEXT

page 1

page 2

page 3

page 8

research
08/12/2021

Attention-driven Graph Clustering Network

The combination of the traditional convolutional network (i.e., an auto-...
research
07/14/2022

Image Clustering with Contrastive Learning and Multi-scale Graph Convolutional Networks

Deep clustering has recently attracted significant attention. Despite th...
research
12/15/2020

Deep Fusion Clustering Network

Deep clustering is a fundamental yet challenging task for data analysis....
research
09/28/2021

Adaptive Attribute and Structure Subspace Clustering Network

Deep self-expressiveness-based subspace clustering methods have demonstr...
research
11/19/2022

Graph Augmentation Clustering Network

Existing graph clustering networks heavily rely on a predefined graph an...
research
04/21/2023

Deep Multiview Clustering by Contrasting Cluster Assignments

Multiview clustering (MVC) aims to reveal the underlying structure of mu...
research
07/19/2021

Rethinking Graph Autoencoder Models for Attributed Graph Clustering

Most recent graph clustering methods have resorted to Graph Auto-Encoder...

Please sign up or login with your details

Forgot password? Click here to reset