Cyclic Label Propagation for Graph Semi-supervised Learning

11/24/2020
by   Zhao Li, et al.
0

Graph neural networks (GNNs) have emerged as effective approaches for graph analysis, especially in the scenario of semi-supervised learning. Despite its success, GNN often suffers from over-smoothing and over-fitting problems, which affects its performance on node classification tasks. We analyze that an alternative method, the label propagation algorithm (LPA), avoids the aforementioned problems thus it is a promising choice for graph semi-supervised learning. Nevertheless, the intrinsic limitations of LPA on feature exploitation and relation modeling make propagating labels become less effective. To overcome these limitations, we introduce a novel framework for graph semi-supervised learning termed as Cyclic Label Propagation (CycProp for abbreviation), which integrates GNNs into the process of label propagation in a cyclic and mutually reinforcing manner to exploit the advantages of both GNNs and LPA. In particular, our proposed CycProp updates the node embeddings learned by GNN module with the augmented information by label propagation, while fine-tunes the weighted graph of label propagation with the help of node embedding in turn. After the model converges, reliably predicted labels and informative node embeddings are obtained with the LPA and GNN modules respectively. Extensive experiments on various real-world datasets are conducted, and the experimental results empirically demonstrate that the proposed CycProp model can achieve relatively significant gains over the state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/27/2020

Label-Consistency based Graph Neural Networks for Semi-supervised Node Classification

Graph neural networks (GNNs) achieve remarkable success in graph-based s...
research
03/23/2022

Semi-Supervised Graph Learning Meets Dimensionality Reduction

Semi-supervised learning (SSL) has recently received increased attention...
research
11/28/2022

Flip Initial Features: Generalization of Neural Networks for Semi-supervised Node Classification

Graph neural networks (GNNs) have been widely used under semi-supervised...
research
04/19/2021

Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced training

It is hard to directly implement Graph Neural Networks (GNNs) on large s...
research
10/13/2021

SSSNET: Semi-Supervised Signed Network Clustering

Node embeddings are a powerful tool in the analysis of networks; yet, th...
research
06/14/2021

PI-GNN: A Novel Perspective on Semi-Supervised Node Classification against Noisy Labels

Semi-supervised node classification, as a fundamental problem in graph l...
research
10/27/2020

Combining Label Propagation and Simple Models Out-performs Graph Neural Networks

Graph Neural Networks (GNNs) are the predominant technique for learning ...

Please sign up or login with your details

Forgot password? Click here to reset