Structure-Aware Hard Negative Mining for Heterogeneous Graph Contrastive Learning

08/31/2021
by   Yanqiao Zhu, et al.
Beijing University of Posts and Telecommunications
Emory University
ia.ac.cn
5

Recently, heterogeneous Graph Neural Networks (GNNs) have become a de facto model for analyzing HGs, while most of them rely on a relative large number of labeled data. In this work, we investigate Contrastive Learning (CL), a key component in self-supervised approaches, on HGs to alleviate the label scarcity problem. We first generate multiple semantic views according to metapaths and network schemas. Then, by pushing node embeddings corresponding to different semantic views close to each other (positives) and pulling other embeddings apart (negatives), one can obtain informative representations without human annotations. However, this CL approach ignores the relative hardness of negative samples, which may lead to suboptimal performance. Considering the complex graph structure and the smoothing nature of GNNs, we propose a structure-aware hard negative mining scheme that measures hardness by structural characteristics for HGs. By synthesizing more negative nodes, we give larger weights to harder negatives with limited computational overhead to further boost the performance. Empirical studies on three real-world datasets show the effectiveness of our proposed method. The proposed method consistently outperforms existing state-of-the-art methods and notably, even surpasses several supervised counterparts.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/24/2023

Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network

Heterogeneous graph neural networks (HGNNs) as an emerging technique hav...
05/19/2021

Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning

Heterogeneous graph neural networks (HGNNs) as an emerging technique hav...
06/07/2020

Deep Graph Contrastive Representation Learning

Graph representation learning nowadays becomes fundamental in analyzing ...
05/17/2023

Investigating the Effect of Hard Negative Sample Distribution on Contrastive Knowledge Graph Embedding

The success of the knowledge graph completion task heavily depends on th...
12/16/2022

Hard Sample Aware Network for Contrastive Deep Graph Clustering

Contrastive deep graph clustering, which aims to divide nodes into disjo...
04/25/2023

Unsupervised Synthetic Image Refinement via Contrastive Learning and Consistent Semantic-Structural Constraints

Ensuring the realism of computer-generated synthetic images is crucial t...
09/23/2020

Structure Aware Negative Sampling in Knowledge Graphs

Learning low-dimensional representations for entities and relations in k...

Please sign up or login with your details

Forgot password? Click here to reset