Generalized Neural Graph Embedding with Matrix Factorization

by   Junliang Guo, et al.

Recent advances in language modeling such as word2vec motivate a number of graph embedding approaches by treating random walk sequences as sentences to encode structural proximity in a graph. However, most of the existing principles of neural graph embedding do not incorporate auxiliary information such as node content flexibly. In this paper we take a matrix factorization perspective of graph embedding which generalizes to structural embedding as well as content embedding in a natural way. For structure embedding, we validate that the matrix we construct and factorize preserves the high-order proximities of the graph. Label information can be further integrated into the matrix via the process of random walk sampling to enhance the quality of embedding. In addition, we generalize the Skip-Gram Negative Sampling model to integrate the content of the graph in a matrix factorization framework. As a consequence, graph embedding can be learned in a unified framework integrating graph structure and node content as well as label information simultaneously. We demonstrate the efficacy of the proposed model with the tasks of semi-supervised node classification and link prediction on a variety of real-world benchmark network datasets.


page 1

page 2

page 3

page 4


Kernel Node Embeddings

Learning representations of nodes in a low dimensional space is a crucia...

Graph embeddings via matrix factorization for link prediction: smoothing or truncating negatives?

Link prediction – the process of uncovering missing links in a complex n...

Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec

Since the invention of word2vec, the skip-gram model has significantly a...

Free Energy Node Embedding via Generalized Skip-gram with Negative Sampling

A widely established set of unsupervised node embedding methods can be i...

Scalable Graph Embeddings via Sparse Transpose Proximities

Graph embedding learns low-dimensional representations for nodes in a gr...

DGEM: A New Dual-modal Graph Embedding Method in Recommendation System

In the current deep learning based recommendation system, the embedding ...

On Spectral Graph Embedding: A Non-Backtracking Perspective and Graph Approximation

Graph embedding has been proven to be efficient and effective in facilit...

Please sign up or login with your details

Forgot password? Click here to reset