Efficient Probabilistic Logic Reasoning with Graph Neural Networks

by   Yuyu Zhang, et al.
Ant Financial
Siemens AG
University of Illinois at Urbana-Champaign
Georgia Institute of Technology

Markov Logic Networks (MLNs), which elegantly combine logic rules and probabilistic graphical models, can be used to address many knowledge graph problems. However, inference in MLN is computationally intensive, making the industrial-scale application of MLN very difficult. In recent years, graph neural networks (GNNs) have emerged as efficient and effective tools for large-scale graph problems. Nevertheless, GNNs do not explicitly incorporate prior logic rules into the models, and may require many labeled examples for a target task. In this paper, we explore the combination of MLNs and GNNs, and use graph neural networks for variational inference in MLN. We propose a GNN variant, named ExpressGNN, which strikes a nice balance between the representation power and the simplicity of the model. Our extensive experiments on several benchmark datasets demonstrate that ExpressGNN leads to effective and efficient probabilistic logic reasoning.


page 1

page 2

page 3

page 4


Can Graph Neural Networks Help Logic Reasoning?

Effectively combining logic reasoning and probabilistic inference has be...

Understanding and Improving Deep Graph Neural Networks: A Probabilistic Graphical Model Perspective

Recently, graph-based models designed for downstream tasks have signific...

Logical Expressiveness of Graph Neural Network for Knowledge Graph Reasoning

Graph Neural Networks (GNNs) have been recently introduced to learn from...

CARE: Certifiably Robust Learning with Reasoning via Variational Inference

Despite great recent advances achieved by deep neural networks (DNNs), t...

Stochastic Aggregation in Graph Neural Networks

Graph neural networks (GNNs) manifest pathologies including over-smoothi...

Towards an Efficient and General Framework of Robust Training for Graph Neural Networks

Graph Neural Networks (GNNs) have made significant advances on several f...

Gamora: Graph Learning based Symbolic Reasoning for Large-Scale Boolean Networks

Reasoning high-level abstractions from bit-blasted Boolean networks (BNs...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset