Motif Learning in Knowledge Graphs Using Trajectories Of Differential Equations

by   Mojtaba Nayyeri, et al.

Knowledge Graph Embeddings (KGEs) have shown promising performance on link prediction tasks by mapping the entities and relations from a knowledge graph into a geometric space (usually a vector space). Ultimately, the plausibility of the predicted links is measured by using a scoring function over the learned embeddings (vectors). Therefore, the capability in preserving graph characteristics including structural aspects and semantics highly depends on the design of the KGE, as well as the inherited abilities from the underlying geometry. Many KGEs use the flat geometry which renders them incapable of preserving complex structures and consequently causes wrong inferences by the models. To address this problem, we propose a neuro differential KGE that embeds nodes of a KG on the trajectories of Ordinary Differential Equations (ODEs). To this end, we represent each relation (edge) in a KG as a vector field on a smooth Riemannian manifold. We specifically parameterize ODEs by a neural network to represent various complex shape manifolds and more importantly complex shape vector fields on the manifold. Therefore, the underlying embedding space is capable of getting various geometric forms to encode complexity in subgraph structures with different motifs. Experiments on synthetic and benchmark dataset as well as social network KGs justify the ODE trajectories as a means to structure preservation and consequently avoiding wrong inferences over state-of-the-art KGE models.


page 1

page 2

page 3

page 4


5* Knowledge Graph Embeddings with Projective Transformations

Performing link prediction using knowledge graph embedding (KGE) models ...

TorusE: Knowledge Graph Embedding on a Lie Group

Knowledge graphs are useful for many artificial intelligence (AI) tasks....

Geometry Interaction Knowledge Graph Embeddings

Knowledge graph (KG) embeddings have shown great power in learning repre...

ModulE: Module Embedding for Knowledge Graphs

Knowledge graph embedding (KGE) has been shown to be a powerful tool for...

PairRE: Knowledge Graph Embeddings via Paired Relation Vectors

Distance based knowledge graph embedding methods show promising results ...

EL Embeddings: Geometric construction of models for the Description Logic EL ++

An embedding is a function that maps entities from one algebraic structu...

On Qualitative Shape Inferences: a journey from geometry to topology

Shape inference is classically ill-posed, because it involves a map from...

Please sign up or login with your details

Forgot password? Click here to reset