Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphs

by   Nurendra Choudhary, et al.
Virginia Polytechnic Institute and State University

Knowledge Graphs (KGs) are ubiquitous structures for information storagein several real-world applications such as web search, e-commerce, social networks, and biology. Querying KGs remains a foundational and challenging problem due to their size and complexity. Promising approaches to tackle this problem include embedding the KG units (e.g., entities and relations) in a Euclidean space such that the query embedding contains the information relevant to its results. These approaches, however, fail to capture the hierarchical nature and semantic information of the entities present in the graph. Additionally, most of these approaches only utilize multi-hop queries (that can be modeled by simple translation operations) to learn embeddings and ignore more complex operations such as intersection and union of simpler queries. To tackle such complex operations, in this paper, we formulate KG representation learning as a self-supervised logical query reasoning problem that utilizes translation, intersection and union queries over KGs. We propose Hyperboloid Embeddings (HypE), a novel self-supervised dynamic reasoning framework, that utilizes positive first-order existential queries on a KG to learn representations of its entities and relations as hyperboloids in a Poincaré ball. HypE models the positive first-order queries as geometrical translation, intersection, and union. For the problem of KG reasoning in real-world datasets, the proposed HypE model significantly outperforms the state-of-the art results. We also apply HypE to an anomaly detection task on a popular e-commerce website product taxonomy as well as hierarchically organized web articles and demonstrate significant performance improvements compared to existing baseline methods. Finally, we also visualize the learned HypE embeddings in a Poincaré ball to clearly interpret and comprehend the representation space.


page 1

page 2

page 3

page 4


Complex Logical Reasoning over Knowledge Graphs using Large Language Models

Reasoning over knowledge graphs (KGs) is a challenging task that require...

Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs

Logical reasoning over Knowledge Graphs (KGs) is a fundamental technique...

Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphs

Multi-hop reasoning over real-life knowledge graphs (KGs) is a highly ch...

Neural Methods for Logical Reasoning Over Knowledge Graphs

Reasoning is a fundamental problem for computers and deeply studied in A...

Reasoning over Multi-view Knowledge Graphs

Recently, knowledge representation learning (KRL) is emerging as the sta...

Cardinality Estimation over Knowledge Graphs with Embeddings and Graph Neural Networks

Cardinality Estimation over Knowledge Graphs (KG) is crucial for query o...

Rethinking Existential First Order Queries and their Inference on Knowledge Graphs

Reasoning on knowledge graphs is a challenging task because it utilizes ...

Please sign up or login with your details

Forgot password? Click here to reset