Edge: Enriching Knowledge Graph Embeddings with External Text

04/11/2021
by   Saed Rezayi, et al.
0

Knowledge graphs suffer from sparsity which degrades the quality of representations generated by various methods. While there is an abundance of textual information throughout the web and many existing knowledge bases, aligning information across these diverse data sources remains a challenge in the literature. Previous work has partially addressed this issue by enriching knowledge graph entities based on "hard" co-occurrence of words present in the entities of the knowledge graphs and external text, while we achieve "soft" augmentation by proposing a knowledge graph enrichment and embedding framework named Edge. Given an original knowledge graph, we first generate a rich but noisy augmented graph using external texts in semantic and structural level. To distill the relevant knowledge and suppress the introduced noise, we design a graph alignment term in a shared embedding space between the original graph and augmented graph. To enhance the embedding learning on the augmented graph, we further regularize the locality relationship of target entity based on negative sampling. Experimental results on four benchmark datasets demonstrate the robustness and effectiveness of Edge in link prediction and node classification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2021

Membership Inference Attacks on Knowledge Graphs

Knowledge graphs have become increasingly popular supplemental informati...
research
07/28/2023

Select and Augment: Enhanced Dense Retrieval Knowledge Graph Augmentation

Injecting textual information into knowledge graph (KG) entity represent...
research
10/26/2020

A Survey of Embedding Space Alignment Methods for Language and Knowledge Graphs

Neural embedding approaches have become a staple in the fields of comput...
research
08/04/2022

Image-based Contextual Pill Recognition with Medical Knowledge Graph Assistance

Identifying pills given their captured images under various conditions a...
research
08/18/2023

Semantic relatedness in DBpedia: A comparative and experimental assessment

Evaluating semantic relatedness of Web resources is still an open challe...
research
11/01/2018

MOHONE: Modeling Higher Order Network Effects in KnowledgeGraphs via Network Infused Embeddings

Many knowledge graph embedding methods operate on triples and are theref...
research
08/04/2022

Integrating Knowledge Graph embedding and pretrained Language Models in Hypercomplex Spaces

Knowledge Graphs, such as Wikidata, comprise structural and textual know...

Please sign up or login with your details

Forgot password? Click here to reset