Entity Context Graph: Learning Entity Representations fromSemi-Structured Textual Sources on the Web

by   Kalpa Gunaratna, et al.

Knowledge is captured in the form of entities and their relationships and stored in knowledge graphs. Knowledge graphs enhance the capabilities of applications in many different areas including Web search, recommendation, and natural language understanding. This is mainly because, entities enable machines to understand things that go beyond simple tokens. Many modern algorithms use learned entity embeddings from these structured representations. However, building a knowledge graph takes time and effort, hence very costly and nontrivial. On the other hand, many Web sources describe entities in some structured format and therefore, finding ways to get them into useful entity knowledge is advantageous. We propose an approach that processes entity centric textual knowledge sources to learn entity embeddings and in turn avoids the need for a traditional knowledge graph. We first extract triples into the new representation format that does not use traditional complex triple extraction methods defined by pre-determined relationship labels. Then we learn entity embeddings through this new type of triples. We show that the embeddings learned from our approach are: (i) high quality and comparable to a known knowledge graph-based embeddings and can be used to improve them further, (ii) better than a contextual language model-based entity embeddings, and (iii) easy to compute and versatile in domain-specific applications where a knowledge graph is not readily available


page 1

page 2

page 3

page 4


KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation

Pre-trained language representation models (PLMs) learn effective langua...

Convolutional Neural Knowledge Graph Learning

Previous models for learning entity and relationship embeddings of knowl...

Getting Quechua Closer to Final Users through Knowledge Graphs

Quechua language and Quechua knowledge gather millions of people around ...

ProVe: A Pipeline for Automated Provenance Verification of Knowledge Graphs against Textual Sources

Knowledge Graphs are repositories of information that gather data from a...

Graph4Code: A Machine Interpretable Knowledge Graph for Code

Knowledge graphs have proven to be extremely useful in powering diverse ...

Growing and Serving Large Open-domain Knowledge Graphs

Applications of large open-domain knowledge graphs (KGs) to real-world p...

Open-World Visual Recognition Using Knowledge Graphs

In a real-world setting, visual recognition systems can be brought to ma...

Please sign up or login with your details

Forgot password? Click here to reset