Standing on the Shoulders of Predecessors: Meta-Knowledge Transfer for Knowledge Graphs

by   Mingyang Chen, et al.

Knowledge graphs (KGs) have become widespread, and various knowledge graphs are constructed incessantly to support many in-KG and out-of-KG applications. During the construction of KGs, although new KGs may contain new entities with respect to constructed KGs, some entity-independent knowledge can be transferred from constructed KGs to new KGs. We call such knowledge meta-knowledge, and refer to the problem of transferring meta-knowledge from constructed (source) KGs to new (target) KGs to improve the performance of tasks on target KGs as meta-knowledge transfer for knowledge graphs. However, there is no available general framework that can tackle meta-knowledge transfer for both in-KG and out-of-KG tasks uniformly. Therefore, in this paper, we propose a framework, MorsE, which means conducting Meta-Learning for Meta-Knowledge Transfer via Knowledge Graph Embedding. MorsE represents the meta-knowledge via Knowledge Graph Embedding and learns the meta-knowledge by Meta-Learning. Specifically, MorsE uses an entity initializer and a Graph Neural Network (GNN) modulator to entity-independently obtain entity embeddings given a KG and is trained following the meta-learning setting to gain the ability of effectively obtaining embeddings. Experimental results on meta-knowledge transfer for both in-KG and out-of-KG tasks show that MorsE is able to learn and transfer meta-knowledge between KGs effectively, and outperforms existing state-of-the-art models.


page 1

page 2

page 3

page 4


Meta-Learning Based Knowledge Extrapolation for Temporal Knowledge Graph

In the last few years, the solution to Knowledge Graph (KG) completion v...

An Adversarial Transfer Network for Knowledge Representation Learning

Knowledge representation learning has received a lot of attention in the...

Self-Distillation with Meta Learning for Knowledge Graph Completion

In this paper, we propose a selfdistillation framework with meta learnin...

Meta-Learning Based Knowledge Extrapolation for Knowledge Graphs in the Federated Setting

We study the knowledge extrapolation problem to embed new components (i....

A Simple Approach to Case-Based Reasoning in Knowledge Bases

We present a surprisingly simple yet accurate approach to reasoning in k...

Meta-Graph Based HIN Spectral Embedding: Methods, Analyses, and Insights

In this work, we propose to study the utility of different meta-graphs, ...

Knowledge Graph Embedding Methods for Entity Alignment: An Experimental Review

In recent years, we have witnessed the proliferation of knowledge graphs...

Please sign up or login with your details

Forgot password? Click here to reset