How Can Graph Neural Networks Help Document Retrieval: A Case Study on CORD19 with Concept Map Generation

01/12/2022
by   Hejie Cui, et al.
Emory University
16

Graph neural networks (GNNs), as a group of powerful tools for representation learning on irregular data, have manifested superiority in various downstream tasks. With unstructured texts represented as concept maps, GNNs can be exploited for tasks like document retrieval. Intrigued by how can GNNs help document retrieval, we conduct an empirical study on a large-scale multi-discipline dataset CORD-19. Results show that instead of the complex structure-oriented GNNs such as GINs and GATs, our proposed semantics-oriented graph functions achieve better and more stable performance based on the BM25 retrieved candidates. Our insights in this case study can serve as a guideline for future work to develop effective GNNs with appropriate semantics-oriented inductive biases for textual reasoning tasks like document retrieval and classification. All code for this case study is available at https://github.com/HennyJie/GNN-DocRetrieval.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/20/2021

Large-scale graph representation learning with very deep GNNs and self-supervision

Effectively and efficiently deploying graph neural networks (GNNs) at sc...
02/01/2023

Simple yet Effective Gradient-Free Graph Convolutional Networks

Linearized Graph Neural Networks (GNNs) have attracted great attention i...
08/02/2021

Evaluating Deep Graph Neural Networks

Graph Neural Networks (GNNs) have already been widely applied in various...
11/29/2022

Graph Neural Networks: A Powerful and Versatile Tool for Advancing Design, Reliability, and Security of ICs

Graph neural networks (GNNs) have pushed the state-of-the-art (SOTA) for...
08/23/2022

Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networks

Geometric Deep Learning has recently attracted significant interest in a...

Please sign up or login with your details

Forgot password? Click here to reset