MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction

11/14/2022
by   Xiaozhi Wang, et al.
Tsinghua University
0

The diverse relationships among real-world events, including coreference, temporal, causal, and subevent relations, are fundamental to understanding natural languages. However, two drawbacks of existing datasets limit event relation extraction (ERE) tasks: (1) Small scale. Due to the annotation complexity, the data scale of existing datasets is limited, which cannot well train and evaluate data-hungry models. (2) Absence of unified annotation. Different types of event relations naturally interact with each other, but existing datasets only cover limited relation types at once, which prevents models from taking full advantage of relation interactions. To address these issues, we construct a unified large-scale human-annotated ERE dataset MAVEN-ERE with improved annotation schemes. It contains 103,193 event coreference chains, 1,216,217 temporal relations, 57,992 causal relations, and 15,841 subevent relations, which is larger than existing datasets of all the ERE tasks by at least an order of magnitude. Experiments show that ERE on MAVEN-ERE is quite challenging, and considering relation interactions with joint learning can improve performances. The dataset and source codes can be obtained from https://github.com/THU-KEG/MAVEN-ERE.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/28/2023

More than Classification: A Unified Framework for Event Temporal Relation Extraction

Event temporal relation extraction (ETRE) is usually formulated as a mul...
04/26/2019

Contextualized Word Embeddings Enhanced Event Temporal Relation Extraction for Story Understanding

Learning causal and temporal relationships between events is an importan...
04/20/2018

A Multi-Axis Annotation Scheme for Event Temporal Relations

Existing temporal relation (TempRel) annotation schemes often have low i...
11/03/2021

SERC: Syntactic and Semantic Sequence based Event Relation Classification

Temporal and causal relations play an important role in determining the ...
10/13/2020

Joint Constrained Learning for Event-Event Relation Extraction

Understanding natural language involves recognizing how multiple event m...
12/03/2020

Rel3D: A Minimally Contrastive Benchmark for Grounding Spatial Relations in 3D

Understanding spatial relations (e.g., "laptop on table") in visual inpu...
02/04/2019

Fine-Grained Temporal Relation Extraction

We present a novel semantic framework for modeling temporal relations an...

Please sign up or login with your details

Forgot password? Click here to reset