SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)

by   Nancy X. R. Wang, et al.

Understanding tables is an important and relevant task that involves understanding table structure as well as being able to compare and contrast information within cells. In this paper, we address this challenge by presenting a new dataset and tasks that addresses this goal in a shared task in SemEval 2020 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS). Our dataset contains 981 manually-generated tables and an auto-generated dataset of 1980 tables providing over 180K statement and over 16M evidence annotations. SEM-TAB-FACTS featured two sub-tasks. In sub-task A, the goal was to determine if a statement is supported, refuted or unknown in relation to a table. In sub-task B, the focus was on identifying the specific cells of a table that provide evidence for the statement. 69 teams signed up to participate in the task with 19 successful submissions to subtask A and 12 successful submissions to subtask B. We present our results and main findings from the competition.


page 1

page 2

page 3

page 4


BreakingBERT@IITK at SemEval-2021 Task 9 : Statement Verification and Evidence Finding with Tables

Recently, there has been an interest in factual verification and predict...

Can Society Function Without Ethical Agents? An Informational Perspective

Many facts are learned through the intermediation of individuals with sp...

Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with Tables

Question answering from semi-structured tables can be seen as a semantic...

arXiVeri: Automatic table verification with GPT

Without accurate transcription of numerical data in scientific documents...

Graph Reasoning with Context-Aware Linearization for Interpretable Fact Extraction and Verification

This paper presents an end-to-end system for fact extraction and verific...

A Survey on Figure Classification Techniques in Scientific Documents

Figures visually represent an essential piece of information and provide...

Please sign up or login with your details

Forgot password? Click here to reset