The Argument Reasoning Comprehension Task

by   Ivan Habernal, et al.

Reasoning is a crucial part of natural language argumentation. In order to comprehend an argument, one has to reconstruct and analyze its reasoning. As arguments are highly contextualized, most reasoning-related content is left implicit and usually presupposed. Thus, argument comprehension requires not only language understanding and logic skills, but it also heavily depends on common sense. In this article we define a new task, argument reasoning comprehension. Given a natural language argument with a reason and a claim, the goal is to choose the correct implicit reasoning from two options. The challenging factor is that both options are plausible and lexically very close while leading to contradicting claims. To provide an empirical common ground for the task, we propose a complex, yet scalable crowdsourcing process, and we create a new freely licensed dataset based on authentic arguments from news comments. While the resulting 2k high-quality instances are also suitable for other argumentation-related tasks, such as stance detection, argument component identification, and abstractive argument summarization, we focus on the argument reasoning comprehension task and experiment with several systems based on neural attention and language models. Our results clearly reveal that current methods lack the capability to solve the task.


page 1

page 2

page 3

page 4


Annotating Implicit Reasoning in Arguments with Causal Links

Most of the existing work that focus on the identification of implicit k...

Probing Neural Network Comprehension of Natural Language Arguments

We are surprised to find that BERT's peak performance of 77 Reasoning Co...

NLITrans at SemEval-2018 Task 12: Transfer of Semantic Knowledge for Argument Comprehension

The Argument Reasoning Comprehension Task requires significant language ...

SNU_IDS at SemEval-2018 Task 12: Sentence Encoder with Contextualized Vectors for Argument Reasoning Comprehension

We present a novel neural architecture for the Argument Reasoning Compre...

A Comparative Study on Collecting High-Quality Implicit Reasonings at a Large-scale

Explicating implicit reasoning (i.e. warrants) in arguments is a long-st...

Towards a Holistic View on Argument Quality Prediction

Argumentation is one of society's foundational pillars, and, sparked by ...

Attentive Interaction Model: Modeling Changes in View in Argumentation

We present a neural architecture for modeling argumentative dialogue tha...

Please sign up or login with your details

Forgot password? Click here to reset