TYPIC: A Corpus of Template-Based Diagnostic Comments on Argumentation

by   Shoichi Naito, et al.

Providing feedback on the argumentation of learner is essential for development of critical thinking skills, but it takes a lot of time and effort. To reduce the burden on teachers, we aim to automate a process of giving feedback, especially giving diagnostic comments which point out the weaknesses inherent in the argumentation. It is advisable to give specific diagnostic comments so that learners can recognize the diagnosis without misunderstanding. However, it is not obvious how the task of providing specific diagnostic comments should be formulated. We present a formulation of the task as template selection and slot filling to make an automatic evaluation easier and the behavior of the model more tractable. The key to the formulation is the possibility of creating a template set that is sufficient for practical use. In this paper, we define three criteria that a template set should satisfy: expressiveness, informativeness, and uniqueness, and verify the feasibility to create a template set that satisfies these criteria as a first trial. We will show that it is feasible through an annotation study that converts diagnostic comments given in text into a template format. The corpus used in the annotation study is publicly available.


Teach Me How to Improve My Argumentation Skills: A Survey on Feedback in Argumentation

The use of argumentation in education has been shown to improve critical...

Sentence-level Feedback Generation for English Language Learners: Does Data Augmentation Help?

In this paper, we present strong baselines for the task of Feedback Comm...

What do class comments tell us? An investigation of comment evolution and practices in Pharo

Previous studies have characterized code comments in different programmi...

On deletion diagnostic statistic in regression

A brief review about choosing a normalizing or scaling matrix for deleti...

An Enhanced Corpus for Arabic Newspapers Comments

In this paper, we propose our enhanced approach to create a dedicated co...

Unification of Template-Expansion and XML-Validation

The processing of XML documents often includes creation and validation. ...

A comment-driven evidence appraisal approach for decision-making when only uncertain evidence available

Purpose: To explore whether comments could be used as an assistant tool ...

Please sign up or login with your details

Forgot password? Click here to reset