Automatic Short Answer Grading and Feedback Using Text Mining Methods

by   Neslihan Suzen, et al.

Automatic grading is not a new approach but the need to adapt the latest technology to automatic grading has become very important. As the technology has rapidly became more powerful on scoring exams and es- says, especially after the 1990s, partially or wholly automated grading systems using computational methods have evolved and have become a major area of research. In particular, the demand of scoring of natural language responses has created a need for tools that can be applied to automatically grade these responses. In this paper, we focus on the concept of automatic grading of short answer questions such as are typical in the UK GCSE system, and providing useful feedback on their answers to students. We present experimental results on a dataset provided from the introductory computer science class in the Uni- versity of North Texas. We first apply standard data mining techniques to the corpus of student answers for the purpose of measuring similarity between the student answers and the model answer. This is based on the number of common words. We then evaluate the relation between these similarities and marks awarded by scorers. We then consider a clustering approach that groups student answers into clusters. Each cluster would be awarded the same mark, and the same feedback given to each answer in a cluster. In this manner, we demonstrate that clusters indicate the groups of students who are awarded the same or the similar scores. Words in each cluster are compared to show that clusters are constructed based on how many and which words of the model answer have been used. The main novelty in this paper is that we design a model to predict marks based on the similarities between the student answers and the model answer.


Data-Mining Textual Responses to Uncover Misconception Patterns

An important, yet largely unstudied, problem in student data analysis is...

Cheating Automatic Short Answer Grading: On the Adversarial Usage of Adjectives and Adverbs

Automatic grading models are valued for the time and effort saved during...

Real-Time Automated Answer Scoring

In recent years, the role of big data analytics has exponentially grown ...

Clustering students' open-ended questionnaire answers

Open responses form a rich but underused source of information in educat...

Joint Multi-Domain Learning for Automatic Short Answer Grading

One of the fundamental challenges towards building any intelligent tutor...

Get It Scored Using AutoSAS – An Automated System for Scoring Short Answers

In the era of MOOCs, online exams are taken by millions of candidates, w...

Stacking Neural Network Models for Automatic Short Answer Scoring

Automatic short answer scoring is one of the text classification problem...

Please sign up or login with your details

Forgot password? Click here to reset