research
∙
03/17/2021
The Human Evaluation Datasheet 1.0: A Template for Recording Details of Human Evaluation Experiments in NLP
This paper introduces the Human Evaluation Datasheet, a template for rec...
share
research
∙
03/14/2021
A Systematic Review of Reproducibility Research in Natural Language Processing
Against the background of what has been termed a reproducibility crisis ...
research
∙
02/02/2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
We introduce GEM, a living benchmark for natural language Generation (NL...
research
∙
05/29/2018
Human vs Automatic Metrics: on the Importance of Correlation Design
This paper discusses two existing approaches to the correlation analysis...
research
∙
07/21/2017