What Makes a Good Summary? Reconsidering the Focus of Automatic Summarization

by   Maartje ter Hoeve, et al.

Automatic text summarization has enjoyed great progress over the last years. Now is the time to re-assess its focus and objectives. Does the current focus fully adhere to users' desires or should we expand or change our focus? We investigate this question empirically by conducting a survey amongst heavy users of pre-made summaries. We find that the current focus of the field does not fully align with participants' wishes. In response, we identify three groups of implications. First, we argue that it is important to adopt a broader perspective on automatic summarization. Based on our findings, we illustrate how we can expand our view when it comes to the types of input material that is to be summarized, the purpose of the summaries and their potential formats. Second, we define requirements for datasets that can facilitate these research directions. Third, usefulness is an important aspect of summarization that should be included in our evaluation methodology; we propose a methodology to evaluate the usefulness of a summary. With this work we unlock important research directions for future work on automatic summarization and we hope to initiate the development of methods in these directions.


page 1

page 13


Summarization with Graphical Elements

Automatic text summarization has experienced substantial progress in rec...

Automatic text summarization: What has been done and what has to be done

Summaries are important when it comes to process huge amounts of informa...

Towards automatic extractive text summarization of A-133 Single Audit reports with machine learning

The rapid growth of text data has motivated the development of machine-l...

Universal Evasion Attacks on Summarization Scoring

The automatic scoring of summaries is important as it guides the develop...

How to Evaluate a Summarizer: Study Design and Statistical Analysis for Manual Linguistic Quality Evaluation

Manual evaluation is essential to judge progress on automatic text summa...

The Role of Summarization in Generative Agents: A Preliminary Perspective

Generative agents that simulate human society show tremendous potential ...

Conducting sparse feature selection on arbitrarily long phrases in text corpora with a focus on interpretability

We propose a general framework for topic-specific summarization of large...

Please sign up or login with your details

Forgot password? Click here to reset