Forgotten Knowledge: Examining the Citational Amnesia in NLP

by   Janvijay Singh, et al.

Citing papers is the primary method through which modern scientific writing discusses and builds on past work. Collectively, citing a diverse set of papers (in time and area of study) is an indicator of how widely the community is reading. Yet, there is little work looking at broad temporal patterns of citation. This work systematically and empirically examines: How far back in time do we tend to go to cite papers? How has that changed over time, and what factors correlate with this citational attention/amnesia? We chose NLP as our domain of interest and analyzed approximately 71.5K papers to show and quantify several key trends in citation. Notably, around 62 the immediate five years prior to publication, whereas only about 17 than ten years old. Furthermore, we show that the median age and age diversity of cited papers were steadily increasing from 1990 to 2014, but since then, the trend has reversed, and current NLP papers have an all-time low temporal citation diversity. Finally, we show that unlike the 1990s, the highly cited papers in the last decade were also papers with the least citation diversity, likely contributing to the intense (and arguably harmful) recency focus. Code, data, and a demo are available on the project homepage.


Geographic Citation Gaps in NLP Research

In a fair world, people have equitable opportunities to education, to co...

Trends in Explainable AI (XAI) Literature

The XAI literature is decentralized, both in terminology and in publicat...

Universality of citation distributions and its explanation

Universality or near-universality of citation distributions was found em...

Highly cited references in PLOS ONE and their in-text usage over time

In this article, we describe highly cited publications in a PLOS ONE ful...

The narrowing of literature use and the restricted mobility of papers in the sciences

It is a matter of debate whether a shrinking proportion of scholarly lit...

What Do We Mean by "Accessibility Research"? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019

Accessibility research has grown substantially in the past few decades, ...

Machine Learning vs. Deep Learning in 5G Networks – A Comparison of Scientific Impact

Introduction of fifth generation (5G) wireless network technology has ma...

Please sign up or login with your details

Forgot password? Click here to reset