Geographic Citation Gaps in NLP Research

by   Mukund Rungta, et al.

In a fair world, people have equitable opportunities to education, to conduct scientific research, to publish, and to get credit for their work, regardless of where they live. However, it is common knowledge among researchers that a vast number of papers accepted at top NLP venues come from a handful of western countries and (lately) China; whereas, very few papers from Africa and South America get published. Similar disparities are also believed to exist for paper citation counts. In the spirit of "what we do not measure, we cannot improve", this work asks a series of questions on the relationship between geographical location and publication success (acceptance in top NLP venues and citation impact). We first created a dataset of 70,000 papers from the ACL Anthology, extracted their meta-information, and generated their citation network. We then show that not only are there substantial geographical disparities in paper acceptance and citation but also that these disparities persist even when controlling for a number of variables such as venue of publication and sub-field of NLP. Further, despite some steps taken by the NLP community to improve geographical diversity, we show that the disparity in publication metrics across locations is still on an increasing trend since the early 2000s. We release our code and dataset here:


page 4

page 6


Forgotten Knowledge: Examining the Citational Amnesia in NLP

Citing papers is the primary method through which modern scientific writ...

Long-term Scientific Impact Revisited

Citation based measures are widely used as quantitative proxies for subj...

Citation Count Analysis for Papers with Preprints

We explore the degree to which papers prepublished on arXiv garner more ...

Early identification of important patents through network centrality

One of the most challenging problems in technological forecasting is to ...

Go Wide, Go Deep: Quantifying the Impact of Scientific Papers through Influence Dispersion Trees

Despite a long history of use of citation count as a measure to assess t...

Citation Sentiment Changes Analysis

Metrics for measuring the citation sentiment changes were introduced. Ci...

Quantifying the topic disparity of scientific articles

Citation count is a popular index for assessing scientific papers. Howev...

Please sign up or login with your details

Forgot password? Click here to reset