Semantic Analysis for Automated Evaluation of the Potential Impact of Research Articles

by   Neslihan Suzen, et al.

Can the analysis of the semantics of words used in the text of a scientific paper predict its future impact measured by citations? This study details examples of automated text classification that achieved 80 distinguishing between highly-cited and little-cited articles. Automated intelligent systems allow the identification of promising works that could become influential in the scientific community. The problems of quantifying the meaning of texts and representation of human language have been clear since the inception of Natural Language Processing. This paper presents a novel method for vector representation of text meaning based on information theory and show how this informational semantics is used for text classification on the basis of the Leicester Scientific Corpus. We describe the experimental framework used to evaluate the impact of scientific articles through their informational semantics. Our interest is in citation classification to discover how important semantics of texts are in predicting the citation count. We propose the semantics of texts as an important factor for citation prediction. For each article, our system extracts the abstract of paper, represents the words of the abstract as vectors in Meaning Space, automatically analyses the distribution of scientific categories (Web of Science categories) within the text of abstract, and then classifies papers according to citation counts (highly-cited, little-cited). We show that an informational approach to representing the meaning of a text has offered a way to effectively predict the scientific impact of research papers.


page 1

page 2

page 3

page 4


Citation Analysis of Computer Systems Papers

Citation analysis is used extensively in the bibliometrics literature to...

Analyzing Linguistic Complexity and Scientific Impact

The number of publications and the number of citations received have bec...

S2ORC: The Semantic Scholar Open Research Corpus

We introduce S2ORC, a large contextual citation graph of English-languag...

Cited Text Spans for Citation Text Generation

Automatic related work generation must ground their outputs to the conte...

Investigating Disagreement in the Scientific Literature

Disagreement is essential to scientific progress. However, the extent of...

Hierarchical Classification of Research Fields in the "Web of Science" Using Deep Learning

This paper presents a hierarchical classification system that automatica...

Please sign up or login with your details

Forgot password? Click here to reset