Measuring the Evolution of a Scientific Field through Citation Frames

Published on Dec 1, 2018in Transactions of the Association for Computational Linguistics
· DOI :10.1162/tacl_a_00028
David Jurgens15
Estimated H-index: 15
Srijan Kumar10
Estimated H-index: 10
(Stanford University)
+ 2 AuthorsDaniel Jurafsky68
Estimated H-index: 68
(Stanford University)
Citations have long been used to characterize the state of a scientific field and to identify influential works. However, writers use citations for different purposes, and this varied purpose influences uptake by future scholars.  Unfortunately, our understanding of how scholars use and frame citations has been limited to small-scale manual citation analysis of individual papers.  We perform the largest behavioral study of citations to date, analyzing how scientific works frame their contributions through different types of citations and how this framing affects the field as a whole. We introduce a new dataset of nearly 2,000 citations annotated for their function, and use it to develop a state-of-the-art classifier and label the papers of an entire field: Natural Language Processing.  We then show how differences in framing affect scientific uptake and reveal the evolution of the publication venues and the field as a whole. We demonstrate that authors are sensitive to discourse structure and publication venue when citing, and that how a paper frames its work through citations is predictive of the citation count it will receive. Finally, we use changes in citation framing to show that the field of NLP is undergoing a significant increase in consensus.
  • References (34)
  • Citations (3)
#1Yuxiao Dong (ND: University of Notre Dame)H-Index: 11
#2Reid A. Johnson (ND: University of Notre Dame)H-Index: 6
Last.Nitesh V. Chawla (ND: University of Notre Dame)H-Index: 42
view all 3 authors...
#1Marc Bertin (Université du Québec)H-Index: 5
#2Iana Atanassova (Université du Québec)H-Index: 5
Last.Vincent Larivière (UdeM: Université de Montréal)H-Index: 38
view all 4 authors...
#1Xiaodan Zhu (National Research Council)H-Index: 22
#2Peter D. Turney (National Research Council)H-Index: 39
Last.André Vellino (U of O: University of Ottawa)H-Index: 8
view all 4 authors...
#1Ying Ding (IU: Indiana University Bloomington)H-Index: 38
#2Guo Yong Zhang (IU: Indiana University Bloomington)H-Index: 3
Last.ChengXiang Zhai (UIUC: University of Illinois at Urbana–Champaign)H-Index: 66
view all 6 authors...
#1M. Fernández-Delgado (University of Santiago de Compostela)H-Index: 13
#2E. Cernadas (University of Santiago de Compostela)H-Index: 11
Last.Dinani AmorimH-Index: 1
view all 4 authors...
#1Dashun Wang (NU: Northeastern University)H-Index: 14
#2Chaoming Song (NU: Northeastern University)H-Index: 25
Last.Albert-La szlo Baraba siH-Index: 115
view all 3 authors...
Cited By3
Jul 21, 2019 in SIGIR (International ACM SIGIR Conference on Research and Development in Information Retrieval)
#1He Zhao (BIT: Beijing Institute of Technology)H-Index: 1
#2Zhunchen Luo (Academy of Military Science)H-Index: 1
view all 4 authors...
#1Chien-yu Huang (Edin.: University of Edinburgh)
#2Arlene Casey (Edin.: University of Edinburgh)
Last.Alan Medlar (UH: University of Helsinki)H-Index: 6
view all 4 authors...
View next paperInvestigating Facets to Characterise Citations for Scholars