Match!

Measuring the Value of Research Data: A Citation Analysis of Oceanographic Data Sets

Published on Mar 26, 2014in PLOS ONE2.776
· DOI :10.1371/journal.pone.0092590
Christopher W. Belter7
Estimated H-index: 7
(NOAA: National Oceanic and Atmospheric Administration)
Sources
Abstract
Evaluation of scientific research is becoming increasingly reliant on publication-based bibliometric indicators, which may result in the devaluation of other scientific activities - such as data curation – that do not necessarily result in the production of scientific publications. This issue may undermine the movement to openly share and cite data sets in scientific publications because researchers are unlikely to devote the effort necessary to curate their research data if they are unlikely to receive credit for doing so. This analysis attempts to demonstrate the bibliometric impact of properly curated and openly accessible data sets by attempting to generate citation counts for three data sets archived at the National Oceanographic Data Center. My findings suggest that all three data sets are highly cited, with estimated citation counts in most cases higher than 99% of all the journal articles published in Oceanography during the same years. I also find that methods of citing and referring to these data sets in scientific publications are highly inconsistent, despite the fact that a formal citation format is suggested for each data set. These findings have important implications for developing a data citation format, encouraging researchers to properly curate their research data, and evaluating the bibliometric impact of individuals and institutions.
Figures & Tables
  • References (74)
  • Citations (35)
📖 Papers frequently viewed together
20112.78PLOS ONE
8 Authors (Carol Tenopir, ..., Mike Frame)
742 Citations
2015
529 Citations
397 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
References74
Newest
#1Kate ThomasH-Index: 1
96 Citations
#1Heather A. Piwowar (National Evolutionary Synthesis Center)H-Index: 17
Background. Attribution to the original contributor upon reuse of published data is important both as a reward for data creators and to document the provenance of research findings. Previous studies have found that papers with publicly available datasets receive a higher number of citations than similar studies without available data. However, few previous analyses have had the statistical power to control for the many variables known to predict citation rate, which has led to uncertain estimate...
200 CitationsSource
#1Mark J. Costello (University of Auckland)H-Index: 39
#2William K. Michener (UNM: University of New Mexico)H-Index: 31
Last. Philip E. Bourne (UM: University of Montana)H-Index: 57
view all 5 authors...
Concerns over data quality impede the use of public biodiversity databases and subsequent benefits to society. Data publication could follow the well-established publication process: with automated quality checks, peer review, and editorial decisions. This would improve data accuracy, reduce the need for users to ‘clean' the data, and might increase data use. Authors and editors would get due credit for a peer-reviewed (data) publication through use and citation metrics. Adopting standards relat...
115 CitationsSource
#1Giovanni Abramo (National Research Council)H-Index: 28
#2Tindaro Cicero (University of Rome Tor Vergata)H-Index: 13
Last. Ciriaco Andrea D’Angelo (University of Rome Tor Vergata)H-Index: 28
view all 3 authors...
There has been ample demonstration that bibliometrics is superior to peer-review for national research assessment exercises in the hard sciences. In this paper we examine the Italian case, taking the 2001---2003 university performance rankings list based on bibliometrics as benchmark. We compare the accuracy of the first national evaluation exercise, conducted entirely by peer-review, to other rankings lists prepared at zero cost, based on indicators indirectly linked to performance or available...
24 CitationsSource
#1Krzysztof J. Gorgolewski (MPG: Max Planck Society)H-Index: 29
#2Daniel S. Margulies (MPG: Max Planck Society)H-Index: 31
Last. Michael P. Milham (MIND Institute)H-Index: 84
view all 3 authors...
The neuroimaging community has been increasingly called up to openly share data. Although data sharing has been a cornerstone of large-scale data consortia, the incentive for the individual researcher remains unclear. Other fields have benefited from embracing a data publication form—the data paper—that allows researchers to publish their dataset as a citable scientific publication. Such publishing mechanisms both give credit that is recognizable within the scientific ecosystem, and also ensures...
37 CitationsSource
#1Laurie GoodmanH-Index: 11
#2Rebecca N LawrenceH-Index: 8
Last. Kevin AshleyH-Index: 1
view all 3 authors...
3 CitationsSource
#1Philip W. BoydH-Index: 75
Last. Cynthia ChandlerH-Index: 6
view all 3 authors...
Some of the largest scientific manipulation experiments conducted on our planet have enriched broad swaths of the surface ocean with iron. Surface ocean signatures of these iron enrichment experiments have covered areas up to > 1,000 km2 and have been conspicuous from space. Twelve of these multidisciplinary studies have been conducted since the early 1990s in three specific ocean regions— the Southern Ocean, and equatorial and sub-Arctic areas of the Pacific Ocean— where plant nutrients are per...
10 CitationsSource
#1Ludo Waltman (LEI: Leiden University)H-Index: 39
#2Clara Calero-Medina (LEI: Leiden University)H-Index: 6
Last. Paul Wouters (LEI: Leiden University)H-Index: 26
view all 10 authors...
The Leiden Ranking 2011/2012 is a ranking of universities based on bibliometric indicators of publication output, citation impact, and scientific collaboration. The ranking includes 500 major universities from 41 different countries. This paper provides an extensive discussion of the Leiden Ranking 2011/2012. The ranking is compared with other global university rankings, in particular the Academic Ranking of World Universities (commonly known as the Shanghai Ranking) and the Times Higher Educati...
258 CitationsSource
#2Paul E. UhlirH-Index: 1
#5PolicyH-Index: 10
Last. Global AffairsH-Index: 10
view all 1 authors...
The growth of electronic publishing of literature has created new challenges, such as the need for mechanisms for citing online references in ways that can assure discoverability and retrieval for many years into the future. The growth in online datasets presents related, yet more complex challenges. It depends upon the ability to reliably identify, locate, access, interpret, and verify the version, integrity, and provenance of digital datasets. Data citation standards and good practices can for...
24 Citations
#1Richard E. Chandler (UCL: University College London)H-Index: 24
#2Peter W. Thorne (NCSU: North Carolina State University)H-Index: 40
Last. Kate M. Willett (Met Office)H-Index: 11
view all 4 authors...
Climate science has a key role to play in informing strategies for adapting to and mitigating the effects of climate change. However, given the magnitude of the issues involved and their implications, it is imperative that the scientific process is–and is seen to be—rigorous, defensible, and transparent so as to ensure trust in the results. A key element in building such trust is to provide access to underlying data, so that interested parties can check published results and compare with their o...
6 CitationsSource
Cited By35
Newest
#1Tong Zeng (SU: Syracuse University)
#2Longfeng Wu (SU: Syracuse University)
Last. Daniel E. Acuña (SU: Syracuse University)
view all 4 authors...
Abstract A citation is a well-established mechanism for connecting scientific artifacts. Citation networks are used by citation analysis for a variety of reasons, prominently to give credit to scientists’ work. However, because of current citation practices, scientists tend to cite only publications, leaving out other types of artifacts such as datasets. Datasets then do not get appropriate credit even though they are increasingly reused and experimented with. We develop a network flow measure, ...
Source
#1Bikun Chen (Nanjing University of Science and Technology)H-Index: 2
#2Dannan Deng (Nanjing University of Science and Technology)
Last. Chengzhi Zhang (Nanjing University of Science and Technology)H-Index: 6
view all 4 authors...
Views and downloads of academic articles have become important supplementary indicators of scholarly impact. It is assumed that linguistic characteristics have an influence on article views and downloads to some extent. To understand the relationship between linguistic characteristics and article views and downloads, this study selected 63,002 full-text articles published from 2014 to 2015 in the PLoS (Public Library of Science) journals (PLoS Biology, PLoS Computational Biology, PLoS Genetics, ...
Source
Last. Daniel E. Acuña (SU: Syracuse University)
view all 4 authors...
A citation is a well-established mechanism for connecting scientific artifacts. Citation networks are used by citation analysis for a variety of reasons, prominently to give credit to scientists' work. However, because of current citation practices, scientists tend to cite only publications, leaving out other types of artifacts such as datasets. Datasets then do not get appropriate credit even though they are increasingly reused and experimented with. We develop a network flow measure, called Da...
#1JungWon Yoon (USF: University of South Florida)H-Index: 9
#2EunKyung Chung (Ewha Womans University)H-Index: 7
Last. Jihyun Kim (Ewha Womans University)H-Index: 1
view all 4 authors...
Source
#1Shelley StallH-Index: 3
#2Lynn YarmeyH-Index: 5
Last. Lesley WybornH-Index: 5
view all 9 authors...
All disciplines should follow the geosciences and demand best practice for publishing and sharing data, argue Shelley Stall and colleagues. All disciplines should follow the geosciences and demand best practice for publishing and sharing data, argue Shelley Stall and colleagues.
6 CitationsSource
#1Xuelian Pan (NU: Nanjing University)H-Index: 5
#2Erjia Yan (Drexel University)H-Index: 19
Last. Weina Hua (NU: Nanjing University)H-Index: 5
view all 4 authors...
Abstract We investigate the contributions of scientific software to library and information science (LIS) research using a sample of 572 English language articles published in 13 journals in 2008, 2011, 2014, and 2017. In particular, we examine the use and citation of software freely available for academic use in the LIS literature; we also explore the extent to which researchers follow software citation instructions provided by software developers. Twenty-seven percent of the LIS journal articl...
Source
Data citation, where products of research such as data sets, software, and tissue cultures are shared and acknowledged, is becoming more common in the era of Open Science. Currently, the practice of formal data citation—where data references are included alongside bibliographic references in the reference section of a publication—is uncommon. We examine the prevalence of data citation, documenting data sharing and reuse, in a sample of full text articles from the biological/biomedical sciences, ...
5 CitationsSource
#1Xuelian Pan (NU: Nanjing University)H-Index: 5
#2Erjia Yan (Drexel University)H-Index: 19
Last. Weina Hua (NU: Nanjing University)H-Index: 5
view all 4 authors...
Abstract This study investigates the use, citation and diffusion of three bibliometric mapping software tools (CiteSpace, HistCite and VOSviewer) in scientific papers. We first conduct a content analysis of a sample of 481 English core journal papers—i.e., papers from journals deemed central to their respective disciplines—in which at least one of these tools is mentioned. This allows us to understand the predominant mention and citation practices surrounding these tools. We then employ several ...
13 CitationsSource
#1Ben Marwick (UW: University of Washington)H-Index: 11
#2Suzanne E. Pilaar Birch (UW: University of Washington)H-Index: 6
How do archaeologists share their research data, if at all? We review what data are, according to current influential definitions, and previous work on the benefits, costs, and norms of data sharing in the sciences broadly. To understand data sharing in archaeology, we present the results of three pilot studies: requests for data by e-mail, review of data availability in published articles, and analysis of archaeological datasets deposited in repositories. We find that archaeologists are often w...
3 CitationsSource
#1Kai Li (Drexel University)H-Index: 10
#2Jason E. RollinsH-Index: 2
Last. Erjia Yan (Drexel University)H-Index: 19
view all 3 authors...
Clarivate Analytics’s Web of Science (WoS) is the world’s leading scientific citation search and analytical information platform. It is used as both a research tool supporting a broad array of scientific tasks across diverse knowledge domains as well as a dataset for large-scale data-intensive studies. WoS has been used in thousands of published academic studies over the past 20 years. It is also the most enduring commercial legacy of Eugene Garfield. Despite the central position WoS holds in co...
19 CitationsSource