Metrics associated with NIH funding: a high-level view.

Published on Jul 1, 2011in Journal of the American Medical Informatics Association4.292
· DOI :10.1136/amiajnl-2011-000213
Kevin W. Boyack30
Estimated H-index: 30
Paul Jordan1
Estimated H-index: 1
(RTP: Research Triangle Park)
Objective To introduce the availability of grant-to-article linkage data associated with National Institutes of Health (NIH) grants and to perform a high-level analysis of the publication outputs and impacts associated with those grants. Design Articles were linked to the grants they acknowledge using the grant acknowledgment strings in PubMed using a parsing and matching process as embodied in the NIH Scientific Publication Information Retrieval & Evaluation System system. Additional data from PubMed and citation counts from Scopus were added to the linkage data. The data comprise 2 572 576 records from 1980 to 2009. Results The data show that synergies between NIH institutes are increasing over time; 29% of current articles acknowledge grants from multiple institutes. The median time lag to publication for a new grant is 3 years. Each grant contributes to approximately 1.7 articles per year, averaged over all grant types. Articles acknowledging US Public Health Service (PHS, which includes NIH) funding are cited twice as much as US-authored articles acknowledging no funding source. Articles acknowledging both PHS funding and a non-US government funding source receive on average 40% more citations that those acknowledging PHS funding sources alone. Conclusion The US PHS is effective at funding research with a higher-than-average impact. The data are amenable to further and much more detailed analysis.
Figures & Tables
  • References (17)
  • Citations (42)
📖 Papers frequently viewed together
1 Author (Dangzhi Zhao)
51 Citations
69 Citations
86 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Dangzhi Zhao (U of A: University of Alberta)H-Index: 15
This paper reports on a bibliometric study of the characteristics and impact of research in the library and information science (LIS) field which was funded through research grant programs, and compares it with research that received no extra funding. Seven core LIS journals were examined to identify articles published in 1998 that acknowledge research grant funding. The distribution of these articles by various criteria (e.g., topic, affiliation, funding agency) was determined. Their impact as ...
51 CitationsSource
NK cell cytotoxicity is controlled by numerous NK inhibitory and activating receptors. Most of the inhibitory receptors bind MHC class I proteins and are expressed in a variegated fashion. It was recently shown that TIGIT, a new protein expressed by T and NK cells binds to PVR and PVR-like receptors and inhibits T cell activity indirectly through the manipulation of DC activity. Here, we show that TIGIT is expressed by all human NK cells, that it binds PVR and PVRL2 but not PVRL3 and that it inh...
2,949 CitationsSource
#1Radmila Lyubarova (Albany Medical College)H-Index: 3
#2Brandon K. Itagaki (UCLA: University of California, Los Angeles)H-Index: 2
Last. Michael W. Itagaki (UCLA: University of California, Los Angeles)H-Index: 7
view all 3 authors...
Background Intense interest surrounds the recent expansion of US National Institutes of Health (NIH) budgets as part of economic stimulus legislation. However, the relationship between NIH funding and cardiovascular disease research is poorly understood, making the likely impact of this policy change unclear. Methods The National Library of Medicine's PubMed database was searched for articles published from 1996 to 2006, originating from U.S. institutions, and containing the phrases “cardiolog,”...
23 CitationsSource
#1Kevin W. Boyack (SNL: Sandia National Laboratories)H-Index: 30
#2Katy Börner (IU: Indiana University)H-Index: 35
Last. Richard KlavansH-Index: 25
view all 3 authors...
How does our collective scholarly knowledge grow over time? What major areas of science exist and how are they interlinked? Which areas are major knowledge producers; which ones are consumers? Computational scientometrics – the application of bibliometric/scientometric methods to large-scale scholarly datasets – and the communication of results via maps of science might help us answer these questions. This paper represents the results of a prototype study that aims to map the structure and evolu...
87 CitationsSource
#1Patrick Kwan (CUHK: The Chinese University of Hong Kong)H-Index: 53
#2Janice M. Johnston (HKU: University of Hong Kong)H-Index: 23
Last. Su LoH-Index: 1
view all 6 authors...
The Health and Health Services Research Fund (HHSRF) is dedicated to support research related to all aspects of health and health services in Hong Kong. We evaluated the fund's outcomes and explored factors associated with the translation of research findings to changes in health policy and provider behaviour.
32 CitationsSource
#1Blaise Cronin (IU: Indiana University Bloomington)H-Index: 38
#2Sara Franks (IU: Indiana University Bloomington)H-Index: 1
Formal and informal modes of collaboration in life sciences research were explored paratextually. The bylines and acknowledgments of more than 1,000 research articles in the journal Cell were analyzed to reveal the strength of collegiate ties and the importance of material and ideational trading between both individuals and labs. Intense coauthorship and subauthorship collaboration were shown to be defining features of contemporary research in the life sciences. © 2006 Wiley Periodicals, Inc.
41 CitationsSource
A review of data mining and analysis techniques that can be used for the mapping of knowledge domains is given. Literature mapping techniques can be based on authors, documents, journals, words, and/or indicators. Most mapping questions are related to research assessment or to the structure and dynamics of disciplines or networks. Several mapping techniques are demonstrated on a data set comprising 20 years of papers published in PNAS. Data from a variety of sources are merged to provide unique ...
93 CitationsSource
#1Kevin W. Boyack (SNL: Sandia National Laboratories)H-Index: 30
#2Katy Börner (IU: Indiana University Bloomington)H-Index: 35
This article reports research on analyzing and visualizing the impact of governmental funding on the amount and citation counts of research publications. For the first time, grant and publication data appear interlinked in one map. We start with an overview of related work and a discussion of available techniques. A concrete example- grant and publication data from Behavioral and Social Science Research, one of four extramural research programs at the National Institute on Aging (NIA)--is analyz...
86 CitationsSource
#1Evaristo Jiménez-Contreras (UGR: University of Granada)H-Index: 20
#2Félix De-Moya-Anegón (UGR: University of Granada)H-Index: 35
Last. Emilio Delgado López-Cózar (UGR: University of Granada)H-Index: 23
view all 3 authors...
This article outlines the evolution of international scientific production in Spain over the last 25 years, a period characterised by steady growth in research production. The following stages in this process are identified in accordance with some of the factors that predominated at different times. From 1974 to 1982 production increased due to causes endogenous to the scientific system itself, as scientists brought their work into line with the patterns which characterised research in other ind...
175 CitationsSource
#1Grant LewisonH-Index: 19
#2Jonathan GrantH-Index: 26
Last. P JansenH-Index: 1
view all 3 authors...
AIMS—To examine the volume and potential impact of gastroenterology research outputs from 1985 to 1998 from 14 developed countries; the overlap with research in cancer, infectious diseases, and genetics; and the funding sources for this research. To determine if countries' research outputs correlated with their burden of corresponding diseases and inputs to their research. METHODS—Selective retrieval of papers from the Science Citation Index and manual look up of a sample to determine funding so...
39 CitationsSource
Cited By42
#1Yarden Katz (Harvard University)H-Index: 13
#2Ulrich Matter (HSG: University of St. Gallen)H-Index: 3
Academic scientists and research institutes are increasingly being evaluated using digital metrics, from bibliometrics to patent counts. These metrics are often framed, by science policy analysts, economists of science as well as funding agencies, as objective and universal proxies for scientific worth, potential, and productivity. In biomedical science, where there is stiff competition for grants from the National Institutes of Health (NIH), metrics are sold as a less arbitrary way to allocate ...
#1Ji-ping GaoH-Index: 1
#2Cheng SuH-Index: 1
Last. Yuntao PanH-Index: 4
view all 5 authors...
Government funding is a key scientific research resource, and it has made a concrete contribution to the world’s science and technology development. But these funds come from common taxpayers, so we need to evaluate the effectiveness of these funds. Generally speaking, policymakers adopt the method of peer review to make assessments. Compared to kinds of shortcomings of peer review, the paper here proposed the benchmarking evaluation method based on the academic publication outputs of supporting...
#1Julie Aldridge (OSU: Ohio State University)
#2Florian Diekmann (OSU: Ohio State University)
AbstractThis study is a bibliometric analysis of journal articles generated from an intramural grant program in the agbiosciences. Using citation analysis and bibliometric mapping, the study analyzes 515 journal articles published from 1999 to 2017. Results show the growth of journal article output, identify the major research fields and topics, describe national and international authorial and institutional collaborations, and quantify the performance and impact of the article output. The grant...
#1Belén Álvarez-Bornstein (CSIC: Spanish National Research Council)H-Index: 2
#2Adrián A. Díaz-Faes (Polytechnic University of Valencia)H-Index: 7
Last. María Bordons (CSIC: Spanish National Research Council)H-Index: 28
view all 3 authors...
Improving our knowledge about funding patterns in different research domains and how funding contributes to research is a matter of great interest for funders and policymakers. This paper aims to (a) compare the funding patterns of two biomedical domains that differ in their basic versus clinical nature, and (b) to elucidate the factors that influence the presence of funding. To do so, we draw on the scientific output of Spain-based researchers in the Virology (basic) and Cardiac and Cardiovascu...
#1George ChackoH-Index: 3
#2Dmitriy KorobskiyH-Index: 1
Last. Samet Keserci ( 1
view all 5 authors...
Data mining coupled to network analysis has been successfully used to study relationships between basic discovery and translational applications such as drug development; as well to document research collaborations and knowledge flows. Assembling relevant data for such studies in a form that supports analysis presents challenges. We have developed Enhanced Research Network Information Environment (ERNIE), an open source, scalable cloud-based platform that (i) integrates data drawn from public an...
1 CitationsSource
#1Fengqing Zhang (Drexel University)H-Index: 8
#2Erjia Yan (Drexel University)H-Index: 22
Last. Yongjun Zhu (SKKU: Sungkyunkwan University)H-Index: 8
view all 4 authors...
This paper examines the impact of NIH funding on research outcomes using data from 108,803 projects funded by NIH between January 2009 and March 2017. We extend the prior knowledge on this topic by incorporating the correlation structure of multiple research outcomes, as well as a comprehensive list of grant-level features capturing information on funding size, gender composition and funding type. Specifically, we utilize partial least squares regression (PLS) to jointly model all three primary ...
1 CitationsSource
#1Ekaterina Galkina Cleary (Bentley University)H-Index: 4
#2Jennifer M. Beierlein (Bentley University)H-Index: 4
Last. Fred D. Ledley (Bentley University)H-Index: 42
view all 5 authors...
This work examines the contribution of NIH funding to published research associated with 210 new molecular entities (NMEs) approved by the Food and Drug Administration from 2010–2016. We identified >2 million publications in PubMed related to the 210 NMEs ( n = 131,092) or their 151 known biological targets ( n = 1,966,281). Of these, >600,000 (29%) were associated with NIH-funded projects in RePORTER. This funding included >200,000 fiscal years of NIH project support (1985–2016) and project cos...
20 CitationsSource
#1Cristian Mejia (TITech: Tokyo Institute of Technology)H-Index: 3
#2Yuya Kajikawa (TITech: Tokyo Institute of Technology)H-Index: 30
Funded research has been linked to academic production and performance. While the presence of funding acknowledgements may serve as an indicator of quality to some extent, we still lack tools to evaluate whether funding agencies allocate resources to novel and innovative research rather than mature fields. We address this issue in the present study by using bibliometrics. In particular, we exploit the citation network properties of academic articles to classify specific research fields into four...
3 CitationsSource
#1Susan Old (NIH: National Institutes of Health)H-Index: 7
#2Neil Thakur (NIH: National Institutes of Health)
The National Institutes of Health (NIH) is the largest biomedical research agency in the world. NIH's mission is to “seek fundamental knowledge about the nature and behavior of living systems and the application of that knowledge to enhance health, lengthen life, and reduce illness and disability.” In pursuing that mission, NIH's goal is to turn discovery into health. Publishing research findings is the cornerstone of meeting that goal. This chapter describes some key elements of the publishing ...
#1Monica Inez Ihli (UT: University of Tennessee)H-Index: 1
Research analyzing the relationship between grants and publications as outcomes in has in the past been challenged by the general disconnect between information systems which track awards, and those which track published research. However, changing systems and data curation practices have created opportunities in which unified grant and publication data can help us to better understand the research lifecycle. More, specifically, the indexing of funding acknowledgements by bibliographic databases...