Icons / Logo / Facebook Created with Sketch. Icons / Logo / Google Created with Sketch. Icons / Logo / ORCID Created with Sketch. Branding/Logomark minus Citation Combined Shape Icon/Bookmark-empty Icon/Copy Icon/Collection Icon/Close Copy 7 no author result Created with Sketch. Icon/Back Created with Sketch. Match!

A comparison of 17 article-level bibliometric indicators of institutional research productivity: Evidence from the information management literature of China

Published on Sep 1, 2017in Information Processing and Management 3.89
· DOI :10.1016/j.ipm.2017.05.002
Jing Li1
Estimated H-index: 1
(CAS: Chinese Academy of Sciences),
Dengsheng Wu10
Estimated H-index: 10
(CAS: Chinese Academy of Sciences)
+ 1 AuthorsMinglu Li6
Estimated H-index: 6
(National Natural Science Foundation of China)
Cite
Abstract
Abstract Periodically ranking institutional research productivity is necessary not only to understand the status of the development of related fields but also to identify gaps and take appropriate corrective steps. Many bibliometric indicators contribute to the assessment of institutional research productivity, but the appropriateness of the indicator and the relationships between different indicators are topics that have not been addressed. For this reason, an indicator framework for the ranking of institutional research performance, which consists of a count of published articles and quality weighted dimensions, is developed. Based on the literature review, 17 indicators in the framework are chosen for study. Based on these indicators, experiments are conducted to rank Chinese institutions in the field of Information Management. Kendall's tau rank correlation coefficient (τ) is calculated, and all pairwise correlations are between 0.34 and 0.98. There are three primary findings: (1) among the article count indicators, the Straight count indicator is significantly different than others; (2) the rankings based on the indicators which are weighted by quality are consistent with those based on the indicators using article count; and (3) the Paper citation weighted indicator is sensitive to the procedure used for institutional ranking.
  • References (53)
  • Citations (8)
Cite
References53
Newest
Published on Jun 2, 2016in Applied Economics 0.97
Scott Alex Beaulier4
Estimated H-index: 4
(ASU: Arizona State University),
Robert Elder2
Estimated H-index: 2
(Beloit College)
+ 1 AuthorsJoshua C. Hall14
Estimated H-index: 14
(WVU: West Virginia University)
ABSTRACTWe provide the first ranking of countries’ economic institutions using an ordinal methodology. Using the five areas of the Fraser Institute’s Economic Freedom of the World (EFW) index, we find that final rankings of a country’s institutions are sensitive to the importance-ordering of Area 1 (Size of Government). When Areas 2–5 are in the most important position, we find that there is no significant difference between the EFW rankings and our rankings. When Area 1 is placed in the most im...
Nianhang Xu9
Estimated H-index: 9
(RUC: Renmin University of China),
Kam C. Chan28
Estimated H-index: 28
(Western Kentucky University),
Chih-Hsiang Chang9
Estimated H-index: 9
(NUK: National University of Kaohsiung)
Abstract We conduct rankings on finance programs based on a rich database of citations for all articles from a set of 23 quality finance journals during 1990–2010. Our work represents a new perspective on the evaluation of faculty research as compared to the traditional counting of total number of publications in the literature. Our findings show that the top-five institutions are the University of Chicago, Harvard University, New York University, the University of Pennsylvania, and Duke Univers...
Benjamin M. Blau13
Estimated H-index: 13
(USU: Utah State University),
Jared F. Egginton3
Estimated H-index: 3
(La. Tech: Louisiana Tech University),
Matthew D. Hill11
Estimated H-index: 11
(USM: University of Southern Mississippi)
We examine differences in price delay for a sample of real estate investment trust (REIT) and non-REIT matched pairs. Results suggest an economically and statistically higher level of price delay for REIT securities, which implies heightened frictions that increase the time needed for new information to be impounded into the prices of REIT shares. The primary drivers for the observed delay differential include differences in idiosyncratic volatility, market risk, and the number of days traded. W...
Published on Nov 1, 2015in Scientometrics 2.77
Dengsheng Wu10
Estimated H-index: 10
(CAS: Chinese Academy of Sciences),
Minglu Li6
Estimated H-index: 6
(National Natural Science Foundation of China)
+ 2 AuthorsJianping LiXiaolei19
Estimated H-index: 19
(CAS: Chinese Academy of Sciences)
Ranking research productivity of institutions periodically is of a great necessity nowadays, for that can not only help understand the latest development level of related fields but also contribute to finding gaps and quickly improve. In previous studies, the number of publications and further impact factors of journals is two widely used indexes to measure research productivity. However, impact factors do not always tally with a quality of the journal, which will lead to a bias of research prod...
Henk F. Moed43
Estimated H-index: 43
(Elsevier),
Gali Halevi7
Estimated H-index: 7
(Elsevier)
This article introduces the Multidimensional Research Assessment Matrix of scientific output. Its base notion holds that the choice of metrics to be applied in a research assessment process depends on the unit of assessment, the research dimension to be assessed, and the purposes and policy context of the assessment. An indicator may by highly useful within one assessment process, but less so in another. For instance, publication counts are useful tools to help discriminate between those staff m...
Published on Oct 1, 2015in Journal of Informetrics 3.88
Jasleen Kaur13
Estimated H-index: 13
(IU: Indiana University Bloomington),
Emilio Ferrara31
Estimated H-index: 31
(IU: Indiana University Bloomington)
+ 2 AuthorsFilippo Radicchi27
Estimated H-index: 27
(IU: Indiana University Bloomington)
Citation metrics are becoming pervasive in the quantitative evaluation of scholars, journals, and institutions. Hiring, promotion, and funding decisions increasingly rely on a variety of impact metrics that cannot disentangle quality from quantity of scientific output, and are biased by factors such as discipline and academic age. Biases affecting the evaluation of single papers are compounded when one aggregates citation-based metrics across an entire publication record. It is not trivial to co...
Published on Sep 1, 2015in Scientometrics 2.77
Lorna Wildgaard4
Estimated H-index: 4
(UCPH: University of Copenhagen)
Author-level bibliometric indicators are becoming a standard tool in research assessment. It is important to investigate what these indicators actually measure to assess their appropriateness in scholar ranking and benchmarking average individual levels of performance. 17 author-level indicators were calculated for 512 researchers in Astronomy, Environmental Science, Philosophy and Public Health. Indicator scores and scholar rankings calculated in Web of Science (WoS) and Google Scholar (GS) wer...
Published on Jan 1, 2015in Organization 2.70
Simon Hussain11
Estimated H-index: 11
(Newcastle University)
The emergence of journal quality lists such as that issued by the UK’s Association of Business Schools (ABS) has instigated a wave of ‘journal list fetishism’ throughout the business school sector. Business school deans and research managers have become fixated on whether the publication records of current staff and new applicants include the requisite number of ‘hits’ in the best ranked journals. Little attention is paid to additional measures of research quality, or to the broader context with...
Published on Jul 4, 2014in The Journal of Education for Business
Mingjun Hou3
Estimated H-index: 3
(Xi'an Jiaotong University),
Peihua Fan2
Estimated H-index: 2
(Xi'an Jiaotong University),
Heng Liu10
Estimated H-index: 10
(SYSU: Sun Yat-sen University)
The authors rank the management schools in Greater China (including Mainland China, Hong Kong, Taiwan, and Macau) based on their academic publications in the Social Sciences Citation Index management and business journals from 2000 to 2010. Following K. Ritzberger's (2008) and X. Yu and Z. Gao's (2010) ranking method, the authors develop six indices to rank institutions from several aspects, including both the quantity and quality of publications. By doing so, they provide a clear viewpoint abou...
Published on Jul 1, 2013in Scientometrics 2.77
Hui-Zhen Fu13
Estimated H-index: 13
(PKU: Peking University),
Yuh-Shan Ho66
Estimated H-index: 66
(PKU: Peking University)
The institutionally independent publications of Tsinghua University and Peking University were compared by two main indicators namely peak-year citations per publication and h-index, based on the data extracted from the Science Citation Index Expanded, Web of Science from 1974 to 2011. Analyzed aspects covered total publication outputs, annual production, impact, authorships, Web of Science categories, journals, and most cited articles. Results shows that the two universities were in the same sc...
Cited By8
Newest
Published on Jul 13, 2019in Scientometrics 2.77
Xiuwen Chen2
Estimated H-index: 2
(CAS: Chinese Academy of Sciences),
Jianping LiXiaolei19
Estimated H-index: 19
(CAS: Chinese Academy of Sciences)
+ 1 AuthorsDengsheng Wu10
Estimated H-index: 10
(CAS: Chinese Academy of Sciences)
From the initial idea, writing, submitting, and reviewing to the online presentation of a research paper takes a long time. The identified intellectual structure of a research paper may have a certain time lag. In view of this problem, scholars have suggested that research grants may be an alternative way to identify intellectual structure as early as possible. However, these comments are mentioned qualitatively. Few researchers have verified the research grant by early identification of the int...
Published on Apr 1, 2019in Health policy and technology 1.23
Abstract Objectives We analyzed research performance, international collaboration, corporate contribution, country level economic factors, and legislative frameworks in association with worldwide implementation of telemedicine programs. Methods We identified telemedicine scholarly output in EMBASE and SCOPUS and SciVal and combine with Third Global Survey on eHealth available in the World Health Organization Global Observatory for eHealth. Results From 71245 telemedicine-related publications onl...
Published on Feb 14, 2019
Lili Yuan1
Estimated H-index: 1
(CAS: Chinese Academy of Sciences),
Jianping LiXiaolei19
Estimated H-index: 19
(CAS: Chinese Academy of Sciences)
+ 2 AuthorsDengsheng Wu10
Estimated H-index: 10
(CAS: Chinese Academy of Sciences)
Meta-syntheses from experts’ judgements and quantitative metrics are two main forms of evaluation. But they both have limitations. This paper constructs a framework for mapping the evaluation results between quantitative metrics and experts’ judgements such that they may be solved. In this way, the weights of metrics in quantitative evaluation are objectively obtained, and the validity of the results can be testified. Weighted average percentile (WAP) is employed to aggregate different experts’ ...
Published on Jan 1, 2019
Carlos M. Baldo1
Estimated H-index: 1
(Colorado Mesa University),
Kyle S. Hull3
Estimated H-index: 3
(Aquinas College),
Simón Aristeguieta-Trillos (Clarion University of Pennsylvania)
Published on Sep 1, 2018in Scientometrics 2.77
Anna Artemovna Avanesova , Tatyana Shamliyan6
Estimated H-index: 6
(Elsevier)
We analyzed comparative trends in research performance of the Russian institutions based on the quantitative and qualitative data available in the international SciVal, Scopus, web of science and the national Russian databases from 2012 to December 2017. Russian Federation represented 2.0% of the world population and 2% of the researchers while accounting to 2.2% of the world publications (14th place in the world scholarly output) with overall field-weighted citation impact of 0.75. Scholarly ou...
Published on Jul 1, 2018in Scientometrics 2.77
Lili Yuan1
Estimated H-index: 1
(CAS: Chinese Academy of Sciences),
Yanni Hao1
Estimated H-index: 1
(National Natural Science Foundation of China)
+ 3 AuthorsDengsheng Wu10
Estimated H-index: 10
(CAS: Chinese Academy of Sciences)
International research collaboration is vital to the success of scientific development of China, and the identification of collaboration partners is the basic unit of collaboration. While many researchers have investigated international research collaboration using publication data, grant data have rarely been used. This paper explores the international research collaboration partners of China from a new data perspective, based on grant data. Using data from the National Natural Science Foundati...
Published on May 1, 2018in Journal of Informetrics 3.88
Dengsheng Wu10
Estimated H-index: 10
(CAS: Chinese Academy of Sciences),
Jing Li1
Estimated H-index: 1
(Anda: Anhui University)
+ 1 AuthorsJianping LiXiaolei19
Estimated H-index: 19
(CAS: Chinese Academy of Sciences)
Abstract Assessing the scholarly impact of academic institutions has become increasingly important. The achievements of editorial board members can create benchmarks for research excellence and can be used to evaluate both individual and institutional performance. This paper proposes a new method based on journal editor data for assessing an institution’s scholarly impact. In this paper, a journal editorship index (JEI) that simultaneously accounts for the journal rating (JR), editor title (ET),...
Published on Jan 1, 2017in IEEE Access 4.10
William H. Walters11
Estimated H-index: 11
(Manhattan College)
This guide presents nine key questions that can help researchers make good use of citation-based journal rankings (metrics) in the natural and social sciences. The nine questions address the characteristics that distinguish one metric from another: the source documents, the citation-counting window, the document types counted, the cited-document window, the impact of highly cited documents, the treatment of self-citations, the distinction between size-dependent and size-independent metrics, the ...
Published on Jan 1, 2017in Procedia Computer Science
Jing Li2
Estimated H-index: 2
(Anda: Anhui University),
Shuai Zhang1
Estimated H-index: 1
(Anda: Anhui University)
+ 1 AuthorsYunzhi Wang1
Estimated H-index: 1
(WHU: Wuhan University)
Abstract In this study, researchers do interviews with 18 samples who are selected as the semi-structured interview object, and then we use the qualitative analysis software, NVivo 11, to qualitatively analyze the original data of the interview. In the end, we get six main influencing factors of the user’s online knowledge consumption behavior, namely, perceived information quality, task-driven, subjective norms, perceived value, perceived price, free values. The perceived information quality is...
Published on Jan 1, 2017in Procedia Computer Science
Xiaoli Lu (CAS: Chinese Academy of Sciences), Cuifeng Ma
Abstract As a new type of potential energy, methane hydrate presents a very high resource value, has been a long-term research focus in oil and gas industry. Based on the Web of Science database, this paper analyzes the research collaboration of international methane hydrate. The paper gives a framework for collaboration network of methane hydrate research. Based on the 7194 collected papers during 2001-2016, the paper calculates the cooperation rate and cooperation degree of methane hydrate res...