Methods and Practices for Institutional Benchmarking based on Research Impact and Competitiveness: A Case Study of ShanghaiTech University

Published on Aug 30, 2019in Journal of Data and Information Science
路 DOI :10.2478/jdis-2019-0015
Jiang Chang1
Estimated H-index: 1
(ShanghaiTech University),
Jianhua Liu1
Estimated H-index: 1
(ShanghaiTech University)
Purpose: To develop and test a mission-oriented and multi-dimensional benchmarking method for a small scale university aiming for internationally first-class basic research. Design/methodology/approach: An individualized evidence-based assessment scheme was employed to benchmark ShanghaiTech University against selected top research institutions, focusing on research impact and competitiveness at the institutional and disciplinary levels. Topic maps opposing ShanghaiTech and corresponding top institutions were produced for the main research disciplines of ShanghaiTech. This provides opportunities for further exploration of strengths and weakness. Findings: This study establishes a preliminary framework for assessing the mission of the university. It further provides assessment principles, assessment questions, and indicators. Analytical methods and data sources were tested and proved to be applicable and efficient. Research limitations: To better fit the selective research focuses of this university, its schema of research disciplines needs to be re-organized and benchmarking targets should include disciplinary top institutions and not necessarily those universities leading overall rankings. Current reliance on research articles and certain databases may neglect important research output types. Practical implications: This study provides a working framework and practical methods for mission-oriented, individual, and multi-dimensional benchmarking that ShanghaiTech decided to use for periodical assessments. It also offers a working reference for other institutions to adapt. Further needs are identified so that ShanghaiTech can tackle them for future benchmarking. Originality/value: This is an effort to develop a mission-oriented, individually designed, systematically structured, and multi-dimensional assessment methodology which differs from often used composite indices.
  • References (16)
  • Citations (1)
馃摉 Papers frequently viewed together
1 Author (B Fies)
2 Citations
1 Author (Sara Booth)
78% of Scinapse members use related papers. After signing in, all features are FREE.
5 CitationsSource
#1Bahaa Ibrahim (Ain Shams University)H-Index: 1
This study focuses on the Arab literature published by researchers from all 22 members of the Arab League during the last 5 years before Arab Spring (2006鈥2010) and the 5 years after Arab Spring (2011鈥2015), in order to identify effects of the Arab Spring on research in the Arab world both performance and Productivity, based on bibliometrics analysis of the data extracted from Web of Science and InCites Essential Science Indicators provided by Thomson Reuters, and by using the statistical softwa...
2 CitationsSource
#1A. Jaya Kumar (IISc: Indian Institute of Science)H-Index: 1
#2Rahul Pandit (IISc: Indian Institute of Science)H-Index: 24
We furnish scientometric data, for science and engineering, of research organizations in India, extracted principally from the Web of Science鈩 (WoS) database via their InCites鈩 tool. We classify the data into different granularity levels and address problems in their reliable extraction from publication metadata. We accumulate scientometric measures such as the numbers of publications, citations, and the h-index for the period 1985鈥2016. We use them to compare research performance in science and...
1 CitationsSource
#1Ying Huang (BIT: Beijing Institute of Technology)H-Index: 6
#2Donghua Zhu (BIT: Beijing Institute of Technology)H-Index: 12
Last. Xuefeng Wang (BIT: Beijing Institute of Technology)H-Index: 6
view all 6 authors...
With rapid advances and diversifications in new fields of science and technology, new journals are emerging as a location for the exchange of research methods and findings in these burgeoning communities. These new journals are large in number and, in their early years, it is unclear how central these journals will be in the fields of science and technology. On one hand, these new journals offer valuable data sources for bibliometric scholars to understand and analyze emerging fields; on the oth...
4 CitationsSource
59 CitationsSource
#1Ludo Waltman (LEI: Leiden University)H-Index: 39
Citation impact indicators nowadays play an important role in research evaluation, and consequently these indicators have received a lot of attention in the bibliometric and scientometric literature. This paper provides an in-depth review of the literature on citation impact indicators. First, an overview is given of the literature on bibliographic databases that can be used to calculate citation impact indicators (Web of Science, Scopus, and Google Scholar). Next, selected topics in the literat...
226 CitationsSource
#1Carol Tenopir (UT: University of Tennessee)H-Index: 38
1 CitationsSource
#1Diana Hicks (Georgia Institute of Technology)H-Index: 28
#2Paul Wouters (LEI: Leiden University)H-Index: 26
Last. Ismael Rafols (Polytechnic University of Valencia)H-Index: 28
view all 5 authors...
Use these ten principles to guide research evaluation, urge Diana Hicks, Paul Wouters and colleagues.
473 CitationsSource
#1Ludo Waltman (LEI: Leiden University)H-Index: 39
#2Nees Jan van Eck (LEI: Leiden University)H-Index: 34
Different scientific fields have different citation practices. Citation-based bibliometric indicators need to normalize for such differences between fields in order to allow for meaningful between-field comparisons of citation impact. Traditionally, normalization for field differences has usually been done based on a field classification system. In this approach, each publication belongs to one or more fields and the citation impact of a publication is calculated relative to the other publicatio...
85 CitationsSource
#1Zuo-qi Ding (CPU: China Pharmaceutical University)H-Index: 2
#2Jian-Ping Ge (Beihang University)H-Index: 1
Last. Xiao-nan Zheng (CPU: China Pharmaceutical University)H-Index: 2
view all 4 authors...
Pharmacology/pharmacy is an important scientific field and plays a pivotal role in new drug research and development. China has steadily increased investment in drug development. This study aimed to evaluate the productivity of China in the field pharmacology/pharmacy in the past decade in relation to ten representative countries. The publications in the field pharmacology/pharmacy of China and ten representative countries in the past decade (2001---2010) were retrieved from Web of Science datab...
20 CitationsSource
Cited By1
#1RonaldRousseau (Katholieke Universiteit Leuven)H-Index: 41
#2Xiaolin Zhang (CAS: Chinese Academy of Sciences)