Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way

Published on Aug 1, 2012in Scientometrics2.77
· DOI :10.1007/s11192-012-0679-8
Henk F. Moed47
Estimated H-index: 47
Lisa Colledge3
Estimated H-index: 3
+ 4 AuthorsMayur Amin4
Estimated H-index: 4
In a reply to Jerome K. Vanclay's manuscript "Impact Factor: outdated artefact or stepping-stone to journal certification?" we discuss the value of journal metrics for the assessment of scientific-scholarly journals from a general bibliometric perspective, and from the point of view of creators of new journal metrics, journal editors and publishers. We conclude that citation-based indicators of journal performance are appropriate tools in journal assessment provided that they are accurate, and used with care and competence.
  • References (34)
  • Citations (52)
📖 Papers frequently viewed together
389 Citations
181 Citations
285 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Vicente P. Guerrero-Bote (University of Extremadura)H-Index: 18
#2Félix De-Moya-Anegón (CSIC: Spanish National Research Council)H-Index: 33
A new size-independent indicator of scientific journal prestige, the SJR2 indicator, is proposed. This indicator takes into account not only the prestige of the citing scientific journal but also its closeness to the cited journal using the cosine of the angle between the vectors of the two journals’ cocitation profiles. To eliminate the size effect, the accumulated prestige is divided by the fraction of the journal's citable documents, thus eliminating the decreasing tendency of this type of in...
136 CitationsSource
#1Jan Reedijk (KSU: King Saud University)H-Index: 78
15 CitationsSource
In the case of the scientometric evaluation of multi- or interdisciplinary units one risks to compare apples with oranges: each paper has to be assessed in comparison to an appropriate reference set. We suggest that the set of citing papers can be considered as the relevant representation of the field of impact. In order to normalize for differences in citation behavior among fields, citations can be fractionally counted proportionately to the length of the reference lists in the citing papers. ...
82 CitationsSource
1 CitationsSource
#2Vicente P. Guerrero-Bote (University of Extremadura)H-Index: 18
Last. Félix De-Moya-Anegón (CSIC: Spanish National Research Council)H-Index: 33
view all 3 authors...
285 CitationsSource
#1Henk F. Moed (LEI: Leiden University)H-Index: 47
389 CitationsSource
#1Lisa Colledge (Elsevier)H-Index: 3
#2Félix De-Moya-Anegón (CSIC: Spanish National Research Council)H-Index: 33
Last. Henk F. Moed (LEI: Leiden University)H-Index: 47
view all 6 authors...
This paper introduces two journal metrics recently endorsed by Elsevier's Scopus: SCImago Journal Rank (SJR) and Source Normalized Impact per Paper (SNIP). SJR weights citations according to the status of the citing journal and aims to measure journal prestige rather than popularity. SNIP compensates for disparities in citation potential and aims to account for differences in topicality across research fields. The paper underlines important points to keep in mind when using journal metrics in ge...
39 CitationsSource
#1Vicente P. Guerrero Bote (University of Extremadura)H-Index: 7
#2Borja González-Pereira (University of Extremadura)H-Index: 2
Last. Félix De-Moya-Anegón (CSIC: Spanish National Research Council)H-Index: 33
view all 3 authors...
This work was financed by the Junta de Extremadura - Consejeria de Educacion Ciencia & Tecnologia and the Fondo Social Europeo as part of research project PRI06A200, and by the Plan Nacional de Investigacion Cientifica, Desarrollo e Innovacion Tecnologica 2008-2011 and the Fondo Europeo de Desarrollo Regional (FEDER) as part of research projects TIN2008-06514-C02-01 and TIN2008-06514-C02-02.
80 CitationsSource
Automated structure validation was introduced in chemical crystallography about 12 years ago as a tool to assist practitioners with the exponential growth in crystal structure analyses. Validation has since evolved into an easy-to-use checkCIF/PLATON web-based IUCr service. The result of a crystal structure determination has to be supplied as a CIF-formatted computer-readable file. The checking software tests the data in the CIF for completeness, quality and consistency. In addition, the reporte...
10.4k CitationsSource
#1GlänzelWolfgang (MTA: Hungarian Academy of Sciences)H-Index: 58
In recent studies the issue of the relatedness between journal impact factors and other measures of journal impact have been raised and discussed from both merely empirical and theoretical perspectives. Models of the underlying citation processes suggest distributions with two or more free parameters. Proceeding from the relation between the journals’ mean citation rate and uncitedness and the assumption of an underlying Generalised Waring Distribution (GWD) model, it is found that the journal i...
28 CitationsSource
Cited By52
#1Manolis Antonoyiannakis (Columbia University)H-Index: 4
We study how a single paper affects the Impact Factor (IF) by analyzing data from 3,088,511 papers published in 11639 journals in the 2017 Journal Citation Reports of Clarivate Analytics. We find t...
#2Jakob KapellerH-Index: 11
Last. Stefan SteinerbergerH-Index: 10
view all 3 authors...
In this paper we comparatively explore three claims concerning the disciplinary character of economics by means of citation analysis. The three claims under study are: (1) economics exhibits strong forms of institutional stratification and, as a byproduct, a rather pronounced internal hierarchy, (2) economists strongly conform to institutional incentives and (3) modern mainstream economics is a largely self-referential intellectual project mostly inaccessible to disciplinary or paradigmatic outs...
#1Ted Brown (Monash University, Peninsula campus)H-Index: 24
#2Sharon A. Gutman (CUMC: Columbia University Medical Center)H-Index: 12
AbstractBackground: Journals are currently assessed and ranked using a number of different quantitative performance metrics.Aim: To compare and correlate the publication metrics of English-language...
2 CitationsSource
Because the Impact Factor (IF) is an average quantity and most journals are small, IFs are volatile. We study how a single paper affects the IF using data from 11639 journals in the 2017 Journal Citation Reports. We define as volatility the IF gain (or loss) caused by a single paper, and this is inversely proportional to journal size. We find high volatilities for hundreds of journals annually due to their top-cited paper: whether it is a highly-cited paper in a small journal, or a moderately (o...
#1John A. Barrick (BYU: Brigham Young University)H-Index: 4
#2Nathan William Mecham (BYU: Brigham Young University)H-Index: 1
Last. David A. Wood (BYU: Brigham Young University)H-Index: 22
view all 4 authors...
This paper presents rankings of accounting journals disaggregated by topical area (AIS, audit, financial, managerial, tax, and other) and methodology (analytical, archival, experimental, and other). We find that only for the financial topical area and archival methodology does the traditional top-3 characterization of the best journals accurately describe which journals publish the most-cited work. For all other areas, including AIS, audit, managerial, tax, and other topics, and all other method...
3 CitationsSource
#1Ali Abrishami (Shahid Beheshti University)H-Index: 2
#2Sadegh Aliakbary (Shahid Beheshti University)H-Index: 6
Abstract With the growing number of published scientific papers world-wide, the need to evaluation and quality assessment methods for research papers is increasing. Scientific fields such as scientometrics, informetrics, and bibliometrics establish quantified analysis methods and measurements for evaluating scientific papers. In this area, an important problem is to predict the future influence of a published paper. Particularly, early discrimination between influential papers and insignificant ...
3 CitationsSource
#1Aceil Al-Khatib (JUST: Jordan University of Science and Technology)H-Index: 6
#2Jaime A. TeixeiraH-Index: 6
Authors endure considerable hardship carrying out biomedical research, from generating ideas to completing their manuscripts and submitting their findings and data (as is increasingly required) to a journal. When researchers submit to journals, they entrust their findings and ideas to editors and peer reviewers who are expected to respect the confidentiality of peer review. Inherent trust in peer review is built on the ethical conduct of authors, editors and reviewers, and on the respect of this...
4 CitationsSource
Abstract The objective assessment of the prestige of an academic institution is a difficult and hotly debated task. In the last few years, different types of university rankings have been proposed to quantify it, yet the debate on what rankings are exactly measuring is enduring. To address the issue we have measured a quantitative and reliable proxy of the academic reputation of a given institution and compared our findings with well-established impact indicators and academic rankings. Specifica...
3 CitationsSource
#1Cristina López-Duarte (University of Oviedo)H-Index: 11
#2Marta Suárez (University of Oviedo)H-Index: 18
Last. Belén González Díaz (University of Oviedo)H-Index: 5
view all 3 authors...
AbstractThis is a bibliometric study of reference literature related to the influence of national culture issues on expatriate management. It is based on publications in elite Management, International Business, and Human Resource academic journals between 2000 and 2012. The database comprises 222 articles involving 368 authors and 223 academic institutions. The analysis uses a broad scoring procedure that includes: (I) scholars and institutions’ productivity in terms of number of publications (...
1 CitationsSource