Match!

Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way

Published on Aug 1, 2012in Scientometrics2.77
· DOI :10.1007/s11192-012-0679-8
Henk F. Moed43
Estimated H-index: 43
(Elsevier),
Lisa Colledge3
Estimated H-index: 3
(Elsevier)
+ 4 AuthorsMayur Amin5
Estimated H-index: 5
(Elsevier)
Cite
Abstract
In a reply to Jerome K. Vanclay's manuscript "Impact Factor: outdated artefact or stepping-stone to journal certification?" we discuss the value of journal metrics for the assessment of scientific-scholarly journals from a general bibliometric perspective, and from the point of view of creators of new journal metrics, journal editors and publishers. We conclude that citation-based indicators of journal performance are appropriate tools in journal assessment provided that they are accurate, and used with care and competence.
  • References (34)
  • Citations (47)
Cite
References34
Newest
Published on Jan 23, 2012in Angewandte Chemie12.26
Jan Reedijk73
Estimated H-index: 73
(KSU: King Saud University)
Published on 2010in Journal of Informetrics3.88
Loet Leydesdorff77
Estimated H-index: 77
,
Tobias Opthof
In the case of the scientometric evaluation of multi- or interdisciplinary units one risks to compare apples with oranges: each paper has to be assessed in comparison to an appropriate reference set. We suggest that the set of citing papers can be considered as the relevant representation of the field of impact. In order to normalize for differences in citation behavior among fields, citations can be fractionally counted proportionately to the length of the reference lists in the citing papers. ...
Published on Jul 1, 2010in Journal of Informetrics3.88
Borja González-Pereira2
Estimated H-index: 2
,
Vicente P. Guerrero-Bote17
Estimated H-index: 17
(University of Extremadura),
Félix De-Moya-Anegón33
Estimated H-index: 33
(CSIC: Spanish National Research Council)
A size-independent indicator of journals’ scientific prestige, the SCImago Journal Rank (SJR) indicator, is proposed that ranks scholarly journals based on citation weighting schemes and eigenvector centrality. It is designed for use with complex and heterogeneous citation networks such as Scopus. Its computation method is described, and the results of its implementation on the Scopus 2007 dataset is compared with those of an ad hoc Journal Impact Factor, JIF(3y), both generally and within speci...
Lisa Colledge3
Estimated H-index: 3
(Elsevier),
Félix De-Moya-Anegón33
Estimated H-index: 33
(CSIC: Spanish National Research Council)
+ 3 AuthorsHenk F. Moed43
Estimated H-index: 43
(LEI: Leiden University)
This paper introduces two journal metrics recently endorsed by Elsevier's Scopus: SCImago Journal Rank (SJR) and Source Normalized Impact per Paper (SNIP). SJR weights citations according to the status of the citing journal and aims to measure journal prestige rather than popularity. SNIP compensates for disparities in citation potential and aims to account for differences in topicality across research fields. The paper underlines important points to keep in mind when using journal metrics in ge...
Published on Dec 1, 2009in arXiv: Digital Libraries
Vicente Pablo Guerrero Bote7
Estimated H-index: 7
(University of Extremadura),
Borja González-Pereira2
Estimated H-index: 2
(University of Extremadura),
Félix De-Moya-Anegón33
Estimated H-index: 33
(CSIC: Spanish National Research Council)
This work was financed by the Junta de Extremadura - Consejeria de Educacion Ciencia & Tecnologia and the Fondo Social Europeo as part of research project PRI06A200, and by the Plan Nacional de Investigacion Cientifica, Desarrollo e Innovacion Tecnologica 2008-2011 and the Fondo Europeo de Desarrollo Regional (FEDER) as part of research projects TIN2008-06514-C02-01 and TIN2008-06514-C02-02.
Published on Feb 1, 2009in Scientometrics2.77
GlänzelWolfgang55
Estimated H-index: 55
(MTA: Hungarian Academy of Sciences)
In recent studies the issue of the relatedness between journal impact factors and other measures of journal impact have been raised and discussed from both merely empirical and theoretical perspectives. Models of the underlying citation processes suggest distributions with two or more free parameters. Proceeding from the relation between the journals’ mean citation rate and uncitedness and the assumption of an underlying Generalised Waring Distribution (GWD) model, it is found that the journal i...
Anthony L. Spek67
Estimated H-index: 67
(UU: Utrecht University)
Automated structure validation was introduced in chemical crystallography about 12 years ago as a tool to assist practitioners with the exponential growth in crystal structure analyses. Validation has since evolved into an easy-to-use checkCIF/PLATON web-based IUCr service. The result of a crystal structure determination has to be supplied as a CIF-formatted computer-readable file. The checking software tests the data in the CIF for completeness, quality and consistency. In addition, the reporte...
Michel Zitt18
Estimated H-index: 18
(INRA: Institut national de la recherche agronomique),
Henry Small31
Estimated H-index: 31
(Thomson Reuters)
A new approach to the field normalization of the classical journal impact factor is introduced. This approach, called the audience factor, takes into consideration the citing propensity of journals for a given cited journal, specifically, the mean number of references of each citing journal, and fractionally weights the citations from those citing journals. Hence, the audience factor is a variant of a fractional citation-counting scheme, but computed on the citing journal rather than the citing ...
Published on Mar 7, 2008in Journal of Documentation1.57
Jan Reedijk73
Estimated H-index: 73
(LEI: Leiden University),
Henk F. Moed43
Estimated H-index: 43
(LEI: Leiden University)
Purpose – The purpose of this paper is to examine the effects of the use of the citation‐based journal impact factor for evaluative purposes upon the behaviour of authors and editors. It seeks to give a critical examination of a number of claims as regards the manipulability of this indicator on the basis of an empirical analysis of publication and referencing practices of authors and journal editorsDesign/methodology/approach – The paper describes mechanisms that may affect the numerical values...
Cited By47
Newest
Published on Nov 10, 2019in Scandinavian Journal of Occupational Therapy1.32
Ted Brown23
Estimated H-index: 23
(Monash University, Peninsula campus),
Sharon A. Gutman12
Estimated H-index: 12
(CUMC: Columbia University Medical Center)
AbstractBackground: Journals are currently assessed and ranked using a number of different quantitative performance metrics.Aim: To compare and correlate the publication metrics of English-language occupational therapy journals published in 2015.Method: Bibliometric data was sourced for 14 English-language occupational therapy journals including the Journal Citations Report (JCR) 2-year impact factor (IF), Eigenfactor Score (EFS), Article Influence Score (AIS), Scopus Source Normalized Impact pe...
Published on 2019in arXiv: Digital Libraries
Ali Abrishami1
Estimated H-index: 1
(Shahid Beheshti University),
Sadegh Aliakbary5
Estimated H-index: 5
(Shahid Beheshti University)
With the growing number of published scientific papers world-wide, the need to evaluation and quality assessment methods for research papers is increasing. Scientific fields such as scientometrics, informetrics and bibliometrics establish quantified analysis methods and measurements for scientific papers. In this area, an important problem is to predict the future influence of a published paper. Particularly, early discrimination between influential papers and insignificant papers may find impor...
Published on Feb 1, 2019in Science and Engineering Ethics2.27
Aceil Al-Khatib5
Estimated H-index: 5
(JUST: Jordan University of Science and Technology),
Jaime A. Teixeira10
Estimated H-index: 10
Authors endure considerable hardship carrying out biomedical research, from generating ideas to completing their manuscripts and submitting their findings and data (as is increasingly required) to a journal. When researchers submit to journals, they entrust their findings and ideas to editors and peer reviewers who are expected to respect the confidentiality of peer review. Inherent trust in peer review is built on the ethical conduct of authors, editors and reviewers, and on the respect of this...
Published on 2019in Journal of Informetrics3.88
Francesco Alessandro Massucci6
Estimated H-index: 6
,
Domingo Docampo11
Estimated H-index: 11
(University of Vigo)
Abstract The objective assessment of the prestige of an academic institution is a difficult and hotly debated task. In the last few years, different types of university rankings have been proposed to quantify it, yet the debate on what rankings are exactly measuring is enduring. To address the issue we have measured a quantitative and reliable proxy of the academic reputation of a given institution and compared our findings with well-established impact indicators and academic rankings. Specifica...
Published on Jun 6, 2019in arXiv: Digital Libraries
Manolis Antonoyiannakis3
Estimated H-index: 3
(Columbia University)
Because the Impact Factor (IF) is an average quantity and most journals are small, IFs are volatile. We study how a single paper affects the IF using data from 11639 journals in the 2017 Journal Citation Reports. We define as volatility the IF gain (or loss) caused by a single paper, and this is inversely proportional to journal size. We find high volatilities for hundreds of journals annually due to their top-cited paper: whether it is a highly-cited paper in a small journal, or a moderately (o...
Published on Dec 5, 2017in Journal of Information Systems
John A. Barrick1
Estimated H-index: 1
,
Nathan William Mecham1
Estimated H-index: 1
+ 1 AuthorsDavid A. Wood21
Estimated H-index: 21
This paper presents rankings of accounting journals disaggregated by topical area (AIS, audit, financial, managerial, tax, and other) and methodology (analytical, archival, experimental, and other). We find that only for the financial topical area and archival methodology does the traditional top-3 characterization of the best journals accurately describe which journals publish the most-cited work. For all other areas, including AIS, audit, managerial, tax, and other topics, and all other method...
Cristina López-Duarte11
Estimated H-index: 11
(University of Oviedo),
Marta Suárez16
Estimated H-index: 16
(University of Oviedo),
Belén González Díaz5
Estimated H-index: 5
(University of Oviedo)
AbstractThis is a bibliometric study of reference literature related to the influence of national culture issues on expatriate management. It is based on publications in elite Management, International Business, and Human Resource academic journals between 2000 and 2012. The database comprises 222 articles involving 368 authors and 223 academic institutions. The analysis uses a broad scoring procedure that includes: (I) scholars and institutions’ productivity in terms of number of publications (...
Published on Sep 1, 2017in Scientometrics2.77
Jessica Petersen3
Estimated H-index: 3
(UHH: University of Hamburg),
Fabian Hattke5
Estimated H-index: 5
(UHH: University of Hamburg),
Rick Vogel8
Estimated H-index: 8
(UHH: University of Hamburg)
In striving for academic relevance and recognition, editors exert a significant influence on a journal's mission and content. We examine how characteristics of editors, in particular the diversity of editorial teams, are related to journal impact. Our sample comprises 2244 editors who were affiliated with 645 volumes of 138 business and management journals. Using multi-level modeling, we relate editorial team characteristics to journal impact as reflected in three widely used measures: Five-year...
Published on Jun 12, 2017in Online Information Review1.93
Sara M. González-Betancor3
Estimated H-index: 3
,
Pablo Dorta-González11
Estimated H-index: 11
Purpose The two most used citation impact indicators in the assessment of scientific journals are, nowadays, the impact factor and the h-index. However, both indicators are not field normalized (vary heavily depending on the scientific category). Furthermore, the impact factor is not robust to the presence of articles with a large number of citations, while the h-index depends on the journal size. These limitations are very important when comparing journals of different sizes and categories. The...
View next paperImpact factor: outdated artefact or stepping-stone to journal certification?