The citation indexes and the quantification of knowledge

Published on Mar 20, 2009in Journal of Educational Administration
· DOI :10.1108/09578230910941075
Óscar Rodríguez-Ruiz4
Estimated H-index: 4
(Complutense University of Madrid)
Purpose – This paper seeks to show the limitations of citation analysis to measure the quality of scientific contributions, also exploring the consequences of the assessment of research performance for educational institutions.Design/methodology/approach – The study reviews the literature about citation and assessment of the research endeavour to identify problems that clearly affect the administration of the institutions of higher educationFindings – Citation and other metrics are being used increasingly by the educational administration. Citation indexes can be considered as useful indicators, but they do not represent the quality of research. For this reason, bibliometric measurement cannot be the essential part of academic appraisal.Originality/value – The paper highlights the fact that administrators in higher education institutions and academic authorities need to be conscious of the essential role of peer review.
  • References (27)
  • Citations (19)
📖 Papers frequently viewed together
25 Citations
6 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Neal S. YoungH-Index: 106
#2John P. A. IoannidisH-Index: 151
Last. Omar Al-UbaydliH-Index: 10
view all 3 authors...
Summary The current system of publication in biomedical research provides a distorted view of the reality of scientific data that are generated in the laboratory and clinic. This system can be studied by applying principles from the field of economics. The “winner’s curse,” a more general statement of publication bias, suggests that the small proportion of results chosen for publication are unrepresentative of scientists’ repeated samplings of the real world. The self-correcting mechanism in sci...
290 CitationsSource
#1Linda Butler (ANU: Australian National University)H-Index: 18
Australia is about to move to a new system of distributing government block grants for research among universities, with the introduction of a process similar to Britain's Research Assess- ment Exercise (RAE). One of the most significant departures from the current RAE model is that, in the Australian Research Quality Framework, peer judgements will be informed by quantitative per- formance measures, including bibliometrics. The data will not be used in any formulaic way, but will sit alongside ...
75 CitationsSource
#1Howard I. Browman (Norwegian Institute of Marine Research)H-Index: 32
#2Konstantinos I. Stergiou (A.U.Th.: Aristotle University of Thessaloniki)H-Index: 33
Quantifying the relative performance of individual scholars, groups of scholars, depart- ments, institutions, provinces/states/regions and countries has become an integral part of decision- making over research policy, funding allocations, awarding of grants, faculty hirings, and claims for promotion and tenure. Bibliometric indices (based mainly upon citation counts), such as the h-index and the journal impact factor (JIF), are heavily relied upon in such assessments. There is a growing consens...
49 CitationsSource
#1Jeppe NicolaisenH-Index: 11
462 CitationsSource
Here's something that affects the behaviour and even careers of many contributors to the BMJ, yet many readers couldn't care less about it. Editors fall somewhere in between. It's the impact factor, a measure of citations to articles in the journal, which is “capable of recognising some value, some quality” (doi: 10.1136/bmj.39146.545752.BE) or “worthless” (doi: 10.1136/bmj.39146.549225.BE), or has indirectly “distorted the fundamental character of journals” (doi: 10.1136/bmj.39142.454086.AD), o...
1 CitationsSource
#1Richard J. Hobbs (University of Birmingham)H-Index: 97
Even advocates of impact factors admit that they are a flawed measure of quality. Gareth Williams believes we should get rid of them whereas Richard Hobbs thinks refinement is the answer
52 CitationsSource
Hannah Brown investigates the use and abuse of journal rankings George Lundberg spent the early 1980s lamenting the loss of his journal's once great reputation. JAMA (the Journal of the American Medical Association ), which he had taken over in 1982, had been in decline since its peak of popularity in the 1960s. And a new set of rankings that pitted medical journals against each other on the basis of article citations now seemed to confirm that JAMA was a long way behind the best. To make his ed...
94 CitationsSource
#1Pat Sikes (University of Sheffield)H-Index: 20
What it is like to be an academic working in a ‘new’ university in the 2000s depends upon specific contexts and individual biographies. Even so, it is the case that change, contingent upon local and national policy initiatives, is endemic in the higher education sector and has had some impact upon most people working there. This article explores some of the work‐related perceptions and experiences of a group of staff working in a School of Education at a ‘new’ university with a view to gaining a...
85 CitationsSource
#1Linda Butler (ANU: Australian National University)H-Index: 18
#2Martijn S. Visser (LEI: Leiden University)H-Index: 15
This paper reports the first results of the extension of citation analysis to 'non-source' items, which is one strand of an extensive study of quantitative performance indicators used in the assessment of research. It would be presumptuous to draw firm conclusions from this first foray into the realm of non-source citations, however our analysis is based on an extensive experimental database of over 30,000 publications, so the results can be viewed as strong pointers to possible generalised outc...
124 CitationsSource
#1Marshall McLuhanH-Index: 29
Automotive air conditioners tend to overheat and also cause the automobile to overheat when it is operated at slow speeds or idled. This problem is overcome by providing an improved automotive air conditioner and method of operating the same wherein the temperature of the air conditioner refrigerant and/or the temperature of the automotive radiator coolant is monitored and when the temperature thereof reaches a predetermined level, liquid water is applied to the heat exchange surfaces of the air...
626 Citations
Cited By19
#1Lina Zhou (UNCC: University of North Carolina at Charlotte)H-Index: 1
#2Uchechukwuka Amadi (Northcentral University)H-Index: 1
Last. Dongsong Zhang (UNCC: University of North Carolina at Charlotte)H-Index: 1
view all 3 authors...
Traditional citation analysis methods have been criticized because their theoretical base of statistical counts does not reflect the motive or judgment of citing authors. In particular, self-citations may give undue credits to a cited article or mislead scientific development. This research aims to answer the question of whether self-citation is biased by probing into the motives and context of citations. It takes an integrated and fine-grained view of self-citations by examining them via multip...
1 CitationsSource
The purpose of this paper is to reveal the limitations of h-index in assessing research performance through citation analysis and suggest two new indexes called prime index (P-index) and value added index (V-index), which are simpler to compute than g-index and more informative. For more serious research performance evaluation, analytic hierarchy process (AHP) methodology is proposed.,The methodology adopted is to compare existing indexes for citation-based research assessment and identify their...
#1Karen Chapman (UA: University of Alabama)H-Index: 6
#2Alexander E. Ellinger (UA: University of Alabama)H-Index: 36
Last. Jesse Nash (UA: University of Alabama)H-Index: 1
view all 4 authors...
Despite growing utilization of scholarly metrics to assess faculty research output, quality, impact, and productivity, the marketing discipline has yet to develop a comprehensive, generalizable benchmark for assessing scholar productivity. This study builds on and extends previous productivity benchmark studies by examining a considerably larger and more representative sample of over 1,000 marketing scholars from U.S. research-intensive schools and by assessing marketing scholar productivity ove...
1 CitationsSource
#2Aleksandar VenclH-Index: 12
Last. Pandora PsilakiH-Index: 1
view all 5 authors...
1 CitationsSource
#1Scott Eacott (UNSW: University of New South Wales)H-Index: 12
ABSTRACTAs a field of knowledge production, educational administration and leadership scholars do a substantial amount of talking past one another. These parallel monologues are a major issue for the advancement of knowledge. Original contributions can only be made in relation to others. That is, the innovation or significance of scholarship is an act of (social) scientific distinction. This means purposely engaging with the other. In this paper, I argue that the knowledge frontiers of education...
8 CitationsSource
In this study, research materials for the spatial concentration and utilization sharing of research equipment were surveyed, and then the effect factor and the effectiveness were analyzed based on ...
#1Andrei Dynich (DUT: Dalian University of Technology)H-Index: 1
#2Wang Yan-zhang (DUT: Dalian University of Technology)H-Index: 7
Changes in scientific interaction under penetration of e-commerce are considered.Benefits from introduction of e-commerce into the area of science are listed.Directions of advancement of science on the basis e-commercialization are forecasted.Steps towards improvement of assessment of labor of a scientist are proposed.Ways of socialization and commercialization of the scientific output are indicated. This work discusses the advancement of science and the penetration of e-commerce into modern sci...
1 CitationsSource
#1Yurij L. Katchanov (HSE: National Research University – Higher School of Economics)H-Index: 2
The paper is written with the assumption that the purpose of a mathematical theory of citation is to explain bibliometric regularities at the level of mathematical formalism. A mathematical formalism is proposed for the appearance of power law distributions in social citation systems. The principal contributions of this paper are an axiomatic characterization of citation distributions in terms of the Ekeland variational principle and a mathematical exploration of the power law nature of citation...
1 CitationsSource
#1Matt Elbeck (Troy University)H-Index: 7
#2Arne Baruca (Texas A&M University–San Antonio)H-Index: 3
This article proposes a journal-neutral Publication to Citation Ratio (PCR) to complement qualitative methods to evaluate a marketing educator’s scholarship for reappointment, promotion, tenure, and post-tenure review (RPTP) decisions. We empirically establish a minimum time period to evaluate scholarship data, then benchmark publication and citation counts from a sample of 270 marketing educators. The purpose is to equally represent the academic ranks and business school emphasis (teaching to r...
1 CitationsSource
#1Sara BarsantiH-Index: 6
#2Silvia GiovanelliH-Index: 1
Last. Sabina NutiH-Index: 12
view all 3 authors...
La ricerca rappresenta una delle tre attivita che contraddistinguono la triplice mission delle Aziende Ospedaliero- Universitarie. Questo articolo analizza metodi e proposte di indicatori bibliometrici di monitoraggio della ricerca che possono essere parte dei sistemi di valutazione multidimensionali della performance. Dopo un’introduzione sui sistemi di accountability per le attivita di ricerca e sul dibattito intorno alla validita degli indicatori bibliometrici, l’articolo presenta alcune espe...
1 CitationsSource