The Academic Journal Ranking Problem consists in formulating a formal assessment of scientific journals. An outcome variable must be constructed that allows valid journal comparison, either as a set of tiers (ordered classes) or as a numerical index. But part of the problem is also to devise a procedure to get this outcome, that is, how to get and use relevant data coming from expert opinions or from citations database. We propose a novel approach to the problem that applies fuzzy cluster analysis to peer reviews and opinion surveys. The procedure is composed of two steps: the first is to collect the most relevant qualitative assessments from international organizations (for example, the ones available in the Harzing database) and, as inductive analysis, to apply fuzzy clustering to determine homogeneous journal classes; the second deductive step is to determine the hidden logical rules that underlies the classification, using a classification tree to reproduce the same patterns of the first step. Our approach is applied to the classification of 138 academic journals that were selected by members of AMASES, an Italian mathematics association, as the most prominent journals of our field. The clusters that are determined by our method show that rankings are affected by two hidden dimensions: one is the academic prestige of a publication, but the other is the disciplinary diffusion of a mathematics subfield. In particular, mathematics journals that are close to finance or economics are usually ranked better than journals dealing with linear algebra or systems dynamics. © 2011 Springer Science+Business Media, LLC.

Benati, S., Stefani, S. (2011). The Academic Journals Ranking Problem: a Fuzzy Clustering Approach. JOURNAL OF CLASSIFICATION, 28(1), 7-20 [10.1007/s00357-011-9072-1].

The Academic Journals Ranking Problem: a Fuzzy Clustering Approach

STEFANI, SILVANA
2011

Abstract

The Academic Journal Ranking Problem consists in formulating a formal assessment of scientific journals. An outcome variable must be constructed that allows valid journal comparison, either as a set of tiers (ordered classes) or as a numerical index. But part of the problem is also to devise a procedure to get this outcome, that is, how to get and use relevant data coming from expert opinions or from citations database. We propose a novel approach to the problem that applies fuzzy cluster analysis to peer reviews and opinion surveys. The procedure is composed of two steps: the first is to collect the most relevant qualitative assessments from international organizations (for example, the ones available in the Harzing database) and, as inductive analysis, to apply fuzzy clustering to determine homogeneous journal classes; the second deductive step is to determine the hidden logical rules that underlies the classification, using a classification tree to reproduce the same patterns of the first step. Our approach is applied to the classification of 138 academic journals that were selected by members of AMASES, an Italian mathematics association, as the most prominent journals of our field. The clusters that are determined by our method show that rankings are affected by two hidden dimensions: one is the academic prestige of a publication, but the other is the disciplinary diffusion of a mathematics subfield. In particular, mathematics journals that are close to finance or economics are usually ranked better than journals dealing with linear algebra or systems dynamics. © 2011 Springer Science+Business Media, LLC.
Articolo in rivista - Articolo scientifico
Classification tree; Fuzzy clustering model; Harzing data base; Impact Factor; Journal quality problem
English
2011
28
1
7
20
none
Benati, S., Stefani, S. (2011). The Academic Journals Ranking Problem: a Fuzzy Clustering Approach. JOURNAL OF CLASSIFICATION, 28(1), 7-20 [10.1007/s00357-011-9072-1].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/21580
Citazioni
  • Scopus 13
  • ???jsp.display-item.citation.isi??? 11
Social impact