We analyse some individual indicators related to the evaluation of re- search products of Universities put forward by the Italian Steering Committee for Research Evaluation (CIVR). The underlying structure of the data has been examined by means of Factor Analysis to explore the relationships among individual indicators and the existence of common dimensions of academic research. A set of individual indicators has been selected to construct a composite indicator (CI) of scientific research for the Universities considered. To this objective, five normalisation methods, a weighting scheme, and two aggregation schemes have been computed and combined, resulting in 135 CIs. The variation in the rankings assigned by the CIs to the Universities has been explored to gauge the robustness of the CIs rankings and to assesses the contribution of the individual sources of uncertainty.
Ranking the Italian universities: a sensitivity analysis of research performance composite indicators
GNALDI, MICHELA;RANALLI, Maria Giovanna
2009
Abstract
We analyse some individual indicators related to the evaluation of re- search products of Universities put forward by the Italian Steering Committee for Research Evaluation (CIVR). The underlying structure of the data has been examined by means of Factor Analysis to explore the relationships among individual indicators and the existence of common dimensions of academic research. A set of individual indicators has been selected to construct a composite indicator (CI) of scientific research for the Universities considered. To this objective, five normalisation methods, a weighting scheme, and two aggregation schemes have been computed and combined, resulting in 135 CIs. The variation in the rankings assigned by the CIs to the Universities has been explored to gauge the robustness of the CIs rankings and to assesses the contribution of the individual sources of uncertainty.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
