Composite indicators (CIs) are a useful communication tool for conveying summary performance information in a relatively simple way. They are used widely in various sectors in public services. In Italy, they are also employed to allocate a quota of public funding to the universities. Despite increasing use, CIs value and benefit are still under debate and their suitability for the benchmark of universities is challenged by methodological issues and the multi-dimensional facet of higher education institutions. The issue addressed in the present work is whether the composite measure employed by the Italian Government is an accurate tool for evaluating, ranking and funding universities. For this purpose—after a revision of the indicators, weighting and aggregation methods put forward at the national level—CIs have been computed for the overall university perfor- mance, employing the indicators chosen at the national level and combining various weighting and normalisation schemes. The variation in the rankings assigned by the CIs to the given universities has been then explored to gauge its robustness. In the light of the results, some technical and analytical issues involved in the design of CIs and their policy implications are also discussed.
Measuring University Performance by Means of Composite Indicators: A Robustness Analysis of the Composite Measure Used for the Benchmark of Italian Universities
GNALDI, MICHELA;RANALLI, Maria Giovanna
2016
Abstract
Composite indicators (CIs) are a useful communication tool for conveying summary performance information in a relatively simple way. They are used widely in various sectors in public services. In Italy, they are also employed to allocate a quota of public funding to the universities. Despite increasing use, CIs value and benefit are still under debate and their suitability for the benchmark of universities is challenged by methodological issues and the multi-dimensional facet of higher education institutions. The issue addressed in the present work is whether the composite measure employed by the Italian Government is an accurate tool for evaluating, ranking and funding universities. For this purpose—after a revision of the indicators, weighting and aggregation methods put forward at the national level—CIs have been computed for the overall university perfor- mance, employing the indicators chosen at the national level and combining various weighting and normalisation schemes. The variation in the rankings assigned by the CIs to the given universities has been then explored to gauge its robustness. In the light of the results, some technical and analytical issues involved in the design of CIs and their policy implications are also discussed.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
