Why Universities should ignore League Tables
Very busy day today but I couldn’t resist a quick post to draw attention to a new report by an independent think tank called the Higher Education Policy Institute (PDF available here; high-level summary there). It says a lot of things that I’ve discussed on this blog already and I agree strongly with most of the conclusions. The report is focused on the international league tables, but much of what it says (in terms of methodological criticism) also applies to the national tables. Unfortunately, I doubt if this will make much difference to the behaviour of the bean-counters who have now taken control of higher education, for whom strategies intended to ‘game’ position in these, largely bogus, tables seem to be the main focus of their policy rather than the pursuit of teaching and scholarship, which is what should universities actually be for.
Here is the introduction to high-level summary:
Rankings of global universities, such as the THE World University Rankings, the QS World University Rankings and the Academic Ranking of World Universities claim to identify the ‘best’ universities in the world and then list them in rank order. They are enormously influential, as universities and even governments alter their policies to improve their position.
The new research shows the league tables are based almost exclusively on research-related criteria and the data they use are unreliable and sometimes worse. As a result, it is unwise and undesirable to give the league tables so much weight.
Later on we find some recommendations:
The report considers the inputs for the various international league tables and discusses their overall weaknesses before considering some improvements that could be made. These include:
- ranking bodies should audit and validate data provided by universities;
- league table criteria should move beyond research-related measures;
- surveys of reputation should be dropped, given their methodological flaws;
- league table results should be published in more complex ways than simple numerical rankings; and
- universities and governments should not exaggerate the importance of rankings when determining priorities.
No doubt the purveyors of these ranking – I’ll refrain from calling them “rankers” – will mount a spirited defence of their business, but I agree with the view expressed in this report that as they stand these league tables are at best meaningless and at worst damaging.Follow @telescoper