Rankings – a means of measuring quality?

Last year a rankings group comprised of administrators from various divisions in the University Administration was set up to deal with rankings-related matters. The group will primarily focus on strengthening analyses of the University’s rankings, but will also review how the University disseminates the results and whether we need to do anything to increase our chances of achieving better results in the measurements regularly carried out by various ranking organisations, the results of which are presented in the form of lists.

Emma Östlund is controller at the Planning Division and responsible for rankings-related matters.

“We’re just starting our efforts to broaden our approach to rankings. For the University to work effectively on rankings, the issue needs to be addressed more widely within the organisation. The rankings group is a first step in this direction.”

Challenges and opportunities

It is hard to say at present whether and how the current pandemic will affect rankings, but some signs can already be seen. For example, the number of international students is an indicator in several rankings, and the pandemic could clearly affect the outcome in that regard.

“Publications and citations are other key indicators in most rankings based on multi-year data series, but we don’t yet know how these factors will be affected by COVID-19. In order to detect trends over time, it will be necessary to develop bibliometric analyses linked to rankings, which in itself may provide a basis for broader discussion.”

Rankings have been criticised in the past, and it has been questioned whether they represent a valid measure of quality. But whatever the views may be on ranking organisations’ measurement methods, the University needs to take rankings into account, particularly when it comes to recruiting international researchers and students.

Newly appointed Vice-Chancellor Anders Hagfeldt said in his inaugural address that university rankings “should be taken with a few pinches of salt,” while also stressing that we must not shy away from rankings: “We should critically examine how rankings are produced and used, but should also develop other indicators of a university’s success and importance”.

“The Vice-Chancellor said he looks forward to discussions about the University’s views on rankings, how we can improve, and how we can make use of rankings. The topic of rankings will be discussed at the upcoming University Board meeting in April, as well as on other occasions,” Emma Östlund says.