From Wikipedia, the free encyclopedia

The THES - QS World University Rankings is an annual publication of university rankings around the world, published by The Times Higher Education Supplement (THES) and Quacquarelli Symonds (QS). THES ranking has been criticized by many in the United States and other places in the world as “irrelevant,” “non-representative,” and even “self-promoting” because of using categories that would highly favor British universities. Notably, 2-3 British universities consistently rank among the top five in the world in THES ranking, which are often not even ranked in the top ten according to all other global university rankings (Cambridge University being the exception). The Academic Ranking of World Universities by Shanghai University and the ranking of world universities by Newsweek are generally more respectable and widely recognized.

The ranking weights are:

• Peer Review Score (40%)
• Recruiter Review (10%)
• International Faculty Score (5%)
• International Students Score (5%)
• Faculty/Student Score (20%)
• Citations/Faculty Score (20%).

Contents 1 Commentary 2 Controversy 3 References 4 See also 5 External links

The Guardian^[1] and The Times^[2] report on the findings.

Many universities in UK and the Asia-Pacific region (where the Times is well-known) have also commented on the credibility of the rankings. Vice-Chancellor of Massey University, Professor Judith Kinnear says the THES-QS ranking is a “wonderful external acknowledgement of several University attributes, including the quality of its research, research training, teaching and employability.“ She says the rankings are a true measure of a university’s ability to fly high internationally: “The Times Higher Education ranking provides a rather more sophisticated, robust and well rounded measure of international and national ranking than either New Zealand’s Performance Based Research Fund (PBRF) measure or the Shanghai rankings.” ^[3]

National University of Singapore (NUS) President Professor Shih Choon Fong said, "We are encouraged and heartened to be ranked once again among the world's leading universities …In our continuing pursuit of excellence in education and research, NUS can contribute to Singapore's rising reputation and visibility in the global higher education landscape." ^[4].

Ian Leslie, the pro-vice chancellor for research at Cambridge University said: "It is very reassuring that the collegiate systems of Cambridge and Oxford continue to be valued and respected by peers, and that the excellence of teaching and of research at both institutions is reflected in this ranking." ^[5]

The vice-chancellor of Oxford University, John Hood, said: "The exceptional talents of Oxford's students and staff are on display daily. This last year has seen many faculty members gaining national and international plaudits for their teaching, scholarship and research, and our motivated students continue to achieve in a number of fields, not just academically. Our place amongst the handful of truly world-class universities, despite the financial challenges we face, is testament to the quality and the drive of the members of this university." ^[6]

Vice-Chancellor of the University of Wollongong in Australia, Professor Gerard Sutton, said the ranking was a testament to a university’s standing in the international community, identifying… “an elite group of world-class universities.” ^[7]

The THES - QS World University Rankings had attracted criticisms ever since it was first published in 2004. The Rankings have been criticized^[8] for placing too much emphasis on peer review, which receives 40% of the overall score. Some have expressed concern on the manner in which the peer review has been carried out. In a certain report^[9], Peter Wills from the University of Auckland, New Zealand wrote of the QS-THES Ranking:

"But we note also that this survey establishes its rankings by appealing to university staff, even offering financial enticements to participate (see Appendix II). Staff are likely to feel it is in their greatest interest to rank their own institution more highly than others. This means the results of the survey and any apparent change in ranking are highly questionable, and that a high ranking has no real intrinsic value in any case. We are vehemently opposed to the evaluation of the University according to the outcome of such PR competitions."

Some errors have also been reported on the faculty-student ratio used in the ranking. At the 16th Annual New Zealand International Education Conference held at Christchurch, New Zealand in August 2007, Simon Marginson presented a paper^[10] which outlines the fundamental flaws underlying the QS-THES Rankings. A similar article^[11] (also published by the same author) appeared in The Australian newspaper in December 2006. Some of the points mentioned include:

1. Half of the THES index is comprised by existing reputation: 40 per cent by a reputational survey of academics (‘peer review’), and another 10 per cent determined by a survey of ‘global employers’. The THES index is too easily open to manipulation as it is not specified who is surveyed or what questions are asked. By changing the recipients of the surveys, or the way the survey results are factored in, the results can be shifted markedly.
2. The pool of responses is heavily weighted in favour of academic ‘peers’ from nations where the Times is well-known, such as the UK, Australia, New Zealand, Malaysia and so on.
3. Results have been highly volatile. There have been many sharp rises and falls, especially in the second half of the THES top200 where small differences in metrics can generate large rankings effects. Fudan in China has oscillated between 72 and 195, RMIT in Australia between 55 and 146. In the US, Emory has risen from 173 to 56 and Purdue fell from 59 to 127.
4. The performance of the Australian universities is also inflated. Despite a relatively poor citation rate and moderate staffing ratios they do exceptionally well in the reputational academic survey and internationalisation indicators, especially that for students. Australia has 13 of the THES top 200 and appears as the third strongest system in the world, ahead of Japan, Canada, Germany and western Europe (the G7 nations). This makes sense in relation to Australia’s international marketing but not all round performance or reputation.
5. It's good when people say nice things about you, but it is better when those things are true. It is hard to resist the temptation to use the THES rankings in institutional marketing, but it would be a serious strategic error to assume that they are soundly based.

Although THES-QS had introduced several changes in methodology in 2007 which were aimed at addressing some of the above criticisms^[12], the ranking has continued to be controversial. In an article^[13] in the peer-reviewed BMC Journal authored by several scientists from USA and Greece, it was pointed out:

"If properly performed, most scientists would consider peer review to have very good construct validity; many may even consider it the gold standard for appraising excellence. However, even peers need some standardized input data to peer review. The Times simply asks each expert to list the 30 universities they regard as top institutions of their area without offering input data on any performance indicators. Research products may occasionally be more visible to outsiders, but it is unlikely that any expert possesses a global view of the inner workings of teaching at institutions worldwide. Moreover, the expert selection process of The Times is entirely unclear. The survey response rate among the selected experts was only <1% in 2006 (1 600 of 190 000 contacted). In the absence of any guarantee for protection from selection biases, measurement validity can be very problematic."

Alex Usher, Vice President of the Educational Policy Institute in USA, commented:^[14]

"Most people in the rankings business think that the main problem with the Times is the opaque way it constructs its sample for its reputational rankings - a not-unimportant question given that reputation makes up 50% of the sample. Moreover, this year's switch from using raw reputation scores to using normalized Z-scores has really shaken things up at the top-end of the rankings by reducing the advantage held by really top universities - University of British Columbia (UBC) for instance, is now functionally equivalent to Harvard in the Peer Review score, which, no disrespect to UBC, is ludicrous. I'll be honest and say that at the moment the THES Rankings are an inferior product to the Shanghai Jiao Tong's Academic Ranking of World Universities."

The latest criticism of the QS-THES league tables came from Andrew Oswald, Professor or Economics at University of Warwick:^[15]

"Such claims do us a disservice. The organisations who promote such ideas should be unhappy themselves, and so should any supine UK universities who endorse results they view as untruthful. Using these league table results on your websites, universities, if in private you deride the quality of the findings, is unprincipled and will ultimately be destructive of yourselves, because if you are not in the truth business what business are you in, exactly? Worse, this kind of material incorrectly reassures the UK government that our universities are international powerhouses. Let us instead, a bit more coolly, do what people in universities are paid to do. Let us use reliable data to try to discern the truth. In the last 20 years, Oxford has won no Nobel Prizes. (Nor has Warwick.) Cambridge has done only slightly better. Stanford University in the United States, purportedly number 19 in the world, garnered three times as many Nobel Prizes over the past two decades as the universities of Oxford and Cambridge did combined. "

• College and university rankings

• Official 2007 Rankings - Top 400
• Times Higher Education - official website
• QS - official website and full top 200 listings from 2006
• 2005 Rankings
• University Ranking Watch
• THES World University Rankings 2004/2006
• World University Rankings 2003 to 2007