Showing posts with label Sutton Trust. Show all posts
Showing posts with label Sutton Trust. Show all posts

20 October 2011

UK Top Universities – The World’s View

Previous posts have attempted to identify what politicians like to call the UK’s ‘top universities’ or ‘most competitive universities’. Having recently come up with a Top 30 for 2012 by combining the four UK league tables, it seemed a useful check to see where our elite institutions stood in the various world-wide university rankings. Of these, the three most credible seem to be the Times Higher Education World University Rankings 2011-2012 (400 institutions), the QS World University Rankings 2011/2012 (700 institutions) and the Academic Ranking of World Universities – 2011 (500 institutions, and is sometimes known as the Shanghai Ranking).

The first Table below takes the UK's 2012 Top 30 and shows where they stand internationally (TH, QS and AR as above):
Be warned, the economist David Blanchflower has a low opinion of the QS rankings and has pointed out:
Note that since 2000, the faculty of the University of Cambridge has been awarded one Nobel Prize, in 2010, which was its first since 1984, while UCL and Oxford have both had none. Indeed, the University of Oxford's faculty hasn't received one since 1973. By contrast, MIT and Columbia have both had five; UC Berkeley has had four while Stanford, Rockefeller, Johns Hopkins, Chicago and Princeton have each had two and Harvard one.
He favours the Shanghai Ranking and thinks the QS one should be ignored. Nonetheless, the international rankings can be combined (see note below) and a differently-ordered UK Top set results (Russell Group and Sutton Trust shown as before):

Interestingly, certain universities which have become increasingly highly regarded domestically in recent years, for example Bath and Exeter, have a fairly low international standing by comparison with say, Bristol (all three in SW England, as it happens). Manchester, on the other hand, which had dropped out of my Top 30 since 2011 (and more significantly was ranked 29, 32, 37= and 41 in the four UK 2012 league tables) reappears well up. As well as Manchester, Aberdeen and Queen’s Belfast appear in all three international tables, and so have been added to the original Top 30. Perhaps something to think about, if you intend to make a career in a multinational or international academia.

NOTE ON RANKINGS

As usual rankings are added to give totals, and the lower that total the higher the combined rank. Banded scores have been mid-pointed, so 301-400 is taken as 350.5. SOAS and Aston do not appear in the AR 500 so have been nominated 501=, and again SOAS has had to be nominated 401 in the TH table. Perhaps they should be excluded altogether.

None of this should be taken too seriously. In neither the UK nor the international rankings, have I gone into the different criteria being used. Firstly, the rankings don’t vary that much, at least in the national tables. Secondly, as I hoped I made clear at the outset, it’s been an attempt to combine perceptions as to what might be a “top” university, the reality almost certainly being beyond measurement from the point of an individual student on a particular course of study.

4 October 2011

University League Tables (2012 update) and Participation

One of the most popular items on this blog has been University League Tables and Participation, posted in January 2011:
In a previous post (University Entrance - Today's 11+? ) I pointed out that the current participation rate in higher education in the UK was at a similar level to 11+ success and grammar school attendance in the 1960s. At that time, however, university was for an elite minority – less than 10% of the under 21 age group. Although this is no longer the case, there is a perception of there being an institutional elite, and arguably, for those choosing which universities to apply to, and for recruiters of graduates, the perception can be more important than the reality. This post looks at some possible shapers of these perceptions (league tables and elite groupings), and then revisits the statistics of participation.
The post combined the results of four published league tables (each one using its own assessment criteria, but with inevitable overlaps) to produce a listing of the top 30 universities. The league tables have been reissued for 2012 (by The Times, Sunday Times, Guardian and Complete University Guide) so I have taken the opportunity to update the table, again identifying the Russell Group, and the Sutton Trust’s ‘elite’ (ST13) and ‘highly selective’ (STHS) groups. Access to the ‘top universities’ continues to be a significant political issue and has come to be regarded as a key determinant of social mobility. For example, Ed Miliband used the words ‘top universities’ once, and ‘most competitive universities’ twice, in his speech at the Labour Party conference last week.  (UPDATE: However, David Cameron made no reference to universities in his speech to the Conservative Party conference on 5 October, with the education passage focussing on schools).


At the bottom of the 30, Manchester and Liverpool have been replaced by Surrey and Reading. Otherwise changes in ranking are probably not significant, particularly in the top 10.

The graph showing the capacity of the elite groupings alongside historic participation rates is taken from the earlier post – it is only meant to be illustrative and I have assumed that, for that purpose, the changes to the relevant data in one year are insignificant.


To find out how this Top 30 rates in the three international league tables, see my later post.

18 March 2011

Social Mobility and the Conscience of the Rich

Most of us do not make considerable fortunes – so who are we to criticise those who do or how they choose to spend their largesse? If rich men want to buy Picassos and lend them to the Tate, surely it’s up to them? Of course, there is a long history of charitable donations by the wealthy from Andrew Carnegie to Bill Gates, and recently two Britons who made fortunes in the financial services boom have set up charitable foundations to examine issues relating to social mobility.

The Sutton Trust was founded in 1997 by Sir Peter Lampl after a career in private equity in the US. “The main objective of the Sutton Trust is to improve educational opportunities for young people from non-privileged backgrounds and increase social mobility”. Clive Cowdery, who made a fortune in the insurance industry, in 2005 set up the Resolution Foundation, “an independent, not-for-profit research and policy organisation dedicated to improving the well-being of low-to-middle earners (LMEs) in today’s mixed economy”.

The Trust and the Foundation are registered charities with a similar modus operandi. The Sutton Trust sees itself as:
a 'do-tank' which not only undertakes research and advocates policy change, but also funds, develops and tests innovative practical solutions to educational inequality. The Trust is now focusing on research and policy work.
The Resolution Foundation undertakes:
original research and economic analysis to understand the challenges facing LMEs today. We develop practical and effective policy proposals to tackle the issues we identify, and we engage with policy makers and other key stakeholders to influence decision making and bring about change.
Both organisations employ “bright young things” to get the work done, “clever old things” as trustees, and are chaired by their founders. Both get frequent media coverage of their activities, the longer established Sutton Trust probably being better-known, but the Resolution Foundation recently sponsored a high-profile event with Ed Miliband as a speaker. Both undertake research relating to social mobility, the Sutton Trust, because of its interest in the inherently long-term benefits of education, tends to look at inter-generational issues. Resolution has recently published a report, “Moving on up? Social mobility in the 1990s and 2000s”. It compared how intra-generationally mobile people a group of people in their 30s had been in the 1990s with another younger group’s experience in their 30s during the 2000s.

The Resolution report received good press coverage, eg in the Financial Times on 11 March 2011 under the headline “Social mobility ‘increased 22% during 2000s’”:
Social mobility – at least as measured by earnings – increased during the past decade, according to a study that challenges the widely held view that social mobility is static or even in decline. Research focused on the earnings of people now in their thirties and early forties shows the chances of making a significant move up or down the earnings ladder remain pretty low.
But the work, by the Resolution Foundation, calculates there was a 22 per cent increase in the probability of moving significantly up the earnings distribution table in the 2000s compared with the 1990s. Back then, less than 3 per cent of people who started the decade in the bottom 20 per cent of earnings made it into the top 20 per cent by the end of the decade. In the 2000s that percentage remained low but had almost doubled to nearly 6 per cent.
Social mobility is a politically-loaded topic. Comparisons between the 1990s and the 2000s are to a large extent between the periods of Conservative and New Labour government, so evidence of improved social mobility after 2000 reflects well on Labour. Not that any party wants to neglect the issue. The Coalition Deputy Prime Minister, Nick Clegg, gave a speech on social mobility in August 2010 in which he said “our long-term social policy goal is social mobility” (though this was primarily directed at inter-generational mobility). It wasn’t surprising, then, that two members of the UK twitterati with long political antennae, Paul Waugh and John Rentoul, picked up on reports of the Resolution study, asking “What does this mean for the Coalition's narrative?” and “What does this mean for the media narrative?”, respectively. This post attempts to answer their questions – and fails.

The devil always lies in the detail, so the starting point in coming up with an answer was the Resolution report, in particular Section 3, which explains that the data for the older group came from the National Child Development Study (NCDS) and for the younger group from the British Cohort Study (BCS). NCDS attempts to follow through their lives all the people born in one week in England, Scotland and Wales in 1958. The second has aimed to follow all the children in England, Scotland and Wales born in one week in 1970. Among the data collected by NCDS and BCS from the individuals who make up these “cohorts” has been information about incomes. This provided the basis of the Resolution study which used changes in earnings as the measure of mobility. Table 1 of the report (page 9, reproduced below) summarises the data sets that were used.
It is important at this point to realise that “Sample size” here refers to the number of individuals whose data was selected by Resolution from the respective NCDS and BCS cohorts. How and why this was done is explained in Appendix A and attention should be paid to Tables A1 and A2. In essence, individuals who had negative or zero earnings and individuals who were self-employed (“due to the unreliability of earnings data for that group”) were excluded.

Using the data in Table A1 it is possible to reconstruct the “Economic Activity” of the total NCDS cohort of 11469 (apparently) individual and compare it with that of the 5903 in the Resolution sample:

Again, the effect of the exclusion applied to produce the Resolution sample from the total NCDS cohort can be seen in the “Social Class” percentages:

Something similar happens with the BCS-derived sample:

Appendix A recognises the apparent over-representation of the higher social classes, particularly in the BCS sample, but goes on to argue:
To test the effect of this on our findings of mobility we re-ran the regression of log earnings found in Table A5 of the Appendix B but with respondents from the managerial and skilled manual social classes excluded from both cohorts. The results are shown in Table A3 and are purely indicative as exclusion of the managerial and skilled manual classes removes 57 percent of respondents from the NCDS sample and 65 percent from the BCS sample. Using these reduced samples, mobility is still significantly higher among the 2000s BCS cohort than the 1990s NCDS cohort. However, we acknowledge that the increased probability of inclusion in the BCS cohort due to respondents being a member of the managerial or skilled manual classes may have increased the overall estimate, but not reduced its significance.
The Resolution report then says:
Another point to note is that the rate of exclusion overall is much higher in the BCS cohort where the excluded sample contained 2,105 more respondents than the final research sample. In comparison, the NCDS excluded sample contained 337 fewer respondents than the final research sample.
This is more easily understood by reference to the table below:
The report then states:
The reason for this is likely to be the data collection methodology of the 2008 BCS survey which used a telephone interview rather than the face-to-face interview used in other NCDS and BCS surveys. Telephone interviews tend to have lower response rates than face-to-face interviews and overall attrition between the start and end points of the BCS survey (2000 and 2008) used in this research was higher than between the start and end points of the NCDS survey (1991 and 2000).
To understand the expression “start and end points” it is helpful to look at the website of the Centre for Longitudinal Studies (CLS, part of the University of London’s Institute of Education). Their NCDS page explains that the NCDS cohort (considered to be 16240 individuals) was surveyed in 1991 and 1999/2000 at the ages of 33 and 42 (cf Table 1 quoted above) and that samples of 11407 and 11419 (about 70%) were achieved. Neither of these figures is exactly the 11469 Resolution figure, but not far off, and there certainly wasn’t any “attrition” between the two surveys.

The Centre’s BCS pages are more problematic. They confirm the Resolution figure of 11261 30-year olds (out of a target 16068, again 70%) surveyed in 1999/2000 (Table 1 again) but provide little data about the 2008 telephone survey, although “the dataset will be available from the UK Data Archive in September 2010”. It turns out that the National Centre for Social Research (NCSR) was contracted by CLS to undertake the 2008 survey, and their Technical Report is available. This reveals that the intention was to survey 11843 of the BCS cohort as selected by CLS and that 8874 telephone interviews were achieved (75%) by NCSR. However, how many of these 8874 were excluded by Resolution as being self-employed or without income is not clear. If 40 % were excluded, as was the case for the 1999/2000 BCS dataset, that would have given a sample of about 3600 individuals. However, this would not be consistent with the statement in Section 3 of the report: “The size of the cohort samples which are above 4,500 in both [NCDS and BCS] cases”.

Not being a social scientist (probably apparent in previous posts about IEA and IPPR) I accept that I lack a proper appreciation of the difficulties such work presents in terms of data. Having acquired the earnings numbers, Resolution, I’m sure, crunched them competently to produce the tabulations of transitions and estimates of mobility. I wonder, however, about the errors in the data that might derive from the exclusions made by Resolution from both the NCDS and BCS datasets. Also, it is not clear how Resolution treated the much smaller 2008 BCS dataset. Its reduced size was not exactly due to “attrition” (a problem which develops over time with all longitudinal surveys) but to a change in methodology. Is it possible that moving to a telephone survey introduced a bias towards individuals with higher earnings?  Anyway, putting it crudely, the report seems to show that in the 1990s, when incomes generally were rising, the NCDS group were all getting better off with small relative changes (all boats rising with the tide) ie there was high absolute mobility.  In the 2000s, a period of largely stagnant incomes, the younger group experienced bigger relative changes (snakes and ladders).  The characteristics of the winners and losers in relative terms is going to be the subject of future Resolution research.    
So, to return to the Waugh/Rentoul questions – I don’t think I can help! Apart from pointing out that the government is more interested in inter-generational than the intra-generational mobility which Resolution was attempting to address.

What should rich men with a conscience, and a broader interest in society than making money out of it, do with their money? Of course it’s up to them if they want to set up think tanks to investigate hobby-horse issues. (Personally I would want to emulate Bryan Ferry and collect modern British art!) I do wonder, though, whether mainstream politics, where the full breadth of social issues and claims on public money have to be addressed, might be a better outlet for these undoubtedly clever and energetic individuals (quite a few of the current Cabinet seem to have made a pile). It seems undemocratic to me that certain single issues can gain more attention than they deserve, by comparison with others which don’t happen to be rich men’s fancies.

13 January 2011

University League Tables and Participation

The data in the Table below has been updated in a later post.

In a previous post ( University Entrance - Today's 11+? ) I pointed out that the current participation rate in higher education in the UK was at a similar level to 11+ success and grammar school attendance in the 1960s.  At that time, however, university was for an elite minority – less than 10% of the under 21 age group. Although this is no longer the case, there is a perception of there being an institutional elite, and arguably, for those choosing which universities to apply to and for recruiters of graduates, the perception can be more important than the reality. This post looks at some possible shapers of these perceptions ('league tables' and elite groupings), and then revisits the statistics of participation.

There are currently four league tables of UK universities published by the Independent, Guardian, Sunday Times and Times newspapers. Taking the top 30 in each case, they consist of 41 different institutions. However, 22 of the 41 feature in all four tables. Also, 11 of the 41 feature in only one, so an overall top 30 can be identified as those institutions appearing in more than one league table, and their rankings can be combined as below. There are three other groupings of highly-rated institutions which can be put alongside the league tables. The Russell Group of 20 major research universities is regarded as being an elite. Also, the Sutton Trust, which looks at issues of social mobility and access to higher education, has identified for its purposes a group of 13 elite universities and a larger group of 30 which it regards as highly selective. The table below indicates which of the 'Top 30' universities fall into these three groups (RG, ST13 and STHS respectively).



A graph in the previous post showed how university participation has increased since the 1960s. Using UCAS statistics for the undergraduate numbers at each university, the proportion of the under 21’s which various groupings of universities within the 'Top 30' are recruiting can be calculated, and the levels are indicated on the new graph below.  The 4.2% for the 'Top 12' cater for the mid-60s level of participation


Of course, there are obvious limitations in drawing up a league table of universities – there are going to be excellent courses and very able students in the many unlisted institutions. Individual circumstances can be overriding as well – if your family owns a chain of golf courses, you might well want to go for the best golf course management degree wherever it may. However, if your aspiration is to take a humanities degree – one of the many flavours of history, say – but then move into management, the perception a future employer may have of your university is a factor which can’t be ignored. Being at one of the universities in the table above, particularly in the top half, is unlikely to stand in your way; although it won’t be the only thing they will be looking for.


Notes on the Table and Chart

As last time, this is a blog post not a PhD thesis, so I have used a broad brush with the data.

From 1950 to 1998 the graph shows the Age Participation Index (API) which was defined as the number of UK-domiciled young (aged less than 21) initial entrants to full-time and sandwich undergraduate courses of higher education, expressed as a proportion of the averaged 18 to 19 year old GB population. After 1999 the data is for the Higher Education Initial Participation Rate HEIPR20 (17-20 year olds English domiciled and in English Welsh and Scottish institutions).

Positions in the individual league tables were added (Oxford, 1st in all four, scoring 4 etc). A university unplaced in a particular league table was assumed to be 31st equal if it appeared in the other three tables, 32nd equal if it appeared in only one other table. UCAS provides numbers for undergraduates for each university, (all courses are assumed here to be of three years), and percentages for mature and international students. Hence the places available to the HEIPR20 contingent, the recent overall size and participation rate for this being provided by the BIS Department. The decimal place in the statistics for the groupings (eg Russell Group 9.2%) should probably be ignored.