It’s been a while since I posted anything in the bad statistics file, but an article in today’s Grauniad has now given me an opportunity to rectify that omission.
The piece concerned, entitled Racism on the rise in Britain is based on some new data from the British Social Attitudes survey; the full report can be found here (PDF). The main result is shown in this graph:
The version of this plot shown in the Guardian piece has the smoothed long-term trend (the blue curve, based on a five-year moving average of the data and clearly generally downward since 1986) removed.
In any case the report, as is sadly almost always the case in surveys of this kind, neglects any mention of the statistical uncertainty in the survey. In fact the last point is based on a sample of 2149 respondents. Suppose the fraction of the population describing themselves as having some prejudice is . For a sample of size with respondents indicating that they describe themselves as “very prejudiced or a little prejudiced” then one can straightforwardly estimate . So far so good, as long as there is no bias induced by the form of the question asked nor in the selection of the sample…
However, a little bit of mathematics involving the binomial distribution yields an answer for the uncertainty in this estimate of p in terms of the sampling error:
For the sample size given, and a value this amounts to a standard error of about 1%. About 95% of samples drawn from a population in which the true fraction is will yield an estimate within , i.e. within about 2% of the true figure. This is consistent with the “noise” on the unsmoothed curve and it shows that the year-on-year variation shown in the unsmoothed graph is largely attributable to sampling uncertainty; note that the sample sizes vary from year to year too. The results for 2012 and 2013 are 26% and 30% exactly, which differ by 4% and are therefore explicable solely in terms of sampling fluctuations.
I don’t know whether racial prejudice is on the rise in the UK or not, nor even how accurately such attitudes are measured by such surveys in the first place, but there’s no evidence in these data of any significant change over the past year. Given the behaviour of the smoothed data however, there is evidence that in the very long term the fraction of population identifying themselves as prejudiced is actually falling.
Newspapers however rarely let proper statistics get in the way of a good story, even to the extent of removing evidence that contradicts their own prejudice.Follow @telescoper
This entry was posted on May 28, 2014 at 2:20 pm and is filed under Bad Statistics, Politics with tags binomial distribution, British Social Attitudes Survey, racism, sampling uncertainty, statistics. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.