Showing posts with label the numbers game. Show all posts
Showing posts with label the numbers game. Show all posts

Monday, November 19, 2012

The psephological calculus

The US presidential election now seems like ages ago, but this Guardian interview is a good reminder of why analysts like Nate Silver are important.

Political commentary could use a lot more cool-headed analysis and less tendentious windbaggery.

Or, as Silver puts it:

"Numbers aren't perfect, but for me, it's numbers with all their imperfections versus bullshit. You had people saying, 'You can't quantify people's feelings through numbers!' But what's the alternative? Me sitting at my Georgetown cocktail party saying that I know how people in Toledo, Ohio, are going to vote better than the actual people of Toledo, Ohio, who answered a survey? It's incredibly presumptuous. And truth is an absolute defence. So if they got it right it would be one thing, but they didn't. They're consistently quite wrong."

Quite remarkably, reading this interview makes me want to take a statistics class.

Thursday, January 19, 2012

Outrage by the numbers

You may have noted a bit of outrage regarding the revelation that London's Metropolitan Police spent £35,000 on calls to the 'speaking clock' (a telephone service to provide callers with the precise time) in the last two years.

(Well, you may have noticed it if you read the Daily Mail, and I know that not all of you indulge in that particular pleasure.)

Not that I always necessarily feel like standing up for the boys in blue, but I thought I would point out James Ball's interesting article at the Guardian today, where he takes a closer look at this expense, finding:


So what does the spend on the speaking clock represent? The force spent £16,879 on calls to the service in 2010/11. At 31p per call, that's just under 54,500 calls over the year.

That works out as 1.5 calls to the speaking clock for each officer, or in other words represents each officer in the force using the service just once or twice each year.

Is that unreasonable? Accurate time is occasionally important to police, when noting chronologies in reports or ahead of operations.

It's not hard to imagine police officers needing to sync their watches (or phones) on particular operations on occasion, or perhaps occasionally mistrusting their computer's clock when trying to timestamp a report.

The rest is worth reading as well.

I would admit to finding it a bit odd that a such a clunky seeming technology as the speaking clock would still be in semi-regular usage, and for this reason I probably would have smirked as well on first seeing this kind of headline.

Still, as Ball points out, the Met has a budget of four billion pounds a year, and with an enormous staff, small costs per officer add up quickly.





Wednesday, August 19, 2009

Charts and graphs

Just a couple of the more interesting visualisations of data that I've run across in the last 24 hours or so.

Evaluating the US health-care debate with regard to truthiness:


Background. Via.



Also, the number of nuclear weapons in the world:


Source, Wikimedia Commons. Source for underlying numbers. Via and discussion.

Thursday, December 04, 2008

The calculus of the caring society

I'm not really much of a numbers guy, but I was struck by a recent post by Ben Goldacre at his Bad Science blog which highlights the care that needs to be taken when using statistics to measure changing social attitudes.

More accurately, he--for, like, the thousandth time--points out how the media fail to take this care.

My interest in this issue has increased, as I'm currently making my first forays into using serious quantitative data for a historical study. Indeed, I spent much of the last two days trying to come to grips with pivot tables so that I can make some sense of the information I've been carefully collating and entering into a spreadsheet.

Some of you may have gotten drowsy simply reading those last two sentences, and not long ago I might have been with you; however, I'm starting to find something exciting about making numbers do various little dances. (And, after a period of wanting to throw my laptop against the wall out of frustration, I seem to have gotten my tables to do what they are supposed to.)

I have the good fortune of working with a colleague who knows his way around numbers, and I've become increasingly aware of how much discipline is required in teaching your figures the requisite dance steps. This is especially so in cases when you're trying to use that data to tell you about such nebulous topics as 'cultural attitudes' or 'social life'.

The specific topic of Goldacre post was a recent spate of stories suggesting that there had been a shift toward a more 'caring society' based on a figure showing a greater number of births of children with Down syndrome. The logic behind this, I think, is that the growth in Down syndrome births showed a greater willingness to bring such pregancies to term. A number of media sources took this story and ran with it, expanding on the notion that this figure might tell us something meaningful about social attitudes.

And, yes, maybe they have changed in some positive ways.

But Goldacre points out the key problem with drawing that conclusion from that figure: while more Down pregnancies are being brought to term, there is another factor that needs to be taken into account in order to place that in its correct context:

There has indeed been a 4% increase in Down’s syndrome live births in England and Wales from 1989 to 2006 (717 and 749 affected births in the two years respectively). However, since 1989 there has also been a far greater increase in the number of Down syndrome foetuses created in the first place, because people are getting pregnant much later in life.

What causes Down syndrome? We don’t really know, but maternal age is the only well-recognised association. Your risk of a Down syndrome pregnancy below the age of 25 is about 1 in 1600. This rises to about 1 in 340 at 35, and 1 in 40 at the age of 43. In 1989 6% of pregnant women were over 35 years of age. By 2006 it was 15%.

I was not aware of the age-at-birth link to Down syndrome. (My mother was about to turn 44 when I was born. 1 in 40 might sound like long odds to you, but they're not long enough if you ask me...)

But what does this shift in birth patterns mean for claims of a more caring society?

Well:

The National Down Syndrome Cytogenetic Register holds probably the largest single dataset on Down syndrome, with over 17,000 anonymous records collected since 1989, and one of the most reliable resources in the search for patterns and possible causal factors. They have calculated that if you account for the increase in the age at which people are becoming pregnant, the number of Down’s Syndrome live births in the UK would have increased from 1989 to 2006: not by 4%, but from 717 to an estimated 1454, if screening and subsequent terminations had not been available.

Except, of course, antenatal screening is widely available, it is widely taken up, and contrary to what every newspaper told you this week, it is widely acted upon. More than 9 out of ten women who have an antenatal diagnosis of Down’s syndrome decide to have a termination of the pregnancy. This proportion has not changed since 1989. This is the “decisions” that Felicity Finch, Radio 4, the Mail, the Times, the Mirror, and the rest are claiming more parents are taking: to carry on with a Down syndrome pregnancy. This is what they are taking as evidence of a more caring society. But the figure has not changed.

While I'm interested in this story largely as a cautionary tale for the misuse of statistical data leading to the misunderstanding of society (which is a problem that is magnified in a historical context, when the statistics are a bit more iffy and our other information about social context more partial), Goldacre points out that there is a more direct reason why such stories are problematic.

Crass and insensitive moral reasoning helps nobody. If I terminate a Down syndrome pregnancy, is that proof that society is not a warm caring place, and that I am not a warm caring person? For many parents the decision to terminate will be a difficult and upsetting one, especially later in life, and stories like this make a pretty challenging backdrop for making it. This would have been true even if their figures had been correct, but as is so often the case, for those with spare flesh to wave at strangers, their facts and figures are simply incorrect.
He also links to further background provided by the NHS, if you care to look.