« Gladwell on Prescription Drugs | Main | How much does a gallon of pickles cost? »
Margins of Error
The usually indispensable electoral-vote.com, which I check eagerly every morning, today contains the following howler:
Remember that Zogby saying PA is a (47-47) tie means the pollster is predicting that there is a 95% chance that the true score for each candidate falls in the range 43% to 51%, no more and no less.
Of course it means much more; for example it means that the candidates are substantially more likely to be about one point apart than to be about four points apart. But electoral-vote.com compounds the error:
All the battleground states are statistical ties. A couple of percent lead means nothing
Acutally, as no reader of marginalrevolution.com will need to be told, the candidate with a 2% lead among those surveyed, if that lead is within the reported "margin of error" has less than a 95% chance, but still greater than a 50% chance, of having the lead among the public at large (ignoring, of course, all of the potential problems with surveys other than sampling error.)
Since everyone knows this, it's hardly worth pointing out, except for the fact that these silly statements about margins of error have become ubiquitous in the press, and it's worth asking why. Surely it must be obvious to all reporters and most readers that it's better to have a two point lead in the polls than a two point deficit. So why does everyone keep saying otherwise?
Posted by Steve Landsburg on October 29, 2004 at 12:53 PM in Current Affairs, Political Science | Permalink
TrackBack
TrackBack URL for this entry:
http://www.typepad.com/t/trackback/3576/1340732
Listed below are links to weblogs that reference Margins of Error:
» Statistical Illiteracy from The Cranky Professor
I really do think that if I ran a major newspaper I would require people who intended to use statistics... [Read More]
Tracked on Oct 29, 2004 5:29:48 PM
» Bad Surveys from Truck and Barter
I'd like to state my views on survey error clearly, but I have to write quickly, so you should expect some oddities in what follows: IMHO, we have no reason (i.e. statistical theory) to expect political polls to be consistent with one another. Most pol... [Read More]
Tracked on Oct 30, 2004 5:24:59 PM
» HOW TO READ POLLS from Pejmanesque
Courtesy of Steve Landsbug. It's rather amazing how many people don't know this information and parrot the wrong information regarding margins of error. UPDATE: Here is a very good post guaranteed to give heartburn to anyone taking comfort in the... [Read More]
Tracked on Oct 31, 2004 9:31:09 PM
» Useful Statistics from voluntaryXchange
Pollsters and the media have been lying very badly about polls and what they tell us. I refuse to be shy about this: the polls had the big question right (that Bush would win), yet they systematically lied by repeatedly [Read More]
Tracked on Nov 3, 2004 1:41:00 PM
» Legacy Media Liars from voluntaryXchange
Pollsters and the media have been lying very badly about polls and what they tell us. I refuse to be shy about this: the polls had the big question right (that Bush would win), yet they systematically lied by repeatedly [Read More]
Tracked on Nov 3, 2004 1:43:29 PM
» Legacy Media Liars from voluntaryXchange
Pollsters and the media have been lying very badly about polls and what they tell us. I refuse to be shy about this: the polls had the big question right (that Bush would win), yet they systematically lied by repeatedly [Read More]
Tracked on Nov 3, 2004 1:50:53 PM
» Legacy Media Liars from voluntaryXchange
Pollsters and the media have been lying very badly about polls and what they tell us. I refuse to be shy about this: the polls had the big question right (that Bush would win), yet they systematically lied by repeatedly [Read More]
Tracked on Nov 3, 2004 3:00:33 PM





