In Hindsight, Those Presidential Polls Looked Just Fine | WAMU 88.5 - American University Radio

NPR : News

Filed Under:

In Hindsight, Those Presidential Polls Looked Just Fine

For as much criticism as pollsters endured in the run-up to Election Day, a look back shows many of them hit very close to the bull's-eye for the presidential race — but some did better than others.

Take the venerable Gallup. It had Mitt Romney at 49 percent and President Obama at 48 percent in a poll published Monday, a day before the voting. And when undecided voters were split up among candidates, Gallup put the figure at 50 percent Romney, 49 percent Obama.

The actual outcome: Obama 50 percent; Romney 48 percent — within Gallup's margin of error of plus or minus 2 percentage points.

"Our final estimate of the national popular vote was actually fairly accurate," says Frank Newport, Gallup's editor-in-chief. "It was within a point or two of what the [candidates] got. In a broad sense, it was pretty close."

Peter Enns, a professor at Cornell University's Institute for the Social Sciences, agrees that most of the polls fell within the margin of error.

The biggest challenge for pollsters, and the one that accounts for most of the variation among them, is figuring out who will show up on Election Day to vote, Enns says.

It's the difference between registered voters and likely voters.

"About a week ago, Gallup had Romney up by 5 percent — and that's substantial if the margin of error is plus or minus 3 percentage points — but among registered voters, they had Romney up by only a percent, and that's a statistical tie," Enns says.

Gallup's Newport acknowledges that the Obama campaign's "ground game" was so good that — to some extent — it upset conventional polling theory.

Usually, the question is how many people who say they will vote actually do so. "But this time around ... people might tell a pollster they were not planning to vote and then do the opposite on Election Day," Newport said.

John Hudak, a fellow in governance studies at the Brookings Institution, says the big turnout among Latinos this year could have thrown some pollsters a curve, especially the ones that aren't flexible enough to conduct their face-to-face or telephone interviews in Spanish.

"In this election cycle in particular, where President Obama won over 70 percent of the Latino vote, if you're not sampling Latinos in Spanish in states like Florida, New Mexico or Colorado, you're not capturing that entire demographic," Hudak says.

There are some other possible factors that could affect getting a good sample of likely voters. Whether a pollster calls any (or enough) cellphones could be crucial, though the issue is controversial in public opinion polling circles.

The theory is that people who use cellphones only (no landline) tend to be Democrats, so if you're not reaching those folks, you're undercounting the blue column. But cellphones have their own problems. With a built-in caller ID, fewer people are likely to answer a call they don't recognize — like one from a pollster.

"Some say it's important, others that it's not. That's an open question," says Hudak.

There's another way to zero in on the perfect numbers. Cue statistician Nate Silver, who blogs for The New York Times. His forecasts this election year were deadly accurate.

He called all 50 states correctly and was within a few tenths of a percent on the popular vote, beating his own extraordinary record of missing just one state in 2008.

Silver uses lots of individual polls and then runs them through a weighted formula. "Each of the polls is essentially a best guess with some error around it," Enns says. "If you combine across all the polls, some are going to be wrong in one direction and some are going to be wrong in the other direction, and that should get you closer to an accurate result."

So, that's the first thing. The second is that Silver relies on polls conducted on a state-by-state basis instead of a national sample, Hudak says. The state polls provide a better perspective because they are closer to ground level.

Enns says Silver and the others who weighted the aggregated polls provided very good information this election.

"Where errors were made is when one particular poll was overemphasized, and all the weight was placed on that," Enns says.

"So, if you get someone quoting the Gallup poll, essentially they are weighting that poll as one and all other information as zero," he says. "You might be right, but you are much more likely to be wrong than if you take the information from all polls together."

Copyright 2012 National Public Radio. To see more, visit


In This Test Kitchen, The Secret To A Great Cookbook Is Try, Try Again

Yotam Ottolenghi and his partner have a thriving food empire that includes wildly successful cookbooks. We go inside their London test kitchen as recipes are put through their paces.

Bugs: Not What's For Dinner — Until They're Tastier, Maybe

A U.K. researcher says the environmental argument for eating bugs isn't working on its own. She says chefs and policymakers must "make insect dishes appeal as food, not just a way to save the planet."
WAMU 88.5

Neighbors, Arlington County Board Disagree Over Future Of Historic Property

Leaders in Arlington County are taking action to sell a historic property — a move that has neighbors in the Bluemont neighborhood up in arms.

Questions Remain About How To Use Data From License Plate Scanners

The scanners are standard equipment for police, but what's not settled is what happens to all the data collected. That data can link people to certain addresses and flag unusual activity.

Leave a Comment

Help keep the conversation civil. Please refer to our Terms of Use and Code of Conduct before posting your comments.