NSA Polls, Damned Lies, and Statistics
Depending on how the question is asked, Americans either think President Bush is doing what’s needed to catch those pesky terrorists or is a power grubbing snoop.
A widely reported WaPo-ABC News poll released yesterday showed that nearly two thirds of Americans support the NSA scanning telephone call records. Now, a Newsweek poll shows a majority thinking it goes “too far.”
How can this be? Editor & Publisher helpfully suggests that the public got smarter, quite literally, overnight:
So what happened? Most likely views changed that much in one day after more negative media reports (including many from conservative commentators such as MSNBC’s Joe Scarborough) surfaced. The Washington Post survey took place before many Americans had heard about, or thought about, the implications. The Newsweek Poll also reached twice as many Americans.
Expanding the sample size, once it is at acceptable levels, has negligible results on the margin of error. It has no effect on the responses. But, sure, more information on a rapidly breaking story could plausibly change minds.
More likely, though, the explanation for two polls released in close proximity with wildly different results comes down to methodology. One of the most important issues is question wording.
Here’s the WaPo/ABC question:
It’s been reported that the National Security Agency has been collecting the phone call records of tens of millions of Americans. It then analyzes calling patterns in an effort to identify possible terrorism suspects, without listening to or recording the conversations. Would you consider this an acceptable or unacceptable way for the federal government to investigate terrorism?
Frankly, that’s a bit convoluted. Still, it presents the program in great context: What’s happening, how it’s happening, and why it’s happening.
The Newsweek question is not provided. From their report on the poll results, though, one gathers that they conflated the electronic eavesdropping and phone record search programs.
According to the latest NEWSWEEK poll, 53 percent of Americans think the NSA’s surveillance program “goes too far in invading people’s privacy,” while 41 percent see it as a necessary tool to combat terrorism. […] 57 percent said that in light of the NSA data-mining news and other executive actions, the Bush-Cheney Administration has “gone too far in expanding presidential power.”
This is, obviously, a wholly different issue.
Public opinion on this matter will no doubt evolve and gell as more information becomes available. It will be viewed through a filtered lens based on perceptions of the Bush administration, which is in a free fall in the polls. It’s unlikely to change radically in a single day, however.
Update: I still can’t find a link to the poll itself on the Newsweek site but Kevin Drum has a screen cap of it.
14. Now on another subject. . . As you may know there are reports that the NSA, a government intelligence agency, has been collecting the phone call records of Americans. The agency doesn’t actually listen to the calls but logs in nearly every phone number to create a database of calls made within the United States. Which of the following comes CLOSER to your own view of this domestic surveillance program?
It is a necessary tool to combat terrorism.
It goes too far in invading people’s privacy.
This wording, like the WaPo/ABC wording, is convoluted but reasonably fair. Calling it a “domestic surveillance program,” especially in light of thirteen previous questions, is inaccurate, though, and could certainly influence the results. Further, there could easily be a conditioning effect set up by the previous questions if they are not being rotated.