Critical Thinking

With the 2016 Election Polls Missing the Mark, Should Newsrooms Rely Less on Polls This Year?


With the 2016 election polls missing the mark, should newsrooms rely less on polls this year?

Sam Burdette, 19, senior, University of Arizona, Tucson, Ariz.

Burdette is studying journalism and serves as editor-in-chief of the university’s student-run paper, The Daily Wildcat. She plans to pursue a master’s degree and hopes to work in breaking news after college. 

I’m not sure newsrooms should be using polling information less in the future, but they should instead present the results as they actually are—mere estimates. Only after the polls were deemed to be obviously flawed—i.e. after President Trump took his surprising win in 2016—did we start hearing about why those polling results may have been flawed. However, we should have known all along those poll results could certainly misrepresent the truth of the public’s opinion.

In my statistics classes following the election, the 2016 polls were a popular topic of discussion, especially because it was easy for senior high school stats students to pick out where things may have gone wrong. Over the course of maybe a week, we learned how polls may have only targeted those on the extremes of the political spectrum, how leading questions may have confused participants and how the media’s omission or lack of attention to confidence intervals may have misrepresented the actual results. Whatever the cause, the point is I believe news media should be upfront and very clear with their audience about the level of exactness the polling results actually have.

I think this can be as simple as an extra paragraph or an editor’s note in a story that references poll results, or a one-sentence disclaimer before or after a presentation of the results on television or over the radio. One of the primary jobs of the news media is to promote democracy, to inform the public of what they need to know so they can make informed decisions about their government and the world around them. In order to do this, we need to be transparent that a lead in the polls is not an exact percentage by any means but an estimate of a huge number of voters that is prone to both statistical and human bias.

Mark Treinen, 52, editor, Green Bay Press-Gazette, Green Bay, Wis.

Treinen has served as the editor since April 2019. He is also the news director for USA TODAY Network in Central and Eastern Wisconsin. He has been an editor with Gannett newspapers in Wisconsin for 25 years.

Just one day after voters selected Donald J. Trump as president, the Pew Research Center published an article aiming to answer this question: “How could the polls have been so wrong about the state of the election?”

The authors acknowledged it was too soon to tell exactly why election polls showed Democrat Hillary Clinton with a commanding lead headed into November. But their article shared the thoughts of many pundits at the time—that pollsters asked the wrong voters, or that people who responded were afraid to say they’d vote for Trump, or that analysts made faulty predictions about which candidate would generate more enthusiasm on Election Day.

In the nearly four years since that election, the narrative about disastrous polling has evolved. Nate Silver of FiveThirtyEight observed in 2018 that in retrospect, the 2016 polls were only slightly farther off the mark than for the four previous presidential elections and actually average in accuracy in a longer-term historical comparison.

All of which is to say that newsrooms should rely less on polls—survey responses are not the same as completed ballots—but the results still provide information to help identify shifts in mood, attention and attitudes about elections, candidates and issues. As one source in a broader strategy for covering elections, polls are not inherently bad.

Our experience in local politics reporting in Wisconsin, including during the 2016 election, demonstrates where we should shift any time and attention we take away from poll-obsessing: Journalists covering major elections should speak to and observe voters themselves, a lot of voters over a broad geography and period of time.

We’re doing more of that in our news organization, and we are positioning ourselves to catch trends we might have missed if we were overly focused on survey results. Those subtle changes in tone and rhetoric, the more prominent and prolific campaign signs in our communities, the political donations pouring in from individuals, even—gasp!—Facebook comments are all indicators that should feed into news coverage of the election.

Then, maybe, the question in November will be: “How did news organizations get this  election so right?”


1 comment on this story | Please log in to comment by clicking here
Terry Flanagan

Should polls even be given as much coverage as they are? And how likely are polls going to influence voters? I think we would want polls to be neutral when it comes to influence. Just another news statistics. Polls should not drive turnout or public opinion. But how do you make sure this happens? Will less reporting of poll results make them seem less important. Not only do polls seem to drive the news cycle, but they are a prime driver of campaign pledge drives. Candidates seem to believe that more contributions will help swing the polls towards them. Polls are not elections., but we almost treat them as such.

The sheer number of polls and the amount of reporting of poll results may make them seem more important than they are. The only thing that matters is the actual voting. Voters need to be encouraged to vote regardless of what the polls say and the news media needs to push that. I think it might also be nice to have polls that just tried to find out what issues were important to people without necessarily getting an opinion on those issues. That way, the public has an idea of what most people consider important and what may be at stake in the election. Those issues will be on the ballot indirectly and people should be thinking about what candidates will deliver on the issues important to them. And the media can question the candidates on those issues.

To the extent that polling is reported, it might also be nice to give a history of the accuracy of the pollsters in previous election cycles. But, I really think most poll results should be a hyperlink for the curious and not a headline. People should be free to ignore poll results and probably should. The focus should be on candidates and issues. Polls may encourage voters to become lazy, overconfident, desperate, or feeling hopeless. What we really want are involved voters who will vote whether the polls think their candidate has a chance or not.

Friday, September 4, 2020