Polls Used for Snapshots are neither Research nor News Events

Featured

Article by Molly Jong-Fast in Vanity Fair on prolific polling and polls on Biden versus Trump in the 2024 Presidential elections, appearing daily in media outlets, but she explains what’s wrong with focus upon polls.

Selective questions, snapshots conducted a year out from an election, media cherry picking outcomes, polls are now deemed to be media ‘events’, ‘horse race coverage’ that ignore substantive policy issues, measurement error and sampling eg. people not picking up phones vs. those who do which is only 1/100.

One would also add, that hollowed out media and resources for reporting not only leads to desk based scraping social media for news, but too much reliance upon polling for ‘news’; becomes circular when media no longer informs citizenry?  

Let’s Stop Treating Polls as Actual News Events

The stakes of 2024 are too important for the media to obsess over every “snapshot” of the electorate.

By Molly Jong-Fast NOVEMBER 27, 2023

Pick up a newspaper, turn on cable news, click on Drudge or listen to a podcast and you will encounter multiple stories on polls. Did you know that Joe Biden is polling poorly? Did you know Americans are deeply unhappy with the economy despite its metrics being very good? Did you know that Biden’s weakness among young voters should be taken seriously?

Everywhere you look there are polls, and these polls provide fodder for stories, which then fuel news cycles and shape narratives around the 2024 election, such as how Biden should drop out because of his age. “Voters think Biden’s too old,” says contrarian comedian Bill Maher, and indeed, there are polls, like one from The Wall Street Journal, in which voters are asked if Biden, 81—along with Donald Trump, 77—is “too old to run.” The poll, in which 73% of voters consider Biden too old, was cited in a separate Journal story asking, “Is Biden Too Old to Run Again?”

Of course, polls can be upended when voters actually go to the polls. Reuters gave Hillary Clinton about a 90% chance of winning on Election Day 2016, while the Huffington Post told us that Trump had “essentially no path to an Electoral College victory.” Everyone knows what happened next.

And yet recent 2024 polls, which serve, at best, as snapshots of the electorate a year out, become news events unto themselves, generating reams of coverage and endless commentary. They’re not actually breaking news events, like, say, a train derailment, even if treated as such. They’re more creations of a media industrial complex that longs for easy data points, for things that feel like facts but are actually imprecise measuring mechanisms. 

For every piece that is directly about polling, like one from Politico proclaiming “the polls keep getting worse for Biden,” there are others based on the suppositions gleaned from poll results, such The Washington Post examining “Trump’s improved image.” Even pieces downplaying some headline-grabbing polls as the “wrong” ones, may seize on others to make a point.

“The odd thing about media polls is that they are reported as a newsworthy event, but this kind of event ‘happens’ only when a newsroom decides it’s time for one—and when it has the money,” NYU journalism professor Jay Rosen wrote in an email.

Polls may fall into the category of pseudo-events, a term coined in 1962 by Daniel J. Boorstin and defined as something that “planted primarily (not always exclusively) for the immediate purpose of being reported or reproduced.” Just like polls, a pseudo-event’s “relation to the underlying reality of the situation is ambiguous.” (This idea was recently discussed by on John Dickerson on Slate’s Political Gabfest episode on polling episode). In this way, a poll may be more like a press conference, something that is created to shape a narrative.

There are other problems with polls, according to Margaret Sullivan, the media critic and recently named executive director of Columbia University’s journalism ethics center. “Polls are, by definition, horse race coverage, which focused on who’s up or down, not substance, ignoring what Jay Rosen calls ‘the stakes,’” she told me. “I wouldn’t go so far as to say never write a poll story but, in general, journalists are bad at predictions and should do some more meaningful reporting instead.”

Rosen has been out front this presidential election cycle with an “organizing principle” for journalists: “Not the odds, but the stakes.” The focus, he argues, should be “not who has what chances of winning, but the consequences for American democracy.” Placing too much emphasis on polls can shift the political conversation from critical reporting about what’s happening—such as the impact of Biden’s administration’s policies or Trump’s authoritarian plans for a second term—to predictions about what may happen a year later.

G. Elliott Morris, editorial director of data analytics for ABC News’ FiveThirtyEight, noted in an email how “pollsters like to market their work as ‘snapshots in time’—quick, one-off readings of the public’s attitudes that get less accurate the further you get from that moment in time. That means that polls of the 2024 election are of very little utility this far ahead—roughly of zero predictive value, historically speaking, though there’s reasons to believe they’re more predictive now with higher levels of polarization.”

“But they’re also subject to a lot of measurement error,” Morris continued. “Only about one out of every 100 people a pollster calls picks up the phone. Those respondents can be really weird, politically speaking, and are also prone to overreacting to the news cycle. This means we need to be even more careful when reading into a single poll’s results.”

Even if the intention of conducting a poll is to capture the views and sentiments of voters, the outsized coverage of it may distort the picture of what’s going on. As Boorstin wrote, “The shadow has become the substance…. By a diabolical irony the very facsimiles of the world which we make on purpose to bring it within our grasp, to make it less elusive, have transported us into a new world of blurs.”

For more related blogs and articles on Ageing Democracy, Consumer Behaviour, Evaluation, Media, Political Strategy, Research Customer Behaviour through Feedback and Survey instrument design click through:

Lobbyists and Media – Push Politicians to Right – But Not Voters?

Interesting article from The Conversation ‘Politicians believe voters to be more conservative than they really are’ analysing the mismatch between media and politicians versus the electorate and society at large in Europe, US and Australia, why?

‘on a majority of issues, politicians consistently overestimate the share of citizens who hold right-wing views.  Importantly, politicians’ overestimation of how many citizens hold right-wing views is consistent across the ideological spectrum. Politicians hold a conservative bias regardless of whether they represent left- or right-wing parties’

Student Evaluations in Higher Education and Universities

While student evaluations or ‘happy sheets’ become routine in higher education and universities, some question both effectiveness and efficiency in using such instruments to assess quality. Further, what is quality in teaching, learning, assessment, technology, administration and student well-being, then how and when should it be applied?

Focus Group Feedback – Qualitative Data Analysis – Grounded Theory & Coding

Potential respondents must have the ethics of research explained before any interview or feedback, not only verbally at start of an interview or related interaction, but inclusion on a briefing document explaining study and research, storage of data, along with ethics.

Focus interviews, individual or via a group, based on psychoanalysis, can be very adaptable, allow expression of body language, in addition to concept checking or informal communication which would be precluded by the written form.  However, there are disadvantages, interviews can be very time consuming to conduct, transcribe, code and analyse when using open questions to elicit perceptions, attitudes and experience of the research area, plus they can be subjective or prone to bias.

Focus Group Research for Digital e-Marketing Strategy Development

Optimal research is based on triangulation between scholarly and industry research representing a process with related factors, then analysis and coding of key stakeholder feedback according to same process.  Thirdly, it can be followed by quantitative data gathering or survey of customers’ attitudes on the factors that emerged, joining the circle or triangulation.

The literature review can highlight research and industry issues or views of marketing and communications for international education or related products and services, leading to an optimal marketing and communications construct to inform strategy and professional practice.  Additionally, to inform or validate any construct, qualitative data needs to be collected through focus type respondents from industry or target market, coded and analysed for inclusion of important factors in a survey instrument.

Critical Thinking or Analysis: Importance for Education, Media and Empowered Citizens

Throughout the world, especially now with social media, the digital volume of information and velocity, all citizens need skills of critical analysis, especially through the education system, community and media.

While newsrooms cut costs, headcounts and resources, many journalists or reporters now have less time and fewer resources to produce more news content.  However, this comes with the commensurate risk of media being gamed by corporate and political forces of the right, due to media using heuristic shortcuts on any issue and inherently biassed towards parties of the right.