Polling inquiry highlights communications challenge for industry

UK — There is ‘no silver bullet’ to address the issue of polling errors, according to the chair of the inquiry into the polling failures surrounding last year’s General Election. 

Crop_polling_station

The findings, available here, outlined the initial thoughts of the inquiry panel around the general causes of the failure of almost all pollsters to correctly predict a Conservative majority last May. 

Ruling out factors such as turnout weighting and late swing, the discussion focused on the idea that unrepresentative samples — specifically underrepresentation of older voters and overrepresentation of the politically engaged — were the most likely explanation of the error. Early recommendations from the panel focused on improving sampling, either by obtaining a more representative sample of people within levels of current weighting variables, or by improving weighting by using more or better weighting variables. 

However Professor Patrick Sturgis, director of the National Centre for Research Methods and chair of the panel, insisted that there was "no silver bullet" to address the issue. "The risk of polling misses in the future can be reduced, but not removed," he said. 

According to ComRes’ director of political polling, Tom Mludzinski, this awareness of the limitations of polling is key to moving forward. "I think that’s part of the communications challenge for the industry – being realistic about what we can and can’t do," he said.

"In some ways what happened during the election has strengthened our hand in what we’re trying to do – that is in being more realistic, but also being cleverer. We shouldn't just be trying to go for one-off findings, but also trying to find out what’s behind the data: what’s underlying it and what’s causing reactions and perceptions and where it might be going."

The process has also been, said Mludzinski, a useful exercise in hearing what’s happening across the industry. "We feel we’re on the right lines with the work we’ve done already," he said. "It’s positive for all the agencies to be looking within themselves and it’s in our competitive nature to be as accurate as possible. I’m sure we’ll all take away a number of learnings."

A full report of the inquiry, commissioned by the British Polling Council and the Market Research Society, will be published in March. Interested parties can submit evidence for consideration by the inquiry panel here

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

0 Comments


Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts