Public polls lack openness and scrutiny, say party pollsters

US— A group of pollsters who work for the two main political parties have criticised the proliferation of published polls that fail to disclose how they were conducted, and the “sometimes uncritical” media coverage of such surveys.

In an open letter, 19 campaign pollsters say that the media’s practice of “judging polls by their accuracy in the closing weeks of an election rather than by the professionalism with which they were conducted is unfortunate”.

Among the signatories are Democrat pollster Diane Feldman, Republican pollster Bob Moore, and Joel Benenson, who conducted polling for Barack Obama’s presidential election campaign.

Public polls, they explain, differ on whether they reveal information on how voters were sampled and screened, whether bilingual interviewing took place, and whether potentially biasing questions were asked before the main ‘horse race’ question.

The authors raised particular concerns about hard-to-reach groups such as ethnic minorities, whose views may be underrepresented or distorted by weighting in some polls.

The letter highlights the standards developed by the American Association of Public Opinion Research (AAPOR), which call for “full and complete disclosure” of survey methodology at the time results are released. “We would urge extreme caution in coverage of polls that do not meet these standards,” the authors said.

As political observers look back on the US mid-term elections to see which polls got it “right” and which got it “wrong”, the authors call for polls to be judged by their professionalism “rather than by apparent accuracy in the closing weeks of campaigns”.

Public polls “have the capacity to shape media and donor reactions to election contests”, the authors write. “We would urge the media to examine whether publically released polls meet AAPOR standards in choosing whether or not to cover them.”

“Polls that show the most dramatic numbers in terms of candidates’ winning or losing often draw the most media response,” they write. “It is therefore especially critical to subject such polls to rigorous examination.”

In a statement to the Huffington Post, AAPOR president Frank Newport said the association “appreciates and endorses” all efforts to encourage adherence with its code and standards.

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

0 Comments


Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts