Lipstick on a pig

Do respondents prefer their surveys boring?

Reg Baker’s The Survey Geek blog is always a good read: if you work in the “research 2.0” field I’d say it’s essential. Even the staunchest enthusiasts for R2.0 would admit that a lot of froth gets talked around the subject – The Survey Geek is cautious and stubbornly insists on looking at the evidence rather than the hype.

His latest post is a good example: Baker takes a look at some work DMS have done which strongly suggests that “eye candy” tools (flash surveys, slider bars) aren’t more appealing to most participants than plain surveys, and may in fact put some off.

Crucially, the participants who were forced into taking the “rich media” survey in the DMS work gave higher ratings to the survey experience, though their drop-out rates were also higher. This leads to a couple of conjectures.

Optimistically, you could say that if the whole industry switches over to rich media surveys everyone will be happier even if left to their own devices they wouldn’t have chosen that option. Pessimistically, you might argue that the quality of the survey experience might have precious little to do with completion rates or data quality.

How could this be? Well, we might have tormented participants so much that they’ve developed a kind of Stockholm Syndrome and come to admire their captors’ multi-attribute grids. But what seems more likely is that an enjoyable experience simply isn’t an outcome that many research participants expect, and therefore it’s stopped being one they care about. With this mindset, cosmetic changes to make the experience more engaging might simply feel contrived. The lesson for research reformers might be that if you’re still making people do the same old things, changing how they’re done might not have the impact you want.

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

0 Comments

Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts