OPINION16 April 2010

Welcome to our Electionwatch blog

Features

This year’s election is a tough one to call, and it looks like the role of research in trying to predict and understand the outcome will be more prominent than ever.

The introduction of TV debates, the first of which took place last night, provides a hook for yet more polling and analysis, courtesy of YouGov, ComRes, FizzBack, Populus and ICM among others. Ipsos Mori’s Ben Page provided analysis on the BBC, and Conquest is due to reveal results on ITN tonight using a new technique to analyse which candidate has the potential to generate the most buzz among the electorate.

The first of the three planned debates has shown how quickly opinion polls can respond. YouGov claim to have done “the fastest representative survey ever conducted in Britain”, with results out within a few minutes of the end of the debate, while Ipsos tracked the responses of a panel watching the event live. In a world where you can exchange opinions on the internet in real-time, viewers and broadcasters are coming to expect this sort of turnaround from pollsters. We are often reminded that polls are only a snapshot in time, so the opportunity for them to be a snapshot from ten minutes ago rather than two days ago, can only help.

Social media data provides countless more opportunities for measurement and analysis. Voters are interacting with candidates directly online, and the blogs and social networks are responding fast to events, pulling apart the claims and counter-claims, and defacing the posters that campaign teams have spent so much care putting together. One of the companies seeking to make sense of all this data is Tweetminster – not a research agency but a website that tracks UK political happenings on Twitter. It’s running an experiment to see if it can predict the outcome based on what people are saying on Twitter. Having never done polling before, Tweetminster can afford to have a go without risk of losing face.

Meanwhile numerous websites are providing data to voters and mashing it up in useful ways, resulting in an electorate that is more engaged with the numbers and how they are crunched. No need to check the polls when you can go straight to the poll of polls. For the basics on your local representative, check out Theyworkforyou.com. Unsure who to vote for? Voteforpolicies.org.uk and whoshouldivotefor.com will tell you, based on the policies you support. And to find out just how much (or in most cases, how little) that vote is worth, head to Voterpower.org.uk.

How all this affects research depends on how close the pollsters get to the final result, but also on how results are used and discussed by the media and the public. On the first point, we won’t know until May 6th. On the second, we can already see signs of how things are going.

For example, figures from last night’s “Who won the debate?” polls have been misinterpreted by some as being comparable to voting intention polls – leading some commentators to overstate the rise in support for the Lib Dems. The Telegraph says senior Tories have complained that YouGov’s online polls are biased in favour of Labour, which is interesting given that just two years ago it was Labour complaining that the pollster was biased in favour of the Tories (a complaint that was abandoned when the Tories won). And yesterday The Times used a single focus group as the basis for an article on voters’ feelings, extrapolating the changing opinions of the nine people in the group to show how the same swing would affect the final result. Such a sample, the writer noted, “is too small to be representative”.

Lyndsay Peck from Engage Research is among those to have warned of the election’s potential to undermine confidence in consumer research. The research industry needs to make clear the difference between the raw results of opinion polls as published in the press, and the deeper understanding that comes from a relationship between a research agency and its client, she argues.

On a positive note, there is evidence of researchers being appreciated for their nouse as well as their numbers. Peter Kellner of YouGov and Ben Page of Ipsos are among the most prominent commentators on the election.

Last night, Page was commenting with the help of three ‘worms’ – red, blue and yellow lines at the bottom of the screen that wiggled up and down depending on the responses of a panel of viewers with handheld devices. The interesting thing was that Page’s analysis was far more informative than the squiggly lines, which really only there to give the sense of a factual basis for Page’s views. Quantitative data often finds itself exalted at election time, but the lesson of Page’s appearance is that the value of research is in analysis and insight provided by people, not just in the numbers.

3 Comments

14 years ago

In recent issues of the International Journal of Market Research we've been publishing a series of papers on the theme of researching voting intentions. In the latest issue, 52/2, we have a paper by two of the UK's leading experts in the field of political opinion polling, John Curtice (University of Strathclyde) and Nick Sparrow (ICM), exploring the reasons why the Labour vote is often overstated in UK opinion polls, and the factors that pollsters need to take into account in designing effective weigthing methods. A very timely and interesting contribution on this important itopic. In my Editorial in the same issue I've also commented on the impact on the image market research if the polls are deemed to have got it wrong - as an ex clientside researcher I've experianced this at first hand! As Julian Glover commented in a recent article in the Guardian: 'Part science, part art, polling is as accurate as its last mistake'. We also have a paper in 52/2 from Richard Webber, the father of geodemographics, outlining a new way to infer ethnicity - as with geodemographics, this is a tool also of potential value in helping political parties, and researchers, gain a deeper understanding of local constituencies and communities.

Like Report

14 years ago

The market research profession is now widely held to be involved in dodgy data after last nights disparity between the three instant polls. Go to search.twitter.com and search on YouGov and see how much our profession's standing has been damaged by the nature, the results, and the use of this information. It may be, of course, that YouGov is more correct than the other two, but that is not, unfortunately, the point. These three polls have helped put the reputation of the whole industry at risk by being involved in this exercise. I guess YouGov might argue that they did not know the misuse that the Sun and Sky would put their data to - but that would imply they are terribly naive. I think the MRS should consider ruling that these types of instant polls are not consistent with market research and our way of conducting business. Let's stop worrying about incentives so much, and start worrying about something that will drive more business to DIY and voodoo solutions.

Like Report

14 years ago

In addition to the sites you’ve mentioned for helping voters to decide who to support there is www.votematch.org.uk So far in the campaign it has been used over half a million times and readers may wish to compare the results produced by Vote Match to the ‘suggestions’ thrown up by other policy based apps. ORB worked with Vote Match to help ensure that the statements contained in the tool were clear and easily understood. Meanwhile much time was taken in engaging with the political parties to ensure that the assumed policy positions used in the underlying analysis were accurate. The underlying theory is very robust while having received their ‘match’ users can delve deeper to discover what the Parties have said on specific issues. The site can provide details of the previous result in the user’s constituency and will, if asked, send a reminder when it is election day! As with the other sites mentioned Vote Match is a positive example of how online tools are being used to encourage greater engagement with the political process and to help citizens make a more informed choice when voting. In countries such as Germany and The Netherlands up to one in three voters are thought to have used such apps before recent parliamentary elections. Indeed Party leaders in these countries now attend the launch of the official vote matching site. The UK clearly has some way to go in this regard but the signs are that it will rapidly catch up.

Like Report