FEATURE31 August 2011

Questioning the nature of research

Behavioural science

Research is undeniably important, says Rory Sutherland, but it needs to be “significantly improved” in light of what neuromarketing and behavioural economics teaches us.

Res_4005918_rory_sutherland

For him, survey research is an inherently unreliable means of getting to the truth of consumer behaviour and emotions. It’s still “better than ignorance in many cases”, but he says questions must be asked about how research can be “significantly improved” given all we now know about the human brain, thanks to behavioural economics and neuromarketing.

Research: Why is it important for researchers to try to measure consumer emotions?
RS:
Behavioural economics shows that affect has a strong effect on behaviour, and the mood we’re in and all manner of contextual variables affect the decisions we make. Since the majority of money spent on market research is spent on de-contextualised market research – which is essentially asking people to make a theoretical decision – how much predictive value does this really have?

We have to ask some questions about how market research can be significantly improved in light of what neuromarketing and behavioural economics teaches us. The value of research doesn’t diminish in the slightest – if anything it’s heightened – but the nature of the research that we do has to be questioned.

So the ad industry isn’t currently well-served?
For television, where it is automatically assumed that some sort of conscious memory of the commercial and its message has to be carried between the consumption of the commercial and the purchase of the product, there’s some value to using conventional research as a vague measure of likely effectiveness of TV advertising.

“As you get closer to the point of decision, there are factors at work which never really appear in conventional market research. They are contextual factors, social factors”

However, what we realise is that as you get closer to the point of decision, there are factors at work which never really appear in conventional market research. They are contextual factors, social factors. No-one in any research group would ever say, “If there are four brands of shampoo, I’ll buy the one that has most bottles on the shelf”, or “I’ll choose the one that’s on the third shelf up because it’s the one that doesn’t require much reaching down” or “I’ll look at the prices of three products and choose the one in the middle.”

In reality, we use heuristics and shortcuts and cognitively miserliness like this all the time. The mistake that quite a lot of advertising methodologies make is assuming that brand preference translates perfectly into purchase behaviour. It’s also making the assumption, of course, that preference is formed in advance of behaviour. Quite a lot of evidence from both behavioural sciences and from neuroscience suggests that we act first and form our opinions in light of our actions.

If there happens to be a Starbucks on the way to work you will end up going to that more than Costa Coffee, and as a result of that action and in order to make sense of that action, you’ll decide to like Starbucks. And when a market researcher comes up and asks what is your preferred coffee chain, you’ll say Starbucks. But in effect, your preference is a product of your behaviour and not the origin of it. I often say that if you hear a man complain that his wife doesn’t understand him, it doesn’t mean he’s going to have an affair – it means he’s already had one.

Quite a lot of the assumptions on which research is based are perfectly sensible in many ways and a pretty good proxy for what is needed – it’s better than ignorance in many cases. Although, if you spoke to Orlando Wood at BrainJuicer and a company called Real Eyes, they would say that our emotional reaction to a message has more predictive value in terms of behaviour than our stated rational take-out from a message.

So how do we take research past this point, so it’s no longer just a “pretty good proxy”?
I’m very favourable disposed to any research that takes place at or close to the moment of decision, because I think the way we think we decide and the way we actually decide don’t have that much in common. The conscious rational brain isn’t the Oval Office; it isn’t there making executive decisions in our minds. It’s actually the press office issuing explanations for actions we’ve already taken.

One of the reasons we chose the marketing model that we did – where we overtly state a proposition in a dramatised or comedic form that contains within it a persuasive argument for why you should buy a product… Advertisers are very comfortable with it because it absolutely defends you against charges of manipulation. You are dealing purely at a conscious rational level of awareness and preference. The only problem is it’s not really true. Some of the work by [marketing professor] Byron Sharp on mental and physical availability… his assertion would be that distinctiveness is more important a quality in advertising than persuasiveness and differentiation. The most important thing is that a person remembers your brand as having done a lot of advertising because in making purchase decisions we have an availability bias, which pushes us towards buying things we’ve heard of before.

“The conscious rational brain isn’t the Oval Office. It’s actually the press office issuing explanations for actions we’ve already taken”

This is not necessarily irrational. There are perfectly good evolutionary reasons why we’ve developed a lot of these heuristics. The fact that we trust advertised brands more than unfamiliar brands is very sensible. If you spend the money on advertising you are playing a long game and you have faith in your product and a reputation to lose. It’s not in my interest to make a quick buck if it destroys that brand. Our preference then is perfectly rational, but it may be unconscious or subconscious – it may be some Darwinian social instinct we’ve evolved around trust, which is, “Trust people with a reputation and something to lose; don’t trust people with nothing to lose.” It’s why, by and large, I wouldn’t lend money to crack addicts.

But that would mean traditional measures of brand awareness are quite useful then?
Yes, awareness and fame and distinctiveness, and also the awareness that you advertise a lot, not just the “Have I heard of them?” unprompted awareness score. Which of course we don’t always we measure. We don’t ask people, “Which of these have you heard of most? Which is the most famous?” These are degrees of ubiquity but those things can be very valuable.

There’s some very good work done by the Institute of Practitioners in Advertising which shows that your excess share of voice – the extent to which your share of voice exceeds your share of market – is a very reliable predictor of whether or not you’ll grow. So I’m emphatically not downplaying the importance of fame, awareness, mental availability – whatever you want to call it. What I would downplay is detailed dissections of consumers stated reasons for adopting or planning to adopt a particular course of action.

Can researches ever get to understand what goes on in the Oval Office, as you put it, if every time you try to get in there the press office gets in the way?
Yes, very easily – through experimentation. Control-based tests and continual experimentation. That’s how Tesco and Walmart became successful: they tried something different every day. If you talk to academics, they are slightly baffled by the ratio of money spent on research versus the money spent on experimentation within marketing. Direct marketers would be frustrated with this because they – as are some digital marketers – very great believers in split tests.

“If you talk to academics, they are slightly baffled by the ratio of money spent on research versus the money spent on experimentation within marketing”

Quite often, people within a group will pretend they are a maximiser, when most of our decisions are taken as satisficers. We always claim in the presence of others that we are great connoisseurs looking for the best value for money we can find, but most of the time we simply don’t have the mental energy for that. It would be an insane use of our mental resources in any case. So what we do is look for something that is pretty much guaranteed not to be crap. That’s why in some ways you can never quite make sense of the popularity of McDonalds. Everybody, whenever you talk about food, they’ll always talk bullshit about health and Italy and olive oil. But actually, when it comes to eating, what we want is a place that won’t rip us off, won’t give us food poisoning, the toilets will be clean, the service will be OK, and everything will be pretty good.

Paul Dolan, the government’s wellbeing adviser, says: “Nothing is as important as we think it is when we’re thinking about it”.

What explains this under-reliance on the experimental method?
I have no idea.

Is it to do with budget constraints?
It might be idleness, sheer idleness in the sense that constructing experiments takes a bit of work, but it’s relatively inexpensive.

What do you make of efforts to directly measure emotional response? FMRI, EEG, biometrics – that sort of thing?
Very simply, I like it to be done and I’m glad it’s going ahead and it reveals some interesting and revealing things. But its immediate applicability seems to be… I mean the most important revolution in marketing is really just like the most important revolution in science 150 years ago, you know: the scientific principle of experimentation, hypothesis and verification. That’s the most important thing. What I think neuromarketing does is shines a useful light on some of this stuff, because it occasionally provides the why to the what. But as pragmatic marketers, the most important thing to us is the what.

Where do you want research to end up?
More behavioural economics. Behavioural economics is starting to provide aggregate experimental results, which show tendencies, common biases and heuristics. The second generation, the next generation, will be databases of susceptibility, that will shows us which consumers overall are affected by which biases and which heuristics.

  • This interview was conducted in May, for our June edition Special Report on Measuring Emotion. You can read the full print edition, plus web exclusive content, here.

12 Comments

13 years ago

Your theories are correct for most people as they are conditioned by societal norms to lie to themselves. Very few people are truthful to themselves. Starbucks coffee is mediocre in comparison to a local micro-roaster that provides simply the best sourced, properly roasted & brewed coffees.

Like Report

13 years ago | 1 like

But haven't you been conditioned by the societal norm that assumes the more exclusive or "authentic" product is preferable, anonymous? ;) This was a very good article. Into the lab with us!

Like Report

13 years ago

there is a danger that behavioural economics might purely be a flavour of the month or a fad that's gonna outlive its utility soon. I have read his and others' articles and discussions from WPP's pages in the past and he does make a good argument. Unfortunately, I find they stop there because they sound too simplistic to reduce human behaviour to heuristics and when you do this, then everything turns out to be purely academic . (as If these were true we would have had far better predictive abilities.) They blame this lack of predictive abilities... on market research agencies!!!!! I think in one of the WPP senior thought leaders actually lamented the fact that Milward brown (part of WPP) did not provide 'insights' like why do customers stop going to prostitutes when she starts offering her services free or falls in love with him... and this article was on behavioural economics. ..!!!! Luckily most clients of Milward Brown and other insight agencies realise what value they bring to the table.

Like Report

13 years ago

Lovely point, Tom. There probably is a "microbrewery heuristic" at work, conditioned by scarcity bias, where we believe that the best coffee must always be available from small, obscure outlets. Like all that crap about the Guinness in Ireland being better, which it may be subjectively, but only because of the complementary emotions aroused by your surroundings - fiddle-playing drunks, horses running wild in the streets and so forth. But Starbucks has several things the micro-blenders don't: widespread availability and consistency, for a start: and it may not be the world's best coffee, but it's pretty much good enough for me most of the time.

Like Report

13 years ago

For a lighter take I wrote a piece contrasting traditional market research, economics and behavioural economics using the favourite question, 'why did the chicken cross the road'? http://bri-williams.blogspot.com/2011/07/why-chicken-crossed-road-behavioural.html?m=1 Behav eco is a brilliant way of closing the mysterious gap between intended and actual behavior. Thanks for a great article!

Like Report

13 years ago

I fully agree with Tom, I have been working in the M.E region for many years , and have noticed this in most cases, It is a valid and important point research companies and clients need to take into account, but from my experience clients do not listen.

Like Report

13 years ago

I'm a true believer in the value of behavioural research and split testing. I was able to conduct research using both traditional ad survey metrics and split test purchasing behavior against the same group if consumers. Awareness was, in fact, the only survey-based metric that "predicted" actual behavior. Planned purchase did not. As Tom said, get thee to lab! Thanks for the great article, Rory.

Like Report

13 years ago

I think that heuristics and emotion apply in fmcg markets but surely less so in purchase decisions for services like insurance or phone service supplier. For durables like a fridge will not hard information and 'economic rationality come to the fore? Should we not assume all market behaviour is the same?

Like Report

13 years ago

A child is frightened of the dark, not through a prudent oval office decision, but because of an affect implemented and probably innate heuristic. Ask the child why and the answer is honest but incomplete. Sometimes we are aware of our heuristics - I deliberately buy the same detergent because it works well enough for sure and checking out the others is a pain - but we are not always aware. How often do you use familiarity as a decision rule; it reduces cognitive load? Now you think about it, you use it more often than you thought! A good read is “The Irrational Economist” eds Michel-Kerjan and Slovic. And yes, experiments can determine the prevalence and structure of heuristics. Don’t be surprised if they turn out to be sensible, if not utility maximising.

Like Report

13 years ago

The 'experimental method' was actually widely used in marketing going back to the 1960s and 1970s. For example, new product launches were assessed via real Test Markets (such as stores in one TV region or even one town testing a product or split tests). They fell out of fashion due to a number of factors but I dont believe 'sheer idleness' was amongst them. They were impractical because of the cost of producing actual new product to test and the cost of marketing it, lack of cooperation from retailers, making competitors aware of what you were up. Thus the rise of more 'virtual' techniques which could do the work such as simulated test markets. These, of course, use experimental method such as test and control approaches and other means to account for (some) of the behavioural factors.

Like Report

7 years ago

You say that "No-one in any research group would ever say, “If there are four brands of shampoo, I’ll buy the one that has most bottles on the shelf”, etc. but in fact when we do good qualitative research e.g. accompanied shops or in-home immersions, even in-depths we do infact get this level fo insight. BE names to things that we discover all the time, that's why they seem so familiar.

Like Report

Results 1 to 10 of 12