OPINION4 September 2017

Four steps to ensure evidence-based planning

Media Opinion UK

As planning timescales are squeezed, insight gathering and decisions have to be made quickly, but that shouldn't be at the expense of evidence-based research says Kathryn Saxon.

One of many_crop

A  few weeks ago, a colleague was discussing how he'd identified a consumer issue and his approach to solving this problem for one of our clients. His storytelling was enthralling, I was with him all the way, sucked in by his passion and wowed by his enthusiasm. I asked about his evidence –  it was based on a sample of one. 

Now I know that samples of one can be the spark needed to take you in a new direction of thought, but at the same time we must not assume that everyone is like us. Certainly our own media consumption won’t be representative – as highlighted by Newsworks’ Sample of one project where 30 young agency planners and CEO’s (including MEC’s own Tom George) completed the IPA TouchPoints diary.

I'm sure many of us have been in situations where the storytelling is sound but when you look closer the evidence just doesn’t stack up – samples aren’t big enough, data isn’t verified or sources are vague. And in an era when we are awash with data from new sources, which is often driving how we plan, buy and measure, are we just a little too trusting?  Or even sometimes a little sceptical of research which doesn’t back up our preconceived ideas? For example, the popular narrative around newsbrands is largely focused on decline, but recent work by Peter Field using the IPA databank shows that they are highly effective when it comes to building long-term brand health.

Personally I think Facebook’s widely publicised video reporting errors have been a blessing in disguise for the industry. Certainly planners are now more attuned to the perils of inaccurate data and not blindly accepting data from any source.  And as anyone who’s tried to reconcile adserver data with web analytics data will attest, theoretically identical quantities are counted differently in different parts of the ecosystem – just because a number is precise doesn’t make it accurate.

I’ve questioned misleading or inaccurate data from other media partners and only recently a research agency – it seems great story telling can get the better of us all at some time.

So I welcome the recent rallying cry by the IPA and ISBA that as an industry ‘we should be defending the vital importance of accountable audience data, and to uphold the highest industry standards of methodology and independent verification'.

This is so important. No one should be marking their own work and the more we raise these issues and talk about them, the better informed we all are. This in turn gives us confidence and encourages us to ask the right questions and push for more robust evidence, the likes of which has underpinned our planning for so long.

There’s no doubt that planning and delivery of work has sped up. Faster insight is needed as planning timescales are reduced and client deadlines shift to meet business challenges. Of course with limitless advertising opportunities planners have more decisions to make than ever and do so with incomparable data sets and metrics.

So how do we as researchers equip planners to do proper-evidence based planning in this context? 

  1. Organise yourselves so that researchers are peers rather than subordinates to planners. 
  2. Invest in a culture that invites challenge – planners are only people so typically they want their hypotheses confirmed, so creating a culture where ‘that’s not the case’ doesn't need a prefix of ‘sorry, but...'.
  3. Hack the brief to ensure that assumptions aren't implicitly accepted  – great thinking often comes from getting to a deeper issue.
  4. Invest your time in them. Train them on the brilliant industry planning tools we have at our disposal. Ensure that they are used alongside your own in-house tools but continually inspire them to get the best out of what’s available.

And finally, remember my sample of one story? We worked on his theory, we gathered the evidence and needless to say we built it into a great narrative with substance that had a cracking ending. We all tell stories, but just make sure that your story is based on fact not fiction.

Kathryn Saxon is head of research at MEC

1 Comment

6 years ago

Very interesting piece of writing. Investing in a culture -wherein real stories are heard- makes a great difference. Real stories are stories of diversity and inclusion. Also they are based on opinions, facts--and not driven by personal journey.

Like Report