OPINION8 December 2010

Qual’s future’s bright, but is it online?

Trends

NewMR organisers billed it as a ‘Clash of the Titans’, but agreement was reached early on in the debate about the future of qual. Online wouldn’t kill off in-person research, they said – the real fight was over which mode was better.

The debate was over before it even started. Kicking off the NewMR Virtual Festival webinar pitting online versus in-person qualitative research, advocates of both modes agreed that a combination of the two would be relied upon by clients in years to come, rather than one totally displacing the other.

It is inevitable, of course, that offline qual will lose ground to online in the coming years, just as face-to-face and telephone gave up market share in quant work. But both sides in the debate accepted that the choice of online and in-person approaches would remain, and which was used would depend on research objectives.

And so the panellists were left to argue over the amorphous point of which was best at meeting client needs for speed, quality, cost and depthand for creating respondent engagement. Here sharp divisions emerged.

Visionslive.com’s Andreiko Kerdemelidis, for the onliners, talked up the cost benefits, leaving Simon Patterson of QRi Consulting to point out in defence of the offliners that in-person costs have been driven down so much over the years there’s really little difference between the two approaches.

Patterson’s contention, though, was that the little more you pay for in-person qual brings with it a significant improvement in quality of output. Meeting people and talking with them face-to-face offers “unique benefits”, he said, not least the opportunity to discern non-verbal indicators of a person’s underlying emotions which they may have difficulty articulating – if they are even aware of them.

Tom De Ruyck of InSites Consulting, for the onliners, questioned this advantage, saying it was “an illusion to think that either online or in-person methods can get into people’s minds”. Online, he said, with its applications for sharing text, pictures and video, offers “more angles” from which to observe consumers to produce “a more holistic vision”. Chatting with them for two hours in a focus group can’t compare, said De Ruyck.

Both he and Julie Wittes Schlack of Communispace had earlier remarked how online communities allow for long-term relationships to be created with respondents and how this, over time, would lead to deeper engagement with the research and ultimately more in-depth consumer understanding.

“I would agree that [online] you can lose some of the nuance of a live interview,” said Wittes Schlack, but that loss is “more than compensated” by the longitudinal relationship.

But to compare online communites to offline focus groups is to compare “apples to pears” – synchronous to asynchronous studies – said moderator Joanna Chrzanowska. Independent quallie and in-person advocate Geoff Bayley here spied a weakness, and pounced.

Turning their argument against them, Bayley said the onliners were making the point that depth comes over the long-term, when the issue is that clients want speed and depth. Razor Research’s Eleanor Atton chimed in, damning online with the faint praise that it “can be uniquely powerful for getting snapshots of people’s lives”.

Later, as the debate turned to the issue of resistance to online methods, Atton challenged De Ruyck’s claim that traditionalists are loth to use online qual because “people fear the unknown”. She said that, to the contrary, she herself uses online methods and sees them as a complement to her in-person work – a point similarly made by Patterson at the outset of the debate.

Contentiously, Atton said: “We would challenge the onliners that they have a fear of offline.” Despite a spirited defence, it seems, the offliners couldn’t sway those listening. Chrzanowska was reluctant to call a clear winner from the online poll conducted at the conclusion of the debate, though it looked like a majority sided with the view that qual’s future was an internet-enabled one.

3 Comments

14 years ago

Given the online venue, we were expecting a high proportion of attendees to support online methods, and indeed the initial poll showed 80% in favour. The organisers had decided the winner would be the side that had moved this opinion in their direction, and the final poll was showing only 63% in favour of online - so the In-person team were declared the winners. I wanted to have some time to look at the patterns of voting (2 intermediate polls showed both sides neck and neck in terms of the effectiveness of their argument), but in the end the sample was too small for statistical validity - and there was no need to take it too seriously either. Both sides made some good points and we now know what issues need to be explored further.

Like Report

14 years ago

Thanks for the update, Joanna.

Like Report

13 years ago

Good points Dan re: online fulling a deeper dive into the face to face qual side of research and data being subject to what we don't see online. These are both points I raised in the live debate, along with the benefits of longer-term engagement (i.e. it's not just 'snapshots' we get from online). I'm just not sure qual can be ideally holistic if it doesn't include any face-to-face in the approach, particularly whilst we still live (at least a bit) offline. If we erase in-person we erase rich context and identity cues and some permission and sensitivity to build 'live' (or synchronous) empathetic, self-reflective and higher consciousness rapport. Online can and should contribute to this holistic picture too (e.g. taking us to the heart of action we wouldn't otherwise get to, lengthening contact and learning) and I suspect will become the backbone of more (not all) projects (e.g. MROCS with in-person offshoots). And let's remember, sometimes qual doesn't need to be so holistic OR dare I say it, in-person! (e.g. final sense check of pack concepts or to an ad). Something that hasn't been mentioned at all here is creativity and the great role online can play in co-creation and in improving what ideas are available/ explored in a face-to-face setting... though notice I still lean towards including an element of face-to-face too! I think this debate has been really worthwhile, even if it was, in essence, over before it started as we all know the answer (i.e. the future is both and online will take some share from in-person and in-personers need to become a bit more online minded if they want to keep up). What it’s done is remind us that qual is an evolving social science and an art form and that meeting in-person OR online can be incredibly powerful. It's also been a good wake up call to in-person researchers like myself who should be enlisting the help and services of Tom, Andreikos and Julie as much as possible to be even better and more rounded qual researchers in 2011!

Like Report