AOP study highlights ‘inadequacies’ of online engagement metrics

UK— A study by the Association of Online Publishers has highlighted the ‘inadequacies’ of online engagement metrics, casting doubt on the usefulness of measures such as dwell time and frequency of visit, and suggesting that a user’s trust in the website is the most important factor.

The study, conducted for the AOP by GfK NOP, used an online survey of 1,340 regular internet users in the UK to look into ways of measuring engagement with online content and ads. It segmented websites into those carrying original content, including newspaper and magazine sites, portals such as Yahoo and MSN and social networks.

Adverts featured on the original content sites scored highest for trust and for influencing positive brand opinion, while social networks scored lowest on both counts. “Trust is an extremely important metric for driving advertising response and is yet to be strongly associated with social networks,” the study says.

Lee Baker, director of AOP, said: “This is the first research to highlight the inadequacies of metrics to measure engagement that the industry currently employs.”

Tim Cain, head of research and insight at the AOP, said the research “sought to understand better the underlying factors that can really ascribe engagement and create a framework for determining how and where it exists… This study has created a model that can be replicated for comparative analysis at individual site, category or genre level.”

The AOP’s white paper says that volume alone cannot be used to measure engagement. “It is the quality of the time spent on the site, and perceptions of the experience that contribute to overall engagement and receptivity to the advertiisng contained on that site,” it says.

Sarah Messer, chair of the AOP’s research committee and head of commercial research at ITV, said: “This research shows that some indicators, such as ‘dwell time’, are not an accurate measure of ‘engagement time’. Users will visit social network sites daily and for long periods of time, yet by visiting a b2b, consumer or business site and obtaining relevant information or news quickly, doesn’t make the user any less ‘engaged’. In fact, we’ve found users are more likely to respond to advertising on content sites than social networks.”

The study mirrored work carried out by the Online Publishers Association in the US, which used a similar approach of asking respondents to rate sites on a range of attributes, as well as how they would react to ads on those sites.

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

0 Comments


Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts