Web Metrics Mess Only Getting Sloppier
January 3rd, 2008 — Tom Masterman
ClickZ.com’s Kate Kaye provides a useful 2007 summary of the hot issues surrounding Web metrics. Kaye nails it when she says that mere “baby steps” were taken by analytics firms to catch up with the rapidly progressing widget- and AJAX-infused Web. When you boil it down, there were three highlights in 2007. And, as I see it, three key issues exist in 2008.
First, the highlights.
In March, comScore announced its new visits metric. The firm claimed that metrics like page views were “diminishing in significance” due to new technologies, which is hardly accurate. When sites spend money upgrading their dynamic content serving capabilities, they need to understand how consumers are clicking around. KPIs are getting more complicated, but none is truly diminishing. (Well, cookie visitor counts might be doomed.)
In April, things got nasty when IAB CEO Randall Rothenberg slammed comScore and Nielsen Online (then Nielsen//NetRatings) for using an outdated panel sample methodology producing counts two to three times lower than IAB client server logs. Rothenberg called for “a solid and transparent foundation for audience measurement,” and urged comScore and Nielsen to undergo independent audits by the Media Ratings Council.
Highlight #3 was in July, when Nielsen came out with its “total minutes” metric, heralded (by Nielsen) as the “best measure of online engagement.” But, as anyone who’s ever done site redesign research will tell you, lingering visitors are often confused, angry visitors. When its first rankings had AOL (with its omni-present IM window) dominating the uber-efficient Google, I wasn’t left feeling like Nielsen had mastered the evaluation of engagement. Read More… »


A holiday trip to my sleepy Massachusetts hometown never ceases to teach me something. It was a wicked shockah, indeed, when I noticed, affixed to the weekly townie paper, a bright yellow Post-It shouting, “How Local? Wicked Local…
This is the time of the year when we look ahead and ponder the challenges we will face in the upcoming months. But as
Google is close to claiming 60 percent of all Web searches conducted in the U.S., according to the latest figures from Nielsen Online. 