Traffick - The Business of Search Engines & Web Portals
Blog Categories (aka Tags) Archive of Traffick Articles Our Internet Marketing Consulting Services Contact the Traffickers Traffick RSS Feed

Thursday, November 11, 2004

Billions and Billions Crawled

Google attempts to mute Microsoft's buzz by announcing that its index has jumped to a colossal eight billion pages. The company isn't offering many details beyond pointing out that they "continue to innovate on the crawling side of the business," as one official put it. Certainly there are a number of obvious ways that Google could be finding additional pages, given its various overlapping products (eg. conversion tracking, Blogger, AdSense, toolbar, Froogle). Perhaps there are some non-obvious technical advances involved as well in following links on dynamic sites, etc.

Assuming the pages in it are useful, a huge increase in index size is a happy event. Some time ago I conferred with a large law firm, Osler, Hoskin, and Harcourt (osler.com). They had trouble getting all the pages on their highly dynamic site indexed. As much as one might want to scold the company for having such a hard-to-spider site, the more pages Google can find *without* them having to rework their site, the better. And better for the consumer. This site is full of articles and resources, as well as listings of lawyers and their bios.

Today, I noticed that on key queries valued by the company, like "business law canada," osler.com now ranks #3 (behind some public-domain and library resources), and finally ahead of the tiny immigration law company from upstate New York that used to routinely rank first on this query.

Looking for Douglas Rienzo, a partner in the Osler firm? Two years ago, when I searched for particular associates and partners, the only Google mentions of their names were pointing anywhere but the Osler site. Now, the top results are bios that appear on Osler.com, with contact info. This is neither here nor there, but it does prove that a lot more important pages on the massive Osler site got spidered and well-treated by Googlebot.

It's impossible to gauge search quality on just a couple of example searches. But it is heartening to see that on some queries, like "business law canada" -- to say nothing of "Douglas Rienzo" -- the results are now better, not worse, than they were two years ago.

Chris Sherman wonders, does this increase in index size portend the release of new search features or perhaps a significant rejigging of the ranking algorithm?

Can I be first to dub the next cataclysmic Google re-index? We're at about the one-year anniversary of the algorithmic imbroglio that was "Florida."

Let's call the next big one "Ohio."

Posted by Andrew Goodman




View Posts by Category

 

Speaking Engagement

See Andrew Goodman speak at ClickZ Live New York

Need Solid Advice?        

Google AdWords book


Andrew's book, Winning Results With Google AdWords, (McGraw-Hill, 2nd ed.), is still helping tens of thousands of advertisers cut through the noise and set a solid course for campaign ROI.

And for a glowing review of the pioneering 1st ed. of the book, check out this review, by none other than Google's Matt Cutts.


Posts from 2002 to 2010


07/2002
08/2002
09/2002
10/2002
11/2002
12/2002
01/2003
02/2003
03/2003
04/2003
05/2003
06/2003
07/2003
08/2003
09/2003
10/2003
11/2003
12/2003
01/2004
02/2004
03/2004
04/2004
05/2004
06/2004
07/2004
08/2004
09/2004
10/2004
11/2004
12/2004
01/2005
02/2005
03/2005
04/2005
05/2005
06/2005
07/2005
08/2005
09/2005
10/2005
11/2005
12/2005
01/2006
02/2006
03/2006
04/2006
05/2006
06/2006
07/2006
08/2006
09/2006
10/2006
11/2006
12/2006
01/2007
02/2007
03/2007
04/2007
05/2007
06/2007
07/2007
08/2007
09/2007
10/2007
11/2007
12/2007
01/2008
02/2008
03/2008
04/2008
05/2008
06/2008
07/2008
08/2008
09/2008
10/2008
11/2008
12/2008
01/2009
02/2009
03/2009
04/2009
05/2009
06/2009
07/2009
08/2009
09/2009
10/2009
11/2009
12/2009
01/2010
02/2010
03/2010
04/2010

Recent Posts


Is it News? Microsoft Search to Exit Vapor-Land To...

Google Dips Toe in 'Reseller' Channel

Rising Online Ad Tide Lifts Many Boats... Even Mic...

CNN Covers FireFox

Blogs We Love

Evenin', Squire (Can We Interest You in an Alarm S...

The Fall and Rise of Online Advertising

Online, Useless Information Just Doesn't Cut It

A Little Poem for Americans

Tracking Your eBay Auction Sales? Now that's Highl...

 


Traffick - The Business of Search Engines & Web Portals

 


Home | Categories | Archive | About Us | Internet Marketing Consulting | Contact Us
© 1999 - 2013 Traffick.com. All Rights Reserved