July 15, 2004

Googlebot の不思議

Googlebot は4種類いる。

crawl7.googlebot.com "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
crawler10.googlebot.com "Googlebot/2.1 (+http://www.google.com/bot.html)"
crawler4.googlebot.com "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"
crawl31.googlebot.com "Mediapartners-Google/2.1"

crawler1-9 では URL が www.googlebot.com なんだけど、crawl10 以降は www.google.com になっている模様。ちなみに Mediapartners-Google は AdSense 用。

Posted by miyagawa at July 15, 2004 12:38 PM | Permalink | Comments (0) | TrackBack(0)
Comments
Trackbacks
TrackBack URL for this entry: http://blog.bulknews.net/mt3/mt-tb.cgi/1101
Post a comment