I just checked the crawl stats for interfacebus.com using Google's Webmaster Tools. The attached graphic shows Googlebot's [Google's spider] activity over the last 90 days.
The first two graphs appear normal, but the last graph does not. Check out the reduction in time to spider a page even as the amount of data downloaded has increased.
Does this mean that my server has gotten faster over the last few months? Or maybe Google is coming out at 3am when there are less people using the server?
1 comment:
9/12/09 I just checked the crawl stats for the site, and I'm not sure if looking at the right data. Google indicates that only 2 pages a day are being crawled over the last three months ~ that's down from 500 a day for this posting. What is up with that?
Post a Comment