Crawed Pages
This picture shows how the Google spider [googlebot] craws www.interfacebus.com over the last three months. It appears that most pages are hit and spidered with-in one day, than are spidered again during the month. The site has about 1040 pages as determined by the cached pages on Google; “site:interfacebus.com”. Those spikes appear to reach 800 to 850 pages.
skip to main |
skip to sidebar
General electronic topics with updates and issues for www.interfacebus.com
2 comments:
That's just from GoogleBot. There are a dozen other search engines that spider this site all the time.
2007 crawl rate;
http://interfacebus.blogspot.com/2007/04/google-crawl-rate.html
Post a Comment