Wednesday, August 13, 2008

Time to spider the site again


This week end I'll run the Xenu spider again to check for bad links. Some time after that I'll run the GsiteCrawler to generate an xml site map to upload to Google web-master tools [after I fix any issues found by the Xenu crawler]. I never run a crawler during normal office hours, as they put a strain on the server. Both Crawlers have to check each page on the server; or 1523 active pages and 209 inactive pages.

I've updated 1,440 pages since the Xenu program was run, but most have been html up-dates [a few gif files may be included in that count]. However; I've hand checked most pages over that time so I should not find that many issues. I was running the spider program once a month, but it seemed to miss a few issues so I've been hand checking links. The last check by the program indicated 5,978 links

Twenty new pages were added to the site since 6/7/08, so it's about time for a Google site map via GsiteCrawler. There may be a few page-to-page link updates that have been made as well, but not many ~ should make a more up to date site-map regardless.

Most of the page up-dates are due to one or more of these issues [most updated at the same time / page]:

Java script code change for Google Analytics [page visit counter]
Java script code change for Google Ads
Removal of all Java Script code for Google Referral Ads [program terminated]
Removal of two different meta tags [html coding issues, redundant un-required code]
Re-direct gif links as Google pages go out of service [Google web site terminated]
Java script code change for the Google Search Bar [ Code up-date, but not required]
Non-US ['dot'com] pages getting the html rel 'no follow' code [html non visible change]

The attached pic is of a Georgia map indicating 188 visits from that country so far this year. Russia just invaded them.....

No comments:

Post a Comment