Spider Hunter

It is old news that Google uses the sitemap protocol which allows webmasters to tell Google’s spider, Googlebot, which web pages have been updated recently. The greatest advantage is that Google will use the sitemap to make sure they spider your web site in a more intelligent way that you control within the bounds of the sitemap protocol.
The […]

Google announced recently on one of their blogs that they are now using META tags for site map validation. I personally think this is a fantastic idea and wish they would have done this from the beginning.
The Google site map program seems to be obsessed with proving that you own the page that you’re tracking. Which all […]

While I don’t think that these ideas will necessarily get you into either Google or Yahoo’s search indexes any faster or get you better positions looking at your RSS feeds through these interfaces can give you an idea of how your users might see your feed.
Last I heard My Yahoo! was the #1 RSS reader […]

I’ve been playing with Google’s new Sitemap service today.
Seems that Google is looking for a way to let Webmasters tell them exact what pages are on their web sites and when they are updated. It is a good idea for Google as they can have webmaster give them hints on how often to spider their […]

I was reading over at Webmaster World recently and I came across a great thread from GoogleGuy at http://www.webmasterworld.com/forum30/29720.htm
Pretty much from the get go he starts talking about great info for anyone who watches Google and the latest update, but what really caught my eye was some info about GoogleBot.
It seems that when GoogleBot sees […]

Google’s Page Rank technology is no secret these days. In fact it has become a bit of a pain as people try to come up with methods to increase their page rank while somehow cheating the system as a whole. The basic premise of the Page Rank is the idea that each page on the […]

While Google is constantly telling everyone that their Adsense technology has nothing to do with their search engine technology I can’t help to believe that they are at least cousins in the way they handle analysis and indexing. I’m not saying they use the same algorithm, but I am saying that I think they are […]

I’ve been going through my log files in an attempt to see where you, the users, are coming from. In looking through my http_referrer data I’m finding a lot of websites that have nothing to do with Spider Hunter that are reporting to have users coming to this site from links on their sites. I’m […]