Spider Hunter

Now that I have some real data on ASNs to work with I decided to see what ASNs were responsible for hiting my robots.txt file the most and I like the results. Here are the top 4: * AS15169 : 630 Hits : Google * AS14776 : 417 Hits : Inktomi * AS3561 : 230 […]

I’ve been debating this for a while now, but I think I am going to impliment a web service as part of theIP database. It will be a WSDL Feed based on soap. I am thinking that the data that the feeds will be released similar to the data on the IP database itself. To […]

As I’ve been creating the IP Database I’ve been thinking about exactly how many IP addresses are visitng my sites, compared to the total number of IPs I’m going to go out on a limb here and say that less then 10% of the 4+ billion IP addresses are used for web surfing or anything […]

When I was going through the IP to country script to create the IP database I noticed a number in the data files that seemed to have nothing to do with IP addresses. This was an Autonomous System Number, or ASN. An ASN is used by the routing protocol called BGP. I don’t understand the […]

The airport database that I orginally found was incomplete and inaccurate. So I’ve spent he better part of the afternoon trying to find a new one and I did http://www.partow.net/miscellaneous/airportdatabase/ An open source airport code database, mostly complete, I didn’t find the local airstrip down the street, but I don’t always find it when […]

I was wandering and reading on the Internet this morning and I found a reference to a certain ISP that used Three digit airport codes in thier reverse DNS names. This of course made me start to think about other ISPs, that may be doing the same thing. If nothing else this would help get […]

I may have marped on this before, but I am always trying to find new ways to make this community more of a Win-Win situation for everyone. In that theme I implimented a revenue sharing plan for anyone who wants to participate in the WikiWikiWeb, by contibuting to the content. By contibuting content you have […]

I’ve never tried to get high ranking on any search engine. I know that must sound odd coming from me, but the truth of the matter is I’m more intereted in the back end services then writting web pages and doing SEO work. I’ll track IP Addresses any day of the week, but tracking keywords […]