Spider Hunter

I haven’t posted in a bit for a few reasons.
First off I’ve had real work to do. Since I can’t make a living on this site (yet) real work does tend to take a priority
Next a few projects seem to have jumped ahead of this one, in order to make this project even […]

I’m in process of changing from the Network solutions DNS servers to the DNS servers at Zoneedit. The main reason I’m doing this is to gain access to the TXT DNS record so that I can put up my own SPF entry. Hopefully this will not impact the site while I am transferring everything. I’ve […]

Sorry if you visted the site and got an error message. I was working on the data verifcation scripts over the weekend and I changed some of the database tables and how the data gets imported.
In any case the beta code was working great, but I did not copy it over to the live code […]

I’ve spent most of my day working on increasing the speed and availablity of the IP database. Normal stuff like database normalization and indexing.
Hopefully it will be faster now

I’m starting to incorperate IP location information in the online version of the IP database at http://ipd.spiderhunter.com While I’m working on it for the next few days it will be open to everyone, but once I have it the way I like it I will be putting it under the subscription services.

I just opened up the script to go after all Nethandles that way I’ll have the location information, even if I don’t use it. More information is always better.

Now that I have a process to get the nethandle for differnet IP address ranges I can now look at the ARIN Whois data and find the city, state, zipcode and country for that IP address range.
I’m currently only looking at IP ranges that have 256 or less IPs in them, figuring that anything larger […]

Anyone who knows me personally will groan at this one … It’s time to play with the Tiger Line files again. Every year or two the US census bureau http://www.census.gov releases data files that have the information needed to do relatively accurate geocoding or translating addresses into longitude and latitude coordinate. The data files are […]

Actaully it’s over 1.1 million IPs in the IP database. I think it turned over 1 million yesterday sometime, but I noticed it this morning. While there are 4+ billion IPs for use on the Internet using IPv4, not all of them are in use for surfing, I mentioned this a few days ago, but […]

I’ve been playing with the idea of getting the nethandles from ARIN to be able to associate the smaller CIDR ranges with the City, State and maybe even the Zip Code for IP addresses and for the most part I’ve done it. I’ve got an automated process that is gathering data for the nethandles and […]