09 Feb
I’ve been playing with the idea of getting the nethandles from ARIN to be able to associate the smaller CIDR ranges with the City, State and maybe even the Zip Code for IP addresses and for the most part I’ve done it. I’ve got an automated process that is gathering data for the nethandles and […]
Posted in SpiderHunter, IP Tracking, Projects by: simpleenigma
No Comments
08 Feb
Now that I have some real data on ASNs to work with I decided to see what ASNs were responsible for hiting my robots.txt file the most and I like the results. Here are the top 4: * AS15169 : 630 Hits : Google * AS14776 : 417 Hits : Inktomi * AS3561 : 230 […]
Posted in SpiderHunter, Spider, IP Tracking by: simpleenigma
No Comments
07 Feb
I’ve been debating this for a while now, but I think I am going to impliment a web service as part of theIP database. It will be a WSDL Feed based on soap. I am thinking that the data that the feeds will be released similar to the data on the IP database itself. To […]
Posted in SpiderHunter, IP Tracking by: simpleenigma
No Comments
06 Feb
As I’ve been creating the IP Database I’ve been thinking about exactly how many IP addresses are visitng my sites, compared to the total number of IPs I’m going to go out on a limb here and say that less then 10% of the 4+ billion IP addresses are used for web surfing or anything […]
Posted in SpiderHunter, IP Tracking by: simpleenigma
No Comments
04 Feb
When I was going through the IP to country script to create the IP database I noticed a number in the data files that seemed to have nothing to do with IP addresses. This was an Autonomous System Number, or ASN. An ASN is used by the routing protocol called BGP. I don’t understand the […]
Posted in SpiderHunter, IP Tracking by: simpleenigma
No Comments
03 Feb
The airport database that I orginally found was incomplete and inaccurate. So I’ve spent he better part of the afternoon trying to find a new one and I did http://www.partow.net/miscellaneous/airportdatabase/ An open source airport code database, mostly complete, I didn’t find the local airstrip down the street, but I don’t always find it when […]
Posted in SpiderHunter, Projects by: simpleenigma
No Comments
03 Feb
I was wandering and reading on the Internet this morning and I found a reference to a certain ISP that used Three digit airport codes in thier reverse DNS names. This of course made me start to think about other ISPs, that may be doing the same thing. If nothing else this would help get […]
Posted in SpiderHunter, IP Tracking, Projects by: simpleenigma
No Comments
02 Feb
I may have marped on this before, but I am always trying to find new ways to make this community more of a Win-Win situation for everyone. In that theme I implimented a revenue sharing plan for anyone who wants to participate in the WikiWikiWeb, by contibuting to the content. By contibuting content you have […]
Posted in SpiderHunter, Projects by: simpleenigma
No Comments
01 Feb
I’ve never tried to get high ranking on any search engine. I know that must sound odd coming from me, but the truth of the matter is I’m more intereted in the back end services then writting web pages and doing SEO work. I’ll track IP Addresses any day of the week, but tracking keywords […]
Posted in SpiderHunter by: simpleenigma
No Comments
31 Jan
I’ve been spending time today working on the IP database and the members section for the Web site. I finalized some of the members stuff at http://members.spiderhunter.com Most notably I have the IP to Country database downloadable to anyone who has an account. You can get it from http://members.spiderhunter.com and then going to the members […]
Posted in SpiderHunter, IP Tracking, Projects by: simpleenigma
No Comments