Spider Hunter

Archive for July, 2004

16 Jul

Realtime Spider List

I was writing a blog for another one of my sites ( http://www.spamfreeemail.com ) and I was talking about Real-time Black-hole lists. Then the thought occurred to me that I have never seen this simple implementation translated over into Search engine spider detection. Using the same techniques as the RBL a Real-time spider list could […]

14 Jul

DNS Basics

The domain name system, or DNS for short, is a way to convert IP addresses into names that people can easily remember or relate to. DNS also provides information about the domain name to allow for email and other services as well. The three basic DNS records, or type of data, are an A record, […]

14 Jul

IP Basics

Alright, I’m actually going to start doing this more regularly now. I know I’ve said this in the past, but here it really is … I swear
Lets start from the beginning, most of the more advanced users are going to find this really boring.
Each and every computer on the Internet needs to have […]

© 2008 Spider Hunter | Entries (RSS) and Comments (RSS)