Spiderfood for thought
Okay, spider food is not a new concept, as many of the things I am talking about here are not new concepts. Hopefully some of these are new to the readers here or I’m adding new twists to an old idea. At least I’m hoping to get more information out for public consumption then has been out there before. Anyway, spider food is a concept that you want to feed the spider the best content for that spider. It is a key concept behind cloaking and IP tracking because you need to know which spider is visiting to give it the best content. My current idea is to create a spider food script that is dynamic and create the keywords from your content as well as the search terms that have come directly from the search engine you are optimizing for, in this case Google. First off lets look at the content. 80 to 90% of all of my content is stored in a database somewhere. This makes it easy for me to update and the basic 404 trap design that I use on most all of my sites nearly requires it. This also give me the opportunity to process the data that is going to be displayed on each page BEFORE it displays the page. I’m going to be writing some script over the next few days to weeks that will look at the count of the page I am writing, choose a title (usually the title of the article, blog or thread) for each page and select the 15 ‘most interesting’ keywords. The keywords that are going to be chosen will have a keyword density close to a number of my choosing. They will not be on a ‘dead word’ that I am going to create. (Dead words are words that Search Engines don’t look at, like ‘is’ or ‘the’) And, the keywords will look to see if I have gotten any click from google using that word as a search term. The 15 words with the highest rank will be the keywords for that page. I’ll be blogging more on this as I have certain parts figured out, but this is my current project and I’m sure you’ll start to see minor change in these pages to accommodate this new spider food script.
