Hi Falko,
Thanks for this link. I couldn't really find one I was comfortable with and one thing I didn't think to address are "bad bots". I created a robots.txt file for time delay, but found that Google ignores this rule. They do follow the Disallow for a file path or out-right noindex, nofollow, but not time. This can only be adjusted in their webmaster tools (which I believe is crazy). Anyhow, I followed it anyway and the server load is dramatically different. Thanks again,
Mid Carolina
|