View Single Post
Old 11th February 2012, 18:38
midcarolina midcarolina is offline
Senior Member
Join Date: Jul 2011
Posts: 254
Thanks: 1
Thanked 5 Times in 5 Posts

Hi Falko,

Thanks for this link. I couldn't really find one I was comfortable with and one thing I didn't think to address are "bad bots". I created a robots.txt file for time delay, but found that Google ignores this rule. They do follow the Disallow for a file path or out-right noindex, nofollow, but not time. This can only be adjusted in their webmaster tools (which I believe is crazy). Anyhow, I followed it anyway and the server load is dramatically different. Thanks again,

Mid Carolina
Reply With Quote