I have a Vhost site that I cannot seem to get out there into the search engines... I have been reading up on "robots.txt" file and thought this might help get it out there. My log indicates the search engine robots, spiders, whatever... have been in crawling (pardon the pun!) around looking for this file. I have some different config examples, etc. I also know there are pros and cons to it's use. One bit of info I have not found is where to put the file in your server docs!? Anyone know? Have experience using the file!?