TheJediSlayer
Posts: 164 +0
Hello,
I was wondering if it were possible to deny all bots, but bots from search engines like Google. I realize that certain bots will ignore the robots.txt file, but I still would like to create a robots.txt that would deny from all except certain search engines that I put into the robots.txt file. Thanks for any help,
Tyler.
I was wondering if it were possible to deny all bots, but bots from search engines like Google. I realize that certain bots will ignore the robots.txt file, but I still would like to create a robots.txt that would deny from all except certain search engines that I put into the robots.txt file. Thanks for any help,
Tyler.