Irrelevant Subfolders?
-
I have my root domain and as I am a web designer, I use subfolders as sandboxes for client websites. I would not like these to be searched though because they are just demos, ideas and such. Would this be a robots.txt matter or can I have SEOMoz wok with a campaign where I can exclude subfolders? Thank you in advance! : )
-
Hi Wil,
If you want to exclude all robots from crawling these pages you can exclude them from Robots.txt.
If you want to exclude Rogertbot you can find the info on how to do it on: http://www.seomoz.org/dp/rogerbot
I hope that helped,
Istvan