Subdomain Robots.txt

[JohnECF]

If I have a subdomain (a blog) that is having tags and categories indexed when they should not be, because they are creating duplicate content. Can I block them using a robots.txt file? Can I/do I need to have a separate robots file for my subdomain?

If so, how would I format it? Do I need to specify that it is a subdomain robots file, or will the search engines automatically pick this up?

Thanks!

[wissamdandan]

if the url is http://blog.website.com

then the Robots.txt should be accessable threw http://blog.website.com/robots.txt

I would suggest these steps

• Verify your blog the Google webmaster tools
• generate a robots .txt file with Google webmaster tools
• Upload it to the Subdomain.

There is another way if you are using Wordpress.

There is a All in One SEO plugin / Wordpress SEO by Yoast. threw the settings you can specify to add NOINDEX to all Category, tags, author and others. its faster and error free.

[JohnECF]

Thanks Wissam. I was thinking this was the way to go, and I appreciate your input.

I do use the Yoast SEO plugin for Wordpress on another site, but the blog in question is through BlogEngine. I will do what you have suggested.

Cheers!