Should I disallow via robots.txt for my sub folder country TLD's?
-
Hello,
My website is in default English and Spanish as a sub folder TLD. Because of my Joomla platform, Google is listing hundreds of soft 404 links of French, Chinese, German etc. sub TLD's. Again, i never created these country sub folder url's, but Google is crawling them. Is it best to just "Disallow" these sub folder TLD's like the example below, then "mark as fixed" in my crawl errors section in Google Webmaster tools?:
User-agent: *
Disallow: /de/
Disallow: /fr/
Disallow: /cn/
Thank you,
Shawn
-
Joomla will do that to you

To answer your questions: Yes, the use of robots.txt in this case makes sense. You will save some crawling budget that can be spent by Google's bot somewhere else.
I would't worry about the WMT errors though - nothing bad can happen if you have them there and if you solve the issue those will go away - no need to spent time on those - it dosen't affect your performance in any way.
Hope it helps.
Cheers.