Robot.txt and Sitemap
-
Simple question for today

What do you use to create a sitemap ( if your site is NOT Wordpress ) and do you mention your sitemap in your robot.txt?
Thanks in advance!
-
Hi Angelos,
We use http://www.xml-sitemaps.com/ and yes we mention our sitemaps, among other things, in our robots.tct file:
http://www.ccisolutions.com/robots.txt
and
-
You could try one of the following listed here https://code.google.com/p/sitemap-generators/wiki/SitemapGenerators
Yes its a good practice to mention your sitemap in robots.txt and dont forget to submit it ( at the very least ) via Google/Bing WebMasterTools
-
I use GsiteCrawler all the time. Its free and gives you lot of options. You can get it here:http://gsitecrawler.com/
Best regards,
Devanur Rafi.
-
I use xml-sitemaps.com for sitemap generation as its simple and easy to use!
If you are adding sitemap link in your robots.txt file its fine but not adding is not really a big problem!
-
Hi Angelos, you've received some great responses. Did any of them answer your question?