The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Educational Resources
    4. Robot.txt and Sitemap

    Robot.txt and Sitemap

    Educational Resources
    6 6 1.4k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Angelos_Savvaidis
      Angelos_Savvaidis last edited by

      Simple question for today 🙂

      What do you use to create a sitemap ( if your site is NOT Wordpress ) and do you mention your sitemap in your robot.txt?

      Thanks in advance!

      1 Reply Last reply Reply Quote 0
      • danatanseo
        danatanseo last edited by

        Hi Angelos,

        We use http://www.xml-sitemaps.com/ and yes we mention our sitemaps, among other things, in our robots.tct file:

        http://www.ccisolutions.com/robots.txt

        and

        http://www.celebratecommunion.com/robots.txt

        1 Reply Last reply Reply Quote 2
        • Saijo.George
          Saijo.George last edited by

          You could try one of the following listed here https://code.google.com/p/sitemap-generators/wiki/SitemapGenerators

          Yes its a good practice to mention your sitemap in robots.txt and dont forget to submit it ( at the very least ) via Google/Bing WebMasterTools

          1 Reply Last reply Reply Quote 0
          • Devanur-Rafi
            Devanur-Rafi last edited by

            I use GsiteCrawler all the time. Its free and gives you lot of options. You can get it here:http://gsitecrawler.com/

            Best regards,

            Devanur Rafi.

            1 Reply Last reply Reply Quote 0
            • MoosaHemani
              MoosaHemani last edited by

              I use xml-sitemaps.com for sitemap generation as its simple and easy to use!

              If you are adding sitemap link in your robots.txt file its fine but not adding is not really a big problem!

              1 Reply Last reply Reply Quote 2
              • Christy-Correll
                Christy-Correll last edited by

                Hi Angelos, you've received some great responses. Did any of them answer your question?

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • How can I index my website on yahoo.com?
                  midnights838
                  midnights838
                  0
                  3
                  27

                • Can you check my Quran site and its technical issues?
                  ShirleyLemons
                  ShirleyLemons
                  0
                  6
                  40

                • A simple link juice question!
                  Chris.Menke
                  Chris.Menke
                  0
                  5
                  89

                • When looking up a URL in GSC's URL Inspection tool has anyone ever come across a page that has the following page in "Referring Page" --> http://achadda-dev.us.archive.org/
                  0
                  1
                  27

                • I want to know how is looking my website?
                  Pauline21
                  Pauline21
                  1
                  5
                  119

                • How can I secure my website?
                  effectdigital
                  effectdigital
                  1
                  4
                  78

                • Blog Post Relevance vs Traffic
                  annonces.salam
                  annonces.salam
                  1
                  5
                  149

                • What are you doing to change their stars?
                  fatetmpwcosl
                  fatetmpwcosl
                  3
                  14
                  202

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy