The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Wordpress Robots.txt Sitemap submission?

    Wordpress Robots.txt Sitemap submission?

    Technical SEO Issues
    2 2 387
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • joony2008
      joony2008 last edited by

      Alright, my question comes directly from this article by SEOmoz

      http://www.seomoz.org/learn-seo/r...

      Yes, I have submitted the sitemap to google, bing's webmaster tools and

      and I want to add the location of our site's sitemaps and does it mean that I erase everything in the robots.txt right now and replace it with?

      <code>User-agent: *
      Disallow: 
      
      Sitemap: http://www.example.com/none-standard-location/sitemap.xml</code>
      

      <code>???</code>

      
      because Wordpress comes with some default disallows like wp-admin, trackback, plugins.
      
      I have also read this, but was wondering if this is the correct way to add sitemap on Wordpress Robots.txt.
      
      [http://www.seomoz.org/q/removing-...](http://www.seomoz.org/q/removing-robots-txt-on-wordpress-site-problem)
      
      I am using Multisite with Yoast plugin so I have more than one sitemap.xml to submit
      
      Do I erase everything in Robots.txt and replace it with how SEOmoz recommended? hmm that sounds not right.
      
      like 
      
      

      <code> <code>
      <code>User-agent: *
      Disallow: </code>

      Sitemap: http://www.example.com/sitemap_index.xml</code>
      
      <code>```
      Sitemap: http://www.example.com/sub/sitemap_index.xml
      ```</code> 
      
      <code>?????????</code>
      ```</code> 
      
      1 Reply Last reply Reply Quote 0
      • evolvingSEO
        evolvingSEO last edited by

        Hi!

        Definitely don't delete what's in the robots.txt file now. Simply add the sitemap lines at the top of the file, one per line - like this example from the WordPress documentation

        Leave everything is intact below it that is already in your robots.txt file. You probably don't have as much "stuff" as this example, so just add your sitemaps at the top and you should be all set.

        -Dan

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • How to stop robots.txt restricting access to sitemap?
          PatrickDelehanty
          PatrickDelehanty
          0
          3
          181

        • "Url blocked by robots.txt." on my Video Sitemap
          sergeystefoglo
          sergeystefoglo
          0
          3
          521

        • Is sitemap required on my robots.txt?
          LoganRay
          LoganRay
          0
          4
          7.3k

        • What are the negative implications of listing URLs in a sitemap that are then blocked in the robots.txt?
          Dezzign
          Dezzign
          0
          3
          153

        • Will an XML sitemap override a robots.txt
          mememax
          mememax
          0
          5
          2.4k

        • BEST Wordpress Robots.txt Sitemap Practice??
          evolvingSEO
          evolvingSEO
          0
          2
          1.7k

        • Removing robots.txt on WordPress site problem
          nextlevelweb
          nextlevelweb
          0
          21
          38.1k

        • Robots.txt and robots meta
          TheEspresseo
          TheEspresseo
          0
          5
          1.1k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy