The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. BEST Wordpress Robots.txt Sitemap Practice??

    BEST Wordpress Robots.txt Sitemap Practice??

    Technical SEO Issues
    2 2 1.7k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • joony2008
      joony2008 last edited by

      Alright, my question comes directly from this article by SEOmoz

      http://www.seomoz.org/learn-seo/robotstxt

      Yes, I have submitted the sitemap to google, bing's webmaster tools and

      and I want to add the location of our site's sitemaps and does it mean that I erase everything in the robots.txt right now and replace it with?

      <code>User-agent: *
      Disallow: 
      
      Sitemap: http://www.example.com/none-standard-location/sitemap.xml</code>
      

      <code>???</code>

      
      because Wordpress comes with some default disallows like wp-admin, trackback, plugins.
      
      I have also read other questions. but was wondering if this is the correct way to add sitemap on Wordpress Robots.txt
      
      http://www.seomoz.org/q/robots-txt-question-2
      
      http://www.seomoz.org/q/quick-robots-txt-check.
      
      http://www.seomoz.org/q/xml-sitemap-instruction-in-robots-txt-worth-doing
      
      I am using Multisite with Yoast plugin so I have more than one sitemap.xml to submit
      
      Do I erase everything in Robots.txt and replace it with how SEOmoz recommended? hmm that sounds not right.
      
      

      User-agent: *
      Disallow:
      Disallow: /wp-admin
      Disallow: /wp-includes
      Disallow: /wp-login.php
      Disallow: /wp-content/plugins
      Disallow: /wp-content/cache
      Disallow: /wp-content/themes
      Disallow: /trackback
      Disallow: /comments

      
      **ERASE EVERYTHING??? and changed it to**
      
      

      <code> <code>
      <code>User-agent: *
      Disallow: </code>

      Sitemap: http://www.example.com/sitemap_index.xml</code>
      
      <code>```
      Sitemap: http://www.example.com/sub/sitemap_index.xml
      ```</code> 
      
      <code>?????????</code>
      ```</code> 
      
      1 Reply Last reply Reply Quote 0
      • evolvingSEO
        evolvingSEO last edited by

        This is a duplicate question and was answered in another thread.

        Thanks!

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Adding your sitemap to robots.txt
          Martijn_Scheijbeler
          Martijn_Scheijbeler
          0
          3
          2.9k

        • 2 sitemaps on my robots.txt?
          MonkStein
          MonkStein
          0
          6
          9.2k

        • Robots.txt and Multiple Sitemaps
          allstatetransmission
          allstatetransmission
          0
          3
          10.9k

        • Robots.txt best practices & tips
          ThompsonPaul
          ThompsonPaul
          0
          4
          3.2k

        • Best practice for XML sitemap depth
          SanketPatel
          SanketPatel
          0
          3
          1.9k

        • Wordpress Robots.txt Sitemap submission?
          evolvingSEO
          evolvingSEO
          0
          2
          387

        • Robots.txt Sitemap with Relative Path
          ClickConsult
          ClickConsult
          0
          2
          8.1k

        • Robots.txt and robots meta
          TheEspresseo
          TheEspresseo
          0
          5
          1.1k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy