The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Site Map Problems or Are They?

    Site Map Problems or Are They?

    Technical SEO Issues
    3 2 204
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Professor
      Professor last edited by

      According to webmaster tools my Sitemap contains urls which are blocked by robots.txt

      Our site map is generically generated and encompasses all web pages, whether I have excluded them using the robots.txt file

      As far as I am aware this has never been an issue until recently. Is this hurting my rankings and how do I fix it?

      Secondly, webmaster tools says there is over 5,000 error/warnings on my site map. But site map is only 1,400 or so pages submitted. How do I see what is going on?

      1 Reply Last reply Reply Quote 0
      • OlegKorneitchouk
        OlegKorneitchouk last edited by

        Usually, you would only put links you want indexed into the sitemap.xml file. GWT is just letting you know some of those links you posted are being blocked by robots (and wont be indexed). Shouldn't hurt your rankings if you don't want to index those pages anyways.

        Check out the Optimization > Sitemaps > # errors link in GWT for more details.

        Professor 1 Reply Last reply Reply Quote 0
        • Professor
          Professor @OlegKorneitchouk last edited by

          Thanks for the robots.txt help - kind of what I figured it's just never said anything about it before.

          Now for the 5000+ errors/warnings for the site map, it only allows me to see a few of them - how do I see the rest? the issue with the robot.txt problem is all i can see right now

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Indexing problem a large site
            Andy-Halliday
            Andy-Halliday
            1
            6
            67

          • Google Indexing of Site Map
            David-Kley
            David-Kley
            0
            6
            172

          • Will sitemap generated in Yoast for a combined wordpress/magento site map entire site ?
            Dan-Lawrence
            Dan-Lawrence
            0
            5
            1.4k

          • Site Map
            OCFurniture
            OCFurniture
            0
            4
            379

          • Redirects in site map
            Cyrus-Shepard
            Cyrus-Shepard
            0
            3
            231

          • Penalities in a brand new site, Sandbox Time or rather a problem of the site?
            KTaylor
            KTaylor
            0
            4
            528

          • Site maps, Is there any benefit?
            Aran_Smithson
            Aran_Smithson
            0
            5
            416

          • Some sites like bbc.co.uk place the most important category links at the bottom of the page while other sites will place the whole site map there. What are the benefits (or not) of both approaches?
            Christy-Correll
            Christy-Correll
            0
            6
            1.0k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy