The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Online Marketing Tools
    4. Url blocked by robots.txt errors - Search Console

    Url blocked by robots.txt errors - Search Console

    Online Marketing Tools
    3 2 333
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RichardRColemanAU
      RichardRColemanAU last edited by

      Hi,

      I'm having some ongoing issues in submitting sitemaps to Google Search Console.

      I've created the sitemaps using the Google XML plugin as normal.

      When I test a map, I get this error - Url blocked by robots.txt errors followed by this note - Sitemap contains urls which are blocked by robots.txt.

      I ran the robots tester and it is good. Checked the pages to confirm they are set to be indexed. A clean open robots.txt file has been uploaded and verified in search console.

      I've done this process many times before all ok but, I am at a loss as to why this is happening this time.

      Really appreciate any assistance here.

      Thanks.

      1 Reply Last reply Reply Quote 1
      • richardbaxter
        richardbaxter last edited by

        Sometimes you get that error if a URL in the sitemap redirects via a blocked URL in robots.txt - could be that?

        RichardRColemanAU 1 Reply Last reply Reply Quote 1
        • RichardRColemanAU
          RichardRColemanAU @richardbaxter last edited by

          Hi,

          Thanks for this. I actually figured it out. There was a broken link hidden on the page. Inspected it to find it and removed it.

          Indexing now. Cheers!

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Proper Usage of the Change of Address Tool in Google Search Console After a Migration
            0
            1
            19

          • Google Search Console linking with Google Analytics
            jacleaves
            jacleaves
            0
            2
            113

          • Google Search Console showing too many pages being indexed
            Nigel_Carr
            Nigel_Carr
            0
            4
            1.6k

          • URL changes in Google Analytics and Google Search Tools
            whitewallmarketing
            whitewallmarketing
            0
            4
            109

          • Crawl error
            Happy-SEO
            Happy-SEO
            2
            4
            363

          • Url grabber?
            Travis_Bailey
            Travis_Bailey
            0
            5
            1.4k

          • Google Search Results: Biography details in search results
            WorldText
            WorldText
            0
            4
            2.3k

          • Variables in URL.
            oznappies
            oznappies
            0
            5
            951

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy