The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Robots blocked by pages webmasters tools

    Robots blocked by pages webmasters tools

    Intermediate & Advanced SEO
    7 2 76
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mihoreis
      mihoreis last edited by

      • a mistake made in software. How can I solve the problem quickly? help me.

      XTRjH

      1 Reply Last reply Reply Quote 0
      • GastonRiera
        GastonRiera last edited by

        Hello there!

        Have you identified all pages that you want to be blocked?
        If you just do not want any page to be blocked, just edit you robots.txt as:

        User-agent: *
        Disallow:

        For more information, check these resources:
        Cómo bloquear URLs con robots.txt - Google Webmasters
        About /robots.txt - robotstxt.org

        Best Luck!
        GR

        mihoreis 1 Reply Last reply Reply Quote 1
        • mihoreis
          mihoreis @GastonRiera last edited by

          Yes,

          in the shape of the photo,

          is it correct? re-scanning takes a long time?

          c4ZCy

          GastonRiera 1 Reply Last reply Reply Quote 0
          • GastonRiera
            GastonRiera @mihoreis last edited by

            its better to set it as I've discribed before:

            User-agent: *
            Disallow:

            It would take over a week, depending in scale of the website.

            mihoreis 1 Reply Last reply Reply Quote 1
            • mihoreis
              mihoreis @GastonRiera last edited by

              OK,

              I did,

              can you check from the picture.

              Thank You.

              zZd9P

              GastonRiera 1 Reply Last reply Reply Quote 0
              • GastonRiera
                GastonRiera @mihoreis last edited by

                That sitemap line place it at the end of the file.
                like this:

                User-agent: *
                Disallow:

                Sitemap: https://site.com/sitemap.xml

                Best luck!

                mihoreis 1 Reply Last reply Reply Quote 1
                • mihoreis
                  mihoreis @GastonRiera last edited by

                  Ok,

                  Updated.

                  I need to wait 1 week then 🙂

                  Thank You, Gaston

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • Search Results Pages Blocked in Robots.txt?
                    BeckyKey
                    BeckyKey
                    0
                    3
                    117

                  • URL Errors in webmaster tools to pages that don't exist?
                    popcreativeltd
                    popcreativeltd
                    0
                    12
                    2.2k

                  • Page Count in Webmaster Tools Index Status Versus Page Count in Webmaster Tools Sitemap
                    AlanBleiweiss
                    AlanBleiweiss
                    0
                    16
                    1.6k

                  • Is there a way to get a list of Total Indexed pages from Google Webmaster Tools?
                    sparrowdog
                    sparrowdog
                    0
                    7
                    10.4k

                  • Whole site blocked by robots in webmaster tools
                    AdamThompson
                    AdamThompson
                    0
                    2
                    109

                  • Soft 404's from pages blocked by robots.txt -- cause for concern?
                    CleverPhD
                    CleverPhD
                    1
                    6
                    2.0k

                  • 1200 pages no followed and blocked by robots on my site. Is that normal?
                    astahl11
                    astahl11
                    0
                    4
                    489

                  • Does using robots.txt to block pages decrease search traffic?
                    KeriMorgret
                    KeriMorgret
                    0
                    4
                    520

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy