The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Does putting Disallow: / at the end of a robots.txt file override the Allow: /xxxx that come before it?

    Does putting Disallow: / at the end of a robots.txt file override the Allow: /xxxx that come before it?

    Technical SEO Issues
    4 3 249
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • gofluent2017
      gofluent2017 last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • Alick300
        Alick300 last edited by

        Hi,

        No it won't override.

        "If you put the Disallow first, then many bots will see it as saying they can't crawl anything. By putting the Allow first, those that apply the rules from top to bottom will see that they can access that page."

        _https://stackoverflow.com/questions/19869004/robots-txt-to-disallow-all-pages-except-one-do-they-override-and-cascade_

        Thanks

        1 Reply Last reply Reply Quote 1
        • Guest
          Guest last edited by

          This post is deleted!
          1 Reply Last reply Reply Quote 0
          • Alick300
            Alick300 last edited by

            Yes agreed with james wolff,

            If you are adding Disallow:/ at last no need to adding any other disallow.

            Thanks

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Blocking subdomains with Robots.txt file
              PaulM01
              PaulM01
              0
              3
              641

            • Robots.txt Disallow: / in Search Console
              GastonRiera
              GastonRiera
              0
              2
              124

            • 'domain:example.com/' is this line with a '/' at the end of the domain valid in a disavow report file ?
              LabeliumUSA
              LabeliumUSA
              0
              3
              42

            • Is there a limit to how many URLs you can put in a robots.txt file?
              CraigBradford
              CraigBradford
              0
              10
              1.1k

            • No descripton on Google/Yahoo/Bing, updated robots.txt - what is the turnaround time or next step for visible results?
              adamhdrb
              adamhdrb
              0
              13
              618

            • Is there any value in having a blank robots.txt file?
              LiamVictor
              LiamVictor
              0
              6
              3.1k

            • Meta Robots Noindex and Robots.txt File
              Devanur-Rafi
              Devanur-Rafi
              0
              2
              125

            • Robots.txt to disallow /index.php/ path
              Mikkehl
              Mikkehl
              0
              9
              7.1k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy