The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Disallow: /sr/ and Disallow: /si/ - robots.txt

    Disallow: /sr/ and Disallow: /si/ - robots.txt

    Web Design
    3 2 74
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • McTaggart
      McTaggart last edited by

      Hello Mozzers - I have come across the two directives above in a robots.txt file of a website - the web dev isn't sure what they meant although he implemented robots.txt - I think just legacy stuff that nobody has analysed for years - I vaguely recall sr means search request but can't remember.

      If any of you know what these directives do, then please let me know.

      1 Reply Last reply Reply Quote 0
      • ThomasHarvey
        ThomasHarvey last edited by

        Have a look at your site through http://web.archive.org/. You'll be able to see what the directories were used for.

        However, if there's no use for them on the current site then what's the purpose of keeping these disallows in the robots.txt?

        1 Reply Last reply Reply Quote 2
        • McTaggart
          McTaggart last edited by

          Thanks Tomas and Mike - good advice - I have done that and found legacy stuff they've since moved away from - there is indeed no current use for the directives.

          I wonder whether there's any resource on the web that lists all robots.txt directives - and interprets them - if not then perhaps it would an idea for Moz?

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Reason for robots.txt file blocking products on category pages?
            Frankie-BTDublin
            Frankie-BTDublin
            0
            7
            183

          • Needs clarification: How "Disallow: /" works?
            Christy-Correll
            Christy-Correll
            0
            5
            84

          • Robots.txt being blocked
            SOM24
            SOM24
            0
            9
            1.4k

          • How to command Robots.txt to this:
            Chenzo
            Chenzo
            0
            7
            151

          • Question #2: All of my INTERNAL links in OSE are being indexed from http://www.e.com/default.asp, and all my EXTERNAL links are linked to http://www.e.com/ am I getting a fraction of the link juice because of that?????
            RobertFisher
            RobertFisher
            0
            2
            157

          • RSS Submissions Positive/Negative/Neutral Impact...
            HiveDigitalInc
            HiveDigitalInc
            0
            2
            519

          • Is it OK to 301 Redirect http://homepage.com to http://blog.homepage.com?
            SimonCullum
            SimonCullum
            0
            4
            601

          • Correct use for Robots.txt
            EricVallee34
            EricVallee34
            0
            5
            1.0k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy