The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Robots.txt for Facet Results

    Robots.txt for Facet Results

    Intermediate & Advanced SEO
    4 3 140
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • BeckyKey
      BeckyKey last edited by

      Hi

      Does anyone know how to properly add facets URL's to Robots txt?

      E.g. of our facets URL -

      http://www.key.co.uk/en/key/platform-trolleys-trucks#facet:-10028265807368&productBeginIndex:0&orderBy:5&pageView:list&

      Everything after the # will need to be blocked on all pages with a facet.

      Thank you

      1 Reply Last reply Reply Quote 0
      • CleverPhD
        CleverPhD last edited by

        Google ignores everything after the hash to start with, so you do not need to block it to finish with.  It is a clever way to pass parameters without having to worry about Google getting lost.

        OlegKorneitchouk BeckyKey 2 Replies Last reply Reply Quote 4
        • OlegKorneitchouk
          OlegKorneitchouk @CleverPhD last edited by

          This is the right answer.

          Great way to check is to see if you have multiple versions of that URL indexed, which you don't: https://www.google.com/search?q=site:http://www.key.co.uk/en/key/platform-trolleys-trucks

          1 Reply Last reply Reply Quote 1
          • BeckyKey
            BeckyKey @CleverPhD last edited by

            Great thank you!

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Search Results Pages Blocked in Robots.txt?
              BeckyKey
              BeckyKey
              0
              3
              117

            • Robots.txt advice
              Martijn_Scheijbeler
              Martijn_Scheijbeler
              0
              3
              105

            • Twitter Robots.TXT
              MarketingChimp10
              MarketingChimp10
              0
              5
              453

            • Robots.txt Help
              GlobeRunner
              GlobeRunner
              0
              5
              162

            • Robots.txt Allowed
              GlobeRunner
              GlobeRunner
              0
              4
              118

            • Why are these results being showed as blocked by robots.txt?
              eyepaq
              eyepaq
              0
              9
              203

            • Robot.txt error
              Rubix
              Rubix
              0
              13
              203

            • Block all search results (dynamic) in robots.txt?
              onwebtoday
              onwebtoday
              0
              9
              4.8k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy