The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Magento Robots & overly dynamic URL-s

    Magento Robots & overly dynamic URL-s

    Technical SEO Issues
    3 2 488
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • tilenkrivec
      tilenkrivec last edited by

      How can i block all URL-s on a Magento store that have 2 or more dynamic parameters in it, since all the parameters have attribute name in it and not some uniform ID

      Would something like:

      Disallow: /?&*

      work? Since the only thing that is constant throughout all the custom parameters is that they are separated with "&"

      Thanks 🙂

      1 Reply Last reply Reply Quote 0
      • OlegKorneitchouk
        OlegKorneitchouk last edited by

        Your code should work, add it then test a dynamic url via GWT > Health > Blocked URLs

        You can also set custom parameters to either be tracked or not tracked via GWT > Configuration > URL Parameters

        tilenkrivec 1 Reply Last reply Reply Quote 2
        • tilenkrivec
          tilenkrivec @OlegKorneitchouk last edited by

          Thanks, it worked 🙂

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • Robots.txt Syntax for Dynamic URLs
            btreloar
            btreloar
            0
            5
            369

          • We have designed a new site and are in dilemna whether or not to change the site's URL structure or maybe few odd looking urls. How exactly do we go about the URL thing in toto? thanks in advance, any suggestion(s) would be dearly welcome
            ShaunPhilips
            ShaunPhilips
            1
            7
            109

          • Robots.txt crawling URL's we dont want it to
            Peterli
            Peterli
            0
            2
            82

          • What's the best way to handle Overly Dynamic Url's?
            GKLA
            GKLA
            0
            2
            309

          • Should we use & or and in our url's?
            jonny512379
            jonny512379
            0
            3
            667

          • Best Practices for adding Dynamic URL's to XML Sitemap
            DeanAndrews
            DeanAndrews
            0
            3
            7.4k

          • Sort parameters and overly dynamic URLs
            ChristopherM
            ChristopherM
            0
            4
            475

          • Overly-Dynamic Urls how to fix in SEOMOZ?
            KeriMorgret
            KeriMorgret
            0
            11
            2.7k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy