The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Why should I add URL parameters where Meta Robots NOINDEX available?

    Why should I add URL parameters where Meta Robots NOINDEX available?

    Intermediate & Advanced SEO
    7 2 2.0k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • CommercePundit
      CommercePundit last edited by

      Today, I have checked Bing webmaster tools and come to know about Ignore URL parameters.

      Bing webmaster tools shows me certain parameters for URLs where I have added META Robots with NOINDEX FOLLOW syntax.

      I can see canopy_search_fabric parameter in suggested section. It's due to following kind or URLs.

      http://www.vistastores.com/patio-umbrellas?canopy_fabric_search=1728

      http://www.vistastores.com/patio-umbrellas?canopy_fabric_search=1729

      http://www.vistastores.com/patio-umbrellas?canopy_fabric_search=1730

      http://www.vistastores.com/patio-umbrellas?canopy_fabric_search=2239

      But, I have added META Robots NOINDEX Follow to disallow crawling. So, why should it happen?

      1 Reply Last reply Reply Quote 0
      • Nobody1560986989723
        Nobody1560986989723 last edited by

        I'd say the first thing to say is that NOINDEX is an assertion on your part that the pages should not be indexed. Search Bots have the ability to ignore your instruction - it should be rare that they do ignore it, but it's not beyond the realms of probability.

        What I would do in your position is add a disallow line to your** robots.txt** to completely disallow access to

        /patio-umbrellas?canopy_fabric_search*

        That should be more effective if you really don't want these URLs in the index.

        CommercePundit 1 Reply Last reply Reply Quote 0
        • CommercePundit
          CommercePundit @Nobody1560986989723 last edited by

          I'm agree to deal with Robots.txt. But, my website have 1000+ attributes for narrow by search & I don't want to disallow all dynamic pages by Robots.txt.

          Will it flexible for me to handle? And answer is no!

          What you think about it?

          Nobody1560986989723 CommercePundit 4 Replies Last reply Reply Quote 0
          • Nobody1560986989723
            Nobody1560986989723 @CommercePundit last edited by

            I suggest then you use pattern matching in order to restrict which parameters you don't want to be crawled.

            http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449

            1 Reply Last reply Reply Quote 1
            • CommercePundit
              CommercePundit @CommercePundit last edited by

              I hope, following one is for me... Right?

              Disallow: /*?
              
              1 Reply Last reply Reply Quote 0
              • Nobody1560986989723
                Nobody1560986989723 @CommercePundit last edited by

                Don't disallow: /*?

                because that may well disallow everything - you will need to be more specific than that.

                Read that whole article on pattern matching and then do a search for 'robots.txt pattern matching' and you will find some examples so you can follow something based on others' experiences.

                1 Reply Last reply Reply Quote 0
                • CommercePundit
                  CommercePundit @CommercePundit last edited by

                  This is good for me... Let me drill down more on that article.... I'll check in Google webmaster tools before make it live on server... So, It may help me more to achieve 100% perfection in task!

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • Site moved. Unable to index page : Noindex detected in robots meta tag?!
                    effectdigital
                    effectdigital
                    0
                    4
                    1.7k

                  • Internal search pages (and faceted navigation) solutions for 2018! Canonical or meta robots "noindex,follow"?
                    1
                    1
                    397

                  • URLs with parameters + canonicals + meta robots
                    JessicaZylberberg
                    JessicaZylberberg
                    0
                    3
                    154

                  • Should I disallow all URL query strings/parameters in Robots.txt?
                    OlegKorneitchouk
                    OlegKorneitchouk
                    0
                    5
                    11.2k

                  • Meta robots or robot.txt file?
                    Andy.Drinkwater
                    Andy.Drinkwater
                    0
                    5
                    152

                  • Google attempting crawl of URLs with parameter randomly placed in URL
                    CleverPhD
                    CleverPhD
                    0
                    5
                    1.6k

                  • URL Parameter is not available in website which was monitored by Google
                    0
                    1
                    678

                  • Robots.txt & url removal vs. noindex, follow?
                    Marcus_Miller
                    Marcus_Miller
                    0
                    3
                    1.6k

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy