The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Should I block robots from URLs containing query strings?

    Should I block robots from URLs containing query strings?

    Technical SEO Issues
    4 3 681
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ShearingsGroup
      ShearingsGroup last edited by

      I'm about to block off all URLs that have a query string using robots.txt. They're mostly URLs with coremetrics tags and other referrer info. I figured that search engines don't need to see these as they're always better off with the original URL.

      Might there be any downside to this that I need to consider?

      Appreciate your help / experiences on this one.

      Thanks

      Jenni

      1 Reply Last reply Reply Quote 0
      • anthonydnelson
        anthonydnelson last edited by

        The downside to this would be if someone linked to the page with the query string, the search engines wouldn't crawl the page and flow link juice properly to the rest of your site.

        Other options:

        1. Use Google and Bing WMT to ignore those parameter query strings.

        2. Make sure the canoncial tag is on those pages, pointing back to the version without the query string

        3. Try to pass referrer info behind the scenes if possible

        ShearingsGroup 1 Reply Last reply Reply Quote 0
        • kchandler
          kchandler last edited by

          Instead of blocking them with robots.txt (which isn't very effective), try using the canonical tag instead.

          For instance, a URL like this:
          http://wwww.testdomain.com/page.html?utm_source=Google&utm_medium=Banner&utm_campaign=Campaign

          You could add this canonical tag in the head:

          With this solution you don't have to worry about losing quality links OR having your query tracking show up in any of the major search engines.

          Cheers- Kyle

          1 Reply Last reply Reply Quote 0
          • ShearingsGroup
            ShearingsGroup @anthonydnelson last edited by

            Thanks for your suggestions. I've already got canonical tags on every page, but they're not all being adhered to and lots of URLs with query strings are still getting organic traffic.

            Passing referrer info behind scenes isn't an option with Coremetrics I don't think. Is it?

            Interested to know more about number 1 though. How would you do that in WMT other than blocking with robots.txt?

            Thanks

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • "Url blocked by robots.txt." on my Video Sitemap
              sergeystefoglo
              sergeystefoglo
              0
              3
              521

            • How to Remove Old Comment Page Query String URLs
              jonmifsud
              jonmifsud
              0
              2
              151

            • No indexing url including query string with Robots txt
              HMK-NL
              HMK-NL
              0
              7
              19.2k

            • Query strings in Canoncials URLs
              irvingw
              irvingw
              0
              4
              373

            • Crawl reveals hundreds of urls with multiple urls in the url string
              irvingw
              irvingw
              0
              5
              455

            • Warnings for blocked by blocked by meta-robots/meta robots Nofollow...how to resolve?
              Cyrus-Shepard
              Cyrus-Shepard
              0
              3
              415

            • Query string in url - duplicate content?
              rhutchings
              rhutchings
              0
              6
              4.9k

            • URL query strings and canonical tag
              bizarro1000
              bizarro1000
              0
              3
              6.5k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy