The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Will blocking urls in robots.txt void out any backlink benefits? - I'll explain...

    Will blocking urls in robots.txt void out any backlink benefits? - I'll explain...

    Intermediate & Advanced SEO
    4 3 1.0k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • AubieJon
      AubieJon last edited by

      Ok...

      So I add tracking parameters to some of my social media campaigns but block those parameters via robots.txt. This helps avoid duplicate content issues (Yes, I do also have correct canonical tags added)... but my question is -- Does this cause me to miss out on any backlink magic coming my way from these articles, posts or links?

      Example url: www.mysite.com/subject/?tracking-info-goes-here-1234

      • Canonical tag is: www.mysite.com/subject/
      • I'm blocking anything with "?tracking-info-goes-here" via robots.txt
      • The url with the tracking info of course IS NOT indexed in Google but IT IS indexed without the tracking parameters.

      What are your thoughts?

      • Should I nix the robots.txt stuff since I already have the canonical tag in place?
      • Do you think I'm getting the backlink "juice" from all the links with the tracking parameter?

      What would you do?

      Why?

      Are you sure? 🙂

      1 Reply Last reply Reply Quote 0
      • josh-riley
        josh-riley last edited by

        If you block with robots.txt link juice can't get passed along. If your canonicals are good, then ideally you wouldn't need the robots. Also, it really removes value of the social media postings.

        So, to your question, if you have the tracking parameter blocked via robots, then no, I don't think you are getting the link juice.

        http://www.rickrduncan.com/robots-txt-file-explained

        When I want link juice passed on but want to avoid duplicate content, I'm more a fan of the no index, follow tags and using canonicals where it makes sense, too. But since you say your URLs with the parameters aren't being indexed then you must be using tags anyway to make that happen and not just relying on robots.

        To your point of "are you sure":

        http://www.evergreensearch.com/minimum-viable-seo-8-ways-to-get-startup-seo-right/

        (I do like to cite sources - there's so many great articles out there!)

        Mark_Ginsberg AubieJon 2 Replies Last reply Reply Quote 2
        • Mark_Ginsberg
          Mark_Ginsberg @josh-riley last edited by

          I agree with what Andrea wrote above - just one additional point - blocking a file via robots.txt doesn't prevent the search engine from not indexing the page. It just prevents the search engine from crawling the page and seeing the content on the page. The page may very well still show up in the index - you'll just see a snippet that your robots.txt file is preventing google from crawling the site and caching it and providing a snippet or preview. If you have canonical tags put in place properly, remove the block on the parameters in your robots.txt and let the engines do things the right way and not have to worry about this question.

          1 Reply Last reply Reply Quote 3
          • AubieJon
            AubieJon @josh-riley last edited by

            Thanks Guys...

            Yeah, I figure that's the right path to take based on what we know... But I love to hear others chime in so I can blame it all on you if something goes wrong - ha! 🙂

            Another Note: Do you think this will cause some kind of unnatural anomaly when the robots.txt file is edited? All of a sudden these links will now be counted (we assume).

            It's likely the answer is no because Google still knows about the links.. they just don't count them - but still thought I'd throw that thought out there.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Block session id URLs with robots.txt
              Mat_C
              Mat_C
              1
              4
              130

            • If Robots.txt have blocked an Image (Image URL) but the other page which can be indexed has this image, how is the image treated?
              alphonseha
              alphonseha
              1
              4
              1.4k

            • Blocking out specific URLs with robots.txt
              Modi
              Modi
              0
              3
              133

            • Can URLs blocked with robots.txt hurt your site?
              workzentre
              workzentre
              0
              4
              302

            • If i disallow unfriendly URL via robots.txt, will its friendly counterpart still be indexed?
              Cyrus-Shepard
              Cyrus-Shepard
              0
              4
              620

            • Soft 404's from pages blocked by robots.txt -- cause for concern?
              CleverPhD
              CleverPhD
              1
              6
              2.0k

            • Block all but one URL in a directory using robots.txt?
              Cyrus-Shepard
              Cyrus-Shepard
              0
              3
              3.5k

            • Robots.txt: Link Juice vs. Crawl Budget vs. Content 'Depth'
              rishil
              rishil
              0
              5
              1.5k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy