The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Affiliate Marketing
    4. Blocking external links in Robots.txt - need advice on Best Practice

    Blocking external links in Robots.txt - need advice on Best Practice

    Affiliate Marketing
    2 2 2.4k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Ben_Malkin_Develo
      Ben_Malkin_Develo last edited by

      I look after an affiliate site that is doing quite well in the search rankings. We've been doing a review of our practices and one thing that has cropped up is our robots.txt.

      In it, we disallow Google from crawling external links. This used to be best practice in the affiliate industry a couple of years ago, but I wanted to know if this is still the case, and what the implications are if we were to:

      a/ leave it as is?

      b/ allow crawling?

      Thanks in advance.

      1 Reply Last reply Reply Quote 0
      • GlobeRunner
        GlobeRunner last edited by

        I'm not sure how you're blocking Google from crawling external links in the robots.txt file--typically you only block them from crawling internal pages on your site.

        If you're using a script, though, to track the clicks on external links and that script is running your site (and you're blocking that script in robot.txt), then that still should be fine. You may want to add a "nofollow" tag on those links, though, so you don't end up passing link "credit" or "link juice" to those affiliates (unless you want to do that?).

        As far as external links go, though, it's typically okay (and expected) that you link out to other sites.

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • My affiliate links are being crawled by Google. Is this a bad thing? Also, should I add rel: nofollow to affiliate links?
          AswadBaghlol
          AswadBaghlol
          0
          2
          124

        • Guilty of keyword cannibalization. What's the best way to fix it without losing link juice?
          donsilvernail
          donsilvernail
          1
          2
          147

        • Setting up external link goals in GA
          john4math
          john4math
          0
          4
          2.0k

        • Tricky Situation. Need the communities help on this. Need Creative ideas. HELP! !!!!
          BizDetox
          BizDetox
          1
          15
          334

        • Tweeting affiliate links...?
          Ant71
          Ant71
          0
          2
          177

        • Link Building Intricacies
          firstconversion
          firstconversion
          0
          3
          579

        • I need some feedback on the value of affiliate aggregators like Link Share
          RobertFisher
          RobertFisher
          0
          6
          2.2k

        • Best Way for Resellers to Use Outbound Links to Software Demos
          Court_LOQUA
          Court_LOQUA
          0
          3
          689

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy