The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Blocking other engines in robots.txt

    Blocking other engines in robots.txt

    Technical SEO Issues
    2 2 581
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Romancing
      Romancing last edited by

      If your primary target of business is not in China is their any benefit to blocking Chinese search robots in robots.txt?

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        I don't see any benefit to blocking search engines with robots.txt with the exception of Bing or Google as necessary.

        Robots.txt is strictly a suggestion to those crawlers who care enough to respect your wishes.

        The only benefit it can offer is IF a crawler chooses to respect your wishes, then your site will have a bit less traffic volume during the crawl. The reality is any specific crawler from one of the many random companies is going to visit so infrequently it wont make any noticeable difference.

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • How to use robots.txt to block areas on page?
          LauraHT
          LauraHT
          0
          8
          225

        • Blocking Affiliate Links via robots.txt
          FedeEinhorn
          FedeEinhorn
          0
          2
          1.9k

        • Block or remove pages using a robots.txt
          OlegKorneitchouk
          OlegKorneitchouk
          0
          2
          422

        • Warnings for blocked by blocked by meta-robots/meta robots Nofollow...how to resolve?
          Cyrus-Shepard
          Cyrus-Shepard
          0
          3
          415

        • Search engines have been blocked by robots.txt., how do I find and fix it?
          KeriMorgret
          KeriMorgret
          0
          7
          524

        • Blocking robots.txt
          de4e
          de4e
          0
          4
          432

        • Robots.txt blocking site or not?
          RyanKent
          RyanKent
          0
          2
          445

        • Search Engine Blocked by Robot Txt warnings for Filter Search result pages--Why?
          languedoc
          languedoc
          0
          5
          915

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy