The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Blocking other engines in robots.txt

    Blocking other engines in robots.txt

    Technical SEO Issues
    2 2 581
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Romancing
      Romancing last edited by

      If your primary target of business is not in China is their any benefit to blocking Chinese search robots in robots.txt?

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        I don't see any benefit to blocking search engines with robots.txt with the exception of Bing or Google as necessary.

        Robots.txt is strictly a suggestion to those crawlers who care enough to respect your wishes.

        The only benefit it can offer is IF a crawler chooses to respect your wishes, then your site will have a bit less traffic volume during the crawl. The reality is any specific crawler from one of the many random companies is going to visit so infrequently it wont make any noticeable difference.

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • Blocking subdomains with Robots.txt file
          PaulM01
          PaulM01
          0
          3
          641

        • Blocked jquery in Robots.txt, Any SEO impact?
          Andy.Drinkwater
          Andy.Drinkwater
          0
          4
          652

        • Block Domain in robots.txt
          donford
          donford
          0
          6
          2.2k

        • Warnings for blocked by blocked by meta-robots/meta robots Nofollow...how to resolve?
          Cyrus-Shepard
          Cyrus-Shepard
          0
          3
          415

        • Blocking robots.txt
          de4e
          de4e
          0
          4
          432

        • Robots.txt blocking site or not?
          RyanKent
          RyanKent
          0
          2
          445

        • Robots.txt and robots meta
          TheEspresseo
          TheEspresseo
          0
          5
          1.1k

        • Search Engine blocked by robots.txt
          Goetzman
          Goetzman
          0
          7
          1.2k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy