The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Not able to serve different robots.txt for CDN77

    Not able to serve different robots.txt for CDN77

    Web Design
    3 2 282
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Aman_123
      Aman_123 last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • KaneJamison
        KaneJamison last edited by

        Your code looks like the code described for "NXG Platform" on this page. Are you sure the first option on that page isn't the correct one since your site appears to be on SSL?

        serve different robots.txt for CDN77's edge servers

        so search bots will be blocked on edge server's robots.txt file

        RewriteEngine On
        RewriteCond %{HTTP:VIA} ^..worldcdn..$ 
        RewriteRule ^robots.txt$ robots_cdn77.txt [L]

        Aman_123 1 Reply Last reply Reply Quote 0
        • Aman_123
          Aman_123 @KaneJamison last edited by

          You are right but the mentioned link is an old article CDN77 is 100% on NGX

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Reason for robots.txt file blocking products on category pages?
            Frankie-BTDublin
            Frankie-BTDublin
            0
            7
            183

          • Block parent folder in robot.txt, but not children
            Martijn_Scheijbeler
            Martijn_Scheijbeler
            0
            3
            547

          • Robots.txt being blocked
            SOM24
            SOM24
            0
            9
            1.4k

          • Strategy for implementing different languages
            bradpts
            bradpts
            0
            3
            140

          • Is it okay to design different mobile site for different browsers
            MonicaOConnor
            MonicaOConnor
            0
            2
            109

          • Using (duplicate) content in different contexts
            LynnPatchett
            LynnPatchett
            0
            6
            110

          • Robots.txt - Allow and Disallow. Can they be the same?
            eventurerob
            eventurerob
            0
            9
            801

          • Search directory - How to apply robots
            Blenny
            Blenny
            0
            3
            276

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy