The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Do I need a separate robots.txt file for my shop subdomain?

    Do I need a separate robots.txt file for my shop subdomain?

    Technical SEO Issues
    6 4 593
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • sjbridle
      sjbridle last edited by

      Hello Mozzers!

      Apologies if this question has been asked before, but I couldn't find an answer so here goes...

      Currently I have one robots.txt file hosted at https://www.mysitename.org.uk/robots.txt

      We host our shop on a separate subdomain https://shop.mysitename.org.uk

      Do I need a separate robots.txt file for my subdomain? (Some Google searches are telling me yes and some no and I've become awfully confused!

      1 Reply Last reply Reply Quote 0
      • ThomasHarvey
        ThomasHarvey last edited by

        Yes, I would have a seperate robots.txt files.

        1 Reply Last reply Reply Quote 1
        • Martijn_Scheijbeler
          Martijn_Scheijbeler last edited by

          It depends what currently is in your robots.txt. Usually it would be useful to have another one for your subdomain.

          sjbridle 1 Reply Last reply Reply Quote 1
          • sjbridle
            sjbridle @Martijn_Scheijbeler last edited by

            Currently we just have: User-agent: *

            I'm in the process of optimising.

            eyepaq 1 Reply Last reply Reply Quote 0
            • eyepaq
              eyepaq @sjbridle last edited by

              You go be fine without one. You only need one if you want to manage that subdmain: add specific xml sitemaps links in robots.txt, cut access to specific folders for that subdomain.

              if you don't need any of that - just move forward without one.

              sjbridle 1 Reply Last reply Reply Quote 2
              • sjbridle
                sjbridle @eyepaq last edited by

                Thank you. I want to disallow specific URLs on the subdomain and add the shop sitemap in the robots.txt file. So I'll go ahead and create another!

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • One robots.txt file for multiple sites?
                  RyanPurkey
                  RyanPurkey
                  0
                  4
                  1.1k

                • Do I need to block my cart page in robots.txt?
                  Hutch42
                  Hutch42
                  0
                  3
                  2.4k

                • Robots.txt on subdomains
                  Whittie
                  Whittie
                  0
                  3
                  3.5k

                • Is there any value in having a blank robots.txt file?
                  LiamVictor
                  LiamVictor
                  0
                  6
                  3.1k

                • Do i have my robots.txt file set up properly
                  ClaireH-184886
                  ClaireH-184886
                  1
                  4
                  319

                • Help needed with robots.txt regarding wordpress!
                  surfgimp
                  surfgimp
                  0
                  6
                  459

                • Robots.txt File Redirects to Home Page
                  NickPateman81
                  NickPateman81
                  0
                  6
                  4.1k

                • Subdomain Robots.txt
                  JohnECF
                  JohnECF
                  0
                  3
                  1.2k

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy