The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Do I need a separate robots.txt file for my shop subdomain?

    Do I need a separate robots.txt file for my shop subdomain?

    Technical SEO Issues
    6 4 593
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • sjbridle
      sjbridle last edited by

      Hello Mozzers!

      Apologies if this question has been asked before, but I couldn't find an answer so here goes...

      Currently I have one robots.txt file hosted at https://www.mysitename.org.uk/robots.txt

      We host our shop on a separate subdomain https://shop.mysitename.org.uk

      Do I need a separate robots.txt file for my subdomain? (Some Google searches are telling me yes and some no and I've become awfully confused!

      1 Reply Last reply Reply Quote 0
      • ThomasHarvey
        ThomasHarvey last edited by

        Yes, I would have a seperate robots.txt files.

        1 Reply Last reply Reply Quote 1
        • Martijn_Scheijbeler
          Martijn_Scheijbeler last edited by

          It depends what currently is in your robots.txt. Usually it would be useful to have another one for your subdomain.

          sjbridle 1 Reply Last reply Reply Quote 1
          • sjbridle
            sjbridle @Martijn_Scheijbeler last edited by

            Currently we just have: User-agent: *

            I'm in the process of optimising.

            eyepaq 1 Reply Last reply Reply Quote 0
            • eyepaq
              eyepaq @sjbridle last edited by

              You go be fine without one. You only need one if you want to manage that subdmain: add specific xml sitemaps links in robots.txt, cut access to specific folders for that subdomain.

              if you don't need any of that - just move forward without one.

              sjbridle 1 Reply Last reply Reply Quote 2
              • sjbridle
                sjbridle @eyepaq last edited by

                Thank you. I want to disallow specific URLs on the subdomain and add the shop sitemap in the robots.txt file. So I'll go ahead and create another!

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • One robots.txt file for multiple sites?
                  RyanPurkey
                  RyanPurkey
                  0
                  4
                  1.1k

                • Robots.txt on subdomains
                  Whittie
                  Whittie
                  0
                  3
                  3.5k

                • Is there any value in having a blank robots.txt file?
                  LiamVictor
                  LiamVictor
                  0
                  6
                  3.1k

                • Does this robots.txt file look right?
                  ThompsonPaul
                  ThompsonPaul
                  0
                  8
                  188

                • Robots.txt file
                  Asher
                  Asher
                  0
                  3
                  261

                • Robots.txt issue - site resubmission needed?
                  GBC
                  GBC
                  0
                  4
                  227

                • Does Bing ignore robots txt files?
                  Nightwing
                  Nightwing
                  0
                  3
                  2.8k

                • Robots.txt for subdomain
                  de4e
                  de4e
                  0
                  3
                  15.0k

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy