The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Irrelevant Subfolders?

    Irrelevant Subfolders?

    Technical SEO Issues
    2 2 380
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Blobe
      Blobe last edited by

      I have my root domain and as I am a web designer, I use subfolders as sandboxes for client websites. I would not like these to be searched though because they are just demos, ideas and such. Would this be a robots.txt matter or can I have SEOMoz wok with a campaign where I can exclude subfolders? Thank you in advance! : )

      1 Reply Last reply Reply Quote 0
      • Keszi
        Keszi last edited by

        Hi Wil,

        If you want to exclude all robots from crawling these pages you can exclude them from Robots.txt.

        If you want to exclude Rogertbot you can find the info on how to do it on: http://www.seomoz.org/dp/rogerbot

        I hope that helped,

        Istvan

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Is having my homepage on a subfolder harmful?
          effectdigital
          effectdigital
          1
          4
          46

        • Subdomain or subfolder?
          NickSamuel
          NickSamuel
          0
          4
          1.6k

        • Moving a subdomain to subfolder with CNAME
          0
          1
          39

        • Moving from a subdomain to subfolder
          Vijay-Gaur
          Vijay-Gaur
          0
          3
          269

        • 404 error for irrelevant URLs
          paints-n-design
          paints-n-design
          0
          5
          170

        • Simple 301 redirect a subfolder to another subfolder
          EricaMcGillivray
          EricaMcGillivray
          0
          3
          7.6k

        • Crawling a subfolder with a dev site
          KeriMorgret
          KeriMorgret
          0
          2
          359

        • Blog in subfolder or folder
          SimonCullum
          SimonCullum
          0
          4
          422

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy