The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. How do I exclude my blog subfolder from being crawled with my main domain (www.) folder?

    How do I exclude my blog subfolder from being crawled with my main domain (www.) folder?

    Moz Tools
    7 4 329
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • sameufemia
      sameufemia last edited by

      I am trying to setup two separate campaigns for my blog and for my main site.

      While it is easy enough to do through the wizard the results I am getting for my main site still include pages that are in my blog sub folder.

      Please Advise!

      1 Reply Last reply Reply Quote 0
      • PaddyDisplays
        PaddyDisplays last edited by

        I'm guessing you mean the seomoz, bot crawling your site?  If so why do you want to crawl them separately, because google won't, they are on the same domain.

        to answer your question, I don't think it can be done

        sameufemia 1 Reply Last reply Reply Quote 1
        • sameufemia
          sameufemia @PaddyDisplays last edited by

          Yes I am referring to the seomoz bot and I understand that google sees the two sub folders as one domain.

          I would like them to be separate just for my own work flow/ability to mange each individually with no spill over.

          But if it can't be done it can't be done.

          Thank you!

          PaddyDisplays 1 Reply Last reply Reply Quote 0
          • PaddyDisplays
            PaddyDisplays @sameufemia last edited by

            i was just thinking, you might be able to put a robots file in the subfolder telling seomoz bot not to crawl that folder, not sure if that's possible.  But make sure you only target seomozs bot only (don't want to tell google not to crawl it).

            but that would stop the subfolder being crawled completely, which I don't think you want

            1 Reply Last reply Reply Quote 0
            • ChiarynMiranda
              ChiarynMiranda last edited by

              Hey Henry,

              Thanks for writing in. Unfortunately, there isn't a way to exclude the blog from the crawl for the main site at this time. If you exclude our crawler from those pages, then we wouldn't be able to crawl for the separate blog campaign either. We do plan to allow you to ignore or remove certain pages from your crawl when we switch to the new Moz Analytics platform, but it may be some time before that is available for all of our users. I'm sorry for the inconvenience that causes in the meantime.

              Please let me know if you have any other questions.

              Chiaryn
              Help Team Ninja

              Svenne 1 Reply Last reply Reply Quote 0
              • Svenne
                Svenne last edited by

                Hey,

                now with the new Moz Analytics platform, has this been implemented yet or still on the plan? I would like to exclude a forum placed in a subfolder as this forum is not our main focus to work with SEO on. It has so many URLs and "eats" up the moz crawl budget for us.

                Thanks!

                1 Reply Last reply Reply Quote 0
                • Svenne
                  Svenne @ChiarynMiranda last edited by

                  Hi,

                  I would like to know if this idea, of excluding a subfolder from a campaign, is available now? If so, how do I set it up?

                  We have a forum in a subfolder and all the data from it kind of blurs my main interest using Seomoz for this website.

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • Other service domain or suddomain or subfolder for domain
                    mferro1984
                    mferro1984
                    0
                    3
                    85

                  • Is www.domain.com/page the same url as www.domain.com/page/ for Google? (extra slash at end of url)
                    danatanseo
                    danatanseo
                    0
                    5
                    205

                  • How to increase the Domain Authority for www.giftbig.com
                    NainaGola
                    NainaGola
                    0
                    2
                    386

                  • Domain redirection www or without
                    brandonjschwartz
                    brandonjschwartz
                    0
                    4
                    372

                  • Can I exclude a sub-domain from SEOMoz campaigns?
                    JoelDay
                    JoelDay
                    0
                    2
                    350

                  • Crawl went from a few errors to thousands when I added Blog
                    AlanMosley
                    AlanMosley
                    0
                    11
                    575

                  • Excluding parameters from seomoz crawl?
                    FrontlineMobility
                    FrontlineMobility
                    0
                    2
                    598

                  • Can I exclude pages from my Crawl Diagnostics?
                    JonathanGoodman
                    JonathanGoodman
                    0
                    3
                    556

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy