The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Massive increase in Moz crawl.

    Massive increase in Moz crawl.

    On-Page / Site Optimization
    2 2 102
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • danwebman
      danwebman last edited by

      I have a subdomain which has just started to be crawled by Moz, Previously this wasn't the case.

      The sub-domain had 16,000+ issues. Why has Moz started to count sub-domains as part  of the main domain, has Google started to do this aswell?

      1 Reply Last reply Reply Quote 0
      • Moz.HelpTeam
        Moz.HelpTeam last edited by

        Hi Dave!

        Thanks for reaching out! My name is Anne, and I helping the Mozzer Alliance today! There could be a few different reasons we've just started crawling this subdomain:

        1. Did you recently link this subdomain to your site differently? Our crawler starts with your home page and uses recursive crawling to find pages on your site through the links we find. This could explain why we just started crawling the subdomain.

        2. Did you change your robots.txt for this subdomain? Our crawler, Rogerbot, follows robots.txt. If you edited this site recently, this could also explain why we just started crawling your subdomain.

        I hope this helps! If you have more questions, please reach out to the help team at https://moz.com/help/contact. From there we can help you troubleshoot what's going on, but keep your campaign details off the interwebz.

        Have a great weekend!

        Anne 😃

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • How to increase domain authority?
          RossKernez
          RossKernez
          0
          2
          55

        • Crawl errors
          MonicaOConnor
          MonicaOConnor
          0
          3
          75

        • Crawl Diagnostics Updates
          Keszi
          Keszi
          0
          4
          85

        • How to update a crawl
          KeriMorgret
          KeriMorgret
          0
          6
          317

        • Full Crawl, now what?
          Marcus_Miller
          Marcus_Miller
          0
          3
          222

        • I built a website on magentogo - IrisScottPrints.com. The seomoz crawl report states 301 rel canonical crawl notices. What if anything should I change?
          RedTrout
          RedTrout
          0
          3
          259

        • SEOmoz crawl error
          DrWho
          DrWho
          0
          6
          559

        • Pages crawled
          KeriMorgret
          KeriMorgret
          0
          3
          903

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy