The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Massive increase in Moz crawl.

    Massive increase in Moz crawl.

    On-Page / Site Optimization
    2 2 102
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • danwebman
      danwebman last edited by

      I have a subdomain which has just started to be crawled by Moz, Previously this wasn't the case.

      The sub-domain had 16,000+ issues. Why has Moz started to count sub-domains as part  of the main domain, has Google started to do this aswell?

      1 Reply Last reply Reply Quote 0
      • Moz.HelpTeam
        Moz.HelpTeam last edited by

        Hi Dave!

        Thanks for reaching out! My name is Anne, and I helping the Mozzer Alliance today! There could be a few different reasons we've just started crawling this subdomain:

        1. Did you recently link this subdomain to your site differently? Our crawler starts with your home page and uses recursive crawling to find pages on your site through the links we find. This could explain why we just started crawling the subdomain.

        2. Did you change your robots.txt for this subdomain? Our crawler, Rogerbot, follows robots.txt. If you edited this site recently, this could also explain why we just started crawling your subdomain.

        I hope this helps! If you have more questions, please reach out to the help team at https://moz.com/help/contact. From there we can help you troubleshoot what's going on, but keep your campaign details off the interwebz.

        Have a great weekend!

        Anne 😃

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Redirect and Redirect Error in Moz Crawl
          andy.bigbangthemes
          andy.bigbangthemes
          0
          4
          49

        • Moz crawl
          WallerD
          WallerD
          0
          5
          99

        • Crawl errors
          MonicaOConnor
          MonicaOConnor
          0
          3
          75

        • Moz Crawl Shows Duplicate Content Which Doesn't Seem To Appear In Google?
          scottiedog
          scottiedog
          0
          3
          90

        • Crawl with cach problem
          Andropenis_Australia
          Andropenis_Australia
          0
          2
          214

        • I built a website on magentogo - IrisScottPrints.com. The seomoz crawl report states 301 rel canonical crawl notices. What if anything should I change?
          RedTrout
          RedTrout
          0
          3
          259

        • SEOmoz crawl error
          DrWho
          DrWho
          0
          6
          559

        • Why has only one page been crawled?
          KeriMorgret
          KeriMorgret
          0
          13
          1.0k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy