The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?

    Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?

    Other Research Tools
    3 2 43
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ctripp1010
      ctripp1010 last edited by

      When I look at the site crawl available through my dashboard, it reports 22.9K pages crawled.  I just ran a on-demand crawl and it is only reporting 6K pages crawled.  Why is the number so much lower?

      1 Reply Last reply Reply Quote 0
      • dave.kudera
        dave.kudera last edited by

        Hey Charles!

        The scope of the two tools are different, Site Crawl has a much higher limit of pages that can be crawled, with you plan we look for up to 20k 200ok pages, where On Demand Crawl is looking for only the first 3k pages that return 200 ok status.

        Hope that helps, let me know if you need anything else.

        ctripp1010 1 Reply Last reply Reply Quote 1
        • ctripp1010
          ctripp1010 @dave.kudera last edited by

          Thanks!  Can you tell me how long it generally takes for the Site Crawl to run?  Mine has been reporting it is "In progress"  for the past 8hrs??

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Moz Pro OnDemand Crawl fail on on WordPress site
            Natalie-Alexis
            Natalie-Alexis
            0
            2
            25

          • How To Stop Moz Crawl From Prepending /blog/ on all our site urls that it crawls
            samantha.chapman
            samantha.chapman
            1
            2
            32

          • Why is Moz Crawling More Pages Than My Site Actually Has?
            tawnycase
            tawnycase
            0
            2
            60

          • Moz Crawl Report Increase in Errors?
            LisaHunt
            LisaHunt
            0
            3
            64

          • Moz Site Crawl Test 404
            Dr-Pete
            Dr-Pete
            0
            4
            99

          • I'm checking keyword difficulty for two different sites. Would love to view the results by site instead of just one large list. Is that possible? Or would it just be easier to keep the lists separate in Excel and just import when I want an updated report?
            0
            1
            0

          • Signed up for moz reports - have received Moz error report - need someone who is capable to take report and perform cleanup edits within Joomla site?
            PortlandWebDesign
            PortlandWebDesign
            0
            5
            112

          • For some reason MOZ is not indexing anything but the home page of my site. Google appears to be indexing the whole site. But it makes my MOZ reports useless. Any recommendations?
            LynnPatchett
            LynnPatchett
            0
            6
            143

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy