The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Crawl Diagnostics: How many pages (deep) will it crawl for dup content

    Crawl Diagnostics: How many pages (deep) will it crawl for dup content

    Other Research Tools
    3 3 103
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • tdawson09
      tdawson09 last edited by

      Does anyone know how deep the crawl diagnostics will crawl when searching for dup content? Will it crawl the entire site, or will it only crawl "x" amount of pages?

      Thanks!

      1 Reply Last reply Reply Quote 0
      • OlegKorneitchouk
        OlegKorneitchouk last edited by

        The number of pages crawled depends on which plan you have - https://moz.com/products/pricing

        • Standard = 250k
        • Medium = 500k
        • Large/Premium = 1.25m
        1 Reply Last reply Reply Quote 0
        • DavidLee
          DavidLee last edited by

          Hello!

          The standard and medium plans will each have a set limit to crawl up to 50,000 pages. The higher plans have adjustable limits, 10,000, 20,000, etc.

          Hope this helps

          1 Reply Last reply Reply Quote 2
          • 1 / 1
          • First post
            Last post
          • Moz Top Pages and Tool Bar Not Crawling Internal Pages and Links
            dave.kudera
            dave.kudera
            0
            2
            42

          • Many Duplicate Content Flags
            samantha.chapman
            samantha.chapman
            0
            2
            88

          • Weird 404 in Crawl Diagnostics
            DirkC
            DirkC
            0
            2
            85

          • Duplicate page content
            aignerart
            aignerart
            0
            5
            133

          • I am doing the On-page SEO for a website that's never had any SEO done before. I will start with the Pages. Is it necessary to do SEO/Keywords for older Posts?
            evolvingSEO
            evolvingSEO
            0
            5
            187

          • Crawl Diagnostic Errors
            ParvatiSingh
            ParvatiSingh
            0
            3
            111

          • Is there a way to get Page Authority values included in the Crawl Diagnostic .csv export?
            Peterli
            Peterli
            0
            2
            109

          • Duplicate page content
            Linda-Vassily
            Linda-Vassily
            0
            3
            115

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy