The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Crawl test tool from SEOmoz - which URLs does it actually crawl?

    Crawl test tool from SEOmoz - which URLs does it actually crawl?

    Moz Tools
    4 3 787
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Elke.GetApp
      Elke.GetApp last edited by

      I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl.

      First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain?

      Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain?

      Thanks for your help!

      1 Reply Last reply Reply Quote 0
      • AlanMosley
        AlanMosley last edited by

        When you become a pro meneber you can set up compaigns, then you can set up by root domain and crawl all sub domains.

        the free version will crawl only one sudomain, such as

        www.example.com

        example.com

        news.example.com

        Elke.GetApp 1 Reply Last reply Reply Quote 0
        • Elke.GetApp
          Elke.GetApp @AlanMosley last edited by

          Alan, thank you for the answer. I am a Pro Member (trial version). But the only crawl diagnostics that I can find inside my campaign is a short Crawl Diagnostics summary which doesn´t include all the information that the crawl test tool gave me... I have just set up a campaign for the root domain, let´s see if the crawl diagnostics give me more information for that one.

          ShaMenz 1 Reply Last reply Reply Quote 0
          • ShaMenz
            ShaMenz @Elke.GetApp last edited by

            Hi Elke,

            An initial Pro campaign will take up to 7 days to complete and will crawl up to a maximum 10,000 URLs for the root domain or sub domain that you choose to set it up for.

            The Crawl Test tool is intended to provide a "quick start " option, which will report against the same diagnostic information, but for a limited number of URLs (3,000 & max of 2 domains per day). This allows you to get started on tidying up site issues while waiting for the full crawl to complete.

            Since the Crawl Test tool allows you to run the quick crawl for any subdomain, it can also be useful for taking a look at the health of established sites you may be quoting on etc.

            Hope that helps,

            Sha

            1 Reply Last reply Reply Quote 2
            • 1 / 1
            • First post
              Last post
            • Where is the crawl test tool located in this new site?
              rblake
              rblake
              1
              2
              142

            • Order of urls in SEOMoz crawl report
              LynnMarie
              LynnMarie
              0
              3
              804

            • Difference in data between http://pro.seomoz.org/tools/keyword-difficulty and http://lsapi.seomoz.com/linkscape/url-metrics/
              claytons
              claytons
              0
              3
              507

            • Our Duplicate Content Crawled by SEOMoz Roger, but Not in Google Webmaster Tools
              RichSteel
              RichSteel
              0
              3
              354

            • Is there a keyword suggestion tool available in the SEOMOZ suite of tools?
              webestate
              webestate
              0
              4
              468

            • 404 errors in SEOMoz crawl tool
              Mark_Jay_Apsey_Jr.
              Mark_Jay_Apsey_Jr.
              0
              2
              410

            • Only 1 page is being crawled by SEOmoz for the last 2 crawls
              KeriMorgret
              KeriMorgret
              0
              6
              863

            • Crawl test. Bot crawled only 200 or so links when it should have crawled thousands
              Ev84
              Ev84
              0
              9
              1.2k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy