The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Pro
    4. Crawl slow again

    Crawl slow again

    Moz Pro
    4 3 565
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • MarkWill
      MarkWill last edited by

      Once again the weekly crawl on my site is very slow. I have around 441 pages in the crawl and this has been running for over 12 hours. This last happened two weeks ago (ran for over 48 hours). Last week's crawl was much quicker (not sure exactly how long but guessing an hour or so).

      Is this a known issue and is there anything that can be done to unblock it? Weekends are the best time for me to assess and respond to changes I have made to my site so having this (small) crawl take most of the weekend is really quite problematic.

      Thanks.

      Mark

      1 Reply Last reply Reply Quote 0
      • irvingw
        irvingw last edited by

        Have you tried changing the crawl rate in Google Webmaster Tools? Also make sure your robots.txt isn't specifying a crawl rate delay

        MarkWill 1 Reply Last reply Reply Quote 0
        • MarkWill
          MarkWill @irvingw last edited by

          Thank you for the response. I do not have a robots.txt file. I'm not following how the Google crawl rate effects this (but would love to learn why). I thought that is only used to define how often Google itself crawls my site and has nothing directly to do with SEOMoz. Also, it is not how often the SEOMoz crawl takes (it starts on time each Saturday) but, rather, how long it takes to complete. For two of the last three weeks it has taken almost 48 hours from start to finish.

          Thanks again.

          Mark

          1 Reply Last reply Reply Quote 0
          • KeriMorgret
            KeriMorgret last edited by

            Your best bet right now is to contact the SEOmoz help desk with an email to help@seomoz.org. They may (not sure) be able to have your crawl start on a different day of the week so it's ready for you by the weekend, and should be able to answer all of your crawl-related questions in general.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Crawl Diagnostics: Next crawl date is in the past
              Abe_Schmidt
              Abe_Schmidt
              0
              4
              291

            • Unable to crawl pages
              KingPings
              KingPings
              0
              5
              122

            • Crawl Diagnostics - Crawling way more pages than my site has?
              LodestoneGen
              LodestoneGen
              0
              5
              410

            • Why is my domain not being crawled anymore?
              ChiarynMiranda
              ChiarynMiranda
              0
              6
              280

            • How do I force a crawl?
              NakulGoyal
              NakulGoyal
              0
              6
              1.5k

            • Only 1 page has been crawled. Why?
              tompollard
              tompollard
              0
              5
              557

            • Crawling One Page
              KeriMorgret
              KeriMorgret
              0
              2
              654

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy