The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Crawl rate drop

    Crawl rate drop

    Intermediate & Advanced SEO
    2 2 418
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Silviu
      Silviu last edited by

      Hi Guys,

      I have a crawl rate drop in webmastertools and can't figure out way. In the last month I removed a lot o duplicate pages that we don't need anymore, there were at least 1.5 million pages. Can this be a motive?

      D7O5x1l

      1 Reply Last reply Reply Quote 0
      • DmitriiK
        DmitriiK last edited by

        Hi there.

        Of course it can! The crawl rate is in pages per day, so if you remove pages (especially 1.5 million), there won't be as much to crawl ๐Ÿ™‚

        Also it can happen, if you have the same static pages and the crawl bot has crawled them all. Google doesn't crawl all pages all the time, they have limited resources. So, if you have launched or updated website recently and now not really updating it, you can see the change in crawl rate.

        However, you can change crawl rate for 90 days, if you need them to crawl your website constantly (usually good for websites in process of reconstruction). Here:ย https://support.google.com/webmasters/answer/48620?hl=en

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Hi. Has anyone seen a drop in their PA recently? We have over 40 clients and 80% dropped and it has been like this for the past 2 months. I wanted to check if other websites are also experiencing this drop or is it just us?
          GastonRiera
          GastonRiera
          0
          2
          57

        • Should I set a max crawl rate in Webmaster Tools?
          LiamMcArthur
          LiamMcArthur
          0
          5
          2.8k

        • Why does my site keep dropping and dropping when it comes to impressions?
          WesleySmits
          WesleySmits
          0
          6
          139

        • Adding video snippet caused drop of star rating snippet in google SERP. Any solution to show both?
          lcourse
          lcourse
          0
          7
          355

        • Google Crawl Rate and Cached version - not updated yet :(
          Perfect007
          Perfect007
          0
          2
          203

        • Is there any delay between crawling a page by google and displaying of the ratings in rich snippet of the results in google?
          NEWCRAFT
          NEWCRAFT
          0
          3
          545

        • How to Set Custom Crawl Rate in Google Webmaster Tools?
          CommercePundit
          CommercePundit
          0
          3
          798

        • What would cause a drastic drop in pages crawled per day?
          Fatwallet
          Fatwallet
          0
          7
          5.8k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        ยฉ 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy