The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Search Engine Trends
    4. A Serious drop in Pages crawled per day

    A Serious drop in Pages crawled per day

    Search Engine Trends
    4 3 2.4k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • vividvilla
      vividvilla last edited by

      On 21st April ,I spotted a sudden decrease in pages crawled per day.Previously it was about 5,000 bust after the drop it reached to 225.From the crawl rate never spiked.

      Here is my website url - http://www.wpstuffs.com/

      8fQHW2G.png

      1 Reply Last reply Reply Quote 0
      • danatanseo
        danatanseo last edited by

        Yes, well there are a couple of things to consider and test.

        First and foremost, check your GWT code and make sure that nothing's change. Same with Google Analytics.

        Have you changed platforms?

        If not, I would say it's "Hoy Crap Batman" time and you need to start analyzing everything. What's your Pagespeed? Is your site online? If so, was it offline earlier in the week? (Maybe you weren't checking every minute) If your site is hosted by someone else, get on the phone and demand some answers.

        1 Reply Last reply Reply Quote 1
        • vividvilla
          vividvilla last edited by

          Iam using WordPress blogging platform and checked the GWT and Analytics but there were no break in code.

          Im using Google Pagespeed CDN service ? will that cause such problems.Previously I was using Cloudflare.

          Current PageSpeed is 92 and load time is under 3seconds.I checked the pingdom report and it doesn't show any down time stats.

          1 Reply Last reply Reply Quote 0
          • WorldText
            WorldText last edited by

            What strikes me is at the same time as your pages crawled fell off a cliff your page load time doubles.  What changed round about then that would have caused an increase in load times?

            If that was around the time you switched CDN, I'd be double and triple checking the new one was set up perfectly and is an improvement on cloudflare.  Did all your pages suddenly get markedly bigger, perhaps due to another plugin being added?  Pingdom tools is also great for picking apart load times.

            That would be where I'd start...

            1 Reply Last reply Reply Quote 1
            • 1 / 1
            • First post
              Last post
            • One of our top visited page (login page) missing primary keyword, does this makes ranking drop of our homepage for same keyword?
              evolvingSEO
              evolvingSEO
              0
              3
              50

            • One day impressions drop... how to figure out why?
              MoosaHemani
              MoosaHemani
              0
              6
              164

            • Drop in Page Indexing, Small rise in Search Queries
              Dr-Pete
              Dr-Pete
              0
              6
              195

            • Rankings fluctuating by around 10 pages between night and day
              JBidigital
              JBidigital
              0
              3
              189

            • Website dropping from page 1google uk
              Johnny4B
              Johnny4B
              0
              8
              211

            • Is my page footer the reason keyword rankings have dropped?
              RichardTaylor
              RichardTaylor
              0
              4
              467

            • Source for how many searches are done on Google per day?
              josh-riley
              josh-riley
              0
              4
              2.9k

            • Kilobytes downloaded per day: poss causes for MAJOR drop?
              babble
              babble
              0
              3
              1.6k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy