The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Search Engine Trends
    4. A Serious drop in Pages crawled per day

    A Serious drop in Pages crawled per day

    Search Engine Trends
    4 3 2.4k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • vividvilla
      vividvilla last edited by

      On 21st April ,I spotted a sudden decrease in pages crawled per day.Previously it was about 5,000 bust after the drop it reached to 225.From the crawl rate never spiked.

      Here is my website url - http://www.wpstuffs.com/

      8fQHW2G.png

      1 Reply Last reply Reply Quote 0
      • danatanseo
        danatanseo last edited by

        Yes, well there are a couple of things to consider and test.

        First and foremost, check your GWT code and make sure that nothing's change. Same with Google Analytics.

        Have you changed platforms?

        If not, I would say it's "Hoy Crap Batman" time and you need to start analyzing everything. What's your Pagespeed? Is your site online? If so, was it offline earlier in the week? (Maybe you weren't checking every minute) If your site is hosted by someone else, get on the phone and demand some answers.

        1 Reply Last reply Reply Quote 1
        • vividvilla
          vividvilla last edited by

          Iam using WordPress blogging platform and checked the GWT and Analytics but there were no break in code.

          Im using Google Pagespeed CDN service ? will that cause such problems.Previously I was using Cloudflare.

          Current PageSpeed is 92 and load time is under 3seconds.I checked the pingdom report and it doesn't show any down time stats.

          1 Reply Last reply Reply Quote 0
          • WorldText
            WorldText last edited by

            What strikes me is at the same time as your pages crawled fell off a cliff your page load time doubles.  What changed round about then that would have caused an increase in load times?

            If that was around the time you switched CDN, I'd be double and triple checking the new one was set up perfectly and is an improvement on cloudflare.  Did all your pages suddenly get markedly bigger, perhaps due to another plugin being added?  Pingdom tools is also great for picking apart load times.

            That would be where I'd start...

            1 Reply Last reply Reply Quote 1
            • 1 / 1
            • First post
              Last post
            • One of our top visited page (login page) missing primary keyword, does this makes ranking drop of our homepage for same keyword?
              evolvingSEO
              evolvingSEO
              0
              3
              50

            • Why is Page Authority dropping?
              BeckyKey
              BeckyKey
              0
              5
              228

            • Ranking dropped with no page changes
              Nobody1530189339743
              Nobody1530189339743
              0
              4
              119

            • Reasons for a sharp decline in pages crawled
              Symmetri
              Symmetri
              0
              4
              386

            • Drop in Page Indexing, Small rise in Search Queries
              Dr-Pete
              Dr-Pete
              0
              6
              195

            • Sudden drop in rankings and indexed pages!
              TakeshiYoung
              TakeshiYoung
              0
              4
              322

            • Ideas on why Pages Per Visit Dropped?
              Aggie
              Aggie
              0
              7
              646

            • Our Rankings are being very inconsistent! Some days we are on the front page, some days we are not in the top 50\. This happens on a weekly and sometimes daily basis... Any thoughts on why this is happening? This newbie appreciates any feedback.
              danatanseo
              danatanseo
              0
              6
              454

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy