The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Webmaster tools crawl stats

    Webmaster tools crawl stats

    Technical SEO Issues
    3 2 321
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Dan-Lawrence
      Dan-Lawrence last edited by

      Hi

      I have a clients site that was having aprox 30 - 50 pages crawled regularly since site launch up until end of Jan.

      On the 21st Jan the crawled pages dropped significantly from this average to about 11 - 20 pages per day.

      This also coincided with a massive rankings drop on the 22nd which i thought was something to do with panda although it later turned out the hosts had changed the DNS and exactly a week after fixing it the rankings returned so i think that was the cause not panda.

      However i note that the crawl rate still hasn't returned to what it was/previous average and is still following the new average of 10-20 pages per day rather than the 30-50 pages per day.

      Does anyone have any ideas why this is ?

      I have since added a site map but hasnt increased crawl rate since

      A bit of further info if it helps in any way is that In the indexed status section says 48 pages ever crawled with 37 pages indexed. There are 48 pages on the site.  The site map section says 37 submitted with 35 indexed.

      I would have thought that since dynamic site map would submit all urls

      Any clarity re the above much appreciated ?

      Cheers

      Dan

      1 Reply Last reply Reply Quote 0
      • EEE3
        EEE3 last edited by

        Hi Dan,

        If you're comfortable with it, post your client's website and sitemap link here for people to take a look at.

        Dan-Lawrence 1 Reply Last reply Reply Quote 0
        • Dan-Lawrence
          Dan-Lawrence @EEE3 last edited by

          Hi EE3

          Sorry but im not otherwise would have done so already.  If it was one of my own projects then no problem but its a client

          Cheers

          Dan

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Webmaster tools showing 200 page load ok - all other testing tools show a 301
            RobertN-London
            RobertN-London
            0
            3
            45

          • Where are the crawled URLS in webmaster tools coming from?
            CleverPhD
            CleverPhD
            0
            4
            202

          • Bogus Crawl Errors in Webmaster Tools?
            EGOL
            EGOL
            0
            5
            206

          • Has Google Stopped Listing URLs with Crawl Errors in Webmaster Tools?
            SEOAndy
            SEOAndy
            0
            2
            129

          • Error in webmaster tools
            TakeshiYoung
            TakeshiYoung
            0
            2
            79

          • Webmaster tools
            TomRayner
            TomRayner
            0
            2
            178

          • Google Webmaster Tool - Crawl Stats Query ?
            AlanMosley
            AlanMosley
            0
            3
            2.0k

          • Google Webmaster tools vs SeoMOZ Crawl Diagnostics
            Yorkie
            Yorkie
            0
            5
            1.4k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy