The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Mysterious drop in the Number of Pages Crawled

    Mysterious drop in the Number of Pages Crawled

    Technical SEO Issues
    4 2 119
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • GladdySEO
      GladdySEO last edited by

      The # of crawled pages on my campaign dashboard has been 90 for months.

      Approximate a week ago it dropped down to 25 crawled pages, and many links went with it.

      I have checked with my web master, and he said no changes have been made which would cause this to happen.

      I am looking for suggestions on how I can go about trouble shooting this issue, and possible solutions.

      Thanks in advance!

      1 Reply Last reply Reply Quote 0
      • jesse-landry
        jesse-landry last edited by

        did you have a sitemap on this site?

        if so, run another one now and compare them to look for answers.

        if not, run one anyway and see if that sheds any light on things.

        any changes to the robots.txt file?

        is this roger-bot's crawl you're referring to?

        GladdySEO 1 Reply Last reply Reply Quote 0
        • GladdySEO
          GladdySEO @jesse-landry last edited by

          I just ran my sitemap, and came up with 25 pages, which corresponds exactly with my Dash Board in SEOMOZ...I am still having trouble wrapping my head around why it has said 90 for months.

          Still checking robots.txt

          Thank you for the quick response!

          1 Reply Last reply Reply Quote 0
          • jesse-landry
            jesse-landry last edited by

            shouldn't be hard to check the robots file.

            go to www.yourdomain.com/robots.txt and tell us what that says. could be a server side issue as well even if they said "no changes.."

            looking at the sitemap might help you figure out what's happening. like, which of the 65 pages are missing. Are they all pages located in the same sub-directory? etc.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • How long after disallowing Googlebot from crawling a domain until those pages drop out of their index?
              MickEdwards
              MickEdwards
              0
              3
              99

            • Log files vs. GWT: major discrepancy in number of pages crawled
              danatanseo
              danatanseo
              0
              4
              104

            • How come only 2 pages of my 16 page infographic are being crawled by Moz?
              EricksonCoaching
              EricksonCoaching
              0
              7
              91

            • Pages with Duplicate Page Content Crawl Diagnostics
              evolvingSEO
              evolvingSEO
              0
              6
              243

            • The number of pages indexed on Bing DROPPED significantly.
              joony2008
              joony2008
              0
              4
              298

            • Page crawling is only seeing a portion of the pages. Any Advice?
              KeriMorgret
              KeriMorgret
              0
              5
              371

            • I have 15,000 pages. How do I have the Google bot crawl all the pages?
              KeriMorgret
              KeriMorgret
              0
              5
              714

            • Keywords Ranking Dropped from 1st Page to Above 5th Page
              Milanoocom
              Milanoocom
              0
              6
              911

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy