The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Mysterious drop in the Number of Pages Crawled

    Mysterious drop in the Number of Pages Crawled

    Technical SEO Issues
    4 2 119
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • GladdySEO
      GladdySEO last edited by

      The # of crawled pages on my campaign dashboard has been 90 for months.

      Approximate a week ago it dropped down to 25 crawled pages, and many links went with it.

      I have checked with my web master, and he said no changes have been made which would cause this to happen.

      I am looking for suggestions on how I can go about trouble shooting this issue, and possible solutions.

      Thanks in advance!

      1 Reply Last reply Reply Quote 0
      • jesse-landry
        jesse-landry last edited by

        did you have a sitemap on this site?

        if so, run another one now and compare them to look for answers.

        if not, run one anyway and see if that sheds any light on things.

        any changes to the robots.txt file?

        is this roger-bot's crawl you're referring to?

        GladdySEO 1 Reply Last reply Reply Quote 0
        • GladdySEO
          GladdySEO @jesse-landry last edited by

          I just ran my sitemap, and came up with 25 pages, which corresponds exactly with my Dash Board in SEOMOZ...I am still having trouble wrapping my head around why it has said 90 for months.

          Still checking robots.txt

          Thank you for the quick response!

          1 Reply Last reply Reply Quote 0
          • jesse-landry
            jesse-landry last edited by

            shouldn't be hard to check the robots file.

            go to www.yourdomain.com/robots.txt and tell us what that says. could be a server side issue as well even if they said "no changes.."

            looking at the sitemap might help you figure out what's happening. like, which of the 65 pages are missing. Are they all pages located in the same sub-directory? etc.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Very wierd pages. 2900 403 errors in page crawl for a site that only has 140 pages.
              H.M.N.
              H.M.N.
              0
              6
              64

            • How long after disallowing Googlebot from crawling a domain until those pages drop out of their index?
              MickEdwards
              MickEdwards
              0
              3
              99

            • How come only 2 pages of my 16 page infographic are being crawled by Moz?
              EricksonCoaching
              EricksonCoaching
              0
              7
              91

            • Pages with Duplicate Page Content Crawl Diagnostics
              evolvingSEO
              evolvingSEO
              0
              6
              243

            • I have 3500 pages crawled by Google, - why is SEOMOZ only able to crawl 400 of these ?
              Abe_Schmidt
              Abe_Schmidt
              0
              2
              95

            • How do I 301 redirect a number of pages to one page
              AndersS
              AndersS
              0
              5
              404

            • Homepage dropping back to page 30 and being replaced by a random page?
              KeriMorgret
              KeriMorgret
              0
              4
              775

            • Crawl report showing only 1 crawled page
              Mikpam
              Mikpam
              0
              4
              913

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy