The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Pro
    4. Drop in number of Pages crawled by Moz crawler

    Drop in number of Pages crawled by Moz crawler

    Moz Pro
    5 3 412
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • AllaO
      AllaO last edited by

      What would cause a sudden drop in the number of pages crawled/accessed by the Moz crawler? The site has about 600 pages of content. We have multiple campaigns set up in our Pro account to track different keyword campaigns- but all for the same domain. Some show 600+ pages accessed, while others only access 7 pages for the same domain. What could be causing these issues?

      1 Reply Last reply Reply Quote 0
      • RobertFisher
        RobertFisher last edited by

        AllaO

        Do you have some campaigns set to track at the root and some at the sub domain? That would be the only way I could think of when they are essentially being run simultaneously.

        Best

        1 Reply Last reply Reply Quote 0
        • Nick_Sayers
          Nick_Sayers last edited by

          AllaO,

          Sorry about the odd crawl activity. I pulled up your campaigns and it looks like something blocked rogerbot from crawling. This could be new redirects or changes in your robots.txt file. If you don't think one of those is the issue get a hold of our support team: https://seomoz.zendesk.com/forums You can submit a ticket from here.

          Best of Luck

          AllaO 1 Reply Last reply Reply Quote 1
          • AllaO
            AllaO @Nick_Sayers last edited by

            Hi Nick,

            Thank you very much.. no actually we did not make any changes to robot.txt, but we have made some changes to sitemap.xml

            Could it create a temporary problem?

            Nick_Sayers 1 Reply Last reply Reply Quote 0
            • Nick_Sayers
              Nick_Sayers @AllaO last edited by

              If that was how our crawler was accessing your pages before, because there aren't links for them else where, then it could be the issue. It does depend there. There are a lot of aspects to how our crawler works so it is really hard to say.

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Is it normal for Moz to report on nofollow pages in crawl diagnostics?
                Chris.Menke
                Chris.Menke
                0
                2
                135

              • Crawl Diagnostics - Crawling way more pages than my site has?
                LodestoneGen
                LodestoneGen
                0
                5
                410

              • "Issue: Duplicate Page Content " in Crawl Diagnostics - but sample pages are not related to page indicated with duplicate content
                cbielich
                cbielich
                0
                2
                345

              • Amount of Pages Crawled Dropped Significantly
                KeriMorgret
                KeriMorgret
                0
                5
                439

              • Only one page has been crawled
                KeriMorgret
                KeriMorgret
                0
                7
                555

              • Issue in number of pages crawled
                Marcus_Miller
                Marcus_Miller
                0
                4
                485

              • Wild fluctuation in number of pages crawled
                NewGlobalVentures.comSEOTexas
                NewGlobalVentures.comSEOTexas
                0
                5
                709

              • Crawling One Page
                KeriMorgret
                KeriMorgret
                0
                2
                654

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy