The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Pro
    4. Drop in number of Pages crawled by Moz crawler

    Drop in number of Pages crawled by Moz crawler

    Moz Pro
    5 3 412
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • AllaO
      AllaO last edited by

      What would cause a sudden drop in the number of pages crawled/accessed by the Moz crawler? The site has about 600 pages of content. We have multiple campaigns set up in our Pro account to track different keyword campaigns- but all for the same domain. Some show 600+ pages accessed, while others only access 7 pages for the same domain. What could be causing these issues?

      1 Reply Last reply Reply Quote 0
      • RobertFisher
        RobertFisher last edited by

        AllaO

        Do you have some campaigns set to track at the root and some at the sub domain? That would be the only way I could think of when they are essentially being run simultaneously.

        Best

        1 Reply Last reply Reply Quote 0
        • Nick_Sayers
          Nick_Sayers last edited by

          AllaO,

          Sorry about the odd crawl activity. I pulled up your campaigns and it looks like something blocked rogerbot from crawling. This could be new redirects or changes in your robots.txt file. If you don't think one of those is the issue get a hold of our support team: https://seomoz.zendesk.com/forums You can submit a ticket from here.

          Best of Luck

          AllaO 1 Reply Last reply Reply Quote 1
          • AllaO
            AllaO @Nick_Sayers last edited by

            Hi Nick,

            Thank you very much.. no actually we did not make any changes to robot.txt, but we have made some changes to sitemap.xml

            Could it create a temporary problem?

            Nick_Sayers 1 Reply Last reply Reply Quote 0
            • Nick_Sayers
              Nick_Sayers @AllaO last edited by

              If that was how our crawler was accessing your pages before, because there aren't links for them else where, then it could be the issue. It does depend there. There are a lot of aspects to how our crawler works so it is really hard to say.

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Moz crawl duplicate pages issues
                MonicaOConnor
                MonicaOConnor
                0
                5
                271

              • Pagination Issues on E-commerce Site: Duplicate Page Title and Content on Moz Crawl
                Dr-Pete
                Dr-Pete
                0
                3
                1.4k

              • Moz crawl only shows 2 pages, but we have more than 1000 pages.
                DavidLee
                DavidLee
                0
                8
                209

              • My moz only one page was crawled
                SmartVapes
                SmartVapes
                0
                5
                159

              • Crawled pages are missing and showing just 1 page crawled
                KeriMorgret
                KeriMorgret
                0
                3
                296

              • Amount of Pages Crawled Dropped Significantly
                KeriMorgret
                KeriMorgret
                0
                5
                439

              • Wild fluctuation in number of pages crawled
                NewGlobalVentures.comSEOTexas
                NewGlobalVentures.comSEOTexas
                0
                5
                709

              • MOZ Crawler only crawling one page per campaign
                AllaO
                AllaO
                0
                5
                740

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy