The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Questions
    4. How do I reduce crawled pages?

    How do I reduce crawled pages?

    Other Questions
    5 3 167
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • etlsnhy
      etlsnhy last edited by

      I am trying to change my subscription level within Moz, but it say's that I am over my allowed number of crawled pages. Each site appears to be using 50,000 pages, but as they are only tiny sites with a maximum of a few hundred pages I have no idea why. Any idea how I can reduce this number?

      1 Reply Last reply Reply Quote 1
      • eli.myers
        eli.myers last edited by

        Hey there!

        Thanks for reaching out to us!

        At the Standard and Medium Subscription Levels, there is no ability to change the number of pages crawled. They are set at 20k pages or 50k pages respectively by default.

        It's not a count of how many pages of your site we are actually crawling, rather it's the maximum amount of pages we could crawl per Campaign.

        If you archive your Campaigns, that will bring the number down from 50k to 0 pages crawled, and then once you reach the required limit you can switch to our Standard plan.

        Let me know if you have any other questions and I'll be more than happy to help!

        Have a great day!

        Eli

        etlsnhy 1 Reply Last reply Reply Quote 2
        • etlsnhy
          etlsnhy @eli.myers last edited by

          So in order to downgrade from Medium to Standard I first have to archive all the campaigns, is that correct? What happens then when I reactivate them once we've downgraded, will they automatically be reassigned to 20k limits?

          1 Reply Last reply Reply Quote 1
          • eli.myers
            eli.myers last edited by

            You would need to archive as many Campaigns as you have on your account in order to reach the limits of the Standard plan (100,000 pages crawled). Meaning, you would only be able to have 2 Active Campaigns on your Medium Plan before you can downgrade (Assuming all the other Subscription limits are met e.g. no Keyword Lists).

            Once you reactivate them I believe that each Camoaign will automatically reassign to 20k limits.

            Let me know if you have any other questions!

            Eli 🙂

            1 Reply Last reply Reply Quote 0
            • davebuts
              davebuts last edited by

              Hi Simon,

              If your sites are only a few hundred pages and Moz is crawling 50k pages, you definitely have some crawl issues on your sites.

              Reducing the number of pages Moz can crawl won't fix these problems - you should have a good SEO take a look at your site to find out why so many pages can be crawled and find out if they really need to be crawled (they probably don't).

              You can then take the appropriate steps to improve how search engines (and crawling tools) crawl your site by blocking access to these pages.

              There's really no need to change your Moz subscription level for this problem.

              Cheers,

              David

              1 Reply Last reply Reply Quote 1
              • 1 / 1
              • First post
                Last post
              • Moz was unable to crawl - how to fix?
                tawnycase
                tawnycase
                0
                2
                255

              • How do I schedule the Moz Crawl?
                FedeEinhorn
                FedeEinhorn
                0
                2
                176

              • Medium Moz account + multiple campaigns, is there a way to set up the amount of crawled pages to each campaign?
                TimHolmes
                TimHolmes
                0
                2
                540

              • HTTPS Crawl Issues
                Cincinnati_WebTec
                Cincinnati_WebTec
                0
                4
                504

              • Page Crawl Limit
                OlegLux
                OlegLux
                0
                3
                199

              • Connect to Facebook pages
                jennita
                jennita
                0
                2
                87

              • Tracking Google Page
                worldviewpr
                worldviewpr
                0
                6
                113

              • "Top Pages by PA" are all old 301 pages. Why? How to fix?
                Christy-Correll
                Christy-Correll
                0
                4
                97

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy