The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Crawl rate

    Crawl rate

    Technical SEO Issues
    5 2 658
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • jwdl
      jwdl last edited by

      Hello,

      In google WMT my site has the following message.

      <form class="form" action="/webmasters/tools/settings-ac?hl=en&siteUrl=http://www.prom-hairstyles.org/&amp;siteUrl=http://www.prom-hairstyles.org/&amp;hl=en" method="POST">Your site has been assigned special crawl rate settings. You will not be able to change the crawl rate.Why would this be?A bit of backgound - this site was hammered by Penguin or maybe panda but seems to be dragging itself back up (maybe) but has dropped from several thousand visitors/day to 100 or so.Cheers,Ian</form>

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        What is your hosting setup? Are you using some form of cloud hosting such as Amazon or have a CDN set up?

        Generally speaking, that message from Google is a good thing. It means they have optimized your crawl rate based on your setup. If you feel there is a need to adjust the rate, it can be done. Are you experiencing any issue?

        The Panda/Penguin issue would have no relation to your crawl rate settings.

        jwdl 1 Reply Last reply Reply Quote 0
        • jwdl
          jwdl @RyanKent last edited by

          Thanks for replying, I have been using a CDN (up until a week ago) and no there haven't been any issues that I can put down to this, I just hadn't seen a message like that before and wondered if it was significant.

          RyanKent jwdl 2 Replies Last reply Reply Quote 0
          • RyanKent
            RyanKent @jwdl last edited by

            There is nothing negative about the message. It is common and expected for sites which use CDNs.

            1 Reply Last reply Reply Quote 1
            • jwdl
              jwdl @jwdl last edited by

              OK thanks.

              Ian

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Crawl rate dropped to zero
                pok3rplay3r
                pok3rplay3r
                0
                13
                771

              • 404s effecting crawl rate?
                DennisSeymour
                DennisSeymour
                0
                4
                126

              • Crawl Results
                sherohass
                sherohass
                0
                5
                132

              • Crawl issue
                Mrlocicero
                Mrlocicero
                0
                3
                202

              • Have a client that migrated their site; went live with noindex/nofollow and for last two SEOMoz crawls only getting one page crawled. In contrast, G.A. is crawling all pages. Just wait?
                Nobody1560986989723
                Nobody1560986989723
                0
                5
                422

              • Suggested crawl rate in google webmaster tools?
                BailHotline
                BailHotline
                0
                4
                1.2k

              • How to increase the crawl rate?
                greyniumseo
                greyniumseo
                0
                3
                675

              • Google crawl rate almost zero since re-launch, organic search up 50% though!
                ShaMenz
                ShaMenz
                0
                4
                819

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy