The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Crawl rate

    Crawl rate

    Technical SEO Issues
    5 2 658
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • jwdl
      jwdl last edited by

      Hello,

      In google WMT my site has the following message.

      <form class="form" action="/webmasters/tools/settings-ac?hl=en&siteUrl=http://www.prom-hairstyles.org/&amp;siteUrl=http://www.prom-hairstyles.org/&amp;hl=en" method="POST">Your site has been assigned special crawl rate settings. You will not be able to change the crawl rate.Why would this be?A bit of backgound - this site was hammered by Penguin or maybe panda but seems to be dragging itself back up (maybe) but has dropped from several thousand visitors/day to 100 or so.Cheers,Ian</form>

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        What is your hosting setup? Are you using some form of cloud hosting such as Amazon or have a CDN set up?

        Generally speaking, that message from Google is a good thing. It means they have optimized your crawl rate based on your setup. If you feel there is a need to adjust the rate, it can be done. Are you experiencing any issue?

        The Panda/Penguin issue would have no relation to your crawl rate settings.

        jwdl 1 Reply Last reply Reply Quote 0
        • jwdl
          jwdl @RyanKent last edited by

          Thanks for replying, I have been using a CDN (up until a week ago) and no there haven't been any issues that I can put down to this, I just hadn't seen a message like that before and wondered if it was significant.

          RyanKent jwdl 2 Replies Last reply Reply Quote 0
          • RyanKent
            RyanKent @jwdl last edited by

            There is nothing negative about the message. It is common and expected for sites which use CDNs.

            1 Reply Last reply Reply Quote 1
            • jwdl
              jwdl @jwdl last edited by

              OK thanks.

              Ian

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Google Crawling Issues! How Can I Get Google to Crawl My Website Regularly?
                libero_net
                libero_net
                1
                8
                142

              • Google crawl rate dropped after we activated CloudFront
                EricaMcGillivray
                EricaMcGillivray
                0
                2
                848

              • Crawl issues
                Christy-Correll
                Christy-Correll
                0
                3
                105

              • 404s effecting crawl rate?
                DennisSeymour
                DennisSeymour
                0
                4
                126

              • I have 3500 pages crawled by Google, - why is SEOMOZ only able to crawl 400 of these ?
                Abe_Schmidt
                Abe_Schmidt
                0
                2
                95

              • Googlebot Crawl Rate causing site slowdown
                Rich_A
                Rich_A
                0
                8
                6.1k

              • Suggested crawl rate in google webmaster tools?
                BailHotline
                BailHotline
                0
                4
                1.2k

              • How to increase the crawl rate?
                greyniumseo
                greyniumseo
                0
                3
                675

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy