The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. How to Set Custom Crawl Rate in Google Webmaster Tools?

    How to Set Custom Crawl Rate in Google Webmaster Tools?

    Intermediate & Advanced SEO
    3 2 798
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • CommercePundit
      CommercePundit last edited by

      This is really silly question to set custom crawl rate in Google webmaster tools. Any one can find out that section under setting tab. But, I have confusion to decide number for request per second and second between requests text field.

      I want to set custom crawl rate for my eCommerce website.

      I checked my Google webmaster tools and find out as attachment. So, Can I use this facility to improve my crawling?

      6233755578_33ce83bb71_b.jpg

      1 Reply Last reply Reply Quote 0
      • DanHill
        DanHill last edited by

        It's better to just leave it on default - custom crawl rates are only needed if you're experiencing traffic problems from the server(as stated in your screenshot).

        Yyou will also use more bandwidth on your own server by the google bot coming more often so this should also be something you think about. Also worth mentioning is that after 90 days it will go back to default settings.

        http://googlewebmastercentral.blogspot.com/2006/10/learn-more-about-googlebots-crawl-of.html

        CommercePundit 1 Reply Last reply Reply Quote 2
        • CommercePundit
          CommercePundit @DanHill last edited by

          Hi Daniel,

          I was thinking about it due to very less number of indexing. Thanks for your suggestion.

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Completely redesigned webmaster - set up new site in Google Webmaster Tools, or keep existing??
            Martijn_Scheijbeler
            Martijn_Scheijbeler
            0
            3
            86

          • Google Penalties not in Webmaster tools?
            KristinaKledzik
            KristinaKledzik
            0
            3
            430

          • Google Webmaster Tools Parameters
            AGMContainerControls
            AGMContainerControls
            0
            5
            187

          • Google Webmaster Tools Set-up
            393morgan
            393morgan
            0
            3
            77

          • Do Google webmaster tool and other backlinks analysis tool ignore the disavow data ?
            GPainter
            GPainter
            0
            6
            320

          • Google Webmaster successfully fetched one of my webpages. Does that mean Google will crawl them or readable by bots?
            Gyorgy
            Gyorgy
            0
            2
            72

          • 404 in google webmaster tool
            CoreyNorthcutt
            CoreyNorthcutt
            0
            6
            288

          • Is Google Webmaster tools Accurate?
            SL_SEM
            SL_SEM
            0
            4
            461

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy