The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Questions
    4. Is there a way to change crawling time for moz and to do it in a less demanding hour of the day?

    Is there a way to change crawling time for moz and to do it in a less demanding hour of the day?

    Other Questions
    3 3 410
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • HellasSITES
      HellasSITES last edited by

      Moz now crawls during the morning.  Would it be possible to crawl during the evening?

      1 Reply Last reply Reply Quote 0
      • Chris.Menke
        Chris.Menke last edited by

        I don't think that's possible, Epameinondas, but you can slow rogerbot down when it comes to crawl your site by adding a crawl delay directive to your robots.txt file:

        User-agent: rogerbotCrawl-delay: 1

        More info on the crawl delay directive:

        http://www.bing.com/blogs/site_blogs/b/webmaster/archive/2009/08/10/crawl-delay-and-the-bing-crawler-msnbot.aspx

        1 Reply Last reply Reply Quote 1
        • ChiarynMiranda
          ChiarynMiranda last edited by

          Hey Epameinondas,

          Chris is correct, unfortunately, and it isn't possible to schedule or predict when Rogerbot will crawl a site. The crawl schedule is affected by a number of factors, including when the previous site crawl ended and how many other sites we will be crawling that day, and the schedule may fluctuate from week to week.

          You can, however dictate how quickly Roger hits your site during the crawl with the crawl delay directive. We recommend having a crawl delay of 10 or lower because Roger will disregard the crawl delay if he can't complete the crawl within our standard service-level agreement.

          Let us know if you need help with anything else.

          Chiaryn
          Help Team Ninja

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Moz unable to crawl site
            Alaeddin
            Alaeddin
            1
            3
            84

          • How to Migrate MOZ Campaign When Domain Changes?
            samantha.chapman
            samantha.chapman
            0
            7
            226

          • Does moz let you use RegEx when setting up crawls?
            tawnycase
            tawnycase
            0
            2
            49

          • Do I have to change my Moz Campaign after we updated to HTTPS?
            Sean_Peerenboom
            Sean_Peerenboom
            0
            2
            313

          • Moving site from one domain to another but don't want to lose my historic MOZ stats. Is there a simple way of doing this in Moz?
            SamWeber
            SamWeber
            0
            2
            47

          • When does SEO.Moz run its crawl?
            stevefidelity
            stevefidelity
            0
            8
            1.2k

          • How do I change the URL for the account Moz is tracking?
            moosepondarts
            moosepondarts
            0
            4
            111

          • Campaign not crawling or no results in 12 days?
            neuralcorp
            neuralcorp
            0
            2
            97

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy