The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Questions
    4. How do I schedule the Moz Crawl?

    How do I schedule the Moz Crawl?

    Other Questions
    2 2 176
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • cmccarty
      cmccarty last edited by

      Right now the Moz Bot (and Rogerbot) crash our site by overwhelming it with pings - during the daytime!  So I've had to block them out entirely, along with a ton of other bots.  How do I schedule the Moz Bot (and Rogerbot) to only crawl our site during a window of time in the middle of the night?

      1 Reply Last reply Reply Quote 0
      • FedeEinhorn
        FedeEinhorn last edited by

        I believe you can't.

        That said Moz crawler shouldn't take down your site, and if it does then you should really consider improving your hosting or checking out why is the site crashing, could be tons of reasons, such as:

        • not enough computing resources (change your hosting);
        • not optimized database queries;
        • etc;
        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Moz unable to crawl site
          Alaeddin
          Alaeddin
          1
          3
          84

        • Moz crawl crashing my site?
          AndyMozster
          AndyMozster
          0
          3
          199

        • Moz was unable to crawl - how to fix?
          tawnycase
          tawnycase
          0
          2
          255

        • Does moz let you use RegEx when setting up crawls?
          tawnycase
          tawnycase
          0
          2
          49

        • How do I disallow MOZ from crawling URL's with parameters?
          Dezzign
          Dezzign
          0
          3
          340

        • When does SEO.Moz run its crawl?
          stevefidelity
          stevefidelity
          0
          8
          1.2k

        • Limiting my MOZ crawled pages
          KeriMorgret
          KeriMorgret
          0
          7
          396

        • MOZ Crawl - Search engine blocked by robots .. but it isn't.
          ChiarynMiranda
          ChiarynMiranda
          0
          8
          1.5k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy