The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Questions
    4. How can you tell Rogerbot when you want it to crawl?

    How can you tell Rogerbot when you want it to crawl?

    Other Questions
    2 2 260
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • KJI
      KJI last edited by

      I want moz to crawl when there are less people on the site

      1 Reply Last reply Reply Quote 1
      • holly_haymaker
        holly_haymaker last edited by

        Hi there!

        Rogerbot can't actually be told to crawl at a specific time. However, if you're finding that he is crawling your site too aggressively you could set up a crawl delay in your robots.txt file to set the number of seconds between requests to the same server.

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • Can you edit the crawl depth on an existing Campaign?
          jocameron
          jocameron
          0
          2
          81

        • How do I schedule the Moz Crawl?
          FedeEinhorn
          FedeEinhorn
          0
          2
          176

        • Seeing what time a crawl was run, configuring crawl settings
          tawnycase
          tawnycase
          0
          2
          71

        • Hi, I want to add a new seat, but I want to restrict them to only 1 of my campaigns. Is this possible? Mucho thanks
          tawnycase
          tawnycase
          1
          4
          152

        • What If I don't want any free trial directly want to subscribe with $149 ..tell me the procedure so that I can subscribe asap
          ChiarynMiranda
          ChiarynMiranda
          0
          6
          149

        • How can I delete a campaign?
          LauraSultan
          LauraSultan
          0
          2
          524

        • Hi moz i cant access my campaigns it says all my pages are crawl and this is the second day only since i am new to this can you help me resolve this and give me back the credits i truly have no idea whats its doing since i am new to this
          Christy-Correll
          Christy-Correll
          0
          3
          113

        • Can I specify when my site is crawled?
          DavidLee
          DavidLee
          0
          4
          76

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy