The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Its been over a month, rogerbot hasn't crawled the entire website yet. Any ideas?

    Its been over a month, rogerbot hasn't crawled the entire website yet. Any ideas?

    Moz Tools
    4 2 322
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • TejaswiNaidu
      TejaswiNaidu last edited by

      Rogerbot has stopped crawling the website at 308 pages past week and has not crawled the website with over 1000+ pages. Any ideas on what I can do to get this fixed & crawling?

      1 Reply Last reply Reply Quote 0
      • BlueprintMarketing
        BlueprintMarketing last edited by

        If you have a stop at 308 that is normal Roger likes to take breaks or smaller amounts of websites in the beginning only indexes he will be back way to make sure is by following the directions below.

        Have you requested that Roger check your site by going into campaigns then selecting reports then selecting weekly?

        Make sure the above steps of been done. Roger is going to town on mine so I don't think you leave you out of the party.

        Respectfully,

        Thomas Zickell

        1 Reply Last reply Reply Quote -1
        • TejaswiNaidu
          TejaswiNaidu last edited by

          @Thomas

          Thanks for the headsup! Ever since asking this question Roger has crawled 2 more pages taking the total to - 310.

          Yes, I've already selected Roger send details on the site on a weekly basis via the reporting section. Thanks for the quick reply and happy holidays!

          Best,

          TJ

          BlueprintMarketing 1 Reply Last reply Reply Quote 0
          • BlueprintMarketing
            BlueprintMarketing @TejaswiNaidu last edited by

            Hi TJ,

            Did that answer your question? if so I am very happy. Please let me know if there's anything else I can do to assist you in fully answering this question. thank you for the kind words.

            Happy holidays,

            Thomas

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Moz isn't recognizing content on our website hosted on bubble.is
              0
              1
              26

            • Crawl report shows Title Element too long but they aren't
              chris.elevate
              chris.elevate
              0
              3
              116

            • Crawl findings 301 redirects I didn't make?
              TrentDrake
              TrentDrake
              0
              3
              104

            • 'Too many on-page links': doesn't add up...
              EricPratum30
              EricPratum30
              0
              4
              305

            • Crawl started on the 18th of December and still hasn't completed!
              cttgroup
              cttgroup
              0
              4
              248

            • Only few pages (308 pages of 1000 something pages) have been crawled and diagnosed in 4 days, how many days till the entire website is crawled complete?
              DarinPirkey
              DarinPirkey
              0
              4
              288

            • Can't get Page Analysis for homepage - any ideas?
              UnderRugSwept
              UnderRugSwept
              0
              9
              394

            • Why won't scheduled crawl of my site begin?
              Prime85
              Prime85
              0
              3
              585

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy