The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Its been over a month, rogerbot hasn't crawled the entire website yet. Any ideas?

    Its been over a month, rogerbot hasn't crawled the entire website yet. Any ideas?

    Moz Tools
    4 2 322
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • TejaswiNaidu
      TejaswiNaidu last edited by

      Rogerbot has stopped crawling the website at 308 pages past week and has not crawled the website with over 1000+ pages. Any ideas on what I can do to get this fixed & crawling?

      1 Reply Last reply Reply Quote 0
      • BlueprintMarketing
        BlueprintMarketing last edited by

        If you have a stop at 308 that is normal Roger likes to take breaks or smaller amounts of websites in the beginning only indexes he will be back way to make sure is by following the directions below.

        Have you requested that Roger check your site by going into campaigns then selecting reports then selecting weekly?

        Make sure the above steps of been done. Roger is going to town on mine so I don't think you leave you out of the party.

        Respectfully,

        Thomas Zickell

        1 Reply Last reply Reply Quote -1
        • TejaswiNaidu
          TejaswiNaidu last edited by

          @Thomas

          Thanks for the headsup! Ever since asking this question Roger has crawled 2 more pages taking the total to - 310.

          Yes, I've already selected Roger send details on the site on a weekly basis via the reporting section. Thanks for the quick reply and happy holidays!

          Best,

          TJ

          BlueprintMarketing 1 Reply Last reply Reply Quote 0
          • BlueprintMarketing
            BlueprintMarketing @TejaswiNaidu last edited by

            Hi TJ,

            Did that answer your question? if so I am very happy. Please let me know if there's anything else I can do to assist you in fully answering this question. thank you for the kind words.

            Happy holidays,

            Thomas

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Moz crawling doesn't show all of my Backlinks
              Dreamgirlseo
              Dreamgirlseo
              1
              5
              253

            • Why doesn't Moz crawl whole pages of our website to report All On-Page issues?
              BigSlate
              BigSlate
              0
              3
              65

            • I have 2 linking root domains on my URL. But I don't get the whole Root domain thing. So I don't understand how I can improve it?
              MissThumann
              MissThumann
              0
              3
              222

            • Since July 1, we've had a HUGE jump in errors on our weekly crawl. We don't think anything has changed on our website. Has MOZ changed something that would account for a large leap in duplicate content and duplicate title errors?
              KristyFord
              KristyFord
              0
              3
              77

            • Crawl findings 301 redirects I didn't make?
              TrentDrake
              TrentDrake
              0
              3
              104

            • 'Too many on-page links': doesn't add up...
              EricPratum30
              EricPratum30
              0
              4
              305

            • My competitive link analysis hasn't been updated in nearly 2 months, why?
              syount
              syount
              0
              3
              390

            • I'm getting "Issue: Title Element Too Long" when the title of the overall website + page title are being combined, shouldn't this solely depend on the page title itself?
              DougRoberts
              DougRoberts
              0
              2
              534

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy