The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Pro
    4. Rogerbot did not crawl my site ! What might be the problem?

    Rogerbot did not crawl my site ! What might be the problem?

    Moz Pro
    5 4 257
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • inlinear
      inlinear last edited by

      When I saw the new crawl for my site I wondered why there are no errors, no warning and 0 notices anymore.

      Then I saw that only 1 page was crawled. There are no Error Messages or webmasters Tools also did not report anything about crawling problems.

      What might be the problem?

      thanks for any tips!
      Holger

      rogerbot-did-not-crawl.PNG

      1 Reply Last reply Reply Quote 0
      • KeriMorgret
        KeriMorgret last edited by

        Hi! Here are some common reasons why only one page is crawled. If this doesn't solve it, opening a ticket with the help desk would be the next step.

        https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages-

        inlinear 1 Reply Last reply Reply Quote 0
        • inlinear
          inlinear @KeriMorgret last edited by

          Thanks Keri,

          But its not about these common problems, because Rogerbot crawled the properly before. May be a ticked will help to find the cause.

          Holger

          1 Reply Last reply Reply Quote 0
          • Peterli
            Peterli last edited by

            Hi there,

            Thanks for reaching out!  I went ahead and started a ticket for you to do some digging.  I will run a few tests on my end to see where it is causing the issue.  I will get in touch you ASAP 🙂

            Thanks again for reaching, hope I could talk to you soon!

            Best,

            1 Reply Last reply Reply Quote 1
            • jeffmace
              jeffmace last edited by

              I am running into this problem as well.  Does anyone have an answer.  I was a customer a year ago and had no problems.  Stopped for a while and then came back, my site was never able to be crawled again.  A few months later I did make a few changes on my site, and just tried again today, but it only gets 1 page.  Once before they told it had to do with something like http 1.0/1.1 which makes no sense.  Not sure why google, bing and the rest can crawl the site, but this service can't.  Hopefully someone has an answer.  I looked at that link that is mentioned and I do not feel that any of those are causing the issues.

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Why my site not crawl?
                jahanidawodi
                jahanidawodi
                0
                5
                68

              • Pagination Issues on E-commerce Site: Duplicate Page Title and Content on Moz Crawl
                Dr-Pete
                Dr-Pete
                0
                3
                1.4k

              • Crawl Diagnostics: Next crawl date is in the past
                Abe_Schmidt
                Abe_Schmidt
                0
                4
                291

              • Why would only 1 pg of an 18 pg site be crawled?
                KeriMorgret
                KeriMorgret
                0
                5
                218

              • Crawled pages are missing and showing just 1 page crawled
                KeriMorgret
                KeriMorgret
                0
                3
                296

              • Crawl slow again
                KeriMorgret
                KeriMorgret
                0
                4
                565

              • Does it really take 3-7 days to crawl a site?
                randfish
                randfish
                0
                3
                1.3k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy