The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Why isn't seo moz properly crawling my site?

    Why isn't seo moz properly crawling my site?

    Other Research Tools
    5 4 225
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • diplomajim
      diplomajim last edited by

      In my campaign results, only 2 pages have been crawled, when there are many more.  Also, when I do the on-page evaluation for my homepage and the main keyword, I get a grade of F, with a ton of errors that my page actually does not have.  It's as if SEO moz is having trouble crawling through my site.

      Any ideas on this?

      1 Reply Last reply Reply Quote 0
      • Modi
        Modi last edited by

        Hi -

        Is it the Initial Crawl or Full Crawl ?

        If its initial crawl, may be you should wait for the final crawl report. However, just a query - have you checked like - Are your pages not getting blocked by meta noindex or through robots tag... What are the sort of errors you getting

        For further info should read this article that why the pages do not get crawled https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages-

        If you still feel an issue - may be can write directly to Moz staff on - help@moz.com

        1 Reply Last reply Reply Quote 0
        • jesse-landry
          jesse-landry last edited by

          Yeah i'd give it a week. It will tell you on your campaign exactly when the next full-crawl is scheduled for. Wait for this date if you haven't already.

          Otherwise contact their support team. The Moz team is quick to respond and a helpful bunch. Just don't call them SEOMoz or Rand will track you down and give you a frowny-face.

          1 Reply Last reply Reply Quote 0
          • diplomajim
            diplomajim last edited by

            Thanks for the replies, but it never got past 2 pages crawled. I have no idea why this is. I got a message saying it may have something to do with user-agent discrimination, but I googled that and there's actually no one talking about it on the internet.

            Google isn't indexing my site either.   It's not a robots.txt problem, I've had that looked at.  The only thing that has changed is that I upgraded the site from cscart v3 to v4. Not sure how that could change anything.

            FedeEinhorn 1 Reply Last reply Reply Quote 0
            • FedeEinhorn
              FedeEinhorn @diplomajim last edited by

              Do you mind posting your URL so we can have a loot at it?

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • How To Stop Moz Crawl From Prepending /blog/ on all our site urls that it crawls
                samantha.chapman
                samantha.chapman
                1
                2
                32

              • Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?
                ctripp1010
                ctripp1010
                0
                3
                43

              • Limit MOZ crawl rate on Shopify or when you don't have access to robots.txt
                AllAboutShapewear
                AllAboutShapewear
                1
                4
                219

              • Moz Bar doesn't show any data and keeps asking me to log in when actually I'm logged in.
                jocameron
                jocameron
                0
                4
                2.8k

              • How do I disallow crawl on a directory when it's a prefix to my site's URL?
                tawnycase
                tawnycase
                0
                3
                88

              • Moz site crawl showing duplicate page titles but webmaster tools doesn't
                andgee28
                andgee28
                0
                4
                130

              • "Sorry! We weren't able to find that page when we crawled your site." Please help!
                Cyrus-Shepard
                Cyrus-Shepard
                0
                10
                714

              • Moz just did my weekly "crawl" and claims my meta titles and descriptions are "missing," but they aren't. What's up with this?
                LifeisRosie
                LifeisRosie
                0
                3
                132

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy