The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Getting Started
    4. My site is not being fully crawled

    My site is not being fully crawled

    Getting Started
    2 2 94
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Scurri
      Scurri last edited by

      Our site has been crawled several times by RogerBot but each time only 6 pages are crawled even though we have more than 100 pages.

      Do I need to submit my sitemap.xml to Moz?

      1 Reply Last reply Reply Quote 0
      • ChiarynMiranda
        ChiarynMiranda last edited by

        Hey There,

        Thanks for writing in. We actually don't have a way to submit an XML sitemap and we only crawl the site by following the HTML links in the source code. From what I am seeing in your crawl, we are find very few unique internal links on your site, so we are only able to find unique 6 pages using the HTML links.

        Unfortunately, it looks like the majority of your site is in Javascript, which our crawler is not able to parse, so we don't see any Javascript links on your site. I'm afraid that a site that is primarily in Java would not be compatible with our crawler.

        I apologize for the inconvenience this causes. Please let me know if you have any other questions.

        Chiaryn

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Why does Moz only seem to be crawling a snap shot of the site I am working with?
          dsmith802020
          dsmith802020
          0
          3
          32

        • Moz not able to crawl our site - any advice?
          Salience_Search_Marketing
          Salience_Search_Marketing
          1
          3
          81

        • How to seo my site ?
          anthonydegalbo
          anthonydegalbo
          0
          9
          156

        • Site Crawl - Crawls only homepage?
          Shotlife_Studio
          Shotlife_Studio
          0
          3
          107

        • Moz can't crawl my site.
          eli.myers
          eli.myers
          0
          2
          118

        • Moz was unable to crawl your site - robots.txt
          JRGRDZ
          JRGRDZ
          0
          5
          386

        • My question is, when you translate your website to another language, does moz crawl both or do i have to add another campaign to moz so that they can crawl it seperately?
          RyanPurkey
          RyanPurkey
          0
          4
          130

        • Crawling Website
          KeriMorgret
          KeriMorgret
          0
          5
          119

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy