The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Crawl Issues

    Crawl Issues

    Moz Tools
    4 4 778
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • CohesiveMarketing
      CohesiveMarketing last edited by

      My website - qtmoving.com - has 26 articles and when the SEOmoz did a crawl it only found 13 articles.  Can someone please give me some insight as to why not all pages are being crawled.

      1 Reply Last reply Reply Quote 0
      • sferrino
        sferrino last edited by

        I just went through it pretty quick and noticed that:

        1. you don't have an xml sitemap, usually named sitemap.xml

        2. You are using javascript for your drop down menu items,

        The 2 above factors will keep all engines from being able to crawl your site fully.

        What I would do is just create a sitemap in the footer so that there is a physical link to each page that is not javascript based.

        1 Reply Last reply Reply Quote 1
        • davieshussein
          davieshussein last edited by

          Hi, I think that, like Steven said, your dropdowns may be a problem. The actual menus are generated completely by javascript and the links in the sub-navigation menus are not physically part of the HTML source. It's actually pretty unnecessary to do that since they can be a part of the source and still act like a dropdown menu regardless using JavaScript. It may mean some changes to your javascript but the gains made definitely outweigh.

          It's just as easy to have the links physically in the HTML source and hide them with JavaScript than to have them generated on the fly. (I imagine it'd make things quicker as well since you're not having to create DOM objects all the time since you're just hiding and showing them).

          1 Reply Last reply Reply Quote 0
          • Guest
            Guest last edited by

            This post is deleted!
            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Unable to get into top 20 even when pages are optimized and most crawl issues resolved
              ClaytonJ
              ClaytonJ
              1
              6
              179

            • Was there another issue crawling rankings on 9th October?
              ChiarynMiranda
              ChiarynMiranda
              0
              3
              272

            • Crawl Diagnostic | Starter Crawl taken 14hrs.. so far
              KeriMorgret
              KeriMorgret
              0
              9
              469

            • Crawl Report Technical Issue
              KeriMorgret
              KeriMorgret
              0
              2
              437

            • Only 1 page is being crawled by SEOmoz for the last 2 crawls
              KeriMorgret
              KeriMorgret
              0
              6
              863

            • On the Crawl Diagnostics Summary, its reporting over 100 "Title Missing or Empty" issues, but they all check out fine?
              sjr4x4
              sjr4x4
              0
              5
              1.0k

            • Crawl test. Bot crawled only 200 or so links when it should have crawled thousands
              Ev84
              Ev84
              0
              9
              1.2k

            • "Issue: Duplicate Page Content " in Crawl Diagnostics - but these pages are noindex
              AaronWheeler
              AaronWheeler
              0
              2
              1.1k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy