The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Summarize your question.Sitemap blocking or not blocking that is the question?

    Summarize your question.Sitemap blocking or not blocking that is the question?

    Technical SEO Issues
    2 2 353
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Nightwing
      Nightwing last edited by

      Hi from wet & overcast wetherby UK 😞

      Ones question is this...

      " Is the sitemap plus boxes blocking bots ie they cant pass on this page http://www.langleys.com/Site-Map.aspx "

      Its just the + boxes that concern me, i remeber reading somewherte javascript nav can be toxic.

      Is there a way to test javascript nav set ups and see if they block bots or not?

      Thanks in advance 🙂

      1 Reply Last reply Reply Quote 0
      • Nobody1560986989723
        Nobody1560986989723 last edited by

        I use Screaming Frog SEO Spider (free version) to check the internal link structure of a website. If a page is blocking ALL spiders it will pick it up.

        Another thing I would say would be to check in Google Webmaster Tools to see if there are any crawl errors.

        And the last thing I would add is to make sure that you have a non-JavaScript way to find all the pages on your website - through strong internal linking or a manual sitemap page that isn't generated through JS. 🙂

        Hope this helps

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Sitemap
          Martijn_Scheijbeler
          Martijn_Scheijbeler
          0
          3
          69

        • What are the negative implications of listing URLs in a sitemap that are then blocked in the robots.txt?
          Dezzign
          Dezzign
          0
          3
          153

        • Sitemap
          Leonie-Kramer
          Leonie-Kramer
          0
          5
          57

        • Sitemap question
          FCBM
          FCBM
          0
          2
          65

        • Question
          DigitalMarketingInstitute
          DigitalMarketingInstitute
          0
          5
          150

        • Summarize your question.Google places listing has gone AWOL :-(
          MiriamEllis
          MiriamEllis
          0
          4
          429

        • Summarize your question.Crawl Diagnostics Summary
          RyanKent
          RyanKent
          0
          2
          506

        • Sitemap question
          NickPateman81
          NickPateman81
          0
          2
          932

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy