The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Some URLs were not accessible to Googlebot due to an HTTP status error.

    Some URLs were not accessible to Googlebot due to an HTTP status error.

    Technical SEO Issues
    3 3 8.3k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • GoldenRanking14
      GoldenRanking14 last edited by

      Hello I'm a seo newbie and some help from the community here would be greatly appreciated.

      I have submitted the sitemap of my website in google webmasters tools and now I got this warning:

      "When we tested a sample of the URLs from your Sitemap, we found that some URLs were not accessible to Googlebot due to an HTTP status error. All accessible URLs will still be submitted."

      How do I fix this? What should I do?

      Many thanks in advance.

      1 Reply Last reply Reply Quote 0
      • Leonie-Kramer
        Leonie-Kramer last edited by

        Hi, It looks like you have url's placed in your sitemap that have an HTTP status error. You can search for the urls and remove them from your sitemap or make sure they have the right status. Does it say which status error? And does it say which url's? Did you check those url's?When you use Screaming frog spider tool (free), you can search for status error's this is an easy way to find these url's.

        Grtz, Leonie

        1 Reply Last reply Reply Quote 1
        • BlueprintMarketing
          BlueprintMarketing last edited by

          You need to confirm that the URLs are in fact 100% of your URLs going into the site map are accessible.

          if it's a big issue in a big site send me the URL in a private message I will use deep crawl to create a XML sitemap for you. The screaming frog tool is excellent as well though does performance well with extremely large sites.

          check your robots.txt file this so great tool if in case you have more than one (it happens)

          http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/

          or

          http://tools.seochat.com/tools/robots-txt-validator/

          so many great free tools are found right here http://tools.seochat.com/tools/

          It could be a number of things although it could be Google being finicky. Run the site through Moz crawler, use feedthebot.com using "tools SEO" or download the free version of http://www.screamingfrog.co.uk/seo-spider/  this will tell you if there is an issue. If your site is static you can even create an alternate site map with screaming frog if your site is large use deep crawl or Moz analytics

          be certain there are no sitemaps redirecting to each other so no redirects going from the old site map to the new site map. Make certain that the site map is in an XML format e.g.  http://example.com/sitemap.xml or if in a different format like https://example.com/sitemap_index.xml make sure the proper format That resolves when you look at the site map is what is going into Webmaster tools. Be certain the site map does not contain over 500 URLs per the site map so example.com/sitemap1.xml and so on keep  numbering them appropriately. sometimes Google is overloaded and does not seem to like to play well with certain site maps or the site map is maybe not generating very well on the server and that is fixed later on. If this is a long-term problem speak to your host or developer. My recommendation is if you've done everything I have talked about that you attempt to submit is the sitemap to to Webmaster tools or  simply build a new sitemap and submit that.

          so if worse comes to worse take the screaming frog and use this URL to send it to Google

          http://www.google.com/submityourcontent/business-owner/

          I hope that helps,

          Thomas

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Help! How to Remove Error Code 901: DNS Errors (But to a URL that doesn't exist!)
            FullSteamBusiness
            FullSteamBusiness
            0
            4
            696

          • What should I do with URLs that cause site map errors?
            Ideas-Money-Art
            Ideas-Money-Art
            0
            10
            151

          • 405 HTTP Status instead of 404
            zeepartner
            zeepartner
            0
            2
            310

          • HTTP status code 302
            JohnHuynh
            JohnHuynh
            0
            3
            215

          • Odd URL errors upon crawl
            Matt1
            Matt1
            0
            6
            157

          • Webmaster tools...URL Errors
            ChrisHolgate
            ChrisHolgate
            0
            2
            202

          • Googlebot cannot access your site
            RyanKent
            RyanKent
            0
            5
            447

          • Duplicate content error from url generated
            pauledwards
            pauledwards
            0
            4
            333

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy