The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Getting Google to index our sitemap

    Getting Google to index our sitemap

    Intermediate & Advanced SEO
    6 2 99
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • shipindex
      shipindex last edited by

      Hi,

      We have a sitemap on AWS that is retrievable via a url that looks like ours http://sitemap.shipindex.org/sitemap.xml.  We have notified Google it exists and it found our 700k urls (we are a database of ship citations with unique urls).  However, it will not index them.  It has been weeks and nothing.  The weird part is that it did do some of them before, it said so, about 26k.  Then it said 0.  Now that I have redone the sitemap, I can't get google to look at it and I have no idea why.  This is really important to us, as we want not just general keywords to find our front page, but we also want specific ship names to show links to us in results.  Does anyone have any clues as to how to get Google's attention and index our sitemap?  Or even just crawl more of our site?  It has done 35k pages crawling, but stopped.

      1 Reply Last reply Reply Quote 0
      • paints-n-design
        paints-n-design last edited by

        Hi,

        I wrote a post about Google & Sitemaps think two month ago, (https://intenseo.de/seo-blog/google/google-sitemaps/) unfortunately in german. So I guess I have to translate the stuff:

        • A Sitemap should have not more than 50,000 entrys (Google-News-Sitemaps only 1,000)
        • and should not be bigger than 50MB

        So you have to split it and you allready did.

        Now your Main-Sitemap is pointing to other Sitemaps (zipped, but thats not a problem), ok. So whenever GSC is telling me, my Sitemap has errors or no entrys, I open it and check. I did, I just opened the first one, look what is in it:

        NoSuchKey<message>The specified key does not exist.</message><key>sitemaps/sitemap1.xml</key><requestid>97FFA90B9843EBCA</requestid>vBzVH8Lx9fLYpPgv5SKfSzlKb4lcGxX4+V9JBO4f/M7HiDXQJT/hoLd9b/IYWanl06M41M4oCN8=

        I opened all of your Sitemaps, no entries in it.At least, Google indexed >8,000 Pages, but not by Sitemap thats for sure.

        You can just create sitemaps with Tools (link at the bottom) or with  e.g. screaming frog and upload them to your server (zipped or not doesn't matter) sent to google and done. If your System is not working at the moment, easy workaround for short.After that - try to find the Bug in creating your sitemaps, solve it and sent these to Google. Before you sent them, open your sitemaps and check if they are working. Don't wait weeks, Google is fast.List of Sitemap Generators: https://code.google.com/archive/p/sitemap-generators/wikis/SitemapGenerators.wiki

        1 Reply Last reply Reply Quote 1
        • shipindex
          shipindex last edited by

          Where are you seeing the error?  I am opening them and see all the content required.  I am confused.  I don't think I have a key field in the sitemaps.

          1 Reply Last reply Reply Quote 0
          • shipindex
            shipindex last edited by

            Maybe I need to change them to plain xml files and update the index file?

            1 Reply Last reply Reply Quote 0
            • shipindex
              shipindex last edited by

              I redid the sitemap and just made them xml, Andreas.  It hasn't seemed to help.  Still not getting indexed.  I don't know where you were seeing that information in the sitemap files.  Can you tell me how you opened them to see that?  All I see is the normal content.

              Shawn

              1 Reply Last reply Reply Quote 0
              • paints-n-design
                paints-n-design last edited by

                Now I can see Sitemaps, loadings takes time ... a lot and they look weird, but maybe ok. But there is stuff in it, wich I wont like to have in Google-Index. Northeless - whats the message in GSC?

                (opend in Chrome, Firefox and on my pixel as well - the first one is looking good, all linked once had the error, now they are differnet from each other (with Linebreaks or without, with space or without) but contain links at least)

                Is the site on a subdomain for pages on a different domain? (didn't saw that) - that makes it way more tricky ...

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • Fetch as Google -- Does not result in pages getting indexed
                  0
                  1
                  82

                • Google does not index image sitemap
                  Storesco
                  Storesco
                  0
                  6
                  1.2k

                • Pages getting into Google Index, blocked by Robots.txt??
                  Devanur-Rafi
                  Devanur-Rafi
                  0
                  10
                  673

                • Does Google index more than three levels down if the XML sitemap is submitted via Google webmaster Tools?
                  Carla_Dawson
                  Carla_Dawson
                  0
                  3
                  1.2k

                • XML Sitemap index within a XML sitemaps index
                  Martijn_Scheijbeler
                  Martijn_Scheijbeler
                  0
                  2
                  1.1k

                • Google Sitemap only indexing 50% Is that a problem?
                  EcommerceSite
                  EcommerceSite
                  0
                  6
                  342

                • Sitemaps / Google Indexing / Submitted
                  Copstead
                  Copstead
                  0
                  3
                  360

                • Sitemap - % of URL's in Google Index?
                  irvingw
                  irvingw
                  0
                  7
                  677

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy