The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Pages not Indexed after a successful Google Fetch

    Pages not Indexed after a successful Google Fetch

    Technical SEO Issues
    8 2 3.4k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • beyondtransition
      beyondtransition last edited by

      I am trying to understand why google isn't indexing key content on my site.

      www.BeyondTransition.com is indexed and new pages show up in a couple of hours.

      My key content is 6 pages of information for each of 3000 events (driven by mySQL on a wordpress platform).

      These pages are reached via a search page, but no direct navigation from the home page.

      When I link to an event page from an indexed page it doesn't show up in search results.

      When I use fetch on webmaster tools the fetch is successful but is then not indexed - or if it does appear in results it's directed to the internal search page

      e.g. http://www.beyondtransition.com/site/races/course/race110003/ has been fetched and submitted with links but when I search for BeyondTransition Ironman Cozumel I get these results....

      So what have I done wrong and how do I go about fixing it? All thoughts and advice appreciated

      Thanks

      Denis

      1 Reply Last reply Reply Quote 0
      • Nick_Ker
        Nick_Ker last edited by

        You should use a XML site map to keep Google up to date with new pages. I could not find one for your site. Otherwise, if the event pages can only be found by using the search feature on your site, those pages will not probably not be crawled and indexed.  you could also submit the feed to RSS sites Fetch as Googlebot may work, but it probably will not be as fast as using a sitemap.xml file.

        Would it be possible to have the event pages available through some kind of navigation in addition to being found by your site's search?

        You might also consider setting up an RSS feed of the events and submitting it to feed burner and other RSS sites. That may be a little complicated, but would also help speed up indexing.

        1 Reply Last reply Reply Quote 1
        • beyondtransition
          beyondtransition last edited by

          Hi Nick,

          Thanks for the answer. I've got a word press plugin but I don't think it captures everything so I'm in the process of manually generating an XML site map - but I think you have you finger on the answer why pages aren't crawled 😞

          Navigation is on the list of things to do - it's working out the relative urgency.

          I like the RSS idea - time for some research on how to do it.

          1 Reply Last reply Reply Quote 0
          • Nick_Ker
            Nick_Ker last edited by

            Since it may not be practical to have every event linked through navigation, maybe a widget that shows the last maybe ten events would be good enough.

            beyondtransition 2 Replies Last reply Reply Quote -1
            • beyondtransition
              beyondtransition @Nick_Ker last edited by

              I''m not sure - I created this page yesterday as a map of all the races and added to the bottom of the home page as 'site map'. I then added 'site map' to the index using fetch on webmaster tools and used the submit links option. This morning it's been indexed but after quick sample none of the links from it have been indexed (or appear in google search results).

              This suggests its something that's wrong with my page/page design but what?????

              So a widget will help, but only once I've figured out the underlying problem

              1 Reply Last reply Reply Quote 0
              • beyondtransition
                beyondtransition @Nick_Ker last edited by

                I''m not sure - I created this page yesterday as a map of all the races and added to the bottom of the home page as 'site map'. I then added 'site map' to the index using fetch on webmaster tools and used the submit links option. This morning it's been indexed but after quick sample none of the links from it have been indexed (or appear in google search results).

                This suggests its something that's wrong with my page/page design but what?????

                So a widget will help, but only once I've figured out the underlying problem

                Nick_Ker beyondtransition 2 Replies Last reply Reply Quote 0
                • Nick_Ker
                  Nick_Ker @beyondtransition last edited by

                  Not sure if it was a connection issue on my end or what, but that page takes a very long time to load, which could explain the lack of indexing of the pages linked from it.  
                  Also, Google states that pages submitted witht the Fetch as Googlebot tool are not guaranteed to be indexed, so there may be quite a delay on that. Are all pages included in your XML sitemap? An XML sitemap is the preferred way to notify Google of pages it may not normally find.  Here is a link to more about XML sitemaps https://www.google.com/support/webmasters/bin/answer.py?answer=156184&hl=en
                  Even with an XML sitemap, Google may not immediately crawl many pages. Actually, indexing is rarely immediate. The frequency of crawling and speed of indexing has to do with many of the same factors as your ranking - quality, number of inbound links and pagerank, site performance, etc. If all your pages load quickly and you are in pretty good shape as far as links, etc, you could also try something to draw Google's attention to the new pages - like Tweeting a link or posting to Google+. That seems to "force" faster indexing in some cases.
                  I just checked your site with webpagetest.org and it is showing a load time of about 14 seconds. Tools.pingdom.com seemed to get hung up on some of the javascripts and couldn't complete its test. Doing what you can to speed up the site and address any other "quality" issues will help with indexing, and your performance in search engine results in general.

                  1 Reply Last reply Reply Quote 1
                  • beyondtransition
                    beyondtransition @beyondtransition last edited by

                    Thanks Nick. I'll work through all of those points 🙂

                    1 Reply Last reply Reply Quote 0
                    • 1 / 1
                    • First post
                      Last post
                    • Why would Google not index all submitted pages?
                      JordanLowry
                      JordanLowry
                      0
                      2
                      77

                    • Why wont google Index this page?
                      AshShep1
                      AshShep1
                      0
                      5
                      79

                    • 404 not found page appears as 200 success in Google Fetch. What to do to correct?
                      ThompsonPaul
                      ThompsonPaul
                      0
                      4
                      1.1k

                    • Pages to be indexed in Google
                      CleverPhD
                      CleverPhD
                      0
                      8
                      159

                    • How Does Google's "index" find the location of pages in the "page directory" to return?
                      reidsteven75
                      reidsteven75
                      0
                      9
                      215

                    • Pages removed from Google index?
                      TomLondon
                      TomLondon
                      0
                      5
                      73

                    • No existing pages in Google index
                      AlanBleiweiss
                      AlanBleiweiss
                      0
                      2
                      146

                    • Pages not indexed by Google
                      loopyal
                      loopyal
                      0
                      6
                      1.8k

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    • Digital Marketers
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • Local Citation Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy