The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Google has discovered a URL but won't index it?

    Google has discovered a URL but won't index it?

    Intermediate & Advanced SEO
    16 5 130
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DanDeceuster
      DanDeceuster last edited by

      Hey all, have a really strange situation I've never encountered before. I launched a new website about 2 months ago. It took an awfully long time to get index, probably 3 weeks. When it did, only the homepage was indexed.

      I completed the site, all it's pages, made and submitted a sitemap...all about a month ago. The coverage report shows that Google has discovered the URL's but not indexed them. Weirdly, 3 of the pages ARE indexed, but the rest are not.

      So I have 42 URL's in the coverage report listed as "Excluded" and 39 say "Discovered- currently not indexed." When I inspect any of these URL's, it says "this page is not in the index, but not because of an error." They are listed as crawled - currently not indexed or discovered - currently not indexed.

      But 3 of them are, and I updated those pages, and now those changes are reflected in Google's index. I have no idea how those 3 made it in while others didn't, or why the crawler came back and indexed the changes but continues to leave the others out.

      Has anyone seen this before and know what to do?

      1 Reply Last reply Reply Quote 0
      • Chris.Menke
        Chris.Menke last edited by

        I'd hold off worrying about it for now.  I've heard many people talk about slow indexation lately.  In the mean time,  aside from the obvious check-for- nofollow- noindex-robots.txt suggestions, have you looked into the history of this domain? By chance was it penalized before you bought it?

        DanDeceuster 1 Reply Last reply Reply Quote 0
        • Vanderlindemedia
          Vanderlindemedia last edited by

          Perhaps the content on those 42 pages or so is alot copy content based? Or pages that really dont matter to be up in search?

          DanDeceuster 1 Reply Last reply Reply Quote 0
          • DanDeceuster
            DanDeceuster @Chris.Menke last edited by

            It's a new domain, no previous ownership, and no issues detected in search console for manual actions or security. There's no robots, noindex or any of that going on. They just won't index a bunch of the pages for some reason and it's very odd.

            Vanderlindemedia 1 Reply Last reply Reply Quote 0
            • Vanderlindemedia
              Vanderlindemedia @DanDeceuster last edited by

              Get quality links.

              DanDeceuster 1 Reply Last reply Reply Quote 0
              • DanDeceuster
                DanDeceuster @Vanderlindemedia last edited by

                It's a review website, and only 3 of my 24 reviews are indexed. All are discovered, most even crawled, but only those three in the index. And when I updated them, the search listing in Google results was updated within a few days. So they came back, are aware of the changes, but just not adding the others to the index.

                And there are no affiliate links on this site at all. No spam, no links to spam, and I've attached a blog with 500+ word well written articles (about 20 so far) and none of the blog posts are indexed either.

                I've never seen anything like this. The content is good, but almost none of it is getting indexed for some reason, despite being discovered and crawled.

                1 Reply Last reply Reply Quote 0
                • DanDeceuster
                  DanDeceuster @Vanderlindemedia last edited by

                  I actually got a quality link 2 weeks ago, but the blog post the link was published in still isn't indexed by Google either. The rest of his site is, just not his newest article for some reason, and it's 2 weeks old now. Another mystery...

                  1 Reply Last reply Reply Quote 0
                  • Vanderlindemedia
                    Vanderlindemedia last edited by

                    My advice is, start listing more reviews! It will be picked up by google automaticly. You gotta be a bit more patient. New websites take awefully alot of time to be indexed.

                    I had a domain of 10+ years of age, replaced it's website, within one day completely reindexed. I have new domains, they can take up to weeks or even a month to be indexed. It's normal.

                    DanDeceuster 1 Reply Last reply Reply Quote 0
                    • willcritchlow
                      willcritchlow last edited by

                      Hi Daniel. Did you get this resolved / did it resolve itself? I'd happily take a look if you'd like if not - just let me know the URL.

                      DanDeceuster 1 Reply Last reply Reply Quote 0
                      • DanDeceuster
                        DanDeceuster @Vanderlindemedia last edited by

                        We keep adding blog posts almost every day, still not getting in the index for some reason. Discovered, yes. Crawled, yes. But not indexed, and no errors or anything.

                        1 Reply Last reply Reply Quote 0
                        • DanDeceuster
                          DanDeceuster @willcritchlow last edited by

                          Hi Will, thanks for reaching out! No, not yet resolved. Still struggling to figure this out. I sent you a message on Facebook and Linkedin- would love to connect and try to get this figured out!

                          willcritchlow 1 Reply Last reply Reply Quote 0
                          • Advanced-Air-Ambulance
                            Advanced-Air-Ambulance last edited by

                            Hey Daniel. I agree with Chris. I have also noticed slow indexation recently. Might be a pain in the arse, but maybe you should request each page to be indexed individually in Search Console to add them to the high priority queue.

                            DanDeceuster 1 Reply Last reply Reply Quote 0
                            • DanDeceuster
                              DanDeceuster @Advanced-Air-Ambulance last edited by

                              Thanks, I've actually submitted request to be indexed multiple times over the last 3 weeks to no avail.

                              1 Reply Last reply Reply Quote 0
                              • willcritchlow
                                willcritchlow @DanDeceuster last edited by

                                You're not the only person reporting odd indexation happenings here on Q&A (see for example this question). And, just like I found for that question, your site appears to have more pages indexed in Bing than in Google - which at least seems to point to us not having missed something obvious like meta noindex or similar.

                                I did also read Google saying that they had issues with the site: command (link) but I don't think that can have anything to do with your situation as they say they have now fixed that issue, and I couldn't find any other pages on your site even with non-site: searches (i.e. it does genuinely appear as though those pages are missing from the index).

                                While I am loathe to point just at links these days, I do wonder if in this case it is just a case of needing some more authority for the whole site before it is seen as big enough and important enough to justify more pages in the index.

                                DanDeceuster 1 Reply Last reply Reply Quote 0
                                • DanDeceuster
                                  DanDeceuster @willcritchlow last edited by

                                  Thanks Will, appreciate the insight. I'm going to get the Bing and Google wordpress plugins on there to see if that helps, build up a few more links and give it some time to wait and see. Thanks!

                                  willcritchlow 1 Reply Last reply Reply Quote 0
                                  • willcritchlow
                                    willcritchlow @DanDeceuster last edited by

                                    Good luck!

                                    1 Reply Last reply Reply Quote 0
                                    • 1 / 1
                                    • First post
                                      Last post
                                    • Magento 1.9 SEO. I have product pages with identical On Page SEO score in the 90's. Some pull up Google page 1 some won't pull up at all. I am searching for the exact title on that page.
                                      CTOPDS
                                      CTOPDS
                                      0
                                      3
                                      63

                                    • Google doesn't index image slideshow
                                      evolvingSEO
                                      evolvingSEO
                                      0
                                      17
                                      606

                                    • Will disallowing URL's in the robots.txt file stop those URL's being indexed by Google
                                      Martijn_Scheijbeler
                                      Martijn_Scheijbeler
                                      0
                                      11
                                      1.6k

                                    • Why isn't my site being indexed by Google?
                                      Chris661
                                      Chris661
                                      0
                                      3
                                      188

                                    • URL Injection Hack - What to do with spammy URLs that keep appearing in Google's index?
                                      Dezzign
                                      Dezzign
                                      0
                                      7
                                      3.6k

                                    • Why isn't google indexing our site?
                                      MikeTek
                                      MikeTek
                                      0
                                      18
                                      438

                                    • Sitemap - % of URL's in Google Index?
                                      irvingw
                                      irvingw
                                      0
                                      7
                                      677

                                    • Google Maps results doesn't show my site url but rather the maps url, why is this?
                                      STPseo
                                      STPseo
                                      0
                                      2
                                      645

                                    Get started with Moz Pro!

                                    Unlock the power of advanced SEO tools and data-driven insights.

                                    Start my free trial
                                    Products
                                    • Moz Pro
                                    • Moz Local
                                    • Moz API
                                    • Moz Data
                                    • STAT
                                    • Product Updates
                                    Moz Solutions
                                    • SMB Solutions
                                    • Agency Solutions
                                    • Enterprise Solutions
                                    • Digital Marketers
                                    Free SEO Tools
                                    • Domain Authority Checker
                                    • Link Explorer
                                    • Keyword Explorer
                                    • Competitive Research
                                    • Brand Authority Checker
                                    • Local Citation Checker
                                    • MozBar Extension
                                    • MozCast
                                    Resources
                                    • Blog
                                    • SEO Learning Center
                                    • Help Hub
                                    • Beginner's Guide to SEO
                                    • How-to Guides
                                    • Moz Academy
                                    • API Docs
                                    About Moz
                                    • About
                                    • Team
                                    • Careers
                                    • Contact
                                    Why Moz
                                    • Case Studies
                                    • Testimonials
                                    Get Involved
                                    • Become an Affiliate
                                    • MozCon
                                    • Webinars
                                    • Practical Marketer Series
                                    • MozPod
                                    Connect with us

                                    Contact the Help team

                                    Join our newsletter
                                    Moz logo
                                    © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                    • Accessibility
                                    • Terms of Use
                                    • Privacy