The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. URLs are not indexed

    URLs are not indexed

    Intermediate & Advanced SEO
    7 3 132
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • prsntsnh
      prsntsnh last edited by

      My website has 0.5 million pages with urls like this- **http://www.mycity4kids.com/Delhi-NCR/collage-painting-classes-%3cnear%3e-shalimar-bagh ****, **none of these urls are indexed.

      Question 1- What can be the possible reason for this issue? Users see this url as : http://www.mycity4kids.com/Delhi-NCR/collage-painting-classes-<near>-shalimar-bagh</near>
      The symbol "<" and ">" get converted into "%3c" and "%3e" respectively, is this the reason for these urls not getting indexed?

      1 Reply Last reply Reply Quote 0
      • Martijn_Scheijbeler
        Martijn_Scheijbeler last edited by

        Hi Prashant,

        Can these pages be found via the navigation or do you have to enter a search term to get to them? I can't find any links to the first page you've listed in your question. If that's the case than it's quite normal that Google didn't index the page as they just aren't able to find the page in the first place.

        prsntsnh 1 Reply Last reply Reply Quote 1
        • prsntsnh
          prsntsnh @Martijn_Scheijbeler last edited by

          Thanks Martijn,

          Yes, if a user enter a search term then these URL get formed. for example if you visit : www.mycity4kids.com and enter Collage Painting Classes in 1st search box and Shalimar Bagh in 2nd search box then you will see this:** http://www.mycity4kids.com/Delhi-NCR/collage-painting-classes-<near>-shalimar-bagh</near>** url in address bar.

          We have submitted these urls on google webmaster using a "sitemap" for indexing still none of them are indexed.

          Martijn_Scheijbeler 1 Reply Last reply Reply Quote 0
          • Martijn_Scheijbeler
            Martijn_Scheijbeler @prsntsnh last edited by

            Hi Prashant,

            Then that's definitely your issue, I wouldn't index any pages to be honest that I couldn't find in any navigation besides self finding the pages. I would link from any related pages to the pages that you want to have indexed.

            prsntsnh 1 Reply Last reply Reply Quote 1
            • prsntsnh
              prsntsnh @Martijn_Scheijbeler last edited by

              Thanks Martijn

              Could you please tell how many ways are there to check whether a page is indexed or not?

              Someone on a different forum told me that we can check "indexed status" of a url by directly googling that url, there is no need to use "site:" operator.

              Martijn_Scheijbeler 1 Reply Last reply Reply Quote 0
              • Martijn_Scheijbeler
                Martijn_Scheijbeler @prsntsnh last edited by

                Just Google the URL it can't be simpler, if there is a result it's indexed.

                1 Reply Last reply Reply Quote 1
                • JaneCopland
                  JaneCopland last edited by

                  Hi Prashant,

                  If these URLs are only created when a user searches for a term, but are not linked to anywhere in HTML either on your site or elsewhere on the Internet, this is a very good reason why they are not indexed.

                  Google does not usually perform queries on a site (e.g. fill in forms) to "discover" what content might be displayed when those forms are filled in. It's tried and tested method of crawling is just that - crawling links and text in HTML. It has become more adventurous with different technology and sometimes finds things that it wouldn't have previously, but linking is still the primary way to ensure something gets crawled.

                  In many cases, you wouldn't want Google finding content that it has to perform queries / fill in forms or searches to get to: this is how some sites create massive amounts of duplicate content by accident. So in a way, Google is doing everyone a favour by not indexing URLs like this.

                  We have submitted these urls on google webmaster using a "sitemap" for indexing still none of them are indexed.

                  I tend to think of sitemaps like road maps: they're a guide. The site itself is the road. If a map tells me that I can drive across a river but when I get there, this is no bridge, I'm not going to drive across the river. Maybe I will if I have a huge four-wheel-drive car with a snorkel, but possibly not. Maybe Google will index URLs it can't find on the web itself, but possibly not.

                  If you want the URLs to be found, link to them 🙂

                  Cheers,

                  Jane

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • Same URL-Structure & the same number of URLs indexed on two different websites - can it lead to a Google penalty?
                    0
                    1
                    13

                  • URL indexed but not submitted in sitemap, however the URL is in the sitemap
                    NickSamuel
                    NickSamuel
                    0
                    2
                    115

                  • If I block a URL via the robots.txt - how long will it take for Google to stop indexing that URL?
                    GastonRiera
                    GastonRiera
                    0
                    3
                    98

                  • URL with a # but no ! being indexed
                    EdelmanDigital
                    EdelmanDigital
                    0
                    4
                    99

                  • More Indexed Pages than URLs on site.
                    LynnPatchett
                    LynnPatchett
                    0
                    6
                    358

                  • Indexed non existent pages, problem appeared after we 301d the url/index to the url.
                    ThompsonPaul
                    ThompsonPaul
                    0
                    4
                    331

                  • Lots of incorrect urls indexed - Googlebot found an extremely high number of URLs on your site
                    SarahCollins
                    SarahCollins
                    0
                    8
                    1.1k

                  • Best Product URL For Indexing
                    waynekolenchuk
                    waynekolenchuk
                    0
                    9
                    813

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy