The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Non existant URLs being generated in index

    Non existant URLs being generated in index

    Technical SEO Issues
    6 3 544
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Benji87
      Benji87 last edited by

      Hi all,

      I have a pretty big problem with my site at the moment which I'm worried will have an impact on my rankings.

      I've just had a crawl test done and for some reason I get a load of urls returned that don't actually exist...

      For example I am getting urls like this in my crawl test and xml sitemap:

      www.applicablejobs.com/jobs/add/android-designer/android-designer/android-designer/android-developer/android-developer/

      www.applicablejobs.com/jobs/add/android-designer/android-designer/android-designer/android-developer/iphone-designer/

      All the urls seem to start off with www.applicablejobs.com/jobs/ and there is an entry for every conceivable combination of slugs.

      I can only assume that if the crawl test and an xml sitemap generator is indexing these urls then Google and other search engines probably are too.

      Does anyone have any idea what might be causing this issue and what can I do to remove them from Googles index if they are?

      Thanks

      1 Reply Last reply Reply Quote 0
      • STPseo
        STPseo last edited by

        Is your domain "www.applicablejobs.com"? If not, it sounds like you may have been hacked and someone added some code snippet to your website. I host some personal sites on Network Solutions and one day I found some strange code snippet on just about every page of the sites I run. After removing the code I had to upload every page again but only after changing all my passwords.

        As for removing them? Google has a tool to remove them. However if this is not your domain - you may want to email Google and inform them of the malicious happenings.

        Benji87 1 Reply Last reply Reply Quote 0
        • Benji87
          Benji87 @STPseo last edited by

          Hi Stephan,

          applicablejobs.com is my url yes.

          STPseo 2 Replies Last reply Reply Quote 0
          • STPseo
            STPseo @Benji87 last edited by

            Okay. Well in that case I cannot speak to why they are happening in the first place. To keep them out of the index you could have exclude the entire /jobs/ directory using the robots.txt. If the /jobs/ directory is needed then you'll have to track down the source of the URL generation. Sorry I can be of more help.

            1 Reply Last reply Reply Quote 0
            • STPseo
              STPseo @Benji87 last edited by

              If you search for this in Goggle: site:www.applicablejobs.com

              You see 43 URLs and none of the bad ones.

              1 Reply Last reply Reply Quote 0
              • WillBlackburn
                WillBlackburn last edited by

                Could they be archived links from years ago?

                I have the same problem. Products we used to sell but either no longer sell or are out of stock (they are made inactive in the CMS and do not appear on site) show up in some google searches and in the crawl test.

                Any ideas?

                Cheers

                Will

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • URLs dropping from index (Crawled, currently not indexed)
                  DmitriiK
                  DmitriiK
                  0
                  2
                  38

                • Huge number of crawl anomalies and 404s - non- existent urls
                  GFD_Chris
                  GFD_Chris
                  0
                  6
                  130

                • Google tries to index non existing language URLs. Why?
                  NickSamuel
                  NickSamuel
                  0
                  2
                  34

                • URL Indexing with Keyword
                  Roman-Delcarmen
                  Roman-Delcarmen
                  1
                  2
                  81

                • Vanity URLs are being indexed in Google
                  seogirl22
                  seogirl22
                  1
                  3
                  879

                • If a URL canonically points to another link, is that URL indexed?
                  Coolguyry
                  Coolguyry
                  0
                  4
                  120

                • Wordpress URL weirdness - why is google registering non-pretty URLS?
                  peterdbaron
                  peterdbaron
                  0
                  4
                  585

                • Canonical for non-exist URL ?
                  Theo-NL
                  Theo-NL
                  0
                  2
                  738

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy