The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Why are these URL's suddenly appearing in WMT?

    Why are these URL's suddenly appearing in WMT?

    Technical SEO Issues
    3 3 155
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ClickConsult
      ClickConsult last edited by

      One of our clients has suddenly experienced a sudden increase in crawl errors for smart phones overnight for pages which no longer exist and there are no links to these pages according to Google.

      There is no evidence as to why Google would suddenly start to crawl these pages as they have not existed for over 5 years, but it does come after a new site design has been put live. Pages do not appear to be in the index when a site search is used.

      There was a similar increase in crawl errors on desktop initially after the new site went live, but these quickly returned to normal. Mobile crawl errors only became apparent after this.

      There are some URL's showing which have no linking page detected so we don't know where these URL's are being found. WMT states "Googlebot couldn't crawl this URL because it points to a non-existent page". Those that do have a linking page are showing an internal page which also doesn't exist so it can't possibly link to any page.

      Any insight is appreciated.

      Andy and Mark at Click Consult.

      1 Reply Last reply Reply Quote 0
      • DirkC
        DirkC last edited by

        If you recently did a site redesign - you probably deleted old redirect rules as well. Google seems to keep all the url's it has indexed over time stored somewhere - and the moment the old redirects disappear - you'll see these very old url's popping up in webmastertools. I had the same experience after a recent migration, and if you search on this forum, you'll find plenty of other people who have encountered the same thing.

        Nothing to worry about - if these errors in WMT are annoying you could put the old redirect rules in place again, or if they are using a seperate folder structure, you could delete these folders via WMT. These errors will disappear over time, even if you don't do anything.

        1 Reply Last reply Reply Quote 2
        • RyanPurkey
          RyanPurkey last edited by

          Hav you crawled your redesigned site with a tool like Xenu or ScreamingFrog?  That will help ferret out any bad links / 404 pages. Also, did you submit an updated sitemap with the redesign? Use 301s? Etc.

          Edit: Looks like Dirk above hit on the most likely issue regarding 301s. You should be set with that.

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • Clean URL vs. Parameter URL and Using Canonical URL...That's a Mouthfull!
            Roman-Delcarmen
            Roman-Delcarmen
            0
            4
            170

          • If I'm using a compressed sitemap (sitemap.xml.gz) that's the URL that gets submitted to webmaster tools, correct?
            ThompsonPaul
            ThompsonPaul
            0
            6
            1.8k

          • Should I change by URL's
            Saijo.George
            Saijo.George
            0
            4
            116

          • What's the best way to handle Overly Dynamic Url's?
            GKLA
            GKLA
            0
            2
            309

          • I'm redesigning a website which will have a new URL format. What's the best way to redirect all the old URLs to the new ones? Is there an automated, fast way to do this?
            GregFindley.co.uk
            GregFindley.co.uk
            0
            2
            303

          • Website's stability and it's affect on SEO
            AlanMosley
            AlanMosley
            0
            2
            1.0k

          • Url's don't want to show up in google. Please help?
            RyanKent
            RyanKent
            0
            5
            587

          • Switching ecommerce CMS's - Best Way to write URL 301's and sub pages?
            tylerfraser
            tylerfraser
            0
            7
            1.2k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy