The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Issue with 'Crawl Errors' in Webmaster Tools

    Issue with 'Crawl Errors' in Webmaster Tools

    Technical SEO Issues
    4 3 782
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RiceMedia
      RiceMedia last edited by

      Have an issue with a large number of 'Not Found' webpages being listed in Webmaster Tools.  In the 'Detected' column, the dates are recent (May 1st - 15th).  However, looking clicking into the 'Linked From' column, all of the link sources are old, many from 2009-10.

      Furthermore, I have checked a large number of the source pages to double check that the links don't still exist, and they don't as I expected.

      Firstly, I am concerned that Google thinks there is a vast number of broken links on this site when in fact there is not.

      Secondly, why if the errors do not actually exist (and never actually have) do they remain listed in Webmaster Tools, which claims they were found again this month?!

      Thirdly, what's the best and quickest way of getting rid of these errors?  Google advises that using the 'URL Removal Tool' will only remove the pages from the Google index, NOT from the crawl errors.  The info is that if they keep getting 404 returns, it will automatically get removed.  Well I don't know how many times they need to get that 404 in order to get rid of a URL and link that haven't existed for 18-24 months?!!

      Thanks.

      1 Reply Last reply Reply Quote 0
      • krissy-cca
        krissy-cca last edited by

        Hey,

        I guess if you've exhausted all other possibilities you can either let them return a 404 and leave them be which will most likely do you no harm or 301 that particular URL to another relevant page on your site.

        Make sure they are actually returning a 404 first though via header response check.

        DD

        1 Reply Last reply Reply Quote 0
        • sferrino
          sferrino last edited by

          Completely agree with Damien. If they don't exist but Webmaster Tools is showing them, 301 them, there has to be a link somewhere on the internet that is causing them to think there is. I would also go through the server logs to see if there is any additional information like a referring page to the non-existent ones.

          1 Reply Last reply Reply Quote 0
          • RiceMedia
            RiceMedia last edited by

            Thanks both for your responses.  It's a strange one and I can only assume that these pages remain in Google's index - I have checked many link sources and found that the links do not exist and therefore haven't done since the page was deleted.  It seems ridicilous that you should have to 301 every page you delete, there are literally 500+ of these phantom links to non-existant URLs and the site is changing all the time.

            I have opted to add a 'no index' meta to the 404s and also encourage them to delete from index by adding the pages to the robots.txt file.

            Let's see if it works - I'll post on here when I know for sure so other people with the same question can see the outcome.

            Thanks again, Damien and Steven.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • What server issues might cause temporary and repeated Soft 404/500 Errors that appear to be functioning correctly when checked later from Google Webmaster Tools?
              badgergravling
              badgergravling
              0
              2
              54

            • Why is Google Webmaster Tools showing 404 Page Not Found Errors for web pages that don't have anything to do with my site?
              MonicaOConnor
              MonicaOConnor
              0
              6
              1.1k

            • Bogus Crawl Errors in Webmaster Tools?
              EGOL
              EGOL
              0
              5
              206

            • Has Google Stopped Listing URLs with Crawl Errors in Webmaster Tools?
              SEOAndy
              SEOAndy
              0
              2
              129

            • I am getting an error message from Google Webmaster Tools and I don't know what to do to correct the problem
              MarieHaynes
              MarieHaynes
              0
              13
              762

            • How to remove crawl errors in google webmaster tools
              Nick_Ker
              Nick_Ker
              0
              2
              925

            • Crawl Errors In Webmaster Tools
              kdaly100
              kdaly100
              0
              4
              641

            • Having some weird crawl issues in Google Webmaster Tools
              Dan-Petrovic
              Dan-Petrovic
              1
              2
              712

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy