The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Handling a Huge Amount of Crawl Errors

    Handling a Huge Amount of Crawl Errors

    On-Page / Site Optimization
    2 2 169
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • spiderz
      spiderz last edited by

      HI all,

      I am faced with a crawl errors issue of a huge site (>1MiO pages) for which I am doing On-page Audit.

      • 404 Erorrs: >80'000

      • Soft 404 Errors: 300

      • 500 Errors: 1600

      All of the above reported in GWT.

      Many of the error links are simply not present on the pages "linked from". I investigated a sample of pages (and their source) looking for the error links footprints and yet nothing.

      What would be the right way to address this issue from SEO perspective, anyway? Clearly. I am not able to investigate the reasons since I am seeing what is generated as HTML and NOT seeing what's behind.

      So my question is: Generally, what is the appropriate way of handling this?

      1. Telling the client that he has to investigate that (I gave my best to at least report the errors)

      2. Engaging my firm further and get a developer from my side to investigate?

      Thanks in advance!!

      1 Reply Last reply Reply Quote 0
      • irvingw
        irvingw last edited by

        Usually an on page audit lists all of the problems and possible reasons why they are happening, not in depth info on how to fix all the issues. That is usually the next phase, "do you want me to work on the site or do you want your dev team to track down the cause of the issues and fix them"

        It also depends what type of contract you have with him of course.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Crawl errors
          MonicaOConnor
          MonicaOConnor
          0
          3
          75

        • Google Crawl Errors from vbseo change
          MichaelC-15022
          MichaelC-15022
          0
          4
          136

        • How do I get rid of crawl errors?
          Kurt_Steinbrueck
          Kurt_Steinbrueck
          0
          7
          140

        • What's the best way to handle crawling of photo gallery?
          OlegKorneitchouk
          OlegKorneitchouk
          0
          2
          193

        • Html and css errors - what do SE spiders do if they come across coding errors? Do they stop crawling the rest of the code below the error
          pab1
          pab1
          0
          3
          511

        • SEO Moz crawl has 3 missing page title errors when they are clearly there.
          Cyrus-Shepard
          Cyrus-Shepard
          0
          5
          593

        • Crawl error: duplicate title for home page
          Sebes
          Sebes
          0
          2
          561

        • Crawl Diagnostics - Duplicate Content and Duplicate Page Title Errors
          JoelWolfgang
          JoelWolfgang
          0
          3
          809

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy