The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. How long after a URL starts showing a 404 does Google stop crawling?

    How long after a URL starts showing a 404 does Google stop crawling?

    On-Page / Site Optimization
    4 3 590
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • AndrewMiller
      AndrewMiller last edited by

      Before hiring me to do SEO, a client re-launched their site and did not 301 the old URLs to the new. Only the home page URL stayed the same.

      For a month after the re-launch, the old URLs returned a 404. For the next month, all 404 pages (basically any non-existent URL) were 301'd to the home page. Finally, 2 months after launching, they properly 301'd the old URLs to the new.

      Now, the new URLs are not ranking well. I assume it's too late to realize any benefit from the 301's, just checking to see if anybody has any insight into how long Google keeps trying to crawl old/404/improperly 301'd URLs.

      Thanks!

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        Google's crawlers follow links. As long as links exist, those links will be crawled, even if the link generates a 404 error. They could choose to follow known 404 links less frequently, but they will still make attempts to follow the link.

        SEM-Freak 1 Reply Last reply Reply Quote 2
        • SEM-Freak
          SEM-Freak @RyanKent last edited by

          Agree. Google will follow the links. Keep checking webmaster tools and 301 the pages Google can't find. I can't see why you would not get the link value.

          AndrewMiller 1 Reply Last reply Reply Quote 1
          • AndrewMiller
            AndrewMiller @SEM-Freak last edited by

            Thanks for the responses. I tend to agree, but my concern is the "permanent" nature of a 301. I assume they will re-crawl the old URLs and replace the previous redirects with the new ones eventually.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Moz Crawl Shows Duplicate Content Which Doesn't Seem To Appear In Google?
              scottiedog
              scottiedog
              0
              3
              90

            • 404 errors in wordpress... Pages have never existed so why is google trying to crawl them?
              ChadEisenhart
              ChadEisenhart
              0
              2
              166

            • 404 crawl errors with all url+domain
              promonet
              promonet
              0
              7
              396

            • Pages that show in Open Site Explorer that show as 404's in search
              RyanKent
              RyanKent
              0
              4
              526

            • URL 404 errors after crawl? HELP!
              ChristineWeinbrecht
              ChristineWeinbrecht
              0
              11
              683

            • Long URLs
              KaneJamison
              KaneJamison
              0
              4
              394

            • How long for Google to re-index
              RobMay
              RobMay
              0
              8
              4.2k

            • How long is too long for domain URL length?
              JesseCWalker
              JesseCWalker
              2
              12
              16.4k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy