The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Does Google make continued attempts to crawl an old page one it has followed a 301 to the new page?

    Does Google make continued attempts to crawl an old page one it has followed a 301 to the new page?

    Intermediate & Advanced SEO
    2 2 126
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RossFruin
      RossFruin last edited by

      I am curious about this for a couple of reasons.

      We have all dealt with a site who switched platforms and didn't plan properly and now have 1,000's of crawl errors. Many of the developers I have talked to have stated very clearly that the HTacccess file should not be used for 1,000's of singe redirects. I figured If I only needed them in their temporarily it wouldn't be an issue. I am curious if once Google follows a 301 from an old page to a new page, will they stop crawling the old page?

      1 Reply Last reply Reply Quote 0
      • CleverPhD
        CleverPhD last edited by

        It will keep on crawling.  I have seen 6 months to 1 year later they come back.  Especially if there are links from other websites pointing to your old URLs.

        Why they do repeat crawls on 301s and 404s for that matter is that they know how much the web changes and assume that there may have been a mistake and so want to double check.    Also, you have to consider, they will not recrawl 1000s of pages all at once.  They will probably pick up the most popular URLs first as they crawl them more often and then the less popular pages later.

        IMHO. You will need to find a long term solution in place.

        Here is the why you dont want to use htaccess

        http://stackoverflow.com/questions/209209/htaccess-redirect-performance

        One suggestion for Apache - RewriteMap

        http://httpd.apache.org/docs/2.0/mod/mod_rewrite.html#rewritemap

        That or all the developers who are telling you not to use .htaccess should have at least 2 solutions to use instead that should work.  Go back to them to solve the issue.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • How long will old pages stay in Google's cache index. We have a new site that is two months old but we are seeing old pages even though we used 301 redirects.
          DonnaDuncan
          DonnaDuncan
          0
          3
          81

        • HELP! How do I get Google to value one page over another (older) page that is ranking?
          evolvingSEO
          evolvingSEO
          0
          5
          112

        • Does it make sense to create new pages with friendlier URLs then redirect old pages to new?
          Keszi
          Keszi
          0
          3
          73

        • Should we show(to google) different city pages on our website which look like home page as one page or different? If yes then how?
          sanchitmalik
          sanchitmalik
          0
          3
          140

        • Does Google still don't index Hashtag Links ? No chance to get a Search Result that leads directly to a section of a page? or to one of numeras Hashtag Pages in a single HTML page?
          Muhammad_Jabali
          Muhammad_Jabali
          0
          3
          748

        • Should you give all the posts in a Forum an unique description? Or let it empty so Google can make one with the crawled keywords .... ...
          Zanox
          Zanox
          0
          5
          97

        • 301 redirects from old to new pages whit a lot of changes
          timhatton
          timhatton
          0
          2
          587

        • Old pages still crawled by SE returning 404s. Better to put 301 or block with robots.txt ?
          RyanKent
          RyanKent
          0
          2
          721

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy