The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Robots.txt error message in Google Webmaster from a later date than the page was cached, how is that?

    Robots.txt error message in Google Webmaster from a later date than the page was cached, how is that?

    Intermediate & Advanced SEO
    3 2 235
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • eTundra
      eTundra last edited by

      I have error messages in Google Webmaster that state that Googlebot encountered errors while attempting to access the robots.txt.  The last date that this was reported was on December 25, 2012 (Merry Christmas), but the last cache date was November 16, 2012 (http://webcache.googleusercontent.com/search?q=cache%3Awww.etundra.com/robots.txt&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a).

      How could I get this error if the page hasn't been cached since November 16, 2012?

      1 Reply Last reply Reply Quote 0
      • Thos003
        Thos003 last edited by

        I've noticed several discrepancies in google's cache system. It seems many of their documents lag and are not updated immediately. It could just be errors in cross data population. If you really want to know the last time the Google bot visited your website then you will want to visit your server logs.

        If your server logs don't show a visit from google on the 25th then we really do have to wonder. My guess is that the webmaster tools is reflective of the correct date. Either way, I'd check for the error they are reporting.

        eTundra 1 Reply Last reply Reply Quote 1
        • eTundra
          eTundra @Thos003 last edited by

          That's what our next move is.  I'll let you all know what comes of it.  Thanks for the response!

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • How long will old pages stay in Google's cache index. We have a new site that is two months old but we are seeing old pages even though we used 301 redirects.
            DonnaDuncan
            DonnaDuncan
            0
            3
            81

          • Does Google cache every page that is been indexed?
            donsilvernail
            donsilvernail
            0
            2
            73

          • I'm noticing that URL that were once indexed by Google are suddenly getting dropped without any error messages in Webmasters Tools, has anyone seen issues like this before?
            nystromandy
            nystromandy
            0
            7
            67

          • Google robots.txt test - not picking up syntax errors?
            McTaggart
            McTaggart
            0
            3
            108

          • Pages are Indexed but not Cached by Google. Why?
            friendoffood
            friendoffood
            0
            44
            19.4k

          • Pages getting into Google Index, blocked by Robots.txt??
            Devanur-Rafi
            Devanur-Rafi
            0
            10
            673

          • Robot.txt error
            Rubix
            Rubix
            0
            13
            203

          • Why are new pages not being indexed, and old pages (now in robots.txt) remain in the index?
            KeriMorgret
            KeriMorgret
            0
            3
            378

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy