The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Will blocking the Wayback Machine (archive.org) have any impact on Google crawl and indexing/SEO?

    Will blocking the Wayback Machine (archive.org) have any impact on Google crawl and indexing/SEO?

    Technical SEO Issues
    3 3 2.2k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • BBuck
      BBuck last edited by

      Will blocking the Wayback Machine (archive.org) by adding the code they give have any impact on Google crawl and indexing/SEO?

      Anyone know?

      Thanks!

      ~Brett

      1 Reply Last reply Reply Quote 0
      • evoba
        evoba last edited by

        Brett,

        I am not sure what code you are referring to but what archive.org suggests is blocking their crawler through robots.txt:

        User-agent: ia_archiver
        Disallow: /

        The robots.txt file should be in your root directory.

        It's explained here: http://archive.org/about/exclude.php

        Doing this will not impact your search results or crawl on Google.

        V-

        1 Reply Last reply Reply Quote 0
        • EricHess
          EricHess last edited by

          I have blocked the Wayback Machine for a client and not allowed them to index the site. I blocked them via the robots.txt and not Meta NoIndex, and while blocking Wayback Machine it did NOT impact the positions within the targeted Google results.

          Hope this helps.

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • Google Sites website https://www.opcfitness.com/ title NOT GOOD FOR SEO
            MiriamEllis
            MiriamEllis
            0
            2
            51

          • Google has indexed m.freedomltd.com/hen-nights/party-locations/london//cocktail-training/ missing a folder.
            GPainter
            GPainter
            0
            5
            106

          • Blocked URL parameters can still be crawled and indexed by google?
            anthonydnelson
            anthonydnelson
            0
            6
            1.7k

          • CDN Being Crawled and Indexed by Google
            irvingw
            irvingw
            0
            2
            1.0k

          • Is Google caching date same as crawling/indexing date?
            Host1
            Host1
            0
            2
            1.8k

          • Will Google Continue to Index the Page with NoIndex Tag Upon Google +1 Button Impression or Click?
            STPseo
            STPseo
            0
            3
            636

          • I have a site that has both http:// and https:// versions indexed, e.g. https://www.homepage.com/ and http://www.homepage.com/. How do I de-index the https// versions without losing the link juice that is going to the https://homepage.com/ pages?
            fthead9
            fthead9
            0
            3
            729

          • Follow up from http://www.seomoz.org/qa/discuss/52837/google-analytics
            KeriMorgret
            KeriMorgret
            0
            8
            1.1k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy