The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Site being indexed by Google before it has launched

    Site being indexed by Google before it has launched

    Technical SEO Issues
    4 4 698
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Sayers
      Sayers last edited by

      We are currently coming towards the end of migrating one of our retail sites over to magento. To our horror, we find out today that some pages are already being indexed by Google, and we have started receiving orders through new site. Do you have any suggestions for what may have caused this? Or similarly, what the best solution would be to de-index ourselves? We most recently excluded anything with a certain parameter from robots.txt - could this being implemented incorrectly have caused this issue?

      Thanks

      1 Reply Last reply Reply Quote 0
      • PathMarketing
        PathMarketing last edited by

        Exclude the whole new site using robots.txt, and remove the current new site-indexed URL's within Webmaster Tools: Optimization > Remove URL's.

        When the new site is ready to launch, undo these removed URL's using the "Reinclude" button, also found within the Remove URL's section of Webmaster Tools. Do this prior to 301'ing the old site pages to the new, and you will probably wish to announce the new site launch via social media as well to encourage indexation. +1'ing a page is considered the fastest way to get it indexed.

        1 Reply Last reply Reply Quote 0
        • Copstead
          Copstead last edited by

          I would be very careful on how you manage this right now.  It all depends on the old and new urls.  If this is something in Dev staging, like http://dev.examplesite.com, then it is alright to do everything possible to clean them up.  But if the new urls are going to be the new final urls, then you have to be careful.

          The best thing you could do right now would be to password protect the new site.  That way there isn't a chance of anything getting to it.

          All it takes is Google finding one link to the site then it will crawl from there.

          1 Reply Last reply Reply Quote 1
          • josh-riley
            josh-riley last edited by

            Google has ignored a robots.txt for my site because it thought we were "hiding" important content.

            Depending on your site structure, putting a "no index" tag on your page is also a good idea. Doing that as pages are built can prevent it (better) from being indexed in the first place. Then you remove the tag when you are ready to go live. And, submit your updated sitemap via GWT when you finish your move so Google will know what pages to index.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Removing a site from Google index with no index met tags
              effectdigital
              effectdigital
              1
              5
              58

            • Site removed from Google Index
              StreamlineMetrics
              StreamlineMetrics
              0
              3
              131

            • Why did Google stop indexing my site?
              JillB2013
              JillB2013
              0
              12
              5.3k

            • Why my site is not indexing in google
              Rajesh.Chandran
              Rajesh.Chandran
              0
              5
              216

            • How do you know what version of your site of Google is in their index?
              trophycentraltrophiesandawards
              trophycentraltrophiesandawards
              0
              3
              309

            • Want to Target Mobile site for Google Mobile Version and Desktop Site for Google Desktop Version
              Cyrus-Shepard
              Cyrus-Shepard
              0
              4
              1.6k

            • Google is indexing proxy (mirror) site.
              YannickVeys
              YannickVeys
              1
              2
              816

            • Some site pages are removed from Google Index
              randfish
              randfish
              0
              6
              1.0k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy