The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Duplicate Content? Designing new site, but all content got indexed on developer's sandbox

    Duplicate Content? Designing new site, but all content got indexed on developer's sandbox

    Web Design
    4 2 186
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • trafficmotion
      trafficmotion last edited by

      An ecommerce I'm helping is getting a complete redesign.

      Their developer had a sandbox version of their new site for design & testing. Several thousand products were loaded into the sandbox site.

      Then Google/Bing crawled and indexed the site (because developer didn't have a robots.txt), picking up and caching about 7,200 pages. There were even 2-3 orders placed on the sandbox site, so people were finding it.

      So what happens now?
      When the sandbox site is transferred to the final version on the proper domain, is there a duplicate content issue?
      How can the developer fix this?

      1 Reply Last reply Reply Quote 0
      • KeriMorgret
        KeriMorgret last edited by

        Is the sandbox on its own subdomain or own domain? If so, verify the site in Google/Bing webmaster tools (subdomains verify as their own site), put in a robots.txt excluding everything, then go and request URL removal of the entire site in the webmaster tools.

        1 Reply Last reply Reply Quote 1
        • trafficmotion
          trafficmotion last edited by

          Thank you for the very clear response!

          The sandbox is on a subdomain of the developer's website. ourSite.theirDevSite.com/sandbox/

          Their robots.txt actually redirects to their main website (why? no idea).

          But the developer should verify the subdomain sandbox site in GWT/BWT, then disallow everything with robots.txt (and stop redirecting it), then request the entire site to be removed. Anything I'm missing?

          KeriMorgret 1 Reply Last reply Reply Quote 0
          • KeriMorgret
            KeriMorgret @trafficmotion last edited by

            That would seem to be reasonable, with the information you've given. Best of luck!

            1 Reply Last reply Reply Quote 1
            • 1 / 1
            • First post
              Last post
            • Curious why site isn't ranking, rather seems like being penalized for duplicate content but no issues via Google Webmaster...
              izepper
              izepper
              0
              4
              253

            • How to bounce back after a new url & new site design?
              ScottImageWorks
              ScottImageWorks
              0
              7
              645

            • Comparing the site structure/design of my live site to my new design
              Cyrus-Shepard
              Cyrus-Shepard
              0
              4
              202

            • I've set up my own site which is still fairly new but I'm a bit concerned that there is a bloackage SEO wise somewhere because when I try to crawl the site on SEOmoz it only crawls one page.
              JoshED
              JoshED
              0
              7
              219

            • Duplicate Content Problem on Our Site?
              Dr-Pete
              Dr-Pete
              0
              5
              513

            • Duplicate content on mobile sites
              Webmaster_SEO
              Webmaster_SEO
              0
              2
              484

            • SEOMoz crawl report shows a duplicate content and duplicate title for these two url's http://freightmonster.com/ and http://freightmonster.com/index.html. How do I fix this?
              Smith-Digital
              Smith-Digital
              1
              3
              610

            • Duplicate Content for index.html
              SEMCLIX
              SEMCLIX
              0
              9
              3.2k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy