Is this Duplicate Content?

[poolguy]

I searched a snippet of one of our Articles (in quotes) and got two results back in Google, one for the article on our site and one for our development/staging site.  Does that mean that our development site is getting indexed by Google, even thought we "Disallow:/" in the robots.txt file?  Is this a big duplicate content issue?

Thanks

[DavidKauzlaric]

Yes, that is duplicate content and is an issue. Robots.txt is unreliable at best and there are very stringent guidelines to using it properly.

Instead, use an actual meta tag of noindex! That will solve the issue.

[alfredopalconit]

you an either add rel canonical on the dev site, use the url of the live site or make your dev site viewable only within your internal office ip

[saibose]

Yes, you are actually showing 2 shadow copies of your website to Google.

Use a nofollow, noindex tag in the meta. Also, it would be a good idea to have a rel=canonical in place for your testwebsite.(just in case).

[AlanMosley]

Yes it does, before no-indexing the page with meta tag, you should put a rel anoical to the right page, as I find the duplicate can hang arounbd in the index for some time. I would let it be crawled again so that the canonical tag can be found before you remove it

[KeriMorgret]

I personally have had less of a problem with robots.txt not being followed by Google than I have had developers muck with the robots.txt file. In my particular case, they would update the development site with information from the live site (as we were adding more content to a database on the live site and they were syncing it). They'd copy over the live robots.txt as well, and suddenly the development site was being indexed.

I use Code Monitor for all of my robots.txt files, live or development, so I can be notified when they change. https://www.polepositionweb.com/roi/codemonitor/

I suggest verifying the development site in Google Webmaster Tools. From there, you can request the content to be removed (after you've blocked in robots.txt or used the meta noindex), and you can also use their robots.txt tool to see if there was possibly an error in the file.