Need help fixing the duplicate content that keeps growing

[Taiger]

Need help fixing the duplicate content that keeps growing

[Lumina]

You'll have to be a lot more specific. Try answering at least some of these questions so we can help you:

1. What content is being duplicated?
2. Where are the duplicates?
3. Is this all internal (on your site only)?
4. Are you receiving any duplicate content warnings from Moz, Google, etc.?
5. In what way does it "keep[s] growing?"
6. What kind of content is this?

Once you provide answers to some of these questions, I'm sure we'll be able to help you fix the issue.

[Taiger]

Hi thanks for the heads up.. just been very frustrating.

Moz and Google show dup internal content.

Using WordPress and Yoest SEO plugin to try to fix some of the issues.

Blog content

Regards T

[Lumina]

That's still not quite enough to go on. Could you provide the message they're giving you, and/or URLs regarding the duplicate content? Examples in either should prove helpful.

[ChiarynMiranda]

Hey There! It looks like you are trying get some assistance without specifically naming the site you are concerned about and I definitely understand that, but it is really difficult to give advice on this issue without more detailed information. However, I took a look at your campaigns and I am going to address the issue I am seeing with the site that had the largest increase of duplicate content over the last couple of crawls. I apologize if this isn't the site you are referring to.

The campaign I'm looking at is the 5 Star campaign. It looks like a large number of the pages with duplicate content are related to ?attachment parameters in the URL, such as www.site.com/?attachment_id=77899. There is very little content on these pages and it looks like they are added to the site pretty regularly, since all of the ones I looked at are dated closely together.

I'm not an SEO expert, so Bryan may have better advice for you, but I can give a few suggestion of how to resolve this issue. I don't entirely understand the purpose of these pages, so that would affect which of these options might be best for your personal strategy for the site.

You can add a canonical tag to these pages to point to one specific page as the most important page with this content. For this option, they would have to point back to the same page or our crawler will still show them as duplicates because we assume that the two canonical pages are then also likely to be duplicates. Google, however will stop indexing these pages.

You can also block these pages from being accessed using the robots.txt file for this site. For example, it would look something like this:

User-agent: *
Disallow: ?attachment

etc., until you have covered all of the parameters you would like to block. The User-agent: * blocks all crawlers from accessing those pages, but you can also use User-agent: rogerbot to specifically block only our crawler.

I hope this helps! Please let me know if I can help you with anything else.

[Taiger]

Hi Chiaryn, and Bryan
 thanks for your help..

I did not want to be too specific initially as I did not know how open this help request would be.The site is as mentioned above.

One question, will all these duplicate content affect the site in Google?

I can apply the User-agent: *
Disallow: ?attachmentWhat is the code to perform the canonical tag?

Also please can you look at this duplicate content.. I do t understand why it is duplicate content

If I fix these issues will my site ranking improve?

Thanks again

T

[ChiarynMiranda]

Hey T,

I want to let you know that I removed the link to your campaign from your last post and I would recommend that you don't post those types of links publicly. Our site is secure, and only admins and account owners can access data through those links, but you never know what someone may try to do maliciously with that information.

For the link you provided, we are reporting those pages as duplicate content because they are pretty much 100% similar in the code and content for the page: http://www.screencast.com/t/qMgveoj4i. (Our campaign tolerance is 90% similarity.) The only difference is the state name the pages refer to, which is not enough to make the pages different. You can verify that using this tool here: http://smallseotools.com/similar-page-checker/

Here is a great resource for learning about canonical tags: https://moz.com/learn/seo/canonicalization
Here is a post about how we detect duplicate content:https://moz.com/devblog/near-duplicate-detection/ And for more information on using canonical tags, check out this great post by our very own Dr. Pete: http://moz.com/blog/rel-confused-answers-to-your-rel-canonical-questions

[Taiger]

Thank you for your help, So these pages have no content on them yet, So I guess I need to put some content on them. Do you think that these issues affect my google ranking?

T

[Taiger]

can you do me a favour and check if  http://www.............magazine.com is duplicate with the above domain that we are talking about i used your similar page checker and it said 100% we have a redirect on the domain, but i am concerned that it may not be effective